Big Data Migration Consultant Resume
Pleasanton, CA
SUMMARY:
- Confidential is a Lead Teradata & Hadoop Developer, DBA (Performance, Applications and Systems) and Architect with 12 years of experience in the IT industry, 12 of those years utilizing OLAP applications for mainframe and Client/Server environments.
- He possesses 12 years of SQL development, Data analysis, Teradata modeling, development, warehousing, and 12 years providing Teradata architecture.
- Confidential has performed Teradata development including SQL development, macros and stored procedure and also Teradata Database Administration functions such as Teradata Manager Setup, priority scheduling, workload management using TASM, TDQM, physical modeling, semantic view design, physical object management, database clean - up/back-up/restores, performance tuning, space management and system upgrades.
- Experience in Hadoop development on SQOOP, HIVE, IMPALA, HDFS, SPARK AND PIG
TECHNICAL SKILLS:
Databases: Teradata TD15,V2R5/V2R6/TD12(V12),TD13(V13),TD14(V14),TD14.10(V14.10),TD15(V15),Oracle 7.x/8.x, IMS DB, MS-Access,DB2
Languages/Software: Teradata V2R5/V2R6/TD12(V12),TD13(V13),TD14(V14),Teradata T14.10(V14.10),TD15 (Query man, BTEQ, MultiLoad, FastLoad, TPump, ARCMAIN, Fast Export, SQL, TPT etc.), Erwin 3.5.2 /4.0, Teradata DBA Tools (Teradata Manager, Teradata Administer, Visual Explain, PMON, Teradata Static Wizard, Teradata Index Wizard,, PDCR,TSET,TASM etc.), AbInitio GDE & Co-operating System, Oracle, IMS DB, BRIO 6.0, VSAM, PL/SQL, SQL, Cobol II, Cobol 370, MetaCobol, CICS, JCL, TSO/ISPF, Intertest, Via-Soft, Panvallet, Endevor, CA-7,QA Auditor, QMF, Spufi, SDF, Unix Shell scripts, IMS Expert, SQL Forms 3.0, Report Writer 1.0, C++, C, Java, Oracle 7.0.1, HTML, Java 2, JDBC, JDK 1.2.1, Database Triggers, Stored procedures, Assembler (8085 & 8086), MQ Series, IMSExpert, MS Project 2000, Visio, Xpeditor, TOAD, Clarify, Infoman, PVCS, MS Word, MS Excel, MS Access, Control M, SAS, DB2 Platinum utilities, Trillium, Changeman, Microstrategy and INFORMATICA, Viewpoint,DB2,tableau 6.3, Python 3.6.0., SQL workbench, Jenkins
Operating System: Windows XP/2000, UNIX AIX, Linux, HP UNIX, NCR MP-RAS, DOS and MVS/ESA
PROFESSIONAL EXPERIENCE:
Confidential, Pleasanton CA
Big Data Migration Consultant
Responsibilities:
- Developed code to migrate clarity data from EPIC system to Hadoop - HIVE on SPARK
- Developed code to migrate data from Teradata system to Hadoop - HIVE on SPARK
- Developed SQOOP script to export data from EPIC server.
- Developed TPT script to extract data from Teradata.
- Developed Python script for Map Reduce.
Environment: Teradata TD15.0 and Linux/Unix, Python 3.6.0,sqoop, HIVE, SPARK,HDFS, TERADATA utilities TPT, View point 15.0, TASM, SQL assistant.
Confidential, Sunnyvale CATERADATA Consultant
Responsibilities:
- Developed and tuned Teradata Macro’s and Stored Procedure’s.
- Developed SQL’s for Performance analysis.
- Developed and optimized ETL jobs using TPT’s, FastLoad, MLoad and Bteq’s .
- Created and reviewed the Physical model and implemented recommendations.
- Analysis of CPU usage, Spool usage and I/O usage for Apple care queries.
- Analysis of DBQL/PDCR data in order to determine root cause of poor performing queries.
- Reviewed and provided suggestions to improve performance for new developments and enhancements
- SQL tuning including TASM aborted SQLs.
- Followed the best practices in all activities and prepared weekly charts and followed the quality and control processes for Apple care area (contact center and Repair).
- Captured poorly performed user ad-hoc queries, analyzed and provided suggestions to improve performance.
- Replicated data from one system to another system using TPT and ARCMAIN
- Tableau dashboard development for performance analysis.
Environment: Teradata TD14.10 and Linux/Unix, Teradata TD14.10, View point 14.10, TASM, SQL assistant, Teradata utilities( TPT,FLOAD,MLOAD,BTEQ,ARCMAIN) SQL workbench, autosys, incident management, tableau 9.3,Jenkins
Confidential, Plano TexasTeradata Consultant
Responsibilities:
- Did performance remediation for CPU usage and Spool usage for Teradata queries.
- Developed SQL’s for Teradata Performance qualify check.
- Reviewed and provided suggestions to improve performance for new developments and enhancements.
- SQL tuning and DBQL/PDCR data analysis
- UDB DB2 to Hadoop and Teradata migration using SQOOP and HIVE - DMX to Hadoop and TPT to Teradata ( Credit and Debit card data)
- Developed and tuned Teradata Macro’s and stored Procedure’s.
- Developed ETL jobs using TPT’s, Fastload, Mload and Bteq’s and optimized.
- Created and reviewed Physical model and ETL design, and implemented recommendations.
- Defined and implemented backup strategy for new implementations (Arcmain)
Environment: - Sqoop, Hive, Impala, HDFS, UDB DB2,Teradata TD14.10, View point 14.10, TASM, SQL assistant, Teradata utilities, Linux, IBM mainframe MVS, JCL, DB2,, PDCR,xdbw,, TPT 14.10, BTEQ, SQL FLOAD, MULTILOAD, ARC, Linux, Unix, Mainframe, Autosys, TARAGUI and Netbackup, Autosys..
Confidential, Bellevue - WA.Teradata DBA Consultant
Responsibilities:
- Monitoring and Administrating teradata systems using View point 14.10
- Managed Teradata profiles and securities, Documented for SOX.
- Resolving Teradata Service Requests
- Coordinated Teradata Incidents with Teradata GSS. And provided TSET and other information. on request
- Performing system monitoring, upgrades and security hardening, test suites(Linux and mainframe) scandisk, checktable, updatespace, packdisk, mainframe TDP connection checkup etc.
- Analyzing Teradata system health and tuning system if necessary.
- Migrated Mainframe fastload,Mload,Tpump,Bteq DBA scripts to Linux TPT scripts.
- Created and Managed various stored procedures and Macros for security and access control
- Installed Oracle SQL plus for TPT jobs.
- Participated TD13(V13),TD14(V14),TD14.10(V14.10),TD15(V15) Upgrades.
- Created various email alerts and implemented on linux platform and scheduled in Autosys
- Designed and Implemented various security reports on linux platform and scheduled in Autosys.
- Backup and Recovery using Netbackup & Taragui.
- Coordinated Linux server O/S Upgrades, Linux Server Netbackup and Autosys upgrades.
- Developed various stored procedures for handling different DBA functions.
- Identified and designed and implemented workload management TASM changes..
- Participated unity data mover set up and data lab set up.
- Implemented PDCR and migrated old DBQL history data to PDCR database.
- Extracted data from DBQL and PDCR databases and implemented various security and SOX audit reports.
- Developed SQL’s, Macros, Stored procedures for DBA operation.
- Responsible for Maintaining SOX related data.
- Created various SQL’s for auditing and performed SQL tuning.
- Developed Unix shell scripts for application and system support.
Environment: - Teradata TD14.10(V14.10), Teradata TD15(V15),View point 14.10, TASM, SQL assistant, Teradata utilities, Linux, IBM mainframe MVS, JCL, DB2, Teradata TSET, PDCR,xdbw, cnsterm, ferret,TPT 14.10, BTEQ, SQL FLOAD, MULTILOAD, ARC, Linux, Unix, Mainframe, Autosys, TARAGUI and Netbackup, Autosys.
Confidential, Deerfield-ILTeradata DBA - Consultant
Responsibilities:
- Working as senior architect for integrating current data marts into EDW.
- Designed new data model with normalized table for EDW and with surrogate key for storing detail level transactions & transaction history.
- Created logical and physical model for location, production and customer dimensions and generated DDL’s.
- Worked on semantic layer design(Functional Data Layer)
- Performed Design and implementation of physical modeling, PI’s, PPI’s, MLPPI’s, JI’s, aggregate JI’s and soft referential integrity.
- Created source to target mapping.
- Performed SQL tuning.
- Defined and Implemented various backup strategies. - Cluster, All AMP, and Partitioned.
- Created various SQL for semantic layer(functional data layer) and performed SQL tuning
Environment: - Teradata TD13.10(V13.10), Erwin 7.3,sql assistant, Linux, Unix MP RAS, AIX, Arcmain, TASM, Teradata V12 (Queryman, BTEQ, Multiload, Fastload, TPump, ARCMAIN, FastExport, TPT, SQL,
Confidential, Pleasanton CALead Teradata DBA/ARCHITECT Consultant
Responsibilities:
- Team lead and co-ordination, managed 6 team members including 2 in offshore and 4 in onsite.
- Designed and Implemented various Backup strategies for all databases including PMCP - All AMP, Cluster, and Partitioned. Implemented Data purge process for PMCP.
- Performed Physical modeling (from logical model) and object creation.
- Performed Performance tuning for queries and ETL processes.
- Helped ETL team to build stored procedures and ETL load.
- Evaluated all the back up options and designed back up and recovery strategy.
- Implemented long term archival process for huge tables and performed restored operation based on customer demands. Designed and Implemented Monthly Data purge process after Monthly partitioned backup.
- Evaluated QA and Development data refresh options, Designed and implemented processes.
- Performed Backup and Restore using IBM Tivoli backup server.
- Performed Workload management using TASM.
- Defined DBA and Design best practices.
- Created and Managed various stored procedures for security and access control
- Managed TASM Settings, throttles and Priority scheduler.
- Implemented User defined functions.
- Performed Quality assurance.
- Attended Epic Clarity training
- Created Project Plan for various DBA projects and implemented.
- Worked on database application and system related problem incidents and service requests and change requests.
- Participated in VIEWPOINT implementation and provided DBA support to various application implementations and various Business Object and SAS reports.
- Responsible for Maintaining and quarterly auditing SOX related data
- Created various SQL for auditing and performed SQL tuning
- Developed SQL’s, stored procedures, Macros for data analysis.
Environment: Linux, Unix MP RAS, AIX, Tivoli backup, TASM, Teradata TD12(V12) (Queryman, BTEQ, Multiload, Fastload, TPump, ARCMAIN, FastExport, TPT, SQL, Teradata DBA Tools (Teradata Manager, Teradata Administrator, Visual Explain, PMON,PMCP/PDCR, Teradata Static Wizard, Teradata Index Wizard), Teradata DBS utilities, Vproc Manager, Priority Scheduler, Query Session, TWM, TSET, Informatica, ERwin, Viewpoint,Crystal Reports, Business Objects,Viewpoint etc.
Confidential, San Jose, CATeradata DBA & Architect - Consultant
Responsibilities:
- Performed Physical modeling (from logical model) and object creation.
- Performed Performance tuning for queries and ETL process.
- Helped ETL team to build stored procedures and ETL load.
- Evaluated all the back up options and designed back up and recovery strategy.
- Evaluated multi-arc back up process.
- Evaluated data refresh options, designed process and implemented.
- Evaluated DR refresh options and designed DR refresh strategy (dual active).
- Defined DBA and Design best practices.
- Managed Priority scheduler and TDWM architecture
- Implemented User defined functions.
- Performed Quality assurance.
Environment: NCR MP-RAS, Unix, Netbackup Teradata V2R6.1 (Queryman, BTEQ, Multiload, Fastload, TPump, ARCMAIN, Fast Export, TPT, SQL, Teradata DBA Tools (Teradata Manager, Teradata Administrator, Visual Explain, PMON, PMCP,Teradata Static Wizard, Teradata Index Wizard), Teradata DBS utilities, Vproc-Manager, Priority Scheduler, Query Session, TDWM, TSET, Informatica, ERwin etc.
Confidential, Richmond, VATeradata DBA - Consultant
Responsibilities:
- Performed Modeling, Design and Creation of bridge views across Two databases (Old UNISYS capital one systems and new Total systems- TSYS)
- Evaluated performance of the bridge views.
- Evaluation and creation of Materialized views.
- Created physical model for bridge views and cross reference tables.
- Monitored and analyzed resource usage in the production.
- Performed the creation of physical objects and user access.
- Created user access and privileges using roles and profiles.
- Defined and created back up jobs using Netbackup.
- Resolved performance issues with bridge views and implemented solutions with the approval from management.
- Helped testers and programmers in resolving their daily issues.
- Managed spool space, temp space and perm space.
- Created Multiload, Fastload, BTEQ and UNIX shell scripts.
Environment: : NCR MP-RAS, ERwin 4.1, Unix, Netbackup, Teradata V2R5 (Queryman, BTEQ, Multiload, Fastload, TPump, ARCMAIN, Fast Export, SQL, Teradata DBA Tools (Teradata Manager, Teradata Administer, Visual Explain, PMON, Teradata Statistics Wizard, Teradata Index Wizard), Teradata DBS utilities, Vproc Manager, Priority Scheduler, Query Session, TDQM, TSET, ERWIN, GDE and Co-operating System, PMCP,Unix Shell scripting etc.
