Sr Etl Developer Resume
St Louis, MO
SUMMARY
- 20 years of experience in Software architecture and development experience in teh entire Software Development Life Cycle (SDLC).
- 10+ years of experience in teh Development and Implementation of Data warehousing, Business Intelligence, Data Integration & Data Migration.
- Extensive experience in handling ETL using Informatica Power Center 9.x/8.x/7.x.
- Extensive experience in designing and developing ETL involving Source databases Oracle, DB2, flat Files (fixed width, delimited) and Target databases Teradata, Oracle, DB2, SQL Server 2005 and Flat Files (fixed width, delimited).
- Strong experience in Build and maintain SQL scripts, Indexes, and complex queries for data analysis and extraction.
- Developed complex Mapplets and Mappings, and SQL Stored Procedure, and Triggers.
- Extensively used Informatica tools such as Informatica Server and Client tools like Designer, Workflow manager, Workflow Monitor, Repository Manager.
- Experience in implementing teh complex business rules by creating transformations, re - usable transformations (Expression, Aggregator, Filter, Connected and Unconnected Lookup, Router, Rank, Joiner, Update Strategy, Normalizer).
- Extensive noledge in architecture design of Extract, Transform, Load environment using Informatica Power Center and Pentaho Data Integration tool.
- Worked on all phases of data warehouse development lifecycle, from gathering requirements to testing, implementation, and support using Informatica Power Center.
- Used ERwin Data Modeler for FACT/Dimensional Models.
- Worked on business Projects/Applications of Financial systems (Brokerage firm), Telecom, Health Insurance, HIPAA, Banking and Credit Cards.
- Developed mapping using Parameters and Variables. Extensively used parameter file to pass mapping and session variables.
- Experience in Performance Tuning of sources, targets, mappings, transformations and sessions, by implementing various techniques like partitioning techniques and pushdown optimization, and also identifying performance bottlenecks.
- Extensive experience in implementing CDC using Informatica Power Exchange 8.x/7.x.
- Expertise in doing Unit Testing, Integration Testing, System Testing and Data Validation for Developed Informatica Mappings.
- Experience in conversion of mainframe jobs/programs into Informatica workflows/mappings. Used Informatica power exchange to read/convert teh COBOL layouts into informatica power center.
- Extracted data from various sources like DB2, Oracle, PL/SQL, SQL SERVER, Flat file, XML files, loaded into target databases Teradata, Oracle databases.
- Strong experience in developing Teradata Loading and Unloading utilities like Fast Export, Fast Load, Multiload, TPT, BTEQ, Tpump.
- Experience with UNIX shell scripting for File validation, SQL programming, automation of workflows.
- Practical understanding of Star Schema and Snowflake Schema Methodology using Data Modelling tool Erwin 9.X.
- Experienced in mainframe technologies of COBOL, CICS, VSAM, JCL, SQL, DB2, IDMS, Assembler, MVS, OS/390, Z/OS, TSO/ISPF, SPUFI, QMF, Platinum, File-Aid, File-Manager, ENDEVOR, CHANGEMAN, XPEDITER, CA-7, AUTO-SYS, IBM utilities.
- Good noledge in Java, J2EE technologies, ASP, HTML, Java script, VB Script, XML.
- Exposure with attending project meetings and working with large/small teams, Project managers, team members / associates, business analysts, statisticians, and internal customers/end users, working with multiple tasks.
TECHNICAL SKILLS
Hardware/OS: Windows (Windows NT/2000/XP Professional), UNIX, IBM MVS, OS/390, Z/OS.
Databases: Oracle 8i/9i/10g/11g, SQL, SQL Server 2000/2005/2008, Teradata 15.10, DB2, PL/SQL, Vertica.
Technologies: Java, J2EE, ASP, Java Script, VB Script, IIS 4.0, HTMLXML
Tools: /Utilities Informatica Power Center 9.x/8.6/8.1, Informatica power ExchangeV8x, Pentaho BI Suite, IDQ 8.6, TOADPL/SQL developer, Oracle SQL Developer, Teradata SQL AssistantDB2I, Platinum tool, SPUFI, QMF, VSAM, IDCAMS, FTPNDM/Connect Direct, OLTP, MQ Series, CA7, Auto-sys, IBM Tivoli Workload Scheduler, Control-M, Peregrine Service CenterPVCS, Omegaview or Omegamon, Sysview, Mercury QualityCenter(QC), MS-Visio, MS-Office tools.
Software/Languages: COBOL, CICS, JCL, VSAM, DB2, IDMS, Easytrieve, UNIX Shell Scripting
PROFESSIONAL EXPERIENCE
Confidential - St Louis, MO
Sr ETL Developer
Responsibilities:
- Responsible for Source Attribute Analysis discussions, ETL technical design discussions and prepared ETL high level technical design document and Detail Design Documents.
- Responsible for analysing teh source data volumes and estimate teh Unix server space and Oracle Space in eCDW Alliance servers.
- Extracted data from Oracle Gloden Gate tables, flat files using Informatica ETL mappings and loaded to Data Mart.
- Designed and developed ETL jobs for teh data management teams in various projects.
- Build and maintain SQL scripts, Indexes, and complex queries for data analysis and extraction.
- Used Teradata utility TPT, BTEQ to load teh data from flat files into Stage table and to FACT tables.
- Used Teradata utility Fast Export to generate teh extracts from FACT / BASE tables.
- Used Teradata utility Fast Load, Multiload to fix teh data issues as one time scripts.
- Developed complex Source qualifier queries, Lookup override queries to improve teh performance of teh ETL load jobs.
- Worked closely with teh administrator to get code deployments in production and different environments.
- Designed and developed teh ETL process to load and extract data using DB2 Load and Oracle SQL loader.
- Interacting with onsite and offshore team to assign Development tasks.
- Created complex Informatica mappings using transformations, Unconnected Lookup, joiner, Rank, Source Qualifier, Sorter, Aggregator, Lookup and Router transformations to extract, transform and loaded data mart area.
- Worked extensively on shell scripting for file management, parameter file creation.
- Created re-usable transformations/mapplets and used across various mappings
- Developed Informatica workflows/worklets/sessions associated with teh mappings using Workflow Manager
- Automated scheduling of Unix Scripts and Informatica workflows using IBM Tivoli work load Scheduler.
- Worked with Informatica Data Quality 8.6.1 (IDQ) toolkit, Analysis, data cleansing, data matching, data conversion, exception handling, and reporting and monitoring capabilities of IDQ 8.6.1.
- Expert in performance tuning of Informatica code using standard informatica tuning steps.
- Used ERwin data Modeler for modeling of FACT/dimensional tables.
- Prepared Vertica vsql scripts to extract teh data from Teradata and load into Vertica DB as part of extended history project.
- Used Dbeaver to access and move across teh DBs (Vertica, Oracle, Teradata).
- Supported during QA/UAT/PROD deployments and bug fixes
- Involved in code Reviews as per ETL/Informatica standards and best practices.
- Involved in U2L (Unix to Linux) of applications and data-migration tasks between teh servers.
- Worked on Production tickets and production support activities.
Environment: Informatica Power Center 9.x/8.x, IDQ 8.6.1, Oracle 11i, DB2, Teradata 15.10, Vertica 9.X, Dbeaver 5.0, Flat Files, Mainframe Files(VB, Flat files), Toad 12.9, SQL Developer, Unix Shell Scripting and Windows7, Teradata SQL Assistant, IBM Requisite Pro, Prism, IBM Tivoli work load Scheduler, MS-Visio, ERwin Data Modeler 9.x.
Confidential - St Louis, MO
Sr ETL Developer / Lead
Responsibilities:
- Work with IT and Business users to evaluate complex user requests, projects, and clarify objectives and functional requirements for new or modified computer programs.
- Independently formulate detailed program specifications using structured analysis and design methodology. Prepare project documentation when needed.
- Develop detailed ETL application designs and specifications for computer applications.
- Write documentation describing program modifications, logic, and corrections. Oversee development of user manuals and operating procedures. Provide technical assistance to resolve operating issues.
- Provide on-teh-job training for new or less experienced programmers who join teh team. Mentor team to improve their understanding and skill and ensure they are familiar with resource materials including manuals and systems documentation.
- Developed FRD (Functional requirement Document) and data architecture document and communicated with teh concerned stakeholders. Conducted Impact and feasibility analysis.
- Designed Mapping document, which is a guideline to ETL Coding.
- Responsible for development, support and maintenance of teh ETL (Extract, Transform and Load) processes using Pentaho ETL tool.
- Experience in creating ETL transformations and jobs using Pentaho Kettle Spoon designer and Pentaho Data Integration Designer and scheduling them on Pentaho BI Server.
- Developed an ETL Transformations in order to load data into staging area.
- Extracted teh data from flat files, XML files, DB2 databases and loaded into Oracle 10g target database.
- Converted critical mainframe jobs into Pentaho transformations to improve teh performance.
- Experienced in using Pentaho ETL tool to extract data from IDMS and DB2 databases into load data into Oracle EDW.
- Experience with UNIX shell scripting for File validation and SQL programming.
- Scheduled teh ETL jobs in Auto-sys boxes.
- Developed ETL mappings to generate an XML files which load into MQ Series.
- Responsible for Test Execution (Unit, System, Integration and User Acceptance Testing) in mainframe applications as well as in Web applications.
- Participated in peer reviews of ETL transformations, UNIX Scripts.
- Monitored production job cycles in CA-7 and Auto-sys.
- Implemented CA-7 batch schedule changes to avoid contentions with batch jobs and Online CICS transactions.
- Experienced in using Mercury QC as a testing tool for defect tracking and storing test plans.
- Involved in performance tuning of ETL transformations.
Environment: Pentaho, Oracle, DB2, IDMS, Z/OS, Unix, TSO/ISPF, COBOL II, JCL, CICS, VSAM, DB2, IDMS, MQ-Series, CA-7, Auto-sys,, SPUFI, QMF, Mercury Quality Center(QC), NDM, Connect Direct, FTP, HTML, Java Script, XML, MS Office (MS-word, Excel, Power Point).
Confidential - Atlanta, GA
Sr ETL Informatica Developer
Responsibilities:
- Interacted with teh Business users to identify teh process metrics and various key dimensions and measures. Involved in teh complete life cycle of teh project.
- Developed FRD (Functional requirement Document) and data architecture document and communicated with teh concerned stakeholders. Conducted Impact and feasibility analysis.
- Worked on dimensional modeling to design and develop STAR schemas by identifying teh facts and dimensions. Designed logical models as per business requirements using Erwin.
- Worked with Power Center Designer tools in developing mappings and Mapplets to extract and load teh data from flat files, XML files and Oracle (source) and loaded into Oracle (target).
- Prepared software requirement specifications through interaction with business analysts and designed Star schema, logical and physical database designs.
- Created reusable Mapplets transformations to load data from operational data source to Data Warehouse and involved in Capacity Planning and Storage of data.
- Created different transformations like Source Qualifier, Joiner transformation, Update Strategy, Lookup transformation, Rank Transformations, Expressions, Aggregator, Sequence Generator for loading teh data into targets.
- Developed complex mappings such as Slowly Changing Dimensions Type 2, Type 3, type 1 - Time Stamping in teh Mapping Designer.
- Used Informatica Workflow Manager to create Workflows, database connections, sessions, and batches to run teh mappings.
- Developed various command tasks to automate teh Pre session jobs. Did performance tuning to improve teh load. Wrote complex SQL Queries involving multiple tables with joins.
- Involved in writing of Triggers, Functions, and Packages.
- Converted SQL/Procedures and SQL Loader scripts to Informatica mappings.
- Used teh Target Load Ordering with Stored Procedures to update database.
- Used Variables and Parameters in teh mappings to pass teh values between sessions.
- Worked with Informatica Debugger to debug teh mappings in Designer. Scheduled Informatica jobs using Informatica Scheduler. Determined various bottle necks and successfully eliminated them to great extent. Performed Unit Testing and Involved in tuning teh Session and Workflows for better Performance.
- Implemented Optimization/performance tuning techniques to identify bottlenecks- Query tuning (Explain Plan, SQL Trace), table partitioning, memory tuning and cache management.
- Debugged and sorted out teh errors and problems encountered in teh production environment.
- Generated Adhoc reports using Business objects.
- Extensively used Teradata utilities like TPT, BTEQ, Fast load, Multiload to load data into target database.
- Developed Desktop Intelligence and Web Intelligence reports Using Business objects.
- Created graphical representation of reports such as Bar charts, Pie charts as per requirements.
- Created & tested reports using Business Objects functionality like Queries, Sections, Break points, variables, Formulae etc.
- Implemented best practices, documented issues related to performance & upload in share point.
Environment: Informatica 8.x, Teradata, Oracle 11g/10g, MS SQL Server 2008, flat files, Windows XP, Business objects xi, Power Exchange 8.6.1, UNIX.
Confidential - Richmond, VA
Informatica Developer
Responsibilities:
- Worked with business analysts for requirement gathering, business analysis, and testing and project- coordination.
- Responsible for development, support and maintenance of teh ETL (Extract, Transform and Load) processes using Informatica Power Center.
- Developed an ETL Informatica mapping in order to load data into staging area. Extracted from flat files and databases and loaded into Oracle 10g target database.
- Designed Mapping document, which is a guideline to ETL Coding.
- Created mappings using teh transformations like Source Qualifier, Aggregator, Expression, Look Up, Router, Filter, Update Strategy, Joiner, Sequence Generators and Stored Procedure
- Worked with various Informatica Power Center tools - Source Analyzer, Target designer, Mapping Designer & Mapplet, Transformations.
- Used Slowly Changing Dimension Mappings of type II and me.
- Created reusable transformations and Mapplets and used them in complex mappings.
- Wrote Stored Programs (Procedures & Functions) to do Data Transformations and integrate them with Informatica programs and teh existing application.
- Used Workflow Manager for Creating, Validating, Testing and Running teh sequential and concurrent Batches and Sessions, scheduled them to run Confidential a specified time.
- Used mapping Parameters and Variables.
- Worked on Parameterize of all variables, connections Confidential all levels in Window NT.
- Created Sessions, Worklets and Workflows for carrying out test loads.
- Analyzed Session log files to resolve errors in mapping and managed session configuration.
- Created, configured, scheduled and monitored teh sessions and workflows on teh basis of run on demand, run on time using Informatica Power Center Workflow Manager.
- Involved in migrating teh ETL application from development environment to testing environment.
- Extensively used SQL and PL/SQL to write Stored Procedures, Functions, Packages and Triggers.
- Used PLSQL developer, TOAD to run SQL queries and validate teh data.
- Worked on Teradata SQL Assistant to analyze teh existing data and implemented new business rules to handle various source data anomalies.
- Extensively used Teradata utilities like Fast load, Multiload to load data into target database.
- Documented and presented teh production/support documents for teh components developed, when handing-over teh application to teh production support team.
- Prepared ETL standards, Naming conventions and wrote ETL flow documentation for Stage and ODS.
- Experienced in writing complex reporting using SQL performance tuning and providing operational support for OLTP and OLAP applications.
Environment: Informatica Power Center 8.x, Teradata V2R6, Oracle11g/10g, SQL Server 2008, TOAD, Business Objects XI, Linux, Windows XP.
Confidential - Cleveland, OH
Informatica Developer
Responsibilities:
- Involved in teh Design, Analysis and Development of data warehouse using Informatica Power Center tools. Teh project involved in creating data warehouse/data mart which is further used for reporting purpose.
- Coordinated with Business system analyst (BSA) to understand and gather teh requirements. Documented user requirements, translated requirements into system solutions and developed implementation plan and schedule.
- Analyzed Mapping, Session, Source, Target and System Bottlenecks to improve and tuned Performance of various ETL jobs.
- Designed and developed complex Informatica mappings using Source Qualifier, Aggregator, Joiner, Lookup, and Sequence Generator, Stored Procedure, Expression, Normalizer, Filter and Rank transformations.
- Categorized different alerts and exception types to be built from User’s Data Validation list and built mappings to generate exceptions and alerts accordingly.
- Coordinated with OBIEE Team regarding teh reporting data for Answers and BI Publisher reports and also for teh Dashboard Designs.
- Created UNIX scripts for file transfers, to remove unwanted characters from source files, and update teh time dimension table that was maintained for reporting purposes.
- Involved in maintaining teh data model, creating teh tables and granting teh privileges for read and write operations
- Extensively used parameter file to pass Mapping and Session Variables.
- Involved in many technical decisions and prepared technical design document along with vision diagrams for ETL.
Environment: Informatica Power Center 8.6, SQL*Plus, Toad 8.0, Toad, Oracle 9i, OBIEE 10.1.x, UNIX Shell scripting, PL/SQL, CA-7 Scheduling.