We provide IT Staff Augmentation Services!

Etl Developer (lead) Resume

2.00/5 (Submit Your Rating)

NY

SUMMARY:

  • 9 + years of experience in all phases of software development life cycle including Analysis, Design, Development & Testing of data transfers for Finance, Insurance and Healthcare Industries.
  • Technical and Functional experience in Decision Support Systems - Data warehousing implementing ETL (Extract, Transform and Load) using Informatica Power Center 7x,8x,9x,10x, Informatica Data Quality 9.5.1(IDQ)
  • Experience in Designing, Developing, Documenting, Testing of ETL jobs and mappings in Server and Parallel jobs using Data Stage to populate tables in Data Warehouse and Data marts.
  • Good experience in OLTP/OLAP System Study, Analysis and E-R modeling, developing Database Schemas like Star schema and Snowflake schemas.
  • Extensive knowledge on the PowerCenter components as PowerCenter Designer, PowerCenter Repository Manager, Workflow Manager and Workflow Monitor.
  • Handled high volume loads using Informatica and SQL Loader.
  • Expertise in creating mappings in TALEND using tMap, tJoin, tReplicate, tParallelize, tConvertType,tflowtoIterate, tAggregate, tSortRow, tFlowMeter, tLogCatcher, tRowGenerator, tNormalize, tDenormalize, tSetGlobalVar, tHashInput, tHashOutput, tJava, tJavarow, tAggregateRow, tWarn, tLogCatcher, tMysqlScd, tFilter, tGlobalmap, tDie etc.
  • Created Talend ETL jobs to receive attachment files from pop e-mail using tPop, tFileList and tFileInputMail and then loaded data from attachments into database and achieved the files
  • Expertise in creating and using database objects such as Tables, Views, Indexes.
  • Extensive experience on tools like SQL Developer, SQL Navigator and Toad.
  • Extensively documented STTM (mapping documents), TDD (Technical design documents), IDD (Interface design document) and UT docs (Unit test case documents).
  • Very strong knowledge of Informatica Data Quality transformations like Address validator, Parser, Match, Exception, Association, Standardizer and other significant transformations.
  • 3+ years of experience using Talend Data Integration/Big Data Integration (6.1/5.x) / Talend Data Quality.
  • Involved in AWS Data Migration Services and Schema Conversion Tool along with Talend ETL tool.
  • Create, modify and execute DDL in table AWS Redshift tables to load data.
  • Experience in performance tuning of Informatica mappings, capable in identifying and resolving performance bottlenecks at various levels.
  • Expertise knowledge in improving Performance and Troubleshooting of the Informatica mapping and sessions and monitoring Informatica run time statistics.
  • Experience in using the Informatica Utilities like Pushdown optimization, Partitions.
  • Exposure to many Reporting tools like SAP Business objects, SSRS, Tableau
  • Experience working with scheduling tools like Autosys, Tidal, Control M
  • Experienced in integration of various data sources (DB2-UDB, SQL Server, PL/SQL, Oracle, Teradata, XML and MS-Access) into data staging area.
  • Proficient in writing, implementation and testing of triggers, procedures and functions in PL/SQL and Oracle.
  • Experienced in Data Modelling as well as reverse engineering using tools Erwin, Oracle Designer and MS Visio, SQL server management studio, SSIS and SSRS and store procedure.
  • Design and Develop ETL Processes in AWS Glue to migrate Campaign data from external sources like S3, ORC/Parquet/Text Files into AWS Redshift.
  • Data Extraction, aggregations and consolidation of Adobe data within AWS Glue using PySpark.
  • Create external tables with partitions using Hive, AWS Athena and Redshift.
  • Effective in cross-functional and global environments to manage multiple tasks and assignments concurrently with effective communication skills.
  • Experience with multiple software development methodologies including Agile/SCRUM.

TECHNICAL SKILLS:

ETL: Informatica 7.x, 8.6.1, 9.1, 10.1, MS SSIS (SQL server 2008)

Data Modeling: Erwin

Database: Oracle 10g,9i/8i, SQL Server 2008, 2010, DB2, Teradata, Netezza

Domain Skills: Insurance, Investment Banking, Finance, Healthcare

Web technologies: HTML, XML, XSLT

Operating Systems: Windows Server 2003/Xp, HP-UX, IBM-AIX 5.3, Sun Solaris, Red-Hat Linux, MS Access

Development Tools: SQL*Plus 3.3/8.0, TOAD, Microsoft Visio, Putty, Text Pad, .csv files, Erwin, ER Model, Salesforce Integration

Business Intelligence Tools: Business Objects, SSRS (SQL Server 2008), IBM Cognos 8

Scheduling Tools: Tidal, Control M, Autosys

Programming Language: ABAP/4, C, Java, SQL, PL/SQL, UNIX Shell script

PROFESSIONAL EXPERIENCE:

Confidential, NY

ETL Developer (Lead)

Environment: Informatica 10.1.1, 9.5, Oracle 11g, XML, SQL Server 2008, Web services, DB2 Mainframe, Tidal (Scheduler), Gits (Defect Tracker), Unix, Cognos 8(Reporting Tool)

Responsibilities:

  • Worked with ETL Developers in creating External Batches to execute mappings, Mapplets using Informatica workflow designer to integrate Shire’s data from varied sources like Oracle, DB2, flat files and SQL databases and loaded into landing tables of Informatica MDM Hub.
  • Designed and created BO, staging tables, mappings, transformations as per business requirements.
  • Created mappings to perform the tasks such as cleansing the data and populate that into staging tables.
  • Used Metadata manager for validating, promoting, importing and exporting repositories from development environment to testing environment.
  • Involved with Data Steward Team for designing, documenting and configuring Informatica Data Director for supporting management of MDM data.
  • Identified Golden Record for Customer Data by analysing the data and duplicate records coming from different source systems.
  • Helped the testing team for data integrity and consistency.
  • Defined and configured schema, staging tables, and landing tables, base objects foreign-key Relationships, look up systems and tables, packages, query groups and queries/custom queries.
  • Defined the Trust and Validation rules and setting up the match/merge rule sets to get the right master records
  • Used Hierarchies tool, for configuring entity base objects, entity types, relationship base objects, relationship types, profiles, put and display packages and used the entity types as subject areas in IDD.
  • Created mappings using Informatica Power center and loading data into pre-landing tables.
  • Developed data models according to company standards. Used DB2 Connect to extract multiple database source systems to single analytical system for large databases and 24*7 Production support for data warehousing

Confidential, Boston, MA

Sr. ETL/ Talend Developer ( Lead)

Environment: Talend Data Integration 7.1/ 6.1/5.5.1 , Talend Enterprise Big Data Edition 5.5.1, Talend Administrator Console, Oracle 11g, Hive, HDFS, Sqoop, Netezza, SQL Navigator, Toad, Control M, Putty, Winscp.

Responsibilities:

  • Involved as primary on-site ETL Developer during the analysis, planning, design.
  • Participated in all phases of development life-cycle with extensive involvement in the definition and design meetings, functional and technical walkthroughs.
  • Created Talend jobs to copy the files from one server to another and utilized Talend FTP components
  • Developed and executed a migration strategy to move Data Warehouse from an Oracle platform to AWS Redshift.
  • Used ETL methodologies and best practices to create Talend ETL jobs. Followed and enhanced programming and naming standards.
  • Created and deployed physical objects including custom tables, custom views, stored procedures, and Indexes to SQL Server for Staging and Data-Mart environment.
  • Design and Implemented ETL for data load from heterogeneous Sources to SQL Server and Oracle as target databases and for Fact and Slowly Changing Dimensions SCD-Type1 and SCD-Type2.
  • Utilized Big Data components liketHDFSInput, tHDFSOutput, tPigLoad, tPigFilterRow, tPigFilterColumn, tPigStoreResult, tHiveLoad, tHiveInput, tHbaseInput, tHbaseOutput, tSqoopImport and tSqoopExport.
  • Extensively used tMap component which does lookup & Joiner Functions, tjava, tOracle, txml, tdelimtedfiles, tlogrow, tlogback components etc. in many of my Jobs Created and worked on over 100+components to use in my jobs.
  • Used Talend most used components (tMap, tDie, tConvertType, tFlowMeter, tLogCatcher, tRowGenerator, tSetGlobalVar, tHashInput&tHashOutput and many more).
  • Created many complex ETL jobs for data exchange from and to Database Server and various other systems including RDBMS, XML, CSV, and Flat file structures.
  • Load data into Amazon Redshift and use AWS Cloud Watch to collect and monitor AWS RDS instances within Confidential
  • Handled major Production GO-LIVE and User acceptance test activities.
  • Created architecture diagrams for the project based on industry standards
  • Defined escalation process metrics on any aborts and met SLA for production support ticket

Confidential, NY

ETL Developer/ Designer

Environment: Informatica Power Center 9.1, Informatica MDM 9.1, Oracle 10i, SQLServer2016, IBM DB2, XML, Flat files, PL/SQL, Jira, HP Quality Control, UNIX scripting, Windows 2007, CotrolM, Netezza.

Responsibilities:

  • Learnedthe existing DataMarts to understand and integrate the new source of data.
  • Designed and created new Informatica jobs to implement new business logic into the existing process.
  • Using Informatica modules ( Repository Manager, Designer, Workflow Manager and Workflow Monitor) to accomplish end to end ETL process.
  • Created sql scripts/transformations to extract the source data from various sources such as Oracle, Flat Files etc.
  • Used functionality of Informatica ( Mapplets, Stored Procedures, Normalizer, Update Strategy, Router, Joiner, Java, SQL Transformation Etc...) to interpret the business logic into the ETL mappings.
  • Designed and developed complex aggregate, joiner, lookup transformations to implement the business rules in the ETL mappings to load the target Facts and Dimensions.
  • Involved in requirement analysis, ETL design and development for extracting data from the source systems like sales force,Mainframe, DB2, sybase, Oracle, flat files and loading into Netezza.
  • Defined Target Load Order Plan for loading data into Target Tables
  • Used Mapplets and Reusable Transformations prevent redundancy of transformation usage and maintainability.
  • Used Informatica’s features to implement Type 1, 2 changes in slowly changing dimension Change Data Capture ( CDC )
  • Fine-tuned the session performance using Session partitioning for long running sessions.
  • Implemented performance tuning logic on Targets, Sources, mappings, sessions to provide maximum efficiency and performance.
  • Used Versioning, Labels and Deployment group in the production move process.
  • Used debugger to test the mapping and fixed the bugs.
  • Used Workflow Manager for Creating, Validating, Testing and running the sequential and concurrent Sessions and scheduling them to run at specified time.
  • Developed Oracle Stored Procedures, Packages and Functions and utilized in ETL Process.
  • Created Job parameter sets for reusing the parameters.
  • Performed unit testing for jobs and scripts to validate the data and prepared jobs checklists to validate the user requirements.
  • Scheduled workflows using ControlM scheduling tool.

Confidential, Richmond, VA

ETL Developer

Environment: Informatica PowerCenter 9.5, Oracle11g/9i, PL/SQL, Flat files, Facets, XML, Teradata, SQL Server 2012R2,SQL Reporting Services ( SSRS ), SQL Integration Services ( SSIS )

Responsibilities:

  • Involved in gathering business requirements and attended technical review meetings to understand the data warehouse model.
  • Involved in data modeling and design of data warehouse in star schema methodology with confirmed granular dimensions and Fact tables.
  • Developed Technical Specifications of the ETL process flow
  • Extensively used ETL to load data from Flat files, SQL Server and Oracle into Teradata.
  • Developed, deployed, and monitored SSIS Packages and Created Complex ETL Packages using SSIS to extract data from staging tables to partitioned tables with incremental load.
  • Created NetezzaSql scripts to test the table loaded correctly
  • Responsible for determining the bottlenecks and fixing the bottlenecks with performance tuning using Netezza Database .
  • Created SSIS Reusable Packages to extract data from Multi formatted Flat files, Excel, XML files into UL Database and DB2 Billing Systems.
  • Created SSIS Packages using SSIS Designer for export heterogeneous data from OLE DB Source (Oracle), Excel Spreadsheet to SQL Server2005/2008.
  • Performed operations like Data reconciliation, validation and error handling after Extracting data into SQL Server.
  • Worked on SSIS Package, DTS Import/Export for transferring data from Database (Oracle and Text format data) to SQL Server.
  • Created SSRS reports using Report Parameters, Drop-Down Parameters, Multi-Valued Parameters Debugging Parameter Issues Matrix Reports and Charts.
  • Used Informatica Designer to Extract & Transform the data from various source systems by incorporating various business rules. Also used different transformations, sessions and command tasks.
  • Created mappings using different transformations like Aggregator, Expression, Stored Procedure, Filter, Joiner, Lookup, Router and Update Strategy.
  • Developed PL/SQL triggers and master tables for automatic creation of primary keys.
  • Performed SQL and PL/SQL tuning and Application tuning using various tools like EXPLAIN PLAN, SQL*TRACE, TKPROF and AUTOTRACE.
  • Developed Advance PL/SQLpackages, procedures, triggers, functions, Indexes and Collections to implement business logic using SQLNavigator. Generated server-sidePL/SQLscripts for data manipulation and validation and materialized views for remote instances.
  • Worked with Teradata data lake.
  • Responsible for design and developing Teradata BTEQ scripts, MLOAD based on the given business rules and design documents.
  • Experience in Coding Teradata SQL, Teradata Stored Procedures, Macros and Triggers
  • Loading the data into Netezza from legacy systems and flat files using complex UNIX scripts. Implemented Slow changing dimensions SCD-1 and SCD-II mappings to upgrade Slowly Changing Dimension Tables.
  • Experience in migration Informatica objects from 9.1 to 9.5.
  • Experience in Informatica upgrade testing, troubleshoot and resolve issues.
  • Created complex mappings in the designer and monitored them. The mappings involved extensive use of Aggregator, Filter, Router, Expression, Joiner, Union, Normalizer and Sequence generator transformations.
  • Ran the workflows on a daily and weekly basis using Active Batch Scheduling tool.
  • Examined the workflow log files and assigning the ticket to the Informatica support based on the error.
  • Experience in developing Unix Shell Scripts for automation of ETL process.
  • Performed operational support and maintenance of ETL bug fixes and defects.
  • Maintained the target database in the production and testing environments.
  • Supported migration of ETL code from development to QA and QA to production environments.
  • Designed and developed Unix Shell Scripts, FTP, sending files to source directory & managing session files
  • Done extensive testing and wrote queries in SQL to ensure the loading of the data.
  • Developed PL/SQL code at the database level for the new objects.

Confidential, Richmond, VA

Sr. ETL/ Talend Developer

Environment: Talend 6.1/5.5/5.0, Oracle 11g, Teradata SQL Assistant, HDFS, MS SQL Server 2012/2008, PL/SQL, Agile Methodology, Informatica, TOAD, ERwin, AIX, Shell Scripts, AutoSys, SVN.

Responsibilities:

  • Working on building new data warehouse for customer data information.
  • Participated in JAD sessions with business users and SME's for better understanding of the reporting requirements.
  • Design and developed end-to-end ETL process from various source systems to Staging area, from staging to Data Marts.
  • Analyzing the source data to know the quality of data by using TalendData Quality .
  • Broad design, development and testing experience with Talend Integration Suite and knowledge in Performance Tuning of mappings.
  • Developed jobs in Talend Enterprise edition from stage to source, intermediate, conversion and target.
  • Involved in writing SQL Queries and used Joins to access data from Oracle, and MySQL.
  • Used tStatsCatcher, tDie, tLogRow to create a generic joblet to store processing stats.
  • Solid experience in implementing complex business rules by creating re-usable transformations and robust mappings using Talend transformations like tConvertType, tSortRow, tReplace, tAggregateRow, tUnite etc.
  • Developed Talend jobs to populate the claims data to data warehouse - star schema.
  • Developed mappings to load Fact and Dimension tables, SCD Type 1 and SCD Type 2 dimensions and Incremental loading and unit tested the mappings.
  • Used tStatsCatcher, tDie, tLogRow to create a generic joblet to store processing stats into a Database table to record job history.
  • Integrated java code inside Talend studio by using components like tJavaRow, tJava, tJavaFlex and Routines.
  • Experienced in using debug mode of talend to debug a job to fix errors. Created complex mappings using tHashOutput, tHashInput, tNormalize, tDenormalize, tMap, tUniqueRow. tPivotToColumnsDelimited, etc.
  • Used tRunJob component to run child job from a parent job and to pass parameters from parent to child job.
  • Created Context Variables and Groups to run Talend jobs against different environments.
  • Used tParalleize component and multi thread execution option to run subjobs in parallel which increases the performance of a job.
  • Implemented FTP operations using Talend Studio to transfer files in between network folders as well as to FTP server using components like tFileCopy, TFileAcrchive, tFileDelete, tCreateTemporaryFile, tFTPDelete, tFTPCopy, tFTPRename, tFTPut, tFTPGet etc.
  • Experienced in Building a Talend job outside of a Talend studio as well as on TAC server.
  • Experienced in writing expressions with in tmap as per the business need. Handled insert and update Strategy using tmap. Used ETL methodologies and best practices to create Talend ETL jobs.
  • Extracted data from flat files/ databases applied business logic to load them in the staging database as well as flat files.
  • Provided support to develop the entire warehouse architecture and design the ETL process.

Confidential

Database Developer

Environment : Informatica PowerCenter 7.1, Oracle8i, UNIX, PL/SQL, SQL Loader, Autosys, Windows NT

Responsibilities:

  • CreatedUnix Shell Scripts and PL/SQL procedures
  • Participated in system analysis and data modeling , which included creating tables, views, indexes, synonyms, triggers, functions, procedures, cursors and packages .
  • Writing queries and stored procedures in PL/SQL to fetch data from the OLTP system and executed at regular intervals of time.
  • Modified existing forms, reports, and graphs as per the enhancement.
  • Developed PL/SQL scripts to validate and load data into interface tables. The backend was in Oracle and database operations were handled using stored procedures.
  • Worked on all phases of multiple projects from initial concept through research and development, implementation, QA, to live production, by strict adherence to project timelines.
  • Moved data from one database to other database, Used SQL*Loader for datamigration.
  • Provided production support and involved with root cause analysis, bug fixing and promptly updating the business users on day-to-day production issues.

We'd love your feedback!