Etl Developer Resume
Washington, DC
SUMMARY:
- Over 9 years of experience in IT industry as a Software Engineer in the area of Data warehousing specialized in Extract Transform and Load (ETL) and business intelligence (BI), with particular expertise in Informatica, Data Stage, Informatica Data Quality(IDQ), MDM,Informatica Cloud, Power Exchange, Oracle, Teradata, OLAP and Unix Shell Scripting. Specialized in Analysis, Design, Development, Implementation, Modeling, Testing, and support for Data warehousing (DWH) applications from various Heterogeneous Data Sources. Experience on Data Warehousing with architecture, design, development and implementation of data warehouse ETL processes.
- Worked on data quality tools, Informatica data quality (IDQ) 9.1 by creating mappings using different transformations available.
- Involved in all aspects of ETL - requirement gathering, coming up with standard interfaces to be used by operational sources, data cleaning, data load strategies, designing various mappings, developing mappings, unit testing, integration testing, regression testing in development and UAT
- Developed mappings using Informatica Power Center Transformations - Lookup (Unconnected, Connected), Filter, Expression, Router, Joiner, Update Strategy, Aggregator, Stored Procedure, Sorter, and Sequence Generator.
- Dimensional data modeling using Data Modeling, Star Join Schema/Snowflake modeling, fact and dimensions tables, physical and logical data modeling.
- Proficiency in Linux, UNIX and shell scripting and automation.
- Expertise in SQL, PL/SQL, functions, triggers, stored procedures and packages.
- Experienced in Informatica Power Center 9.x/8.x/7.x, Power Connect, Power Exchange.
- Hands on experience in all aspects of Software Development Life Cycle (SDLC).
- Experience in Extraction, Transformation and Loading of data from different source systems like Flat files (Fixed width & Delimited), XML Files, Excel, Oracle, MS SQL Server.
- Worked on Informatica Designer Components - Source Analyzer, Target Analyzer, Warehouse Designer, Transformation Developer, Mapplet and Mapping Designer.
- Strong Experience on Workflow Manager Tools - Task Developer, Worklet & Workflow Designer.
- Expertise in OLTP/OLAP System Study, Analysis and E-R modeling, developing Database Schemas like Star schema and Snowflake schemas.
- Extensively created mappings in TALEND using tMap, tJoin, tReplicate, tParallelize,tConvertType, tflowtoIterate, tAggregate, tSortRow, tFlowMeter, tLogCatcher, tRowGenerator, tNormalize, tDenormalize, tSetGlobalVar, tHashInput, tHashOutput, tJava,tJavarow, tAggregateRow, tWarn, tLogCatcher, tMysqlScd, tFilter, tGlobalmap, tDie etc.
- Experience in using cloud components and connectors to make API calls for accessing data from cloud storage (Google Drive, Salesforce, Amazon S3, DropBox ) in Talend Open Studio.
- Experience in Performance tuning of sources, targets, mappings and sessions.
- Worked on all cache optimization options with Aggregator, Lookup, Joiner transformations.
- Worked on slowly changing dimensions Type I, II &III and its implementation to keep track of historical data.
- Experience using different types of data providers to create documents in Business Objects.
- Generated the Business Objects Reports using the universe as the main Data provider and writing the complex queries including Sub queries, Unions, Intersect and Aliases.
- Skilled in developing applications in Python language for multiple platforms
- Experience in logical/physical data models and Forward/Reverse Engineering using ERwin.
- Experience in UNIX Pre and Post Session command tasks.
TECHNICAL SKILLS:
ETL Tool: Informatica Power Center 9.x/8.x/7.1.x, Data Stage 8.5,Informatica Cloud, Talend open studio 5.1
Data Quality Tool: Informatica Data Quality (IDQ) 9.x, Quality Center, MDM
Methodologies: Star Schema Modeling, Snow-Flake Schema Modeling, FACT and Dimensions Tables, Logical and Physical Data Modeling
Databases: Oracle 11g/10g/9i, MS SQL Server 2005/2000,DB2, MS Access, Teradata, Informix, MongoDB, Netezza, Cassandra, Redshift
Cloud: Informatica Cloud, AWS, Azure, DevOps, salesforce
Languages: SQL, PL/SQL, UNIX Shell Script, Bash, Korn Shell, C, Java, HTML, Python
Tools: Toad, SQL* Loader, PVCS, Rational Clear Case, Rational Clear Quest, QC, Developer 2000, Erwin 8.x, MS Visio, BO, SVN, MicroStrategy 9.x, Cognos 6.x, OBIEE 10.x, Jenkins, aginity
Operating Systems: Windows NT/2000/2003/XP, UNIX, Linux
PROFESSIONAL EXPERIENCE:
Confidential, Washington, DC
ETL Developer
Responsibilities:
- Conceptualizing, designing, developing and implementing the business requirements through Informatica mappings.
- Business analysis and requirements Gathering, designing and customizing data models for Data warehouse supporting data from multiple sources on real time.
- Project life cycle - from analysis to production implementation, with emphasis on identifying the source and source data validation, developing particular logic and transformation as per the requirement and creating mappings and loading the data into different targets.
- Design, Development, Testing and Implementation of ETL processes using Informatica Cloud.
- Designed, developed ETL mappings, enabling the extract, transport and loading of the data into target tables.
- Responsible for creating and modifying PLs, Packages, procedures, functions, cursor, refcursor, view, materialized view, collections etc. according to the business requirements.
- Worked with Memory cache for static and dynamic cache for the better throughput of sessions containing Rank, Lookup, Joiner, Sorter, source qualifier and Aggregator transformations.
- Created and scheduled Worklets. Setup workflow and Tasks to schedule the loads at required frequency using Workflow Manager.
- Designed and developed Informatica mappings for data loads and data cleansing. Extensively worked on Informatica Designer.
- Implemented a partitioning strategy similar to Informatica’s partitioning to increase parallelism.
- Performed tuning functions on Informatica sessions, batches and other related scripts.
- Extensively used almost all of the transformations of Informatica including lookups, stored procedures, Update Strategy and others.
- Prepare documentation on all aspects of ETL processes, definitions and mappings.
- Rigorous unit testing and functional testing to reduce the defects before QA.
- Tested and implemented applications built using Python.
- Coordinated with campaign and reporting team for the change requests and availability of Data.
- Dig deep into complex SQL Query and PL/SQL Procedure to identify items that could be converted to Informatica Cloud ISD.
- Coordinated with all the technical resources and delivery of the quality solutions in the timely manner with overall project objectives.
- Extensively worked on Power connect, Power Exchange and Power Center to pull data from sources like Oracle.
- Strong Experience on RDBMS Concepts.
- Strong experience in OLAP Data Modeling using Dimensional Data Modeling, Star Join Schema Modeling, Snow-Flake Modeling, FACT and Dimensions Tables, Physical and Logical Data Modeling.
- Extensively worked with XML files as the Source and Target, used transformations like XML Generator and XML Parser to transform XML files, used Oracle XMLTYPE data type to store XML files.
Environment: Informatica PowerCenter 10.1, Informatica DataQuality(IDQ),Informatica Cloud, Amazon Red shift,Salesforce, Power Designer, Power Exchange, Scheduler, Work Flows, ETL, Visio, Flat Files,Netezza,Oracle,SQL Server,Unix Shell Scripts, BASH, Aginity, Windows 10, Putty, Winscp, Jira, Mercury, Quality Center, Tableau,microstrategy.
Confidential, Reston, VA
ETL Developer
Responsibilities:
- Business analysis and requirements Gathering, designing and customizing data models for Data warehouse supporting data from multiple sources on real time.
- Project life cycle - from analysis to production implementation, with emphasis on identifying the source and source data validation, developing particular logic and transformation as per the requirement and creating mappings and loading the data into different targets.
- Performed tuning functions on Informatica sessions, batches and other related scripts.
- Extensively used almost all of the transformations of Informatica including lookups, stored procedures, Update Strategy and others.
- Solely responsible for the daily loads, handling the reject data and extensively worked in the performance tuning.
- Used SQL tools TOAD to run SQL queries and validate the data in warehouse.
- Fixed invalid mappings, testing of Stored Procedures and Functions, Unit and Integrating testing of Informatica sessions, batches and the target data.
- Deployed ETL packages, mappings to AWS cloud. CI/CD with Jenkins build tool.
- Tested the data and data integrity among various sources and targets. Associated with Production support team in various performances related issues.
- Meet the SLA at all times and improved the Performance of loading data from Key Data sources.
- Maintained facts and Dimensions using Star Schema and Snowflake Schema.
- Prepare documentation on all aspects of ETL processes, definitions and mappings.
- Rigorous unit testing and functional testing to reduce the defects before QA.
- Tested and implemented applications built using Python.
- Coordinated with campaign and reporting team for the change requests and availability of Data.
Environment: Informatica Power Center 9.6.4, Informatica Data Quality (IDQ), Power Designer, Power Exchange, Scheduler, Work Flows, ETL, Visio, Flat Files, Oracle 11g, XML, PL/SQL, TOAD 9.6.1, Pl/SQL Developer, AWS, Jenkins, DevOps, MongoDB, Rational Clear Case, Rational Clear Quest, Unix Shell Scripts, BASH, SQL Navigator, Windows XP, Putty, Winscp, Jira, Mercury, Quality Center, dbeaver, Cognos.
Confidential, White Oak, MD
Informatica/Talend ETL Developer
Responsibilities:
- Translated business rules and functionality requirements into ETL procedures. Developed ETL procedures to ensure conformity, compliance with standards and lack of redundancy.
- Attended POC for Talend open studio.
- Created the ODS jobs using Talend Open Studio.
- Used Talend open studio to execute jobs for ODS.
- Debugged numerous issues in Talend.
- Worked closely with the administrators with the configuration of Talend Open studio.
- Worked on Talend components like tReplace, tmap, tsort and tFilterColumn, tFilterRow,tJava,Tjavarow, tConvertType etc.
- Used Database components like tMSSQLInput,tMsSqlRow, tMsSqlOutput, tOracleOutput, tOracleInput etc.
- Worked with various File components like tFileCopy, tFileCompare, tFileExist, TFileDelete, tFileRename.
- Worked on improving the performance of Talend jobs.
- Developed and tested all the backend programs, Informatica mappings and update processes.
- Developed Informatica mappings to load data into various dimensions and fact tables from various source systems.
- Developed, tested stored procedures, Cursors, Functions and Packages in PL/SQL for Data ETL.
- Used Power Exchange along with Power Center to leverage data by avoiding manual coding on data extraction programs.
- Created various active and passive transformations like Source Qualifier, Lookup, Router, Normalizer, Aggregator, Filter, Joiner, Expression and standard/reusable mappings using Informatica.
- Made substantial contributions in simplifying the development and maintenance of ETL by creating re-usable Source, Target, Mapplets and Transformation objects.
- Responsible for developing and testing the new conformed dimensions that were used by the conformed fact.
- Used Power Center Workflow Manager to create sessions, and also used various tasks like session, event wait, event raise, email to run with the logic embedded in the mappings.
- Responsible for validating the Informatica mappings against the pre-defined ETL design standards.
- Developed incremental and updateable loading through Informatica mappings.
- Used debugger and breakpoints to view transformations output and debug mappings.
- Documented all the mappings and the transformations involved in ETL process
- Used UNIX shell scripting for scheduling tasks.
- Extracted huge volumes of data from legacy systems and uploaded into Oracle using SQL*Loader and shell scripts.
Environment: Informatica9.1, Power Exchange,Talend Open Studio 5.1, Oracle 10g, SQL Server, ERwinPL/SQL, and UNIX shell scripts, PL/SQL, TOAD.
Confidential, Detroit, MI
ETL Developer
Responsibilities:
- Worked on Trillium Software to cleanse the data.
- Worked on salesforce.com in latest version of Informatica to pulling data and load them to target database.
- Developed mappings using Informatica Power Center Transformations - Lookup (Unconnected, Connected), Filter, Expression, Router, Joiner, Update Strategy, Aggregator, Stored Procedure, Sorter, and Sequence Generator.
- Expertise and experience in ETL design, ETL performance tuning and Data Modeling.
- Expertise in designing and developing Business Intelligence solutions in Data Warehousing/Decision Support Systems using ETL tool Informatica Power Center 8.6.1
- Hands-on and strong experience in developing Informatica Mappings from version 8.6.1 to 9.1
- Extensively worked on Informatica Designer Components-Source Analyzer, Warehouse Designer, Mapping Designer &Mapplet Designer, Transformation Developer, Workflow Manager and Workflow Monitor.
- Development, unit testing and migration in ETL Tool Informatica.
- Used UNIX shell scripting, FTP, file management and automation of ETL processes in CA Service desk tools.
- Data modeling experience using Dimensional Data modeling, Star Schema & Snow Flake Schema, Fact & Dimension tables, Physical &logical data modeling using TOAD tool and utilities.
- Expert in troubleshooting, debugging and improving performance at different stages like database, workflows, complex mappings.
- Experienced in integrating various databases Oracle, Flat files. Developing Core Code Mapping, sessions, workflow for Data Extraction, transformation and loading till Data Mart.
- Data Modeling, ETL Mapping Design and Implementation, Data Securitization, Code review and Review of Unit and System Test Cases and Deployment of ETL Mappings into the production servers.
- Profiling the data to check the quality of the data before loading.
- Administered Informatica repositories and Informatica server running on UNIX.
- Implemented a partitioning strategy similar to Informatica’s partitioning to increase parallelism.
- Upgraded Informatica Power Center software from version 8.1 to 8.6. Trained new developers on Informatica basics.
- Interacted with the Business Users to analyze the business requirements and transform the business requirements into the technical requirements.
- Prepared technical specifications for the development of Informatica (ETL) mappings to load data into various target tables and defining ETL standards.
- Loaded data from various sources like DB2, SQL Server, Flat files into Oracle data warehouse.
- Developed UNIX scripts to performance various level of data check through the data flow.
- Designed and developed complex ETL mappings by making use of transformations like Source Qualifier, Joiner, Update Strategy, Connected Lookup and unconnected Lookup, Rank, Expression, Router, Filter, Aggregator and Sequence Generator transformations.
- Created reusable transformations, mapplets, and shortcuts for Sources and targets to use across various Mappings.
- Created Shared folders, users and managed the privileges to users using Informatica Repository Manager.
- Created shell scripts using Informatica PMCMD command.
- Configured the sessions using workflow manager to have multiple partitions on Source data to improve the performance.
- Created Persistent Lookup cache modified the look up SQL query and tuned transformations like Aggregator, Joiner and implemented Incremental aggregation for better performance.
- Worked closely with Production Control team to schedule shell scripts and Informatica workflows.
- Preparing and using test data/cases to verify accuracy and completeness of ETL process.
- Responsible for Designing of mapping documents and ETL Design Documents
- Automation and scheduling of UNIX Shell scripts, Informatica workflows, SQL procedures using Tidal.
- Design and Developed pre-session, post-session routines and batch execution routines using Informatica Server to run Informatica sessions.
Environment: Informatica Power Center 9.1/8.x, Informatica Data Quality (IDQ), Power Designer, Power Exchange, Scheduler, Work Flows, ETL, MicroStrategy 9.3, Data Stage 8.5, Visio, Flat Files, OBIEE 10.x, Oracle 11g, XML, SQL SERVER, PL/SQL, Teradata, Citrix TIDAL, TOAD 9.6.1, Business Objects XI, Rational Clear Case, Rational Clear Quest, Lotus, Unix Shell Scripts, BASH, SQL Navigator, Windows XP
Confidential, Portland, Oregon
ETL Developer
Responsibilities:
- Interacted with the Business Users to analyze the business requirements and transform the business requirements into the technical requirements.
- Prepared technical specifications for the development of Informatica (ETL) mappings to load data into various target tables and defining ETL standards.
- Implemented dimension model (logical and physical data modeling) in the existing architecture.
- Loaded data from various sources like DB2, SQL Server, Flat files into Oracle data warehouse.
- Designed and developed complex ETL mappings by making use of transformations like Source Qualifier, Joiner, Update Strategy, Connected Lookup and unconnected Lookup, Rank, Expression, Router, Filter, Aggregator and Sequence Generator transformations.
- Created Reusable Transformations, mapplets, Shortcuts for Sources and Targets to use across various Mappings.
- Created Shared folders, users and managed the privileges to users using Informatica Repository Manager.
- Created shell scripts using Informatica PMCMD command.
- Configured the sessions using workflow manager to have multiple partitions on Source data to improve the performance.
- Created Persistent Lookup cache modified the look up SQL query and tuned transformations like Aggregator,Joiner and implemented Incremental aggregation for better performance.
- Created complex PL/SQL, TSQL procedures for applying business rules for dimensional tables, dropping and creating indexes and truncating the temporary tables once the load is completed.
- Created and tested the data accuracy by creating complex Oracle SQL’s using analytical functions.
- Implemented screen door processing for validating and cleansing Flat file sources.
- Prepared ETL specification document providing the rules for initial and incremental load, and also business rules to calculate in each column in the target warehouse.
- Unit testing, User Acceptance Testing to check whether the data loads into target are accurate, which was extracted from different source systems according to the user requirements.
- Preparing and using test data/cases to verify accuracy and completeness of ETL process.
- Actively involved in the production support and also transferred knowledge to the other team members.
- Co-ordinate between different teams across circle and organization to resolve release related issues
Environment: Informatica Power Center 8.6.1, Business Objects XI, Oracle 11g, DB2, SQL Server 2008, XML, TOAD, ETL, DWH, Teradata, Visio, SQL, PL/SQL, Java, Windows XP, UNIX Scheduler, Citrix Web Interface, MS SQL Server 2008, Tortoise CVS
