Etl Developer (informatica Idq) Resume
American Fork, UtaH
PROFESSIONAL SUMMARY:
- 8+ years of IT experience in Planning, Analysis, Design, Implementation, Development, Maintenance and Support for production environment in different domains like Insurance, Banking, Financial, Retail with a strong conceptual background in Database development and Data warehousing.
- Experience in working in Agile Development Methodology and participated heavily in Scrum meetings and Sprint planning meetings.
- Involved in Extracting, cleansing, transforming, integrating and loading data into data warehouse using Data Stage Designer.
- Used the Data Stage Director and the runtime engine to schedule running the solution, testing and debugging its components and monitoring the resulting executable versions (on adhoc or scheduled basis).
- Experience in integration of various data sources like Oracle, DB2, Teradata, Netezza, Mainframes, SQL server, XML, Flat files and extensive knowledge on Oracle, Teradata, Netezza and MS Access
- Experience in creating IDQ Data profiling, ScoreCards, Mapplets, Rules, Mappings, workflows, Data Cleansing, Data Standardization process using IDQ Developer and Informatica Analyst tools.
- Highly proficient in Development, Implementation, Administration and Support of ETL processes for Large - scale Data warehouses by Using Informatica Power Center 10.x, 9.6/9.5/9.1/9.0/8. x/7.x.
- Experience in creating Experience in working with business analysts to identify study and understand requirements and translated them into ETL code in Requirement Analysis phase.
- High Level Design and Detailed Design in the Design phase.
- Experienced with industry standard methodologies like Agile, Scrum and Waterfall methodology within the Software Development Life Cycle (SDLC).
- Extensive knowledge onInformatica Client tools like Designer, Workflow Manager, Workflow Monitor, Repository Manager and Server tools - Informatica Server, Repository Server.
- Experience in developing Enterprise level Data warehouse, Data marts and Operational databases.
- Prepared detail documentation, created and developed complex mappings using various transformations such as Lookup, Joiner, Aggregator, Filter, Sorter, Expression, Router, Union, Rank, Update Strategy, Source Qualifier and Sequence Generator.
- Created and maintained Database Objects like Tables, Views, Materialized views, Indexes, Constraints, Sequence, Table Partitions, Synonyms and Database Link.
- Knowledge in Mater Data Management (MDM) Multi Domain Edition HUB Console Configurations, Informatica Data Director (IDD) Application creations.
- Knowledge on creating the Master Data Management (MDM) Hub Console configurations like Stage Process configuration, Load Process Configuration.
- Knowledge on working ETL process for bringing in the data into MDM landing tables.
- Worked on optimizing the Mappings and implementing the complex business rules by creating re-usable transformations, Mapplets, SQL scripts and triggers and PL/SQL stored procedures.
- Experience in Oracle database Performance Tuning of SQL statements and in SQL * Loader Imports/Exports.
- Expertise in using GUI tolls like Erwin, Toad, SQL Developer, SQL Navigator and SQL *Loader.
- Experience in Validating ETL Tools like Informatica Power Center.
- Extensive knowledge in System Testing / Integration Testing and Regression testing.
- Extensive experience in writing SQL scripts to validate the database systems and for backend database testing.
- Implemented Data extracting, Data profiling, Data cleansing, Data integration, Data transformation and loading into Data marts using Informatica.
- Good knowledge in interacting with Informatica Data Explorer (IDE) and Informatica Data Quality (IDQ) for the data management and data cleansing activities.
- Extensively worked on Facts, used Lookup Transformation and Update Strategy Transformation while working with Slowly Changing Dimensions (SCD) tables Type-1, Type-2.
- Worked extensively on JIRA for issue tracking and project management.
- With both On-site and Off-shore model experience have developed skills in system analysis, troubleshooting, debugging, deployment, Team management, prioritizing tasks and customer handling.
- Skilled in creating & maintaining ETL Specification Documents, Use Cases, Source to target mapping, Requirement Traceability Matrix, performing Impact Assessment and providing Effort estimates, deployment artifacts.
- Continuous monitoring and up keep of assigned Data Services territory
- Extensive knowledge in Analysis, Design, Development, Testing and post-production support for Oracle EBS Suite R11 and R12 version
- Worked with Web Methods Integration team to design, develop and deploy the integrations between Salesforce Cloud system and Oracle EBS.
- Knowledge on over all data migration lead from Responses legacy systems to Oracle EBS.
- Exposure of end to end SDLC and Agile methodology.
- Good communication and presentation skills, works well as an integral part of a team, as well as independently, intellectually flexible and adaptive to change.
TECHNICAL SKILLS:
Data Warehousing Tools: ODI, Informatca IDQ, Informatica Power Center 10.x,9.x,8.x,7.x, Informatica IDQ, SSIS
Databases/RDBMS/Others: MS SQL Server 2008/2005/2000 , Oracle 8i/9i/10g/11g/12c,DB2, Teradata V12, V14, V15, XML, Netezza, Siebel Data Base, Flat files and Excel files.
Data Modeling: ERWIN 4.x/3.x, MS Visio, Ralph-Kimball Methodology, Bill-Inman Methodology, Star Schema, Snow Flake Schema, Physical and Logical Modeling, Dimension Data Modeling, Fact Tables, Dimension Tables.
Programming Languages: java, SQL, PL/SQL, T-SQL, MY-SQL
Job Control and Other Tools: Informatica Scheduler, Putty, SQL*Plus, TOAD, PL/SQL Developer tool,Autosys, Crontab and Control + M
Reporting Tools: OBIEE, Cognos, MicroStrategy and Tableau, SAP BI/BW and SSRS.
PROFESSIONAL EXPERIENCE:
Confidential, American Fork, Utah
ETL Developer (Informatica IDQ)
Responsibilities:
- Responsible for Business meetings, conversion of business rules into technical design document.
- Configured Oracle Data integrator ODI Master Repository Work Repository on Oracle Database.
- Created and Configured ODI Repositories, Interfaces, Packages, Procedures and Scenarios.
- Experience in ODI Designer for importing tables from database, reverse engineering, to develop projects, and release scenarios.
- Led and architected the design of Data Services ETL of data load of SCIMS, Fiduciary, MRT, FPMS and Business file and loaded into CRM systems. Worked on multiple data sources to target system.
- Extensively used Synchronous and Asynchronous Change Data Capture CDC techniques.
- Developed HR data load scheduler in Data Service with Alerts and Notifications
- Used Knowledge modules to achieve client requirements such as connecting to specific technology, extracting data from it, transforming the data, checking it, integrating it.
- Experience with Business systems such as Sales, Inventory and Order Management.
- Used mappings to load data from Flat files, CSV files in to staging area Oracle and load in to Oracle data warehouse
- Extracted data from flat files/ databases applied business logic to load them into Netezza tables.
- Used IDQ to complete initial data profiling and matching/removing duplicate data.
- Extensively knowledge with Teradata SQL Assistant. Developed BTEQ scripts from to load data from Teradata. Staging area to Data Warehouse, Data Warehouse to data marts for specific reporting requirements. Tuned the existing BTEQ script to enhance performance.
- Analyzed the Business requirement for Oracle Data Integrator and mapped the architecture and used ODI for reverse engineering to retrieve metadata from data storage and load it to the repository.
- Used Oracle Data Integrator ODI to develop processes for extracting, cleansing, transforming, integrating, and loading data into data warehouse database
- Applied slowly changing dimensions SCD in various Mappings to load data from source to target and maintained current and historical data on year wise in all brand dimensions.
- Good knowledge on Teradata Macros, BTEQ scripts & Utilities like Multi load, Fast load etc.
- Involved in Teradata BTEQ scripts performance tuning for long running queries in production by using explain plains.
- Creating Informatica Exception Handling Mapping for Data Quality, Data Cleansing and Data Validations.
- Analyzed Session log files in operator navigator to resolve errors in mapping and managed session configuration.
- Worked closely with the end users and designing the documents to the track changes.
- Coordinated with the on-site and off-shore team and working on service requests as team.
- Created new reports and dashboards as per the business need.
- Increased performance of loads by applying proper Hints, Indexes, and Analyzing master tables and explain plans to check cost.
- Modified instance config file as per the need to accommodate data volume in pivot tables and charts.
- Used SQL tools like SQL Developer to run SQL and PL/SQL queries and validate the data loaded into the target tables.
- Used Oracle Stored Procedures, Functions and Packages.
- Developed and fine-tuned PL/SQL stored procedures to increase the performance.
Environment: Informatica Power Centre 10.x, ODI (Oracle Data Integrator), IDQ, 12c, SQL Developer, Oracle 12c, PL/SQL, Netezza.
Confidential, Columbus, Ohio
Sr. ETL Informatica Developer
Responsibilities:
- Involved in Designing Informatica mappings and creating the mappings from the scratch as per the requirement.
- Loaded data from and to XML files, Heterogeneous Database tables and Excel spreadsheet into target Oracle database and applied Business Logic on Transformation Mapping for inserting and updating records when loaded.
- Designed and developed mappings with optimal performance using Aggregator, Joiner, Rank, Sequence Generator, SQL, Uncached & various kinds of Cached Lookup, Connected-Unconnected-Source Target pre and post load Stored Procedure Transformations, Update Strategy, Union, XML Transformations.
- Responsible for implementing Incremental Loading mappings using Mapping Variables and Parameter Files.
- Worked with Session Logs, and Workflow Logs for Error handling and troubleshooting in DEV environment.
- Developed Reusable Transformations and Reusable Mapplets.
- Led and architected the design of Data Services ETL of data load of SCIMS, Fiduciary, MRT, FPMS and Business file and loaded into CRM systems. Worked on multiple data sources to target system.
- Involved in determining the bottlenecks and fixing the bottlenecks for optimum performance.
- Worked with Index Cache and Data Cache in cache using transformation like Rank, Lookup, Joiner, and Aggregator Transformations.
- Worked with Session Logs and Workflow Logs for Error handling and troubleshooting in DEV environment.
- Written complex SQL Query as per business requirement to fetch the data from relational tables.
- Worked on XML source/target and used XML Source Qualifier, XML Parser and XML Generator transformation.
- Used TDM tool for subset processing, created entities,groups and plans executed the workflows.
- Scheduled batch and sessions with Informatica using Informatica scheduler.
- Documented technical specification, business requirements, functional specifications for the development of Informatica Extraction, Transformation and Loading (ETL) mappings to load data into various tables and defined ETL standards. Documented test cases and test plans data for the mappings developed.
- Used Informatica MDM (Siperion) tool to manage Master data of EDW.
- Created relationships for the base objects which reflects from look up tables in MDM.
- Proficient in Data warehouse ETL activities using SQL, PL/SQL, Unix scripting, Python scripting
- Used Test Data Management (TDM) tool for Data Subset, Data Masking operations.
- Created/Developed data Subsets to load data from oracle database based on business requirement for Dev/Uat/Testing environment using TDM tool.
- Generate and run the workflow, monitoring for data masking, data subset in TDM tool.
- In TDM tool I have used all functionalities like creating entities, groups, create plans,execute plans, generating workflows, validating, Monitoring, etc., and also for data masking operations.
- Monitored the jobs daily and involved in production support including immediate fixes for the production job failures.
Environment: Informatica PowerCenter 10.X, Informatica Testdata Manager (TDM tool),Toad, Teradata, SQL Server, PL/SQL, Unix scripting, XML files,XML spy, JIRA, PUTTY, Winscp.
Confidential, Austin, TX.
ETL Informatica Developer/Analyst
Responsibilities:
- Worked with Business analysts and the DBA for requirements gathering, business analysis and designing of the data marts.
- Preparation of technical specification document for the development of Informatica Extraction, Transformation and Loading (ETL) mappings to load data into various tables in Data Marts and defining ETL standards
- Estimates and planning of development work using Agile Software Development.
- Good experience on Agile Methodology and the scrum process.
- Ensured performance metrics are met and tracked
- Worked with CDC option is captures database changes, forwarding them to powercenter for further processing.
- Designed and developed ETL processes using Datastage designer to load data from the xml files, to staging database and from staging to the target Data Warehouse database.
- Used Datastage stages namely, Sequential file, Transformer, Aggregate, Sort, Datasets, Join, Lookup, Change Data Capture, Funnel, Merge, Peek, Row Generator stages in accomplishing the ETL Coding.
- Involved in Data modeling review sessions - E/R diagrams, normalization and de-normalization as per business requirements.
- Worked on CDC (change Data Capture) project within MDM which is an enhancement to existing code where the transactional data is scanned for updates/inserts/deletes and accordingly transformed and applied on MDM DB.
- Interact with business community and gathered requirements based on changing needs. Incorporated identified factors into Talend jobs to build the DataMart
- Comfortable with both technical and functional applications of RDBMS, Data Mapping, Data management and Data transportation.
- Experience in Performance tuning of Source SQL queries and Teradata Queries.
- Designed and Developed ETL (Extract, Transformation & Load) strategy to populate the Data Warehouse from the various source systems such as Oracle, Oracle GG, Flat files, XML, My Sql.
- Sourced transaction data being staged by Golden Gate tool CDC (Change Data Capture) through Informatica Power center and loaded into the target
- Used Talend Admin Console Job conductor to schedule ETL Jobs on daily, weekly, monthly and yearly basis (Cron Trigger)
- Involved in the creation of Oracle Sql and PL/SQL stored procedures and functions.
- Involved in fixing invalid Mappings, testing of Stored Procedures and Functions, Unit and Integration Testing of Informatica Sessions, Batches and the Target Data.
- Tuned the Sessions for better performance by eliminating various performance bottlenecks.
- Used Session Parameters to increase the efficiency of the sessions in the Workflow Manager.
- Writing Unix & Perl script to load data from sources to staging tables, to create indirect file list, generate parameter files for respective paths.
- Used SVN for version control and Autosys for Job scheduling.
- Applied Agile methodology throughout the development life cycle of application.
Environment: Informatica Power Center 9.6.1/9.5.1 , Oracle 11g, Talend, Oracle Golden Gate, CDC, PLSQL, Teradata 14/13, Datastage,Teradata Tools and Utilities, Autosys, My Sql, UNIX, Putty, Perl, MS Visio
Confidential, Cherry Hill, NJ
ETL Developer
Responsibilities:
- Worked with Business Users and Clients to understand the Health caredomain and requirements of Business.
- Used Informatica power center for (ETL) extraction, transformation and loading data from heterogeneous source systems
- Worked extensively on Data Warehousing and Data Integration.
- Involved in all aspects of software development life cycle.
- Helped the Team in building the data model using the ER-win Tool.
- Designed complex new mappings on Informatica power center 7x, reviewed the mappings developed by off-shore team and corrected them with respect to the performance.
- Supervise the installation of Datastage Software and established all the setups including data base connections, plugins, configuration file setup, directory setups
- Used ETL methodologies and best practices to create Talend ETL jobs.
- Storing the Metadata files and file patterns on HBase.
- Made substantial contributions in simplifying the development and maintenance of ETL by creating Re-usable Transformation Objects and Mapplets.
- Designed and Developed Datastage Jobs using Datastage Designer to Import and Export data from heterogeneous data sources Oracle, SQL server, Flat files
- .Knowledge in handling not only XML sources but also can parse other sources like PDF documents, XML schemas, Text Files, HTML Documents.
- Involved in writing Test scenarios, Generic tests cases, detail Positive and negative test cases for ETL also Preparing ETL and SQL routines/code for performing ETL testing (system and integration testing) and Documenting the test results
- Used Talend most used components (tMap, tDie, tConvertType, tFlowMeter, tLogCatcher, tRowGenerator, tSetGlobalVar, tHashInput & tHashOutput and many more).
- Worked with Offshore team and involved in meetings with them to complete the task on weekly basis.
- Had a call meeting daily with the off shore team to know the project updates.
Environment: Informatica Power Centre 9.5.1/9.1, Oracle 10g/11g, Datastage, SQL SERVER 2008, Business Objects, PL/SQL, SQL Developer, Windows XP, UNIX, ERWIN r7, CONTROL-M.
