Idq Developer/etl Tester Resume
Reston, VA
PROFESSIONAL SUMMARY:
- A well - seasoned ETL Informatica developer with 6+ years of experience in varied domains like Healthcare, Banking, Insurance, Financial and Retail domains.
- Experienced in complete life cycle Implementation of data warehouse.
- Hands on experience with Informatica Data Quality (IDQ) tools for Data Analysis / Data Profiling / IDQ Developer.
- Experience in Installation, Configuration, and Administration of Informatica Data Quality and Power Center on Client/Server environment.
- Experience working in Agile Methodology and Waterfall model .
- Experienced in all stages of the software lifecycle Architecture for building a Data warehouse, Star schema and Snowflake Schema
- Worked extensively on developing mapplets, mappings, workflows, and applications.
- Experience in Error Handling and Trouble Shooting Techniques using the log files.
- Extensive experience in Informatica Data Quality Developer and analyst tool .
- Extensively worked on Labeler, Parser, Match, Consolidation transformations to identify the duplicate records.
- Experience in using Standardizer transformation to standardize the data.
- In-depth knowledge on Informatica Address Validator/Address Doctor to discover the mail ability score for personal and business addresses using various input and output ports.
- Extensive experience in Extraction, Transformation and Loading from different data sources using the Informatica Power Center.
- Experience in using update strategies, incremental loads, and implementing Slowly Changing Dimensions of Type I and Type II.
- Experience on creating Human Task , Notification task as a part of workflow and deploying them.
- Experience in creating Human task for Manual Consolidation, Bad record management and review check process using Exception Step, Cluster Step and Review Step.
- Experience in assigning the Task distribution to participants and setup the Notifications as part of Human task.
- Experience in working on heterogeneous sources i.e. Oracle, SQL Server, DB2, VSAM, and Flat files.
- Experience in using job scheduling tools like Autosys .
- Hands on experience working with various databases including Oracle, Teradata, SQL Server, TOAD.
- Expertise in working with UNIX environment
- As ETL Tester primarily test source data extraction, business transformation logic and target table loading. There are so many tasks involved for doing the same.
- Experience in supporting the project around the clock at the time of implementation.
- Experience in coordinating with the Testing for fixing the defects.
- Experience in creating Source to Target columns mapping sheet.
- Experience in moving the developed projects from one environment to another environment.
- Experience in Unit Testing of all ETL Components and submitting the results.
- Proven track record of achieving assigned targets.
- Experience working in both team and individual environments.
TECHNICAL SKILLS:
SDLC: Waterfall, Agile.
Tools: Informatica power center 9.x/8.x/7.x, SQL Developer, Informatica Data Quality (IDQ) 9.0.1, 9.5.1, 9.6.1, CA Workload Automation AE (AutoSys Edition), Informatica Master Data Management 9.6.1.
Operating Systems: Windows XP, UNIX, Win NT
Databases: Oracle, DB2, SQL Server, MySQL, MS Access, Teradata, TOAD
Languages: SQL, PL/SQL, UNIX Scripting, HTML, XML
GUI: Visual Basic
Project Management: MS Project, MS Office
Data Modelling Tool: Erwin, MS Visio, Star Schema, Snow Flake Schema, Physical And Logical Modelling, Dimension Data Modelling, Fact Tables, Dimension Tables, Normalization, De normalization.
PROFESSIONAL EXPERIENCE:
Confidential, Reston, VA
IDQ Developer/ETL Tester
Responsibilities:
- Integration of the DQ mapplets into PC Mappings.
- Performed Data Profiling using Informatica Data Quality Tool.
- Worked on IDQ Analyst for Profiling, Creating rules on Profiling and Scorecards.
- Designed IDQ mappings which is used as Maplets in Power center
- Developed numerous mappings using the various transformations including Address Validator, Association, Case Converter, Classifier, Comparison, Consolidation, Match, Merge, Parser etc.
- Implemented Human task out of the box functionality in IDQ 9.6.1
- Worked with IDQ product development managers and suggested added functionalities to IDQ Developer tool
- Implemented PC DQ mappings to test the standardized data
- Developed Data Quality standardization & cleansing rules using Informatica Data Quality (9.1) based on the facts discovered from profile results.
- Ensuring Data Quality, Cleansed the incoming data feeds and profiled the source systems data as per business rules using IDQ.
- Created Match and Merge rules, developed address validations etc and developed address validations to countries like US, and also developed reusable error handling rules using IDQ
- Working knowledge of data warehouse techniques and practices, experience including ETL processes, dimensional data modeling (Star Schema, Snow Flake Schema, FACT & Dimension Tables), OLTP and OLAP.
- Integration of the DQ mapplets into PC Mappings.
- Interacted with various Business users in gathering requirements to build the data models and schemas
- Created reusable transformations called mapplets and used them in mappings in case of reuse of the transformations in different mappings.
- Understand the data quality rules defined by the business/functional teams and propose the optimization of these rules if applicable, then design and develop these rules with IDQ, including thorough unit test planning and performing.
- Provided Golden Set of Records (View and Responsibilities) using Grouping, Matching, Consolidation to Deployment team
- Performed match/merge and ran match rules to check the effectiveness of MDM on data .
- Assist in code testing, migration, deployment, enhancement and bug fixes.
- Create design and execute test plans, test cases.
- Target table loading from staging file or table after applying transformation.
- Maintaining test case results with test performed on test case id’s. Maintaining defect log.
- Identify troubleshoot and provide solutions for potential issues.
- Approve requirements and design specifications.
- Test flat file data transfers.
- Provide high-level design walkthrough on how the solution will be built for each requirement.
- Involved in development of Autosys JILs.
- Monitoring the jobs on daily basis. The jobs are scheduled using Autosys scheduler.
- Developed Unix Shell Scripts to ensure successful execution of the ETL processes
- Created, maintained and stored manual Test cases, Test plans using HP Quality Center
- Involved in unit testing and system testing while the code is moved to production
- Responsible for troubleshooting issues in Autosys.
Tools: and Application Used: Informatica Developer (IDQ) 9.6.1, Informatica Developer, Informatica Power center 9.6.1, Informatica Master Data Management 9.6.1, Oracle 11g, SQL Developer, Windows 2012, Flat files, PL/SQL, SQL, TOAD, Autosys
Confidential, Gahanna, OH
IDQ Developer
Responsibilities:
- Worked with Informatica Data Quality 9.6.1 (IDQ) toolkit, Analysis, data cleansing, data matching, data conversion, exception handling, reporting and monitoring capabilities of IDQ 9.6.1.
- Perform System Analysis and Requirement Analysis, design and write technical documents and test plans.
- Created a Hybrid process in IDQ by combining both IDQ Developer and analyst version through LDO (Logical Design Objects)
- Worked on IDQ Analyst for Profiling, Creating rules on Profiling and Scorecards.
- Designed and developed IDQ solution to support MDM Projects.
- Developed MDM Hub Match and Merge Rules Batch jobs and Batch groups.
- Created Queries Query Groups and packages in MDM Hub Console.
- Worked with Management for creating the requirements and estimates on the Project.
- Assisted Business Analyst with drafting the requirements, implementing design and development of various components of ETL for various applications.
- Coordinated with DBA in creating and managing tables, indexes, table spaces, auditing and data quality checks.
- Developed numerous mappings using the various transformations including Address Validator, Association, Case Converter, Classifier, Comparison, Consolidation, Match, Merge, Parser etc.
- Created complex mappings using different transformations like Filter, Router, Connected & Unconnected lookups, Stored Procedure, Joiner, Update Strategy, Union, Expression and Aggregator transformations to pipeline data to DataMart. Also, made use of variables and parameters.
- Developed ETL design and development for extracting data from various source systems like Oracle, flat files, XML files to Data Warehouse
- Perform System Analysis and Requirement Analysis, design and write technical documents and test plans
- Extensively used SQL and PL/SQL Scripts and worked in UNIX Environment
- Automated data loading, extraction, reports generation using UNIX Shell scripting.
- Coordinated with DBA in creating and managing tables, indexes, table spaces, auditing and data quality checks.
- Developed Test Scripts, Test Cases, and SQL QA Scripts to perform Unit Testing, System Testing and Load Testing.
- Responsible for creating reusable transformations and complex mappings, partitioning
- Implemented Slowly Changing Dimensions (SCD, Both Type 1 & 2).
- Responsible for authorizing technical documentation and performing reviews, design, data manipulation, and creative problem solving
- Responsible for scheduling mappings with Autosys.
Tools: and Application Used: Informatica Developer (IDQ 9.5.1), Analyst, Informatica MDM 9.7.1, Informatica Power center 9.5.1, Informatica Master Data Management 9.1, Oracle 11g, Windows 2007, Flat files, PL/SQL, SQL
Confidential, Washington DC
IDQ/ETL Lead Developer
Responsibilities:
- High Level Design and Low Level Design based on Functional and Business requirements
- Interacted with subject matter experts and data management team to get information about the business rules for data cleansing.
- Designed IDQ solution to support MDM Projects
- Responsible for the entire DTAP process for the project.
- Conducting design walkthrough for the solution
- Good understanding of relational database management systems like Oracle, PLSQL and SQL and extensively worked on Data Integration using Informatica for the Extraction transformation and loading of data from various database source systems.
- Worked with various developer modules like profiling, standardization and matching.
- Designed various mappings and Mapplets using different transformations such as key generator, match, labeler, case converter, standardize, Address Validator, parser and lookup.
- Worked with address validator to cleanse the address elements. Created input and output templates.
- Optimized Database Management
- Quality assurance of all aspects of the project.
- Involved in building the ETL architecture, and Source to Target mapping to load data into Data Warehouse environment.
- Managed the Metadata associated with the ETL processes used to populate the Data Warehouse.
- Implemented complex business rules in Informatica Power Center by creating re-usable transformations, and robust Mapplets.
- Implemented performance tuning of Sources, Targets, Mappings and Sessions by identifying bottlenecks and used Debugger to debug the complex mappings and fix them.
- Improved session Performance by enabling property incremental aggregation to load incremental data into target table.
- Worked with Functional team to make sure required data has been extracted and loaded and performed the Unit Testing and fixed the errors to meet the requirements.
- Copied/Exported/Imported the mappings/sessions/ worklets /workflows from development to Test Repository and promoted to Production.
- Used Session parameters, Mapping variable/parameters and created Parameter files for imparting flexible runs of workflows based on changing variable values.
- Worked with Static, Dynamic and Persistent Cache in lookup transformation for better throughput of Sessions.
- Modified existing Mappings for enhancements of new business logic/requirements.
- Used Debugger to test the Mappings and fixed the Bugs.
- Prepared migration document to move the Mappings from development to testing and then to production repositories.
- Developed & reviewed test cases. Developed & executed SQL queries to validate actual test results, and match with expected results.
Tools: and Application Used: Power center 9.5.1, Oracle 11g, Windows 2007, Oracle, UNIX, SQL
Confidential, Virginia Beach
ETL Developer
Responsibilities:
- Interacted with data modellers and business analysts to understand the requirements, and the impact of the ETL on the business.
- Involved in the designing of the ETL Specification Documents.
- Developed Slowly Changing Dimensions for Type 1 SCD and Type 2 SCD.
- Created Tables, Keys (Unique and Primary) and Indexes in the SQL server.
- Extracted data from Flat files, DB2, SQL and Oracle Sources. Applied business logic to load the data into Global Data Warehouse.
- Designed and Implemented the ETL code for Address verification, Identity checking by working with IDQ.
- Designed IDQ mappings which is used as Maplets in Power center
- Worked on the Slowly Changing Dimension (SCD) tables, and assisted in the design & implementation of Star Dimensional Modelling technique.
- Maintained Source and Target Mappings, Transformation logic and processes to reflect the changing business environment over time.
- Used the ‘Add Currently Processed Flat File Name’ port to load the Flat File name, and to load contract number coming from Flat File name into Target.
- Worked on complex Source Qualifier queries, Pre and Post SQL queries in the Target.
- Worked on different tasks in Workflow Manager like Sessions, Events Raise, Event Wait, Decision, E-mail, Command, Worklets, Assignment, Timer.
- Scheduled workflows using TIDAL Scheduler.
- Used Workflow Variables, Mapping Parameters and Mapping Variables.
- Created Sessions & Batches for incremental load into Staging tables and scheduled them to run daily.
- Used reusable objects, and inherited changes made to the source automatically.
- Implemented Informatica recommendations, methodologies and best practices.
- Implemented Performance Tuning logic on Targets, Sources, Mappings and Sessions, to provide maximum efficiency and performance.
- Involved at Unit, Integration, System, and Performance testing levels.
- Prepared documentation to describe program development, logic, coding, testing, changes and corrections.
- Created detailed Unit Test Document with all possible Test Cases/Scripts.
- Prepared migration document to move the mappings from Development to Testing and then to Production Repositories.
- Involved in Production Support.
Tools: and Application Used: Informatica Developer (IDQ 9.5.1), Informatica Power Center 8.6/9.0.1, Oracle 10g/11g, SQL server, UNIX, Windows XP
Confidential
ETL Developer
Responsibilities:
- Performed extensive data analysis to identify data gaps, redundancies and issues to help Data Warehousing efforts.
- Gathered requirements and business specifications through extensive interactions with functional teams and users to design the user reports and backend data models.
- Developed detailed physical and logical data models using Erwin.
- Prepared detailed design documentation for the ETL process using standard templates.
- Extracted Deal Manager and Investment Banking project data from transactional systems into the data mart.
- Extensively used Informatica Power center for extracting, transforming and loading databases from Oracle databases.
- Wrote PL/SQL stored procedures, functions and triggers for implementing business rules and transformations.
- Developed materialized views and summary tables necessary for structured and ad-hoc reporting.
- Extensively worked on Informatica Designer tools Mapping Designer, Mapplet designer, Informatica Repository Manager and Informatica Workflow Manager.
- Used Workflow Manager to create Sessions and Tasks and used them to build Workflows and Worklets using various Tasks and scheduled the workflows to run at predetermined times.
- Created shell scripts to run workflows, back up files and email event etc.
- Performed performance tuning using partitioning and optimization of transformations.
- Designed and implemented complex SQL queries for QA testing and report/ data validation.
- Developed complex queries using oracle data bases for reporting purpose.
- Responsible for maintaining the integrity of the SQL database and reporting any issues to the database architect.
- Assisted in mining data from the SQL database that was used in several significant presentations.
- Assisted in offering support to other personnel who were required to access and analyze the SQL database.
- Conducted and coordinated functional testing, integration testing and User Acceptance Testing (UAT). Analyzed various test results to identify the root cause of various issues/bugs.
- Developed Test Plans, Test Cases, and Test Scripts for SIT and support for UAT tests.
- Extensively used the AutoSys jobs for the entire project.
- Prepared status summary reports with details of executed, passed and failed test cases
- Interacted with developers, Business & Management Teams and End Users.
- Participated in regular project status meetings related to testing.
Tools: and Application Used: Power center 9.5.1, Oracle 11g, Windows 2007, Autosys, Application Lifecycle Management (ALM 11), UNIX, SQL, TOAD