Data Repository Engineer/etl Consultant Resume
SUMMARY
- Over 9 Years of experience in Analysis, Design, Development, Testing, Implementation, Enhancement and Support of BI applications which includes strong experience in Data Warehousing (ETL & OLAP) environment as a Data Warehouse Consultant.
- Proficiency in utilizing ETL tool Informatica Power Center 8.x/7.x/6.x/5.x for developing the Data warehouse loads with work experience focused inData Acquisition and Data Integration using DataStage as per client requirement.
- Expertise in designing confirmed and traditional ETL Architecture involving Source databases Main Frame systems (COBOL files), Oracle, Flat Files ( fixed width, delimited ),DB2, SQL server, XML and Target databases Oracle, Teradata, SQL server, XML and Flat Files ( fixed width, delimited )
- Strong knowledge of Dimensional Modeling, Star and Snowflake schema. Designed Fact and Dimension Tables as per the reporting requirements and ease of future enhancements. Expertise in Data Flow Diagrams, Process Models, ER diagrams with modeling tools like ERWIN & VISIO.
- Extensive Experience in designing and developing complex mappings applying various transformations such as lookup, source qualifier, update strategy, router, sequence generator, aggregator, rank, stored procedure, filter joiner and sorter transformations, Mapplets.
- Extensive experience in developing the Workflows, Worklets, Sessions, Mappings, and configuring the Informatica Server using Informatica Power Center.
- Strong experience in implementing CDC using Informatica Power Exchange 8.x/7.x.
- Proficient in delivering the high data quality by designing, developing and automation of audit process and implementation the reconcile process accordingly.
- Excellent knowledge in identifying performance bottlenecks and also in tuning the Mappings and Sessions by implementing various techniques like partitioning techniques and pushdown optimization
- Extensive experience with database languages such as SQL and PL/SQL which includes writing triggers, Stored Procedures, Functions, Views and Cursors.
- Extensively worked on fixing the Performance issues and designing the Abinitio Graphs.
- Procurement experience in ETL development using Data Stage V8
- Profound knowledge about the architecture of the Teradata database. Developed Teradata Loading and Unloading utilities like Fast Export, Fast Load, and Multiload (Mload).
- Extensive knowledge with Teradata SQL Assistant. Developed BTEQ scripts to Load data from Teradata Staging area to Data Warehouse, Data Warehouse to data marts for specific reporting requirements. Tuned the existing BTEQ script to enhance performance.
- Experience in UNIX shell scripting, CRON, FTP and file management in various UNIX environments.
- Strong Knowledge in Relational Database Concepts, Entity Relation Diagrams, Normalization and De normalization Concepts.
- Strong understanding of Data warehouse project development life cycle. Expertise in documenting all the phases of DWH projects.
- Excellent team player and self - starter with good ability to work independently and possess good analytical, problem solving and logical skills.
TECHNICAL SKILLS
ETL Tools: Informatica 9.x/8.x/7.x/6.x, Informatica Power Exchange 7.x/8.x,Datastage 6.x, SQL Server Integration services.
OS: Sun Solaris 2.x/7/8, HP-UX, IBM AIX, Unix, Linux, Ms-DOS,Windows ME/2000/2003/NT/XP, Exceed (Editor)
Databases: Oracle (6.x/7.x/8.0/8i/9i/10g), SQL Server 2008/2005/2000 (T-SQL, Stored procedures, Triggers, DML, DDL, DTS), Teradata V2R5, Teradata V2R3, Sybase 11.5, Informix (XPS, 7.x/8.x), MS-Access, XML,DB2,VSAM
Programming Skills: C++, Shell Scripting (K-Shell, C-Shell), PL/SQL, PERL, FORTRAN, JAVA(Eclipse IDE and Net Beans IDE), HTML,JCL, JAVA Script, J2EE, CSS
Db Tools: SQL*PLUS, SQL*LOADER, SQL*NET, Quest TOAD, SQL Navigator,Oracle Enterprise Manager, Oracle WSGL/Web Tool kit.
DM Tools: Erwin, Visio
Mainframe Based: TSO/ISPF,TSO Expediter,TSO QMF
PROFESSIONAL EXPERIENCE:
Confidential
Data Repository Engineer/ETL Consultant
Responsibilities:
- Understand probation business by meeting various business users, analysts and help desk team.
- Study and Understand existing source system pcms.
- Constantly Coordinate with business users to understand, gather and document business requirements and translate the business
- Requirements into technical specifications and the trade offs.
- Design and build data marts for the various business processes.
- Designed and built well modeled and efficient dimensional models for the data marts for the various business processes involved.
- Dimensional modeling was the most difficult part of the project as probation business was very complicated involving various
- Rules and the source data model had many issues with it .
- Built detailed mapping documents by including the ETL logic, making it easier for the developers.
- Created schemas for the staging, development, test and production models.
- Developed mappings using power center mapping designer to map the source structures to the target structures.
- Used various transformations like expression, filter, router, lookup, joiner, aggregator, sequence generator, sorter .
- Build code to implement business rules and ETL logic.
- Created and configured sessions and workflows in workflow manager.
- Involved in performance tuning of the mappings to improve the efficiency of the mappings.
- Involved in unit testing and integration testing of the mappings and the ETL processes.
- Configured cache sizes for better performance.
- Used stored procedures to implement complicated ETL logic to conform to the business rules.
- Worked with analysts and technical users during UAT.
- Involved in the migration of the mappings from DEV to TEST to PROD
- Conducted and KT sessions.
Environment: Informatica Power center 8.6, Oracle 10g, Oracle 11g, windows 7, Unix, Microsoft Visio 2010, ER Studio.
Confidential
Sr. ETL developer
Responsibilities:
- Coordinate with business users to understand and document business requirements.
- Design and develop an architecture to streamline the data flow process.
- Developed mappings in Informatica to load the data from various SQL sources into XML using different types of transformations like source qualifier, expression, filter, aggregator, update strategy, lookup, sequence generator, joiner, xml outputs and normalizer.
- Used Informatica Workflow Manager to create, Schedule, execute and Monitor Sessions and Workflows.
- Worked on Creating DOS shell scripts as part of the ETL process to schedule tasks/sessions.
- Extensively worked with XML and XSD’s both on Informatica and Siebel ends.
- Optimizing / tuning mappings for better performance and efficiency. Used Pushdown optimization, pipeline partitioning and cache calculation.
- Involved in unit testing of mappings both quantitative and qualitative testing.
- End-to-End Integration testing of ETL-processes from source-system to target database and SIEBEL CRM Application .
- Worked with Memory cache for static and dynamic cache for the better throughput of sessions containing Rank, Lookup, Joiner, Sorter and Aggregator transformations.
- Migrating data mappings to production and monitoring, troubleshooting, and restarting the batch process using Informatica. Migration from dev to test and test to production environment.
- Scheduled sessions and batches on Informatica server using workflow manager.
- Used the Debugger to run Debug sessions setting Breakpoints across instances to verify the accuracy of data.
- Written complex SQL queries and created transact-SQL procedures/functions.
- Extensively used ETL to load data using Power Center from source systems like Sql Server, DB2, XML, Flat Files and Excel Files into, tables and load the data into the target database and XML files.
- Created mappings based on procedure logic to replace procedures and functions.
- Involved in fixing invalid Mappings, testing of Informatica Sessions, and the Target Data.
Environment: Informatica Power Center v 8.6, SQL server 2005, Siebel 7.8, DOS batch Scripts, DB2 9.5, Windows NT, ftp server.
Confidential
Sr. ETL Developer
Responsibilities:
- Worked with business analysts for requirement gathering, business analysis, and translated the business requirements into technical specifications to build the Enterprise data warehouse.
- Analyzed the system for the functionality required as per the requirements and created System Requirement Specification document (Functional Requirement Document).
- Involved in the development of the conceptual, logical and physical data model of the star schema using ERWIN.
- Extensively used Informatica Client tools - Source Analyzer, Warehouse Designer, Mapping Designer, Mapplet Designer, Informatica Repository Manager and Informatica Workflow Manager.
- Designed and developed daily audit and daily/weekly reconcile process ensuring the data quality of the Data warehouse.
- Developed various mappings using Mapping Designer and worked with Aggregator, Lookup (connected and unconnected), Filter, Router, Joiner, Source Qualifier, Expression, Stored Procedure, Sorter and Sequence Generator transformations.
- Created and Configured Workflows, Worklets and Sessions to transport the data to target warehouse tables using Informatica Workflow Manager
- Created users and user groups with appropriate privileges and permissions, folders and folder permissions in Repository manager.
- Developed UNIX shell scripts using PMCMD utility and scheduled ETL load using Maestro.
- Identified performance issues in existing sources, targets and mappings by analyzing the data flow, evaluating transformations and tuned accordingly for better performance.
- Involved in the administration of the Informatica Repository and also in the design and architecture of multiple repositories to support multiple application development areas.
- Involved in Unit and Integrating testing of Informatica Sessions, Batches and the Target Data.
- Extensively involved in coding of the Business Rules through PL/SQL using the Functions, Cursors and Stored Procedures
- Prepared ETL mapping Documents for every mapping and Data Migration document for smooth transfer of project from development to testing environment and then to production environment.
- Prepared Run books providing guidelines to trouble shoot the errors occurred during the run time and instructions on how to restart the loads.
- Actively involved in production support. Implemented fixes/solutions to issues/tickets raised by user community.
Environment: Informatica Power Center 8.1/8.5,8.6, Power Exchange 8.1, Oracle10g, AS 400 DB2, Erwin, Unix Maestro, Crystal reports..
Confidential
Informatica Developer
Responsibilities:
- Interacted with the Business Personnel to analyze the business requirements and transform the business requirements into the technical requirements.
- Prepared technical specifications for the development of Informatica (ETL) mappings to load data into various target tables.
- Developed standard and re-usable mappings and mapplets using various transformations like expression, aggregator, joiner, source qualifier, router, lookup Connected/Unconnected, and filter.
- Extensive use of Persistent cache to reduce session processing time.
- Identified performance issues in existing sources, targets and mappings by analyzing the data flow, evaluating transformations and tuned accordingly for better performance.
- Modifying the shell/Perl scripts as per the business requirements.
- Maintained warehouse metadata, naming standards and warehouse standards for future application development.
- Used Workflow Manager for creating, validating, testing and running the sequential and concurrent sessions and scheduling them to run at specified time and as well to read data from different sources and write it to target databases.
- Extensively used Stored Procedures, Functions and Packages using PL/SQL for creating Connected and Unconnected Stored Procedure Transformations.
- Implemented screen door process for cleaning flat files as per the business requirements.
- Preparing ETL mapping Documents for every mapping and Data Migration document for smooth transfer of project from development to testing environment and then to production environment.
- Involved in Unit testing, User Acceptance testing to check whether the data loads into target are accurate, which was extracted from different source systems according to the user requirements.
- Maintaining issue log of the issues during the UAT phase for future
- Preparing and using test data/cases to verify accuracy and completeness of ETL process.
- Actively involved in the production support and also transferred knowledge to the other team members.
- Co-ordinate between different teams across circle and organization to resolve release related issues.
Technical Environment: Informatica Power Center 7.1.2, Oracle 9i/10g, Flat files, XML, TOAD, Erwin, Shell Scripts, Windows NT, UNIX, Crystal Reports 8/8.5, Crystal Analysis 8.5
Confidential
Sr.Informatica Developer/ Data Analyst
Responsibilities:
- Interacted with business users and business analyst to understand reporting requirements and prepared Functional Requirement document.
- Prepared technical specifications for the development of Informatica (ETL) mappings to load data into various target tables and defining ETL standards.
- Designed and developed data model using Erwin.
- Developed complex mappings using Lookups connected and unconnected, Rank, Sorter, Joiner, Aggregator, Filter, Router transformations to transform the data as per the target requirements.
- Created Workflows and used various tasks like Email, Event-wait and Event-raise, Timer, Scheduler, Control, Decision, Session in the Workflow Manager.
- Used Workflow Monitor to monitor the jobs, review error logs that were generated for each session, and rectified them.
- Worked on performance tuning of the ETL processes. Optimized/tuned mappings for better performance and efficiency.
- Designed and Developed ETL logic for implementing CDC by tracking the changes in critical fields required by the user using Informatica Power Exchange 7.1s
- Delivered comprehensive orientation/induction sessions regarding current projects; relayed critical knowledge and expertise to develop 10 AbInitio resources within 12 months
- Developed Procedures and Functions in PL/SQL.
- Used PMCMD, PMREP and UNIX shell scripts for workflow automation and repository administration.
- Developed Schedules for daily and weekly batches using Unix Maestro.
- Prepared ETL mapping specification document.
- Assisted Testing team in creating test plan and test cases.
- Conducted KT sessions for support team to familiarize the business rules of the applications and issues faced during UAT for ease of future maintenance.
Environment: Informatica Power Center 8.1, Power Exchange 7.1, Oracle 9i, SQL Server, Erwin, MS Access.
Confidential
ETL/Informatica Developer
Responsibilities:
- Participated in requirement gathering, Business Analysis, user meetings, discussing the issues to be resolved and translating user inputs into ETL design documents.
- Created ER diagram of the data model using Erwin data modeler to transform business rules into logical model.
- Involved in the extraction, transformation and loading of data from source flat files and RDBMS tables to target tables.
- Worked with Informatica Power Center Mapping Designer, Workflow Manager, Workflow Monitor and Admin Console.
- Used Source Qualifier, Aggregator, Lookup, Expression, Stored Procedure Transformations.
- Extensively worked with Informatica Designer. Designed and developed Informatica mappings for data loads and data cleansing.
- Developed and documented Informatica Mappings/Transformations, and Informatica sessions in a detail design document.
- Tuned performance of Informatica session for large data files by increasing block size, data cache size, sequence buffer length and target based on commit interval.
- Created Sessions and Batches to run Workflows.
- Responsible for writing unit test cases and performing the unit test.
- Worked with the QA team in order to determine the data validation and performed the data validating at the source and the target database level.
- Involved in Production support and trained the other developers to handle issues
- Developed Database Triggers in order to enforce complicated business logic and integrity constraints, and to enhance data security at database level.
- Documented the ETL process and also issues encountered during UAT and production support for ease of future maintenance.
Environment: Informatica Power Center 6.1.1, Oracle 8i, XML,Toad, SQL Navigator, Erwin, UNIX, Business Objects 6.5, Windows 2000
Confidential
ETL Developer
Responsibilities:
- Designed, developed Informatica mappings, enabling the extract, transport and loading of the data into target tables.
- Extensively worked on Informatica client tools like Designer, Workflow Manager and Workflow monitor.
- Created complex mappings using Aggregator, Expression, Joiner transformations including complex lookups, Stored Procedures, Update Strategy and others.
- Created Workflow, Work lets and Tasks to schedule the loads at required frequency using Workflow Manager.
- Designed and developed table structures, stored procedures, and functions to implement business rules.
- Extensively involved in migration of ETL environment, Database objects and EDW.
- Tested data integrity among various sources, targets and various performance related issues.
- Debugging and problem resolution in Reports and Forms. Generated master-detail, matrix groups and tabular reports.
- Involved in jobs scheduling, monitoring and production support in a 24/7 environment.
Environment: Informatica Power Center 4.1/5.1, Windows 2000, Sun Solaris, SQL Server 2000, Oracle 8i, PL/SQL, UNIX Shell Scripting.
Confidential
ETL Developer
Responsibilities:
- Analyzed specifications and identified source data needs to be moved to Data Mart, participated in the design team and user requirement gathering meetings.
- Performed major role in understanding the business requirements and designing and loading data into data warehouse. Designed star schema using Dimension modeling using the ER-win design tool.
- Extensively used ETL (Informatica) to load data from source (Flat files) to target Oracle database.
- Lookup, Aggregator, sequence, joiner and other transformations are used in populating data process.
- Created Informatica Mappings with PL/SQL procedures/functions to build business rules to load data.
- Involved in scheduling the Informatica Workflows.
- Conducted Performance tuning of application by modifying the SQL statements and using Explain Plan and TOAD Software.
- Used the Oracle stored functions/procedure/Packages.
- Involved in developing the requisite reports (list, grouped list, cross-tabs etc.) using Business Objects.
Environment: Informatica Power Center 5.1, Oracle 8i, PL/SQL, SQL Server 7, Toad, Business Objects 5.1, Windows NT, MS Access.