Etl Informatica Developer Resume
SUMMARY:
- Over 7+ years of total IT experience and technical proficiency in buildingMaster Data Management(MDM), Data Warehouses,Data Integration, Operational Data Stores and ETL processes for clients inEcommerce(Sales orders,Inventorytracking,daily reports) ,Financial (Equities, Futures) and HealthCare (Providers, Members, Organizations, Plans, Claims, and Extracts) domains.
- Hands on experience in Design, Development, Migration, Implementation of Data Warehouse and ETL Application development.
- Hands on experience in working with large scale Data Warehouse implementations and ETL tools using Informatica PowerCenter 8.x/7.x, DataStage 9.x,8.x, Oracle 10g&11g, DB2,Netezza, SQL Server on UNIX and Windows platforms.
- Extensive experience in Extraction, Transformation, and Loading (ETL) data from various data sources into Data Warehouse and Data Marts using Informatica Designer &TalendOpen Studio environment.
- Knowledge on implementing hierarchies, relationships types, packages and profiles for hierarchy management in MDM Hub implementation.
- Expertise in implementing complex business rules by creating several parallel jobs and sequencers for process execution flow with robust mappings in Informatica.
- Experience in working on performance tuning jobs and thereby decreasing the execution time and efficient server utilization with limited resources .
- Worked in different areas include System Analysis, Design, Development and Testing as a specialist in Confidential and Power Center.
- Experience in integration of various data sources like Oracle, DB2, SQL Server, Flat Files,XML files into Data Warehouse and also experienced in Data Cleansing and Data Analysis.
- Extensively used SQL and PL/SQL to write Stored Procedures, Functions, Packages, Cursors, Triggers, Views, and Indexes in distributed environment.
- Hands on experience on different types of data load strategies and scenarios like Historical Dimensions, Surrogate keys, Summary facts etc.
- Strong experience in writing UNIX Shell scripts, SQL Scripts for development, automation of ETL process, error handling, and auditing purposes. Experience in using Autosysand Control - M scheduling tools to organize and schedule jobs.
- Experience in preparing documentation such as High level design, System requirement document, and Technical Specification document etc.
- Worked extensively in all stages of SDLC, from gathering requirements to testing, implementation and support.
- Extensive experience in Data profiling, data cleansing using Informatica IDQ and its integration with MDM.
- Experience in project management, estimations, and resource management activities.Kimball Methodology, Star Schemas, Slowly changing dimensions.
- Familiarity with Oracle Financial Services Analytical Applications (or OFSSA)
- Excellent analytical, problem solving skills with strong technical background and interpersonal skills.
AREAS OF INTEREST:
- Datawarehousing
- Business Analytics
- Big Data
- Data Science
TECHNICAL SKILLS:
Databases: Oracle,Netezza,DB2,NoSQL,T-SQL,MS Access
Operating Systems: Windows/Unix/Linux
Database Tools: TOAD, SQL Navigator
Programming Languages: C, C++, HTML, XML,SQL, PL/ SQL, Java, J2EE,Python
ETL Tools: Informatica Power Center 9.x/8.x (Workflow Manager, Workflow Monitor, Warehouse Designer, Transformation developer) IBM DataStage Enterprise Edition 9.1/8.5 / 7.5
Scripting Languages: Shell Scripting, Perl Scripting
Scheduling Tools: Autosys,Tivoli, Control-M
Application Servers: Web Logic 10.x/9.x, Tomcat
Test Management Tools: Quality Center, JIRA
Reporting tools: Pentaho,SSRS
PROFESSIONAL EXPERIENCE:
ETL Informatica Developer
Confidential
Responsibilities:
- Involved in all phases of SDLC from requirement gathering, design, development, testing, Production, user training and support for production environment.
- Create new mapping designs using various tools in Informatica Designer like Source Analyzer,
- Warehouse Designer, Mapplet Designer and Mapping Designer.
- Experienced in developing mappings using transformations such as Source Qualifier, Aggregator,
- Lookup, Filter, Sequence Generator, Expression, Router, Update Strategy, Rank, XML, Normalizer etc., to load data from different sources like Oracle, Flat Files, Excel Spread Sheets, XML files to the target Data Warehouse.
- Worked in MDM Hub configurations - Data Mappings, Data validation, Hierarchy Manager,customizing/configuring Informatica/Business Data Director
- Created complex mappings that involved implementation of Business Logic to load data in to staging area.
- Designed & Developed Confidential User Exits, Match rules etc
- Worked as an Informatica Administrator to migrate the mappings, sessions, workflows, repositories into the new environment.
- Designed and developed scripts for administrative tasks like backup’s, tuning and periodically refreshing the test databases from the production databases.
- Developed mappings/sessions using Informatica Power Center 8.6 for data loading.
- Performed data manipulations using various Informatica Transformations like Filter, Expression,
- Lookup (Connected and Un-Connected), Aggregate, Update Strategy, Normalizer, Joiner, Router, Sorter and Union.
- Developed Workflows using task developer, Worklet designer and workflow designer in Workflowmanager and monitored the results using workflow monitor.
- Building Reports according to user Requirement.
- Extracted data from Oracle and SQL Server then used Teradata for data warehousing.
- Implementedslowly changing dimensionmethodology for accessing the full history of accounts.
- Write Shell script running workflows in unix environment.
- Optimizing performance tuning at source, target,mapping and session level
- Participated inweeklystatus meetings, and conducting internal andexternal reviews as well as formal walk through among various teams and documenting the proceedings.
Environment: Confidential 10.x, Informatica PowerCenter 9.6, SQL Developer, Oracle 11g, UNIX Shell Scripting.
ETL Developer
Confidential
Responsibilities:
- Extensively used ETL to load data from Flat Files, XML, Oracle to oracle 8i .
- Configure MDM tables in the following sequence: Base Objects, Relationships Base Objects, and
- Defined and developed the ETL process to load the data into the landing tables during the land Process.
- Developed data Mappings between source systems and warehouse components using MappingDesigner
- Worked extensively on different types of transformations like source qualifier, expression, filter,aggregator, rank, update strategy, lookup, stored procedure, sequence generator, joiner, XML.
- Setup folders, groups, users, and permissions and performed Repository administration using Repository Manager.
- Involved in the performance tuning of the Informatica mappings and stored procedures and the sequelqueries inside the source qualifier.
- Created, launched & scheduled sessions.Involved with Informaticateam members in Designing, document and configure the Confidential Hub to support loading, cleansing, matching, merging, and publication of MDM data.
- Involved in the Performance Tuning of Database and Informatica. Improved performance by identifying and rectifying the performance bottle necks.
- Used Server Manager to schedule sessions and batches.Experience with Confidential batchprocessing.
- Involved in creating Business Objects Universe and appropriate reports
- Wrote PL/SQL Packages and Stored procedures to implement business rules and validations.
- Created complex mappings which involved Slowly Changing Dimensions, implementation of Business
- Logic and capturing the deleted records in the source systems.
- Worked extensively with the connected lookup Transformations using dynamic cache.
- Designed workflows with many sessions with decision, assignment task, event wait, and event raise tasks, used informatica scheduler to schedule jobs.
- Reviewed and analyzed functional requirements, mapping documents, problem solving and troubleshooting.
- Worked on data cleansing and standardization using the cleanse functions in Confidential .
- Performed match/merge and ran match rules to check the effectiveness of MDM process on data.
Environment: Informatica ETL9.1, 9.5, MDM, IDD, Oracle 10g/11g/12g, PL/SQL,IDD,SQL Loader, SQL Navigator, Toad, Hub, UNIX, LINUX, Putty, Shell scripting.
Software Engineer
Confidential
Responsibilities:
- Involved in documenting Functional Specifications, Design Specifications documents and created ETLSpecifications documents and updated them as and when needed.
- Designed ETL specifications with transformation rules using ETL best practices for good performance, maintainability of the code and efficient restart ability.
- Designed reusable objects like mapplets & re-usable transformations in Informatica.
- Designed and developed the UNIX shell scripts for the automation of ETL jobs.
- Performed data validation in the target tables using complex SQLs to make sure all the modules are integrated properly.
- Involved in cleansing raw data in staging area using stored procedures in pre and post-sessionroutines.
- Tested and tuned the SQL queries for better performance, Conducted code reviews to make sure thebusiness requirements are met and the coding standards are followed.
- Coordinated with upstream and down stream teams on daily basis for daily batch runs for payment engine processing.
- This payment processing which we refer to as a batch runs on daily basis except on US holidays and we process over 5 to 10 million claims a day. We as a part of support and development team monitor the daily progress of this batch which runs in US day timings from offshore and thereby providing critical support 24x7 for 365 days.
- I being a part of this team in a short while has automated some of the reports which we send to ourdownstreams and thereby made a cost saving of upto 50000 USD per annum and suggested andimplemented many performance tuning techniques and developed new Enhancements on existing systems.
- Supporting the application in Production environment by monitoring the ETL process everyday duringthe nightly loads.
Environment: Informatica 8.6,DataStage 9.1, SQL Developer,Unix, Tivoli Scheduler, Oracle 11g,DB2
Senior Systems Engineer
Confidential
Responsibilities:
- Design, develop, and test Informatica mappings, workflows, worklets, reusable objects, SQL queriesand Shell scripts to implement complex business rules.
- Gathered the requirements from the Business Analyst on client side and developed necessary prototypes to demonstrate full length design and functionality.
- Developed new Informatica jobs using existing Talend code which is an open source and thereby providing security and speed through Informatica without disturbing the existing functionality.This is an agile project which is tracked on day to day basis so we are just two resources working from off shore location in collaboration with HCL technologies which is a strategic partner for Infosys in this project.
- Performance tuning and optimization achieved through the management of indices, table partitioningand optimizing the SQL scripts.
- Created generic packages useful for other team members.
- Migrated the data from SQL Server and DB2 to Oracle.
- Created a mapping document that outlines the sources mapped to the targets
- Created a document outlining the plan of action to be taken for the entire process
- Created views to select data from the existing SQL Server databases.
- Designed mappings to load first the Staging tables and then the destination tables.
- Designing mappings using transformations such as Source Qualifier, Joiner, Expression, Lookup, Filter,Router etc.
- Created different transformations using Informatica for loading the data into SQL Server database.
- Transferred the data from a combination of different input files like XML, Flat files to Oracle.
- Created, optimized, reviewed, and executed Complex SQL queries to validate transformation rulesused in source to target mappings/source views, and to verify data in target tables.
- Created Functional Spec & Technical Spec documentation & also documented the issues found in the end to end testing.
- Generated SQL Loader scripts and Shell scripts for automated daily load processes.
- Developed triggers and stored procedures for data verification and processing.
- Extensively worked on database performance tuning techniques and modifying the complex join statements.
- Involved in the smooth transition from Informatica 7.1 to Informatica 8.0.
- Documented detailed steps for migrating the code.
Environment: InformaticaPowercenter 9.1.5,SQLDeveloper,Unix,Aginity for Netezza,Oracle11g,Netezza, Autosys
Confidential
ETL Developer(Informatica)
Responsibilities:
- Interacting with business owners to gather both functional and technical requirements.
- Documenting the business requirements and framing the business logic for the ETL process.
- Use Agile methodology for SDLC and utilize scrum meetings for creative and productive work.
- Transferring the data from various sources like XML, flat files, DB2 into Oracle data warehouse.
- Migrating historical data from DB2 to the Oracledata warehouse and extensively worked on SCD type 2 using Look up transformation.
- Identifying bottlenecks/issues and fine tuning them for optimal performance.
- Responsible for capturing, reporting, and correcting error data.
- Performed/automated many ETL related tasks including data cleansing, conversion, and transformations to load Oracle 10g based Data Warehouse.
- Used Autosys for job scheduling, workload automation and for generating reports.
- Developer Shell/Perl scripts to transfer files using FTP, SFTP, and to automate ETL jobs.
- Provide on-call support to production system to resolve any issues.
- Conducting code walkthroughs and review peer code and documentation.
- Playing role in design of scalable, reusable, and low maintenance ETL templates. Documenting thebusiness requirements and framing the business logic for the ETL process.
- Developing technical specifications and other helpful ETL documents following standards.
- Involved in creating logical and physical data models using CA ERwin data modeler. Generating the DDL scripts for the physical data model.
- Used Agile methodology for SDLC and utilized scrum meetings for creative and productive work.
- Design and develop PL/SQL packages, stored procedure, tables, views, indexes, and functions;implement best practices to maintain optimal performance.
- Design, develop, and test complex mappings, workflows, worklets, reusable objects, SQL queriesand Shell scripts to implement complex business rules.
- Migrating historical data from DB2 to the Oracle data warehouse.
- Developed Informatica jobs to migrate data from one source system to another and Created new Enhancements and Reports to Accommodate Reason codes Functionality to the existing systems.
- Learnt a lot through interaction with client and functional consultants in drafting technical specifications
