Sr. Etl Informatica/teradata Developer Resume
Fremont, CA
PROFESSIONAL SUMMARY:
- Certified Informatica Consultant having over 10+ years of Experience in dealing Data Warehousing projects using Informatica Power Center and Informatica Data Quality.
- Experienced in gathering Business Requirement Analysis, Designing, Development, Implementation, Testing and large - scale enterprise data warehouse.
- Expertise with Informatica Power Center versions (9x, 8x, 7x) and Strong experience in performing ETL using Repository Manager, Designer, Workflow Manager and Workflow Monitor.
- Experienced in IDQ (9X, 9.5.1) handing some of the transformation to cleanse and profile the incoming data by using Standardizer, Labeler, Parser, Address Validator Transformations.
- Extensively worked on Informatica Power Center Designer components like Source Analyzer, Target Designer, Transformation Developer, Mapplet Designer, and Mapping Designer.
- Worked on different types of transformations like Source Qualifier, Expression, Joiner, Filter, Aggregator, Rank, Router, Sorter, Sequence Generator, SQL, Union, Update strategy, XML - XML Generator, XML Parser, XML Source Qualifier, Lookup (Connected & Unconnected) - Persistent Lookup, Dynamic Lookup, Static Lookup, Shared Lookup, Stored Procedure, Normalizer.
- Expertise in Informatica Power Center Workflow Manager components like, Task Developer - Session, Command, Email, Work let Designer, Workflow Designer
- Strong Knowledge on Dimensional Modelling, Star and Snowflake Schema. Designed Fact, Dimension Tables, implemented SCD’s type1, 2, 3 as per Business Requirements provided by the BA Team.
- Experience in debugging the mapping, Declaring Mapping Parameters and Variables.
- Experienced in Databases like Oracle, SQL Server, DB2 and Teradata. Done backend application coding using TOAD utilizing SQL, PL/SQL, and T-SQL.
- Strong experience on Indexes in Teradata like Unique, non-Unique - Primary Index and Secondary Indexes.
- Experienced with Teradata Utility’s like BTEQ, Fast Load, Multi Load, and T-pump to load data from various source systems to Teradata. Also, used Teradata SQL Assistant to interface with the Teradata.
- Expertize in collect stats and coding standards in Teradata.
- Proficient in Teradata View point like Canary response, Node health, System response time and managing different type of connections. Monitoring system performance and worked on different Portlets.
- Done performance tuning through finding the bottlenecks by observing the Busy Percentile in session log taken at Target, Source, Mapping, Session and System. Also, handled performance tuning in IDQ using Execution Instance.
- Performed Unit Testing and co-ordinate with testing team to signoff the UAT for approve.
- Experienced in Release Management by undertaking Agile and Waterfall Methodology’s.
- Expertise in ITIL Service Level Management ticketing Tool - Service Now and Pac 2000 for production support issues.
- Experienced with Informatica Administration Console like Configuring the domain, nodes, Integrations services (IS), Repository services (RS), Performed upgrades, administrating the users by setting up the permissions for Development, Testing and Production.
- Expertise in RDBMS, data warehousing i.e. OLTP & OLAP systems and in T-SQL DDL/DML, perform SQL Server Enterprise Manager & Management Studio functionality using T-SQL Scripts and Batches.
- Performed Informatica CDC (Change Data Capture), Power Exchange, Knowledge on MDM.
- Automated Informatica jobs, using Scheduler, Autosys, Tidal, and UNIX scripts.
- Experienced in Business Intelligence Tools like in TABLEAU & COGNOS, OBIEE for reporting purpose for end users.
- A very good team player and lead with excellent problem solving and technical skills.
TECHNICAL SKILLS:
ETL Tools: Informatica Power Center 10/9.6/9.1/8.6/7. X, IDQ 9.5.1
Database: Oracle 12c/10g/11g, SQL Server2012/16, Teradata 15/16, IBMDB2,Vertica,Netezza
Scripting: Shell, Perl, Putty
Defect Management Tools: JIRA, Rally, HPQC
Autosys, Tidal, Control: M
Data Modeling: Erwin
Operating Systems: Windows, UNIX, Linux
Business IntelligenceTools: Tableau, Cognos, SSRS
Web Technology: HTML, XML
Programming Languages: C, Java, VB.Net
PROFESSIONAL EXPERIENCE:
Confidential, Fremont, CA
Sr. ETL Informatica/Teradata Developer
Responsibilities:
- Involved in end-to-end implementation of code into PROD/BCP, starts from JIRA creation to Change requesting closing.
- Interacted with Data Modelers and Business Analysts to understand the Business requirement and develop the code.
- By using Informatica Power Center 9.6.1, Designer analyzed the source data to Extract & Transform from various source systems (oracle 11g, oracle Exadata, SQL server, and Teradata and flat files) by incorporating business rules using different objects and functions that the tool supports and load into Global Data Warehouse.
- Maintained source and target mappings, transformation logic and processes to reflect the changing business environment over time.
- Used transformations like Aggregator, Sequence Generator, Update Strategy, Joiner, Java, Normalizer, Sorter, Union, Filter, Router, Expression and Lookup -connected/unconnected to develop robust mappings in Informatica Designer.
- Worked on complex Source Qualifier queries, Pre and Post SQL queries in the Target.
- Worked on different tasks in Workflow Manager like Sessions, Events raise, Event wait, Decision, E-mail, Command, Work lets, Assignment, Timer and Scheduling of the workflow.
- Extensively used workflow variables, mapping parameters and mapping variables.
- Created sessions, batches for incremental load into staging tables and scheduled them to run daily and monthly.
- Used shortcuts to reuse objects without creating multiple objects in the repository and inherit changes made to the source automatically.
- Extensively used Teradata utilities BTEQ, Fast Export, Fast Load and Multi Load to import and export data.
- Worked with Teradata in data Extraction, Transformation and loading from source to target system using Fast Load, TPT and Multi Load. Coordinated with Informatica vendor and admin for TPT issue in PC 10.1 version.
- Applied performance techniques like PDO, partitions and best practices for each transformation to avoid performance issues. Used TPT & Multi load connections in ETL for faster retrieval data.
- Prepared Unix Shell Scripts and these shell scripts to schedule in AUTOSYS for automatic execution at the specific timings.
- Involved in writing shell scripts for file transfers(FTP/SFTP), file renaming and several other database scripts to be executed from UNIX
- Involved in Unit, System Integration and User Acceptance testing.
- Migrated the code into QA (Testing) and supported QA team and UAT (User).
- Created detailed FSD and TSD with all possible Test cases/Scripts.
- Conducted peer reviews developed by my teammates before moving the code into QA.
- Involved in root causes analysis for recurring production failures and implemented permanent solutions to avoid failures.
- Involved in production support activities to fix bugs in daily and monthly jobs.
Environment: Informatica Power Center 9.6.1, Teradata 15.10, Oracle 11g, Oracle Exadata,SQL Server 2012,PL/SQL, SVN, Autosys R11, Unix, PAC2000, JIRA
Confidential, Buffalo, NY
ETL Informatica Developer/Teradata
Responsibilities:
- Worked with Business Users to gather the Requirements and business logics for the new changes.
- Understanding business requirements &enhancing the existing data warehouse design for a better performance.
- Work on different types of Schemas like Nutrition Schema, Fit Work Schema etc. & different tables, around 12 to 13 tables on each schema like Points Table, Member Eligibility Table, and Response Table.
- Extract data from sources like SQL server, Oracle DB’s, Teradata and transform them according to Business rules.
- Mostly used Teradata Utility’s like BTEQ, Fast Load, Multi Load, T-pump to load data extract and load the data into the warehouse.
- Monitor the daily extracts like Enrolment Extracts, Points Extracts, Response Extracts from TOPS and Confidential Database.
- Based on functional requirements, modify the workbook and technical design specification documents.
- Making the necessary code changes to mapping, workflow & Session based on business requirements.
- Preparing the test cases and do thorough testing based on business requirements.
- Prepare the promote sheet, CMR (Change Approve Board) and get approval from the board.
- Responsible for code migration from DEV - QA - Prod environments by coordinating with IT Operations.
- Conduct technical meeting with business users to know more about the problem.
- Involved in peer review of the code changes done by the team members.
- Involved in Application turnover processes with all the applications that goes to production.
- Responsible in building Informatica mappings by using various transformations like Source Qualifier, Expression, Filter, Aggregator, Router, Rank, Joiner, Lookup, Update Strategy, Stored procedure transformations based on the requirement from the end users.
- Done extensive performance tuning by determining bottlenecks at various points like targets, sources, mappings, sessions and system.
- Modified Mapplet and reusable transformations using Mapplet Designer, Transformation developer for the Standardization of data as per the business requirements.
- Responsible for extracting data from heterogeneous sources like Flat Files, Oracle, SQL Server, DB2 and loading the same in to Oracle and Flat Files.
- Used Admin console to configuring the domain, Integrations services, and Repository services.
- Administrated the users by setting up the permissions for Development and Testing and performed setting up the partition design.
- Used IDQ Standardizer Transformation and Address Validation Transformations to cleanse and profiling the data. Carried out the DQ-PC integration to export the Mapping.
- Created users and user groups with appropriate privileges and permissions, folders and folder permissions in Repository Manager.
- Used Debugger in Mappings to debug the Complex mappings and fixed the Errors.
- Prepared ETL mapping Documents for every mapping and Data Migration document for smooth transfer of project development to testing and then to Production environment.
- Prepared and used test data cases to verify accuracy and completeness of ETL process.
- Generated reports with the help of Work sheet &Dashboard using Business Intelligence tool - TABLEAU
- Actively involved in Production Support and helped other team members.
Environment: Informatica Power Center 9.6.1, Informatica Power Exchange 9.1, IDQ 9.5.1, SQL SERVER 2008, Oracle 10g, Teradata v13/14, Tableau 9.3, SQL Assist, Toad, T-SQL, Putty.
Confidential, Dallas, TX
ETL Informatica Developer
Responsibilities:
- Responsible, gathering suit of business requirements, Prepare source to Target Mapping specifications and Transformation rules.
- Extracted the data from various data source systems into the Landing Zone area by creating the Informatica mappings using the Teradata fast Loader Connections.
- Involved in System study, analyses the requirements by meeting the client and designing the system.
- Developed Mappings/ Reusable Objects/ Transformation/Mapplets by using mapping designer, transformation developer and Mapplet designer in Informatica Power Center.
- Worked on utilities like FLOAD, MLOAD, FEXP of Teradata and created batch jobs using BTEQ.
- Worked on Teradata SQL Assistant querying the source/target tables to validate the BTEQ scripts.
- Designed and developed complex Aggregate, Join, Lookup Transformation rules (Business rules) to generate consolidated (Fact/ Summary) data identified by dimensions using Informatica ETL tool
- Created Connected and unconnected Lookup transformation to look up the data from the source and target tables, used Update Strategy transformation.
- Workflow Manager used for creating and maintaining the sessions, Monitor, edit, schedule, copy, abort, and delete session.
- Used HDFS system to load the lots of data and running parallel computation on all data (Map Reduce)
- Setting up Batches and Sessions to schedule the loads at required frequency using Power Center Workflow Manager, pmcmd and using scheduling tools.
- Done Performance Tuning on targets, source, transformation, mappings, and sessions by using session log.
- Used Debugger to debug mappings by creating breakpoints to gain troubleshooting information about data and error conditions.
- Involved in migrating folders from Development to Testing and from Testing to Production Environments, creating the connect strings and synchronizing the connect strings and connection objects in Dev, Test and Prod environments.
- Involved in end to end testing and created Test cases for those mappings.
- Worked with testing team and helped in Testing at Integration Level and UAT sign off.
- Used various tasks like Session task, Event Wait Task, Decision task, Email task, Command task.
- Actively Participated in Team meetings and discussions to propose the solutions to the Problems.
Environment: Informatica Power Center 9.1, Oracle 9i, MS SQL SERVER, Teradata 13.0, SQL, PL/SQL, Hadoop cluster, Erwin, SQL Loader, UNIX Shell Script, T-SQL, Tableau 8.3, Win 2000/NT.
Confidential
MI ETL Developer
Responsibilities:
- Mostly worked on a new business requirement, which know as PDR (Pre-Defined Repair).
- Starts from addressing the business requirements and prepared Design/Functional/Mapping Document.
- Interacted with Data Modelers & Business Analysts to understand the Business needs to develop the code.
- Maintained source and target mappings, transformation logic as per business criteria.
- Used transformations like Aggregator, Sequence Generator, Update Strategy, Joiner, Java, Normalizer, Sorter, Union, Filter, Router, Expression and Lookup -connected/unconnected to develop robust mappings in Informatica Designer.
- Worked on complex Source Qualifier queries, Pre and Post SQL queries in the Target.
- Worked on different tasks in Workflow Manager like Sessions, Events raise, Event wait, Decision, E-mail, Command, Work lets, Assignment, Timer and Scheduling of the workflow.
- Extensively used workflow variables, mapping parameters and mapping variables.
- Created sessions, batches for incremental load into staging tables and scheduled them to run daily and monthly.
- Used shortcuts to reuse objects without creating multiple objects in the repository and inherit changes made to the source automatically.
- Extensively used Teradata utilities BTEQ, Fast Export, Fast Load and Multi Load to import and export data.
- Worked with Teradata in data Extraction, Transformation and loading from source to target system using Fast Load, TPT and Multi Load.
- Used TPT & Multi load connections in ETL for faster retrieval data.
- Prepared Unix Shell Scripts and these shell scripts to schedule in AUTOSYS for automatic execution at the specific timings.
- Involved in writing shell scripts for file transfers(FTP/SFTP), file renaming and several other database scripts to be executed from UNIX
- Involved in Unit, System Integration and User Acceptance testing.
- Migrated the code into QA (Testing) and supported QA team and UAT (User).
- Created detailed FSD and TSD with all possible Test cases/Scripts.
- Conducted peer reviews developed by my teammates before moving the code into QA.
- Involved in root causes analysis for recurring production failures and implemented permanent solutions to avoid failures.
- Involved in production support activities.
Environment: Informatica Power Center 9.6, Oracle 11g, SQL Server 2012, PL/SQL,Teradata 15.10, Autosys, AccuRev, UNIX, Rally.
Confidential, Chicago, IL
ETL / Teradata Developer
Responsibilities:
- Involved in full Software Development Life Cycle (SDLC) - Business Requirements Analysis, preparation of Technical Design documents, Data Analysis, Logical and Physical database design, Coding, Testing, Implementing, and deploying to business users.
- Involved in gathering business requirements, logical modelling, physical database design, data sourcing and data transformation, data loading, SQL and performance tuning.
- Expertise in writing scripts for Data Extraction, Transformation and Loading of data from legacy systems to target data warehouse using BTEQ, FastLoad, MultiLoad, and Tpump.
- Defining the schema, staging tables, and landing zone tables, configuring base objects, foreign-key relationships, complex joins, and building efficient views.
- Performed Query Optimization with the help of explain plans, collect statistics, Primary and Secondary indexes. Used volatile table and derived queries for breaking up complex queries into simpler queries. Streamlined the Teradata scripts and shell scripts migration process on the UNIX box.
- Worked on Informatica Power Center tools - Designer, Repository Manager, Workflow Manager, and Workflow Monitor.
- Developing as well as modifying existing mappings for enhancements of new business requirements mappings to load into staging tables and then to target tables in EDW. Also created Mapplets to use them in different mappings.
- Working on different tasks in Workflows like sessions, events raise, event wait, e-mail, command, worklets and scheduling of the workflow.
- Using various transformations like Filter, Expression, Sequence Generator, Update Strategy, Joiner, Stored Procedure, and Union to develop robust mappings in the Informatica Designer.
- Creating sessions, configuring workflows to extract data from various sources, transforming data, and loading into enterprise data warehouse.
- Running and monitoring daily scheduled jobs by using Work Load manager for supporting EDW (Enterprise Data Warehouse) loads for History as well as incremental data.
- Experience on working with Teradata Campaign Management tool.
- Investigating failed jobs and writing SQL to debug data load issues in Production.
- Interacting with the Source Team and Business to get the Validation of the data.
- Writing SQL Scripts to extract the data from Database and for Testing Purposes.
- Supported the code after postproduction deployment.
- Implemented flexible view of Dashboard by using Tableau.
- Reviewed basic SQL queries and edited inner left, and right joins in Tableau Desktop by connecting live/dynamic and static datasets.
- Involved in Transferring the Processed files from mainframe to target system.
- Familiar with Agile software methodologies (scrum).
Environment: Teradata v14, UNIX, Teradata SQL Assistant, BTEQ, FastLoad, MultiLoad, Tpump, Shell Scripts, Informatica Powercenter 9.6, Tableau, Agile.
Confidential, Long Beach, CA
ETL / Teradata Developer
Responsibilities:
- Involved in Requirement gathering, business Analysis, Design and Development, testing and implementation of business rules
- Design, development and documentation of the ETL (Extract Transformation and Load) strategy to integrate different interfaces with Exigent.
- Work with the data modelers, architects and Cognos developers to create a consumption layer in Teradata and Cognos.
- Performance optimization on the data and consumption layer in Teradata.
- Create and Maintain Teradata Tables, Views, Macros, Triggers and Stored Procedures.
- Coding using Teradata Analytical functions, write UNIX scripts to validate, format and execute the SQLs on UNIX environment.
- Created a BTEQ script for pre-population of the work tables prior to the main load process.
- Involved in Performance tuning for the long running queries.
- Developed UNIX shell scripts to run batch jobs in production.
- Exclusively used Informatica Designer to create en-manupulate source definitions, target definitions, mappings, mapplets, transformation, etc.
- Apply broad in-depth business and technical knowledge to resolve production support and sustainment activities.
- Developed Shell Scripts to perform tasks like starting the Informatica workflow from the Script, used looping techniques, naming the file with the Date file was generated.
- Extensive work experience in the design and development using UNIX shell scripting and SQL
- Effectively used Persistent caches, Informatica Lookup Overrides and other optimizing techniques to improve the Session performance considerably.
- Involved in analysis of end user requirements and business rules based on given documentation and working closely with tech leads and analysts in understanding the current system.
Environment: Teradata v13/v14, Cognos, UNIX Shell Scripts, Informatica, Teradata SQL Assistant, BTEQ, FastLoad, MultiLoad, Tpump, Agile.
Confidential, NYC, NY
ETL Developer
Responsibilities:
- Migrated data from Informatica Powercenter Designer and using transformations like Source Qualifier, Expression, Filter, Router, Joiner, Sequence developer, Update Strategy, Lookup, Sorter, Aggregator, Normalizer, XML Source Qualifier, Stored Procedure etc. for extraction, transformation and loading of data.
- Worked on Netezza as relational Source data base which is dimensional model to generate the existing BO reports.
- Assisted in support functions and maintenance of Netezza data warehousing applications as per program requirements.
- Created complex jobs and implemented Slowly Changing Dimensions (Type 1, Type 2 and Type 3) for data loads.
- Extensively used Erwin for Logical and Physical data modeling and designed Star Schemas.
- Extensively Used Environment SQL commands in workflows prior to extracting the data in the ETL tool.
- Worked with Teradata utilities like BTEQ, Fast Export, Fast Load, Multi Load to export and load data to/from different source data base Netezza.
- Created databases, tables, triggers, macros, views, stored procedures, functions, Packages, joins and hash indexes in Teradata database.
- Expertise using ERWIN for Data modeling and Database design.
- Experience working with Informatica Power Exchange for Netezza and migrating the data using Talend Studio into Teradata.
- Hands on Experience Business Intelligence experience using Business Objects.
- Migrated reports from Business Objects to Tableau.
- Experience in Informatica providing Data warehouse solutions using Power Center and data modeling with ERWIN tool.
- Used Erwin tool for physical and logical data modeling.
- Used Informatica power center to Extract, Transform and Load data into Netezza Data Warehouse from various sources like Oracle and flat files.
- Used Talend extensively for profiling the data and accessing the data quality of the source data.
- Created and Configured Workflows, Worklets, and Sessions to transport the data to target warehouse Netezza tables using Informatica Workflow Manager.
- Migrated Informatica folders, mappings from one environment to another and in the process of change control using Talend and yaml files.
- Implemented Flexible view of dashboard by using Tableau.
- Skilled in Tableau Desktop for Data Visualization, Reporting and Analysis, Cross Map, Scatter Plots, Geographic Map, Pie charts and Bar charts.
- Created jobs in Talend Studio in the development environment and tested in QA and moved into Production environment as well.
- Created and used volatile tables for testing purposes.
- Involved in Code Reviews & Unit Testing for the ETL code developed.
