Sr Etl Informatica/ Teradata Developer & Support Engineer Resume
Dover, NH
PROFESSIONAL SUMMARY:
- 9 years of experience in Information Technology with building & supporting Data Warehouse/Data Mart using Informatica Power Center 10.1/9.6.1/9.5.1/9.1.1/8.6.1/8.1.1
- Strong work experience in Data Warehouse lifecycle process.
- Involved in understanding of Business Processes, grain identification, identification of dimensions and measures (Facts).
- Extensive knowledge on Understanding Data Modeling(ER & Dimensional Modeling), doing Data Integration and Data Migration.
- Extensive experience in working with different RDBMS Oracle, Teradata, My Sql, SQL Server, DB2, Sybase and also with File base system - Flat Files & XML Files.
- Extensive experience in designing and developing complex mappings using transformations lookups (Connected & Un Connected), Normalizer, Source Qualifier, Router, Filter, Expression, Aggregator, Joiner, java and Update Strategy.
- Expert on implementing Slowly Changing Dimensions Type 1, Type 2 and Type 3 for inserting and updating Target tables for maintaining the history.
- Expert on Implementing Change Data Capture (CDC) for handling Incremental loads.
- Experience on Mapping Debugger to validate the mappings and gain troubleshooting information about data and error conditions.
- Experience on post-session and pre-session shell scripts for tasks like merging flat files after Creating, deleting temporary files, changing the file name to reflect the file generated date etc.
- Extensively used Informatica Mapping Parameters and variables.
- Extensively worked withInformaticaperformance tuning involving Identifying and eliminating bottlenecks.
- Experience with Integrating Informatica with Teradata and using Teradata features.
- Extensive experience withTeradatautilities like BTEQ, Fast Export, Fast Load, Multi Load & Tpump also with TPT.
- Proficient inTeradataEXPLAIN plans, Collect Stats option, Primary Indexes (PI, NUPI), Secondary Indexes (USI, NUSI), Partition Primary Index (PPI), Join Indexes (JI), Volatile, global temporary, derived tables etc.
- Expertise in performance tuning and query optimization of theTeradataSQLs.
- Experience with Unit Testing, working with QA team on System testing also involved in UAT.
- Experience with ETL Migrations & Code deployments also involved with Post production validations.
- Solid experience in writing SQL queries, Stored Procedures.
- Experience in working with UNIX Shell Scripts for automatically running sessions, aborting sessions and creating adhoc parameter files.
- Written number of shell scripts to run various batch jobs.
- Implemented Data Warehouse projects both in Agile and Water Fall Methodologies and good understanding on Scrum process.
- Excellent interpersonal and communication skills, capable of driving the DWH projects independently.
TECHNICAL SKILLS:
ETL Tools: Informatica Power Center 10.1/9.6.1/9.5.1/9.1.1/8.6.1, SSIS
Databases: Oracle, MS SQL Server, Teradata15/14/13/12, My Sql, DB2, Sybase
Reporting: Cognos, Business Objects, Dashboard Reporting
Tools: Toad, SQL developer, Sql Assistant
Languages: Unix shell Script, SQL, PL/SQL, Java, Perl
Process/Methodologies: Waterfall Methodology, Agile Methodology (Rally/Jira)
Operating Systems: Windows, Unix & Linux
PROFESSIONAL EXPERIENCE:
Confidential, Dover, NH
Sr ETL Informatica/ Teradata Developer & Support Engineer
Responsibilities:
- Analyzed the Business Requirement Documents (BRD) & Source to Target Mapping Document (STM) for better ETL Process before the development.
- Used Informatica Power Center to pull data from different source systems/ files, cleanse, transform and load data into the Teradata using Teradata Utilities.
- Worked on Informatica- Source Analyzer, Warehouse Designer, Mapping Designer & Mapplet, and Transformation Developer.
- Created Reusable transformations, Mapplets, Worklets using Transformation Developer, Mapplet Designer and Worklet Designer.
- Used most of the transformations such as the Source Qualifier, Expression, Aggregator, Filter, Connected and Unconnected Lookups, Joiner, java, update strategy and stored procedure.
- Extensively used Pre-SQL and Post-SQL scripts for loading the data into the targets according to the requirement.
- Used command task extensively to execute the unix scripts from informatica.
- Developed mappings for SCD Type 1 and SCD Type 2 dimensions.
- Created process to handle Change Data Capture (CDC).
- Involved in source data Profiling and Tuning of queries for Source Data Extraction
- Involved in Initial loads, Incremental loads and Daily loads to ensure that the data is loaded in the tables in a timely and appropriate manner.
- Involved in Enhancing existing Production Objects for additional reporting requirements.
- Tuned the performance of mappings by following Informatica best practices and also applied several methods to get best performance by decreasing the run time of workflows.
- Worked extensively on Informatica Partitioning when dealing with huge volumes of data and also partitioned the tables in Teradata for optimal performance.
- Loaded data in to the Teradata tables using Teradata Utilities Bteq, Fast Load, Multi Load, and Fast Export, TPT.
- Extensively worked in the performance tuning of Teradata BTEQ.
- Worked extensively with different Caches such as Index cache, Data cache and Lookup cache (Static, Dynamic and Persistence) while developing the Mappings.
- Involved in moving the BIG data Hive QL process to Informatica & Teradata.
- Involved in analysis for future migration of Informatica to SSIS and knowledge on SSIS tool.
- Responsible for Unit Testing, Integration Testing and helped with User Acceptance Testing.
- Involved in doing DWH data Analysis for reporting & also written SQL for ADHOC reporting purpose.
- Written Unix Wrappers for different purposes - PMCMD in Built, Archiving Logs, Purging data, FTP the Files.
- Co-ordinate with reporting team for better understanding of DWH data.
- Involved in writing technical design documentation along with deployment activities.
- Scheduling Informatica jobs and implementing dependencies if necessary using Maestro.
- Involved in Heavy Production Support on rotational basis.
Environment: InformaticaPower Center 10.1/9.6.1/9.5.1, SSIS 2017, Teradata 15/14, Oracle 11g, Sybase, My Sql, Sql Server, Flat Files, SQL, PL/SQL, Maestro, Cron Tab, UNIX, Agile, SVN, Sql Assistant, Toad 9.0, Cognos.
Confidential, Boston, MA
Sr. Teradata Developer
Responsibilities:
- Worked with Business Analyst for Confidential & Confidential along with Confidential.
- Extensively worked with various Active transformations like Filter, Sorter, Aggregator, Router and Joiner transformations.
- Extensively worked with various Passive transformations like Expression, Lookup, Sequence Generator, Mapplet Input and Mapplet Output transformations.
- Worked with source databases like Oracle, SQL Server and Flat Files.
- Worked with extracting data from SFDC.
- Extensively worked with Teradata utilities BTEQ, F-Load, M-load & TPT to load data in to Teradata ware house.
- Created complex mappings using Unconnected and Connected lookup Transformations.
- Responsible for the performance tuning of the ETL process at source level, target level, mapping level and session level.
- Tuned performance of Informatica session for large data files by increasing block size, data cache size and target based commit interval.
- Responsible for Performance Tuning of Teradata scripts using explain plans, indexing and Statistics.
- Implemented Slowly changing dimension Type 1 and Type 2.
- Worked with various look up cache like Dynamic Cache, Static Cache, Persistent Cache, Re Cache from database and Shared Cache.
- Worked extensively with update strategy transformation for implementing inserts and updates.
- Worked with various Informatica Power Center objects like Mappings, transformations, Mapplet, Workflows and Session Tasks.
- Auditing is captured in the audit table and EOD snapshot of daily entry is sent to the distributed list to analyze if there are any abnormalities.
- As per business we implemented Auditing and Balancing on the transactional sources so that every record read is either captured in the maintenance tables or wrote to Target tables.
- Extensively used the tasks like email task to deliver the generated reports to the mailboxes and command tasks to write post session and pre session commands.
- Extensively used debugger to test the logic implemented in the mappings.
- Performed error handing using session logs.
- Involved in production support when required.
- Monitored workflows and session using Power Center workflows monitor.
- Used Informatica Scheduler for scheduling the workflows in dev for testing.
- Provided 24*7 support for Production environment jobs.
- Monitoring the Extraction and loading processes of data and Involved in writing UNIX shell scripting for automating the jobs.
Environment: InformaticaPower Center 9.5.1/9.1.1, IDQ 9.5.1, Power Exchange, Teradata 14, Oracle 11g, Flat Files, Autosys, Toad, Textpad, Sql Assistant, Putty, UNIX, Windows.
Confidential, Dallas, Texas
Terradata/ Informatica Developer
Responsibilities:
- Analyzed the Business Requirement Documents (BRD) and laid out the steps for the data extraction, business logic implementation & loading into targets.
- Created detailed Technical specifications for Data Warehouse and ETL processes.
- Developed Source to Target Mappings using Informatica Power Center Designer from Oracle, Flat files sources toTeradatadatabase, implementing the business rules
- Modified BTEQ scripts to load data fromTeradataStaging area toTeradataWare House.
- Requirement gathering and discussion with Architect for design plan.
- Created series of Macros for various applications inTeradataSQL Assistant
- Working closely with Architects and Lead for the applications assessment to all the Data Masking Team on Proxy server and proving support on the databases and applications.
- Extensively used Pre-SQL and Post-SQL scripts for loading the data into the targets according to the requirements.
- Extracted, transformed data from various sources such as Flat files, Oracle 11g and transferred data to the target data warehouseTeradata
- Responsible for buildingTeradatatemporary tables, indexes, macros and BTEQ Scripts for loading/transforming data.
- Developed scripts for loading the data into the base tables in EDW using FastLoad, MultiLoad and BTEQ utilities ofTeradata
- Tested raw data and executed performance scripts.
- Successfully upgraded Informatica 9.1 and to 9.5 and responsible for validating objects in new version of Informatica.
- Managed postproduction issues and delivered all assignments/projects within specified time lines.
- Involved in Initial loads, Incremental loads and Daily loads to ensure that the data is loaded in the tables in a timely and appropriate manner.
- Supported QA for each region testing using Health Rules and Health Answers. Assisted for QA.
- Written Technical design document and application workbook and handover applications to production team.
- Worked in Production support team.
Environment: Informatica Power Center 9.5.1/9.1.1, Oracle 11g, DB2, Teradata 14.0, Flat Files, TeradataSQL Assistant, Toad, Winscp, Putty, Tivoli Workload Scheduler, UNIX.
Confidential, Phoenix, AZ
Teradata/ Informatica Developer
Responsibilities:
- Designed and developed ETL mappings from source systems to target systems.
- Worked with source teams to resolve data quality issues raised by end users.
- Mappings were developed inInformaticausing transformations like Joiner, Expression, Aggregate, Rank, Lookup, Update Strategy, Filter and Router.
- implemented Slowly Changing Dimension and Dynamic lookup techniques.
- Used debugger to validate the mappings and gain troubleshooting information about data and error conditions.
- Developed post and pre session shell scripts and scheduled Event based sessions at theInformatica workflow manager.
- Used Repository manager for validating, promoting, importing and exporting repositories from development environment to testing environment.
- Performed data quality analysis, gathered information to determine data sources, data targets, data definitions, data relationships, and documented business rules.
- Worked on loading Flat Files in to Data warehouse.
- Created Stored procedures and packages.
- UsedInformaticaPower center workflow manager to create sessions, batches to run with the logic embedded in the mappings
- Implemented performance-tuning techniques by identifying and resolving the bottlenecks in source, target, transformations, mappings and sessions.
- Responsible for identifying the missed records in different stages from source to target and resolving the issue.
- Extensively used PL/SQL Procedures/Functions to build business rule.
- Used parameters and variables (sessions/mappings) extensively for incremental loads.
- Used SQL tools like TOAD to run SQL queries and validate the data.
- Analyzed Session Log files in case the session failed to resolve errors in mapping or session configurations.
- Setting up tasks to schedule the loads at required frequency using Power Center workflow manager.
- DB2 Performance tuning both system and database management of DB and DBM configuration. Analyzing queries both Adhoc and Online and provide trace and log analysis.
Environment: InformaticaPowerCenter 9.1.1/8.6.1, Oracle 10g/9i, Db2, Flat Files, Toad, Putty, Winscp, UNIX, Windows.
Confidential
Jr.Informatica Developer
Responsibilities:
- Extracted Data from Different Sources by using Informatica.
- Extensively used Informatica client toolsSource Analyzer, Warehouse designer, Mapping designer and Mapplet Designer.
- Extracted data from different sources of databases. Createdstaging areato cleanse the data and validated the data.
- Designed and developed complexAggregate, expression, filter, join, Router, Lookup and Updatetransformation rules.
- Developed schedules to automate the update processes andInformatica sessions and batches.
- Analyze, design, construct and implement the ETL jobs using Informatica & Teradata utilities.
- Developedmappings/Transformations/mappletsby mapping designer, transformation developer and mapplet designer in Informatica Power Center 8.6.1/9.1.1
- DevelopedShell scriptsto setup runtime environment and for automation
Environment: Informatica Power Center 9.1.1/8.6.1, Teradata 12, Oracle 10g, Flat Files, UNIX Shell Scripts, Erwin.