Tech Lead Sr. Informatica Etl / Database Developer Resume
New, JerseY
SUMMARY
- Highly motivated IT professional with 8+ years of experience in Banking, Financial and Credit Rating analysis sectors.
- Extensive experience designing Data Warehouse, Data Marts and loading data using tools such as Informatica Power Center Client tools, Pentaho, PL/SQL, T - SQL etc.
- Extensive Experience on in Teradata RDBMS and the Data ware housing.
- Strong hands on experience using Teradata utilities (SQL, B-TEQ, Fast Load, MultiLoad, FastExport, Tpump, Visual Explain, Query man)
- Design, development, documentation and production support of all stages of full life cycle projects.
- Responsible for all phases of project life cycle including analysis, requirements gathering, Effort Estimation, Design, development, System testing, Implementation and production support.
- Strong experience in Extraction, Transformation and Loading (ETL) data from various sources such as Flat files, Sybase, Oracle, Teradata and SQL Server Databases into Data Warehouses.
- Strong experience in developer Slow Changing Dimensions (SCD - TYPE1, SCD-TYPE2,SCD-TYPE3)
- Responsible for design and creating standards for reusable objects such as mapplets, worklets, reusable transformations and concurrent workflow execution.
- Extensive Experience with performance improvement techniques such as using partition points, reusable lookup caches, push down optimization amonothers.
- Onsite Lead/point person responsible to resolve on-going critical P1 issues and bug fixes;
- Experience working with Informatica power exchange and Informatica cloud to integrate Salesforce and load the data to Oracle database.
- Solid Experience working with Informatica cloud components such as Informatica Cloud hosting Facility, Secure Agent and Cloud Hosted Agent.
- Experience working with informatica cloud facilities such as Data Sync,Data Replication, Data Masking, Mapping configuration, Bundles, tasks and flows.
- Extensive experience developing Stored Procedures, Functions, Views and Triggers, Complex SQL queries using T-SQL for Sybase & SQL Server and PL/SQL of Oracle.
- Extensive experience in reading query plan and tuning performance of queries and stored procedures.
- Extensive experience in creating List, Range and Round Robin Partitions, creating Rules, Defaults, Types and Constraints in SYBASE ASE.
- Extensive experience in writing UNIX shell scripts used for all backend tasks like workflow execution, checking token count and file count matches, moving files and archiving files.
- Experience in using Scheduling tools like Autosys, Control-M and CA.
- Experience in and support of Oracle applications with strong analytical, technical and logical skills.
- Strong working experience with SQL, writing complex queries and PL/SQL including all database Objects: Stored procedures, Stored functions, Packages, TYPE Objects, Triggers, cursors, REF cursors, Parameterized cursors, Views, Materialized Views, PL/SQL collections.
- Experience in Dynamic SQL, Records, and Exceptional handling.
- Experience in Performance Tuning of SQL queries & Views using Explain Plan, Auto Trace, DBMSProfiler, SQL Trace and TKPROF utilities.
- Experience in Performance Tuning and Query Optimization using various types of Hints, Partitioning, Bulking techniques, and Indexes.
- Good experience with SQL Loader, Import/Export of data files, Materialized views in various types of ETL projects.
- Excellent interpersonal and communication skills, and is experienced in working with senior level managers, business people and developers across multiple disciplines.
- Strong analytical and problem solving skills. Willingness and ability to quickly adapt to new environments and learn new technologies.
- Working experience with HDFS, MapReduce, SQOOP,PIG, HIVE and Spark.
TECHNICAL SKILLS
ETL Tools: Informatica Power Center 9.5.1/9.1/8.6/8.5/8.1/7.1 , Pentaho, Informatica Cloud, Informatica BDE.
Databases: Sybase 15.7, MS SQL Server 2008/2005, Oracle 11g and Teradata 14/13.
Languages: SQL, Transact SQL, PL/SQL and UNIX - Shell scripting.
Big Data Technologies: Hive,SQOOP,PIG,SPARK
Scheduling Tools: Autosys, CA Scheduling Tool
Ticketing Tools: OPAS (BMC Remedy) and Service Now and JIRA.
Versioning Tools: Subversion(SVN), GIT Bucket, PTC - MKS Integrity (APPM).
Data modeling and SQL Tools: Rapid SQL, Toad for Sybase, Toad for Oracle, SQL Developer, Erwin
PROFESSIONAL EXPERIENCE
Confidential, New Jersey
Tech Lead Sr. Informatica ETL / Database Developer
Responsibilities:
- Responsible for design and development of daily and monthly load workflows for Asset management data warehouse.
- Responsible for data modeling of enterprise data such as organization, customer, account etc.
- Developed slowly changing Dimensions (SCD Type I and II) to manage different types of dimensional data.
- Configured Concurrent workflow execution with unique instances to run the same workflow for multiple business systems using different sources.
- Responsible for creating database and ETL standards documents and ensure all developers follow adhere to these standards.
- Review mapping documents created by team members for data flow from sources to targets.
- Worked on Migration of Jobs from CA (Legacy Scheduler) to Autosys and have good knowledge on JIL.
- Extensively used various transformations like Router, Sequence Generator, Normalizer, Update Strategy, Joiner, Filter, Stored Procedure, and Union to develop robust mappings.
- Extensively used parameters and variables to re-use mappings for multiple business units.
- Used Debugger to test mapping logic, debug and resolve transformation logic issues.
- Involved in Performance tuning at source, target, mappings, sessions, and system levels. Responsible for creating performance tuning guide for all developers to follow.
- Created Partitions & Partition points for parallel processing in different threads. (Pass-through, Key Range, Round Robin and Hash Key Partitions)
- Worked on Informatica Cloud to create Source/Target SFDC connections including monitoring and data synchronization.
- Worked with Informatica Power Exchange as well as Informatica cloud to load data to salesforce.com
- Performance Tuning of both Informatica and Database Objects.
- Worked on Analyzing the Query Plan to Identify the Performance Bottle Necks and Tuning the Database Objects to arrive at Optimum Performance.
- Created Autosys JILs and deployed monthly and Daily Calendars.
- Identifying SARG (Search Arguments) and Modifying SARGS to accommodate query optimizers to use the best query plan using indices.
- Modified specific stored procedures (producing highly volatile data) with ‘with recompile’ to avoid using a cached stored procedure query plan and to produce an Optimized Query Plan with the latest distribution data of indexes.
- Forced Indexes, by bypassing query analyzer in certain typical conditions.
- Forced Join order, by bypassing query analyzer in certain typical conditions.
- Forced the Caching strategy and overridden i/o size using perfetch to achieve the better performance by reducing the physical i/o reads.
- Redesigned transactions and changed the locking schemes to achieve the better concurrency and implemented DOL schema for high traffic tables to minimize blocks/deadlocks and improve concurrency. A 40% performance gain was observed on the processes involved.
- Recommended weekly re-indexing and update statistics activity for highly changing data base tables and recompiling the objects using these tables with help of sp recompile.
- Analyzed query to review appropriate indexes were used. Modify queries to add hints and adding indexes as needed.
- Implemented 11g and upgraded the existing database from Oracle 10g to Oracle 11g.
- Responsible for database design using ERwin.
- CreatedIndexes on the tables for faster retrieval of the data to enhance databaseperformance.
- Involved in table redesigning with implementation of Partitions Table and Partition Indexes to makeDatabaseFaster and easier to maintain.
- Partitioned fact tables andmaterialized viewsto enhance query performance.
- Extensively usedBulk collectionin PL/SQL objects for improving the performing.
- Extensively involved in usingHints to direct the optimizerto choose an optimumquery execution plan.
- CreatedMaterialized viewsand Materialized view log required for the application.
- Implemented Database security with creating & revoking Roles and assigning appropriate roles and privileges to users.
- Working with DBA’s to analyze the AWR reports and tuning queries by using the SQL PROFILE and Automatic SQL Tuning.
- Created Teradata stored procedures and functions for reporting.
- Strong hands on experience using Teradata utilities (SQL, B-TEQ, Fast Load, MultiLoad, Fast Export, Tpump, Visual Explain, Query man)
- Good knowledge on Teradata Manager, TDWM, PMON, DBQL, SQL assistant and BTEQ.
- Developed the Teradata Macros, Stored Procedures to load data into Incremental/Staging tables and then move data from staging into Base tables
- Performed high volume maintenance on large Teradata tables using MultiLoad loader utility.
- Used Fast Export utility to extract large volumes of data at high speed from Teradata RDBMS
- Developed TPump scripts to load low volume data into Teradata RDBMS at near real-time.
Environment: Informatica Power Center 9.5.1, Workflow Manager, Workflow Monitor, Mapping Designer, Transact-SQL, Sybase 15.7,SQL Server 2008,Oracle 11g,Teradata 14,PL/SQL, Erwin, Autosys, Control-M, UNIX AIX, Rapid SQL .
Confidential, New Jersey
Sr. ETL/Sybase Developer
Responsibilities:
- Responsible for Business Analysis and Requirements Collection by attending BRD Meetings with Business Analysts.
- Extracted the data from the flat files and other RDBMS databases into staging area and populated onto Data warehouse.
- Responsible for Defining and Designing, Dimension Loads and Fact Loads.
- Performance Tuning of Informatica object by analyzing the reader, writer and transformation threads.
- Defined and designed various robust mappings using transformations like LookUp, Expression, Sequence Generator, Update Strategy, Joiner, Stored Procedure, and Union, Filter, Normalizer, sql transformations.
- Worked on different tasks in Workflows like sessions, events raise, event wait, decision, e-mail task, command, worklets, Timer and scheduling of the workflow
- Developed Slowly changing Dimensions (SCD Type I, II and III ) to load the Dimension Tables .
- Resolving P1 and P2 issues during daily and monthly loads.
- Worked on Migration of Database objects from Oracle to Sybase .
- Involved in building the ETL architecture and Source to Target mapping to load data into Data warehouse.
- Involved in Performance tuning at source, target, mappings, sessions, and system levels.
- Prepared migration document to move the mappings from development to testing and then to production repositories.
- Created Database Stored Procedures for business data validation and transactional data Processing and data changes.
- Created Stored Procedures to satisfy the reporting needs of Analysts, created indexes on tables to achieve the faster data retrieval.
- Wrote triggers for the key database tables to ensure data consistency/integrity and change data capture.
- Worked on Analyzing the Query Plan to Identify the Performance Bottle Necks and Tuning the Database Objects to arrive at Optimum Performance.
- Identified and optimized the long running queries in stored procedures.
- Identifying SARG (Search Arguments) and Modifying SARGS to accommodate query optimizers to use the best query plan using indices.
- Modified specific stored procedures (producing highly volatile data) with ‘with recompile’ to avoid using a cached stored procedure query plan and to produce an Optimized Query Plan with the latest distribution data of indexes.
- Forced Indexes, by bypassing query analyzer in certain typical conditions.
- Forced Join order, by bypassing query analyzer in certain typical conditions.
- Forced the Caching strategy and overridden i/o size using perfetch to achieve the better performance by reducing the physical i/o reads.
- Prepared migration document to move the mappings from development to testing and then to production repositories.
- Redesigned transactions and changed the locking schemes to achieve the better concurrency and implemented DOL schema for high traffic tables to minimize blocks/deadlocks and improve concurrency. A 40% performance gain was observed on the processes involved.
- Recommended weekly re-indexing and update statistics activity for highly changing data base tables and recompiling the objects using these tables with help of sp recompile.
- Partitioned key tables for performance improvement
- Creating Rollout and Rollback Plan and submitting it to Release Management Team.
- Creating the Knowledge Document for Production Support and Conducting Knowledge Transition Meetings.
Environment: Informatica Power Center 9.1, Workflow Manager, Workflow Monitor, Mapping Designer Transact-SQL, Sybase, PL/SQL, SQL Server 2008,Oracle 9i,Erwin, Autosys, Control-M, Sybase, UNIX AIX, Rapid SQL .
Confidential
ETL/Informatica & Database Developer
Responsibilities:
- Understanding the Business requirements based on Functional specification to design the ETL methodology in technical specifications.
- Consolidation, standardization, matching Trillium for the unstructured flat file data.
- Responsible for developing, support and maintenance for the ETL (Extract, Transform and Load) processes using Informatica Power Center 8.5.
- Experience in integration of heterogeneous data sources like Sybase, SQL Server, Oracle and Flat Files (Fixed & delimited) into Staging Area.
- Wrote SQL-Overrides and used filter conditions in source qualifier thereby improving the performance of the mapping.
- Designed and developed mappings using Source Qualifier, Expression, Lookup, Router, Aggregator, Filter, Sequence Generator, Stored Procedure, Update Strategy, joiner and Rank transformations.
- Implemented performance tuning of Sources, Targets, Mappings and Sessions by identifying bottlenecks and used Debugger to debug the complex mappings and fix them.
- Improved session Performance by enabling property incremental aggregation to load incremental data into target table.
- Worked with Functional team to make sure required data has been extracted and loaded and performed the Unit Testing and fixed the errors to meet the requirements.
- Copied/Exported/Imported the mappings/sessions/ work lets /workflows from development to Test Repository and promoted to Production.
- Used Session parameters, Mapping variable/parameters and created Parameter files for imparting flexible runs of workflows based on changing variable values.
- Worked with Static, Dynamic and Persistent Cache in lookup transformation for better throughput of Sessions.
- Used PMCMD command to automate the Power Center sessions and workflows through netz
- Understanding the Business requirements based on Functional specification to design Database Objects.
- Identifying Entities, Attributes and relations among entities using Entity-Entity Matrix and Listing assertions to create an ER diagram followed by RM diagram.
- Developed Stored Procedures, Indexes, Views, defaults, rules, constraints and Triggers using and Sybase 12.5 and SQL Server 2008.
- Responsible for Writing Stored Procedures as per various reporting Needs of Customers.
- Responsible for Analyzing the query plans to tune the database procedures which are invoked for
- Calculating the Global financial accounts &generating the reports.
- Responsible for writing Inline Queries to be used in Front End Application code.
- Responsible for Writing triggers to get the change (CDC) to the Queue table which will be used
- By Real time jobs to process the Changed Data to SQL server from Sybase.
- Working on Production Issues and Analyzing the Root cause and fixing them.
- Updated the locking schemes to achieve the maximum concurrency.
- Identified the Keys and created indexes to achieve the performance.
Environment: Informatica Power Center 8.5, Sybase, SQL Server 2005, Transact SQL, Autosys, Contrl-M, UNIX, Windows 2000
Confidential
Database Developer & L3 Support Associate
Responsibilities:
- Developed Triggers to find the cdc and insert them to CDC queue which used by ETLs to bring Rating data from Various Source databases.
- Developed stored procedures for the display logic of the application as per the requirement document.
- Defined User defined data types to maintain same format throughout the system.
- Analyzed the query plan to document the statistics to look for performance benefits.
- Defined clustered unique Indexes and Non clustered indexes wherever needed to improve the performance of the queries in the procedures.
- Developed Unix shell scripts to compare and bring delta of look up tables data from the source systems to target data bases with the help of isql and other basic Unix commands.
- Developed shell scripts to implement data feed to the target databases using bcp and other basic Unix commands like sed, awk, grep ..Etc.
- Recommendation of Re-indexing activity on a regular basis for the tables on which indexes are defined.
- Defining the roll out plan and presenting it to release management to schedule the releases.
- Scheduling and conducting Knowledge Transfer sessions with Level1 and Level 2 production support Teams
Environment: Sybase, Unix AIX,SQL Server, Rapid SQL .