PROFESSIONAL SUMMARY:

• 9+ years of IT experience with expertise in Analysis, Design, Development, Implementation, Modeling, Testing, and support for Data warehousing applications.
• 2+ years of experience with Hadoop Development using components HDFS, MR2, Yarn, Hive, Sqoop, Flume, Oozie, Hbase, Pig, and Zookeeper. 
• Strong experience in designing and developing solutions in Data Warehousing/Decision Support Systems using Informatica Power Center, Oracle and Unix.
• Experience with Project Scoping, Estimation, Production Support and Offshore Co - ordination.
• Expertise in working with ETL Architects, Data Analysts and data modelers to translate business rules/requirements into conceptual, physical and logical dimensional models and worked with complex normalized and denormalized data models.
• Good understanding of Hadoop architecture and core components such as Name Node, Data Node, Resource Manager, Node Manager and other distributed components in Hadoop platform. 
• Good understanding on data extraction, transformation and load in Hive, Pig and HBase and experience with data transformation from HDFS, HIVE, PIG, HBase, and Oracle.
• Expertise in the Analysis, Design and Development of Software Applications and providing Data Integration/Warehousing solutions using Kimball Methodologies.
• Strong understanding of the principles of DW using Fact Tables, Dimension Tables and Star Schema modeling with knowledge of database architecture for OLTP and OLAP applications.
• Proficient in the Integration of various data sources with multiple relational databases like Oracle11g, MS SQL Server, Teradata, VSAM files and Flat Files into the staging area, ODS, Data Warehouse and Data Mart.
• Expertise in developing Mappings and Mapplets, Sessions, Workflows, Worklets and Tasks using Informatica Designer, Workflow Manager and Batch processes using PMCMD command.
• Experience in Performance Tuning and Debugging of existing ETL processes.
• Worked on various performance optimizations like using distributed cache for small datasets, Partition, Bucketing in Hive and Map Side joins. 
• Expertise working with Stored Procedures, Database Triggers, Functions and Packages.
• Worked with UNIX shell scripting for enhancing the job performance.

TECHNICAL SKILLS:

ETL Tools: Informatica Power Center 9.51./8.x/7.1.4, Power Exchange.

Databases: Oracle 11g/10g/9i, SQL Server 2010, Mainframe DB2, MS Access.

Big Data Tools: Hadoop/Big Data HDFS, MapReduce, HBase, Pig, Hive, Sqoop, Hadoop Streaming, Oozie, Zookeeper, Flume, Spark, Strom, Kafka.

Languages: SQL, PL/SQL, UNIX, Shell Scripting, XML

Operating Systems: UNIX, AIX, LINUX, Windows NT/2010/XP, MS-DOS

Data Modeling Tools: Erwin 7.1, MS Visio, Toad Data modeler

Scheduling Tools: Control-M, Autosys

Query Tools: TOAD for Oracle, TOAD for DB2, SQL Navigator, DB Artisan.

BI/OLAP Tools: OBIEE, Business Objects XI r2 6.1/5.1

PROFESSIONAL EXPERIENCE:

Confidential, NY

Sr. ETL Hadoop Developer

• Involved in development of full life cycle implementation of ETL using Informatica, Oracle and helped with designing the Date warehouse by defining Facts, Dimensions and relationships between them and applied the Corporate Standards in Naming Conventions.
• Involved in complete BigData flow of the application starting from data ingestion from upstream to HDFS, processing the data in HDFS and analyzing the data. 
• Work Closely with QA and Prod support team by providing components, documentation, validation and Knowledge transfer on new projects and debugging on issues
• Design and develop ETL code using Informatica Mappings to load data from heterogeneous Source systems like flat files, XML’s, MS Access files, Oracle to target system Oracle under Stage, then to data warehouse and then to Data Mart tables for reporting.
• Developed ETL with SCD’s, caches, complex joins with optimized SQL queries.
• Created workflow instances, and improved the performance with large data using round robin, Key range partitions, pushdown optimization.
• Developed and tuned Hadoop Map Reduce programs to analyze the data, populate stage tables and store the refined data into partitioned tables in the EDW. 
• Worked on importing and exporting data from Oracle data into HDFS using SQOOP for analysis, visualization and to generate reports. 
• Creating Hive external tables and partitioned tables using Hive Index, and used HQL to make ease of data analytics.
• Provided Oracle development solutions as SQL loader, merge logic with insert/update, views, Materialized views, and generated PLSQL blocks with procedures, functions and cursors.
• Used TOAD to create, execute and Optimized SQL queries to analyze the data, provide support to BA’s, and create various DDL and DML scripts on daily activities.
• While processing huge data, optimized the performance with database partitioning, partition exchange, hints, DOP, drop/rebuilding the indexes and gather stats on the tables/partitions.
• Write MapReduce programs to perform data cleansing, transformation and joins.
• Write ETL jobs using PIG Latin and Worked on tuning the performance of HIVE queries.
• Create HIVE queries to join multiple tables of a source system and load them into Elastic Search Tables and used HIVE QL scripts to perform the incremental loads.
• Using SQOOP to move the structured Oracle data to HDFS, HIVE, PIG and HBase.
• Experience in managing Hadoop Jobs and logs of all the scripts. And, Using Oozie to schedule the workflows to execute the batch job. 
• Using shell scripts to perform ETL process to call sql or pmcmd commands, pre-post ETL process like file validation, zipping, massaging and archiving the source and target files, and used UNIX scripting to manage the file systems.
• Automation and scheduling of Oracle, Informatica and MapReduce batch jobs using Control-M application that are scheduled with file watchers, daily, weekly and on special requests.
• Used Tortoise SVN as version control tool to maintain the code.
• Work closely with Platform service Teams for setup Dev, QA environments based on the configurations, create data refreshment, creating the future partitions, configuring Environment variables to accommodate the framework and help with handshake testing.
• Participate in migrate the code from Development to Test, Production and provided various migration documentations like Environment preparation, deployment components, Batch execution instructions and DFD’s for jobs.

Environment: Informatica Power Center v9.5.1, Oracle 11G, PL/SQL, XML, UNIX, Toad, Control-M, HP ALM, SVN, Hadoop, HDFS, Hive, Pig, Sqoop, MapReduce, Cloudera, Oozie, HBase. 

Confidential, Newark, NJ

ETL Developer

• Coordination with the EWAM core team and business units as required for requirements, solution, testing and training.
• Responsible for Design and Development of ETL and Technical Design documents for Informatica mappings with the High level DFD’s, Process flow description, Source to Target row level transformation logic, performance tuning, and scheduling.
• Worked with BI Developer to understand the Business Requirements and created Mockup reports for end user reports using Microstrategy that includes Dashboards and Report Documents.
• Designing the database structure for data staging area and loading the BW data in to Warehouse via ODS.
• Extensively used the transformations in Informatica power designer including lookups, Stored Procedures, Update Strategy and created Workflows containing multiple tasks like session, command, email, Event wait and Event Raise and Batch processes using PMCMD command.
• Used Informatica features to implement Type 2 changes in slowly changing dimensions to update the data in dimension tables.
• Tuned performance of Informatica session for large data files by increasing block size, data cache size and target based commit interval. Worked with short cuts for various Power Center objects like sources, targets and transformations.
• Performed error handling of sessions by using terse, normal, verbose initialization and verbose data tracing levels. Used Workflow Instance for parallel execution of same code with multiple parameters and variables.
• Fine Tuned SQL queries and PL/SQL blocks for the maximum efficiency and fast response using Oracle Hints, Explain plans and Trace sessions with Cost and Rule based optimization.
• Created Views and materialized views on the Fact tables for reporting teams.
• Created stored procedures and packages in Oracle as a part of the pre and Post ETL process.
• Create Repository, Users and Groups. Analyze and import the Source definitions.
• Coordinated with DBA’s in resolving the database issues that lead to production job failures.
• Involved in Data validation, cleansing, profiling, system integration test, and UAT.
• Worked Closely with QA team for Functional, and User testing by providing components, documentation, validation and Knowledge transfer on ETL design and debugging on issues.
• As part of QA and Production support, provided the DDL’s, DML’s, and validation scripts, and provided L3 support in non-dev environments to resolve the issues.
• Involved in Creating test plan validation documents and worked on Clear Quest for defect tracking.

Environment: Informatica Power Center 8.6.1, Oracle 10g, PL/SQL, TOAD 9.7, SQL Server 2008, Toad Data modeler 4.1, UNIX (AIX), Power Exchange, Clear Quest.

Confidential, Saint Louis, MO

ETL Informatica Developer

• Responsible for preparing Technical Design documents for ETL Mappings for new requirements or the changes in the existing code. Includes Requirement gathering, Analysis, Design, Development, and Testing.
• Involved with source systems owners, day-to-day ETL progress monitoring, Data warehouse target schema design (star schema), maintenance and support.
• Prepared ETL Design documents for Informatica mappings provided the High level DFD’s, Process flow description, Source to Target row level transformation logic, performance instructions, and scheduling.
• Directed the offshore team on daily bases to resolve the development issues through Communication Tracker, and helped the team with Informatica issues like connectivity, permissions, database access etc.
• Extensively worked on multiple sources like Oracle 10g, Teradata, MS SQL server, Sybase, XML and delimited flat files and loaded into Oracle and DB2.
• Extensively used the transformations in Informatica power designer including lookups, Stored Procedures, Update Strategy and created Workflows containing multiple tasks like session, command, email, Event wait and Event Raise and Batch processes using PMCMD command.
• Fine tuned Transformations and mappings for better performance.
• Moving the required source files, Request for table refreshment from the PROD, Database connections, FTP connections, and configuring the access level for the development team.
• Extensively used TOAD to test, debug SQL and PL/SQL Scripts, packages, stored procedures and functions. And TOAD for DB2 to manage the DB2 database.
• Created Autosys JILs, and scheduled the jobs to run the shell scripts to execute the SQL and Workflows.
• Responsible for Code Migration in to various environments like Testing, staging and Production.
• Maintained warehouse metadata, naming standards and data warehouse standards for future application development.
• Tuned performance of Informatica sessions for large data files by increasing block size, data cache size, sequence buffer length and target based commit interval.
• Involved in fine-tuning SQL overrides for performance Enhancements.
• Checked Sessions and error logs to troubleshoot problems and also used debugger for complex.
• Worked on Parameterize of all variables, connections at all levels in UNIX.
• Involved in the designing and Building of Universes, Classes and objects using Business Objects.
• Performed Developer testing, Functional testing, Unit testing and created Test Plans and Test Cases.

Environment: Informatica Powercenter 8.1.1, Oracle 10g, Mainframe DB2, UNIX, TOAD 9.7, TOAD for DB2, Shell Scripting, Autosys, SQL Navigator, XML, Erwin 7.1.

Confidential, Charlotte, NC

ETL Informatica Developer

• Extensively involved in writing ETL Specs for Development and conversion projects.
• Involved in analysis of business requirements from the Data Management group for the newly identified external and internal source data for various business units.
• Responsible for developing, support and maintenance for the ETL (Extract, Transform and Load) processes.
• Involved in analyzing the source data coming from different Data sources such as Oracle, SQL Server, DB2 UDB, Teradata and identifying data anomalies in the source data.
• Coordinated with Business Users and the Offshore Development Team for solving design issues and requirements understanding for the coding phase.
• Extensively created complex mappings using transformations like Filter, aggregator, update strategy, lookup, router, stored procedure, sequence generator, XML and joiner using Informatica Power Center 8.1.1.
• Implemented slowly changing dimensions Type 2 using date.
• Scheduled the Jobs to run at particular time/interval thru the Scheduler using Workflow Manager.
• Created tasks like Session, Decision, Email, Command, Event Wait, Event Raise and Control tasks in preparing the Workflow.
• Successfully moved Sessions and Batches from the development to production environment.
• Wrote several stored procedures for recycling and other extraction purposes.
• Created reusable Mapplets and Transformations to reduce the complexity in mappings and to handle repetitive tasks such as setting and getting Dimension details.
• Involved in Performance tuning at various levels including Target, Source, Mapping, Session for large data files.
• Designed and Developed UNIX Shell scripts to enhance the functionality of ETL application.
• Redesigned some of the mappings and mapplets in the system to meet new functionality.
• Enabled incremental loading in fact table mappings and made required changes to the mappings to populate the production data.
• Worked on 24/7 on call production support environment weekly on call rotation basis between the Production Support Developers in the team.
• Prepared project documentation, Program Specifications, Test Cases and Participated in the complete SDLC.

Environment: Informatica Power Center 7.1.4, Power Connect, Oracle 10g, PL/SQL, TOAD, Teradata V2R5, IBM DB2, VSAM, BTEQ, SQL Server 2005, DBArtisan 3.5, UNIX (AIX), Windows NT.