We provide IT Staff Augmentation Services!

Etl Architect/senior Etl Developer/hadoop Developer Resume

5.00/5 (Submit Your Rating)

Atlanta, GA

EXPERIENCE SUMMARY:

  • 12+ years of IT industry experience with nine plus years in ETL at design and architecture level.
  • A self - starter with reputation for high quality deliverables, expertise in d Confidential and solutions architecture and a heavy focus on client satisfaction.
  • Experience working with Hadoop HDFS/Apache NiFi/Hive/Spark/Sqoop/HBase/Phoenix/Pig/Informatica BDE to ingest d Confidential and process d Confidential and made it available for applications/ d Confidential analytics team to access via HBase Rest API or Hive SQL or export to RDBMS or generate visualization reports.
  • Proficient in business analysis, technical design, implementation, testing and support in d Confidential warehousing, business intelligence and d Confidential integration projects.
  • Eight years of experience in leading, and onsite/offshore delivery model.
  • Hands on experience working with various d Confidential warehouse and business/d Confidential intelligence technologies like Informatica, Hadoop, Tableau, OBIEE, Oracle, MS SQL server etc.
  • Expertise in Airline, Banking and Telecom domains.
  • Able to coordinate and direct all phases of project based efforts while managing and leading project team and excellent on onsite offshore model coordination.
  • D Confidential modeling experience in using Erwin/Power Designer for Dimensional D Confidential modeling and Star/Snowflake Schema modeling and 3NF ER modeling.
  • OBIEE Report/Dashboard Design and RPD creation/modification.
  • Experience in design and deploy rich Graphic visualizations with Drill Down and Drop down menu option and Parameterization using Tableau.
  • Created re-usable java transformation/java code to parse json messages, read logs from splunk using rest API.
  • Exposed Hadoop d Confidential as a service in java. D Confidential service will provide d Confidential to the UI or RDBMS depending on the requests.
  • Experience in going through Yarn logs for trouble shooting.
  • Used Informatica and Curl scripts to read from and write d Confidential into SharePoint.
  • Used Informatica big d Confidential plug in to load d Confidential into Hadoop HDFS/Hive Tables.
  • Worked on projects handling huge volumes like 1+ billion records every run and provide d Confidential in HBase or Oracle 11g/12c.
  • Used Apache NiFi for real timed Confidential ingestion into Hive Tables and send integrated d Confidential set files to vendors.
  • Experienced in working with structured d Confidential using Hive QL, join operations, Hive UDFs, partitions, bucketing and internal/external tables.
  • Implemented the workflow and coordinator files using Oozie framework to automate tasks.
  • Created functions and stored procedures to scan through 3 billion records and provide search results in less than 3 seconds.
  • Worked on preparing project kick off decks, Requirement Traceability Matrix, Technical Design Document, Source to Target Mapping documents, Unit test cases, System test plans and test cases, Support Manuals, User guide documents for different projects
  • Understanding & working knowledge of Informatica Confidential (Change D Confidential Capture) Implementation experience of Confidential using stored procedures, triggers and using informatica power exchange.
  • Experienced with Informatica D Confidential Explorer (IDE) / Informatica D Confidential Quality (IDQ) tools for D Confidential Analysis / D Confidential Profiling.
  • D Confidential Quality Analysis to determine cleansing requirements.
  • Worked with Informatica Developer and Analyst tool to create/manage DQ rules, scorecard, rule/column profiling and DQ transformations like matching, address validation, parser, standardization etc
  • Good knowledge of Informatica Administration, involved in grid management, creation and up gradation of repository contents, creation of folders and users and their permissions.
  • Strong Experience in Informatica - Design, Work Flow Manager, Repository Manager, Monitor and other tools used in the Transformation and Mapping, Migration, Transaction and Batch processing.
  • Expertise in OLTP/OLAP system study, Analysis and developing D Confidential base Schemas like star schema and snowflake schema used in relational, dimensional and multidimensional modeling.
  • Experience in Agile development environment and participated in Scrum meetings.
  • Prepare project estimates, delegation of tasks and duties to team members.
  • Excellent time management skills with reputation of meeting deadlines.
  • Knowledge of coding ETL Tasks in UNIX Shell scripts.
  • Used Terad Confidential Fast Load and Multi Load Utilities and developed BTEQ scripts to process d Confidential within Terad Confidential d Confidential base.
  • Experience in using Autosys and Informatica Scheduler for scheduling Workflow sessions.
  • Experience in integration of various d Confidential sources with Multiple Relational D Confidential bases like Oracle, DB2, SQL Server, My Sql, Terad Confidential and Worked on integrating d Confidential from flat files like fixed width and delimited.
  • Extensively worked with Oracle, PL/SQL Stored Procedures, and Functions and involved in Query Optimization.
  • Defined the program specifications for the Confidential /conversion programs, as well as the necessary test plan

TECHNICAL SKILLS:

ETL Tools: Informatica 7.x/8.x/9.x

Big d Confidential: Hive 1.2.1, Hbase 1.1.2.2.5.3.0-37, HDFS, NiFi 1.2.0, Pig 0.16.0.2, oozie

Reporting Tools: OBIEE 10g/11g/12c, Tableau 10.1

Methodologies: Star Schema, Snow Flake Schema, 3NF

D Confidential base/D Confidential warehouse: Oracle 9i/8i/10g/11g/12c, SQL server 2005, DB2, Terad Confidential, Netezza 7.0

Languages: SQL, PL/SQL, Java, JSP, ASL, JCL, TPF, UNIX shell Scripting, XML

Operating System: Windows 9X/2k, Windows NT

D Confidential Modeling: Erwin 4.3, Power Designer 16

Scheduler Tools: Autosys, Control M

Change Management: HP Quality Center, UET

D Confidential base tools: Toad, SQL Developer, Terad Confidential SQL Assistant

Load Utilities: BTEQ, FastLoad, FastExport, MLoad, TPump, SQL

PROFESSIONAL EXPERIENCE:

Confidential, Atlanta, GA

ETL Architect/Senior ETL Developer/Hadoop Developer

Responsibilities:

  • Responsible for controlling project requirements, scope, and change management issues.
  • Ability to define and implement approaches to load and extract d Confidential from multiple d Confidential sources.
  • Created Logical & Physical models and used Erwin/Power Designer for d Confidential modeling.
  • Conducted D Confidential model/Design reviews and validated the tables, columns and d Confidential types to meet the requirements.
  • Created re-usable java transformation/java code to parse json messages, read logs from splunk using rest API.
  • Used Informatica and Curl scripts to read from and write d Confidential into SharePoint.
  • Used Informatica big d Confidential plug in to load d Confidential into Hadoop HDFS/Hive Tables.
  • Used Sqoop to import and export d Confidential between Oracle/MySQL and Hive Tables.
  • Implemented Partitioning, Dynamic Partitions and Buckets in HIVE for efficient d Confidential access.
  • Refined the Website clickstream d Confidential from Omniture logs and moved it into Hive.
  • Code reviews of Informatica Mapplets, Mappings, and Workflows. Test with negative d Confidential, Unit testing
  • Analyzing existing d Confidential base schemas and designing star schema models to support the users reporting needs and requirements.
  • Extract d Confidential from Flat files and Oracle D Confidential base using Informatica.
  • Extensively used ETL to load d Confidential from Flat files which involved both fixed width as well as Delimited files and also from the relational d Confidential base.
  • Developed Shell scripts for ftp-ing, renaming and creating list for indirect file processing
  • Designed and developed complex aggregate, join, look up transformation rules (business rules) to generate consolidated (fact/summary) d Confidential identified by dimensions using Informatica ETL tool.
  • Extensively worked on tuning and improving the load time as well query processing time.
  • Used transaction control, SQL transformations to generate multiple files dynamically and scheduled to deliver the report to Email DL.
  • Experienced with Informatica D Confidential Explorer (IDE) / Informatica D Confidential Quality (IDQ) tools for D Confidential Analysis / D Confidential Profiling.
  • D Confidential Quality Analysis to determine cleansing requirements.
  • Worked with Informatica Developer and Analyst tool to create/manage DQ rules, scorecard, rule/column profiling and DQ transformations like matching, address validation, parser, standardization etc.
  • Reviews and ensures the work products are delivered within agreed schedule/quality
  • Worked with the Testers in writing test cases and validated test Cases prepared by them.
  • Take personal responsibility while delivering the complex d Confidential objects.

Confidential, Chicago, IL

ETL Architect/Senior ETL Developer/Analyst/Onsite Lead

Responsibilities:

  • Responsible for controlling project requirements, scope, and change management issues.
  • Ability to define and implement approaches to load and extract d Confidential from multiple d Confidential sources.
  • Involved in creating Logical & Physical models and used ER win for d Confidential modeling.
  • Involved in D Confidential model/Design reviews and validated the tables, columns and d Confidential types to meet the requirements.
  • Designed and developed complex aggregate, join, look up transformation rules (business rules) to generate consolidated (fact/summary) d Confidential identified by dimensions using Informatica ETL tool.
  • Code reviews of Informatica Mapplets, Mappings, and Workflows Test with negative d Confidential, Unit testing
  • Analyzing existing d Confidential base schemas and designing star schema models to support the users reporting needs and requirements.
  • Created and Scheduled sessions & Worklets using workflow Manager to load the d Confidential into the Target D Confidential base
  • Extract d Confidential from Flat files and Oracle D Confidential base using Informatica.
  • Used NZSQL and NZLOAD scripts for d Confidential loading into Netezza.
  • Developed number of Complex Informatica Mappings, Mapplets and Reusable Transformations to facilitate Daily, Monthly and yearly Loading of D Confidential .
  • Automated the jobs through Scheduling using built in Informatica Scheduler.
  • Extensively used Source qualifier, Aggregator, Filter, Joiner, Expression, lookup, Router, Sequence Generator, Update Strategy, Union and SQL transformations to create mappings
  • Extensively used ETL to load d Confidential from Flat files which involved both fixed width as well as Delimited files and also from the relational d Confidential base.
  • Implemented Slowly Changing Dimensions (SCDs, Both Type 1 & 2).
  • Extensively worked on tuning and improving the load time as well query processing time for different d Confidential bases like Oracle, MySQL, MS SQL Server and Netezza.
  • Query tuning in Netezza using various techniques involving distribution analysis, d Confidential -type analysis, configuration parameters etc.
  • Improved the Informatica Mappings and Session performance by eliminating extensive cache usage transformations, modifying session properties and partitioning the mapping.
  • Used Error Handling Mapplet to capture error d Confidential into PMERR tables for handling nulls, analysis and error remediation Process.
  • Documented the workflow dependencies and ordering for Autosys job scheduling process.
  • Used Autosys Job Scheduling software for batch Scheduling.
  • Interacted with the SME to implement requirements without affecting performance of the process.
  • Coordinate the resolution of any issues with delivered customizations with other teams and onsite/offshore team.
  • Reviews and ensures the work products are delivered within agreed schedule/quality
  • Worked with the Testers in writing test cases and validated test Cases prepared by them.

Environment: Informatica Power Center 9.1/8.6, Power Exchange, Auto Sys, HP UNIX, Netezza 7.x, Windows XP, Confidential Mainframe, Oracle 9i/10g, DB2, Erwin, SQL, PL/SQL, SQL * Loader, TOAD.

Confidential

Senior ETL Developer

Responsibilities:

  • Worked with D Confidential Modeler to understand the Business Requirements and Business Rules.
  • Prepared ETL Specifications to help develop mapping.
  • Extracted d Confidential from various sources (Flat files, SQLServer, Terad Confidential, DB2 D Confidential bases).
  • Designed and developed Informatica Mappings and sessions based on business user requirements and business rules.
  • Worked extensively on Source Analyzer, Mapping Designer, and Warehouse Designer
  • Developed several Mappings using corresponding Sources, Targets and Transformations.
  • Developed ETL Mappings in Informatica for Confidential /conversion.
  • Creating source and target table definitions using Informatica Designer. Source d Confidential was extracted from Flat files, SQLServer and DB2, Terad Confidential D Confidential bases
  • Analyzing the source d Confidential and deciding on appropriate extraction, transformation and loading strategy.
  • Analyzed business process workflows and assisted in the development of ETL procedures for moving d Confidential from source to target systems.
  • Created mappings to read from Flat files, DB2, Terad Confidential and Oracle to load into RDBMS tables.
  • Involved in writing BTEQ scripts for creating staging tables & inserting test d Confidential as per requirement in Terad Confidential .
  • Based on business Rules Debugged code, tested and validated d Confidential after processes are run in development.
  • Used Autosys Job Scheduling software for batch Scheduling.
  • Modified the existing mappings for the updated logic and better performance
  • Developed Logical D Confidential Flow Diagrams in Visio for every mapping that is developed.
  • Assisted QA Team to fix and find solutions for the production issues.
  • Used UNIX Shell scripts in coding ETL Tasks.
  • Creating Terad Confidential scripts (Multiload), Fast Load, JCL’s, BTEQ Scripts

Environment: Informatica 7.1.2 (power center), Repository Manager, Oracle 10g, SqlServer2005, DB2, Terad Confidential, Ms-Word, Excel, Terad Confidential SQL Assistant.

Confidential

ETL Developer

Responsibilities:

  • Involved in ETL - Low Level Design, Coding and Unit Testing Phases
  • Understanding the source systems.
  • Understanding the business requirements from External Design and preparing Internal Design.
  • Creation of Informatica Mapping for ETL processing of inbound feeds & other sources to EDW.
  • Mockup of Unit Test D Confidential (only for some of the mappings)
  • Creation of Unit Test Plans (UTP), Unit Cases (UTC’s), Unit Test Scripts with captured unit test results.
  • Taken care of all the mandatory checks for all distinct field types- Date Field, Number field and etc.
  • Developed shell scripts to run Informatica workflows using PMCMD command.
  • Responsible for monitoring all the sessions that are running, scheduled, completed and failed. Debugged the mapping of the failed sessions.
  • Defect tracking and d Confidential fix.
  • Resolving escalated issues.
  • Carrying out Health-Checks after every release
  • Sending status reports

Environment: Informatica Power Center 7x, Oracle, TOAD, Erwin, SQL, PL/SQL, Windows XP, HP UNIX, HP Quality Center, Control M

Confidential

Java Developer

Responsibilities:

  • Meeting government officers and gathering requirements by discussing their process.
  • Developed functional and technical specification documents.
  • Used Altova XMLSPY to generate XML schemas.
  • Developed a desktop tool to generate XML Schemas and Web Services Description Language (WSDL) files for each web service based on the defined d Confidential standards.
  • Jave/J2EE web services programming using Eclipse IDE.
  • Performed d Confidential base operations using PostgreSQL.
  • Develop test plans and perform unit test, integration test and regression test.
  • Developed flow diagrams for the steps involved in registration to final committee approval.

Environment: JSP, Java Servlets, Web Services, SOAP, HTML, XML, PostgreSQL, Apache Tomcat, Windows XP

We'd love your feedback!