We provide IT Staff Augmentation Services!

Sr. Etl Developer/architect Resume

Auburn Hills, MI

SUMMARY

  • 8+ years of IT industry experience in ETL and Analytical Reporting Application Development with a very strong background in Data Modelling, Data Analysis, Data Warehousing/Integration and Business Intelligence.
  • Around 8 years of experience in development and implementation of full life cycle of Data Warehousing, Data Integration & Business Intelligence Projects for Confidential .
  • 8 years of experience as IBM DataStage 8.5/11.3/11.5 , Dimensional modelling using Power designer, SQL programming, SQL/PLSQL, BigData - Hadoop, Spark, Scala, Pig, Hive, UNIX Shell script, Business Objects, Cognos and Qlik Sense developer in Confidential .
  • Extensively used DataStage Enterprise Edition/Parallel Extender stages namely DB2 connector, SCD, Datasets, Sort, Merge, Join, Aggregator, Transformer, Lookup, Change Capture, Funnel, Row Generator stages in accomplishing the DataStage Coding.
  • Expertise in strategies and design of DataStage jobs for large volume Data Warehouses.
  • Have very good experience on DataStage migration projects. Worked on migrating ETL projects from IBM Ascential DataStage 7.5 to Infosphere 8.5 version in year 2012.
  • Have worked on migrating ETL projects from IBM DataStage 8.5 to DataStage 11.3/11.5 in 2014.
  • Have worked on converting high volume legacy see commerce system for Mopar suppliers to BI using DataStage ETL. New relational DB2 tables, automated DataStage jobs to load these tables were developed as a part of this conversion project.
  • Possess excellent experience in writing complex algorithm-logic in ETL DataStage.
  • Very good experience in re writing and converting legacy ETL systems which were built on UNIX, stored procedures into a rapid processing system using IBM DataStage.
  • Extensive experience in development, debugging, troubleshooting, monitoring and performance tuning using DataStage Designer, DataStage Director, DataStage Administrator.
  • Experienced in writing optimized complex extraction queries to extract data from different databases.
  • Successfully executed data restructure projects as well as database migration to DB2 9.7 for various BI projects.
  • 8 years of experience in Designing, Maintaining & Tuning side of ETL DataStage jobs, Cognos reports, Qlik Sense analytical visualization dashboards, Business Objects reports.
  • Proficient in SQL programming and RDBMS.
  • Good Knowledge in OLAP Concepts and Designing Data model (Star schema and Snowflake schema).
  • Have worked on Data Modeling tool using (Sybase Power Designer).
  • 5 years of experience in developing SAP business objects Business Objects XIR2/XIR3 reports and universe design.
  • Expert in DB2 SQL, creation of tables. Creation of mart and warehouse.
  • Excellent experience in writing UNIX shell scripts.
  • Very good experience on working with Slowly Changing dimension stage for implementing slowly changing dimensions.
  • Developed Spark code using Scala and Spark-SQL/Streaming for faster testing and processing of data.
  • Responsible for importing data to HDFS using Sqoop from different RDBMS servers and exporting data using Sqoop to the RDBMS servers after aggregations for other ETL operations.
  • Written Spark applications using Scala to interact with the MySQL database using Spark SQL Context and accessed Hive tables using Hive Context.
  • Involved in creating Hive Tables, loading data and writing Hive queries.
  • Knowledge on handling Hive queries using spark SQL that integrate with spark environment implemented in Scala.
  • Good experience with Qlik Sense application design and development.
  • Developed Qlik sense Load scripts for distribution across multiple data sources.
  • Involved in daily interactions with the Business to understand their requirements and act in a Business Liaison role.
  • Worked as Technical Lead and have an experience of 6 years of managing BI team of size 10 in Confidential .
  • Have a good experience to handle aggressive timelines, deliverables and to work in a fast-paced environment with quick turnaround.
  • A team player with exemplary communication, analytical and problem-solving skills.

TECHNICAL SKILLS:

BI Tools: IBM Infosphere DataStage- 7.5,8.5, 11.3/11.5, Informatica, Big data Hadoop, Sparks, HIVE, Pig, Sqoop. Cloudera CDH 5

Reporting Tools: Cognos 10, SAP Business Objects XIR2/XIR3, Qlik Sense, QlikView

Data model Tool: Sybase Power Designer

Data Bases / Software: IBM DB2 9.7, 10.5, Oracle, Teradata, MS Access, DBMS/RDBMS

Languages: SQL, PL/SQL, C, C++, UNIX Shell Script

Office Tools: MS OFFICE, Access, Excel, MS Project, Visio, PowerPoint

Platforms: UNIX, Windows, Vista 7

PROFESSIONAL EXPERIENCE:

Confidential, Auburn Hills, MI

Sr. ETL Developer/Architect

Responsibilities:

  • Leading the data migration project from Mainframe legacy system into Salesforce Objects using DataStage.
  • Working with Business and Analysts to understand the system and create mapping document and business rules for the data migration task into salesforce.
  • Created complex ETL Strategies to implement File based integration with Salesforce and other operational systems and third party vendors.
  • Created ETL strategy to read data from Jason files shared by web services and push the data into salesforce objects incorporating data transformations and applying business rules on them.
  • Completed Design document, UAT sign off document and generated test results.

Confidential, Troy, MI

Sr. ETL / Datawarehouse Developer

Responsibilities:

  • Leading implementation of this EDW data integration project.
  • Daily interaction with business for requirement gathering, design analysis, development, UAT meeting and launch.
  • Responsible for defining business rules for each KPI and preparation of source to Target mapping document for Landing, Core and semantic layer databases.
  • Building data model to inhouse ERP data into EDW system.
  • Providing ETL solution using Teradata, Informatica PowerCenter, IBM Infosphere DataStage 11.5 to bring Data from different SAP ERP systems into Enterprise Datawarehouse.
  • Writing sql queries in Teradata to bring data from staging database layer into core and semantic.
  • Design SAP Business Objects Universes to support business reporting system.
  • Build Qlik Sense dashboard to provide visualization of spend metrics to end customers.

Confidential, Auburn Hills, MI

Sr. ETL / Datawarehouse Developer

Responsibilities:

  • Designed and developed Data Integration, Workflow Solutions and Extract, Transform and Load (ETL) solutions for data warehousing.
  • Created complex ETL Strategies to populate the Data-mart facts and Dimensions and RDBMS models.
  • Completed end to end load automation.
  • Debugged the existing functionality to correct and improve performance.
  • Changed the structure of the tables in the database model to improve the performance for retrieving the data.
  • Analyzing the existing informational sources and methods, understanding the customer expectations and identifying the problem areas.
  • Identified business needs, evaluated business and technical alternatives, recommended solutions and participated in their implementation.
  • Analysis of the Business Rules and Mappings. Analyzed the SLD and implemented the same in the jobs.
  • Worked on analyzing data from different ODS systems.
  • Participated in the design and development of data mart for the new system and mappings between sources and operational staging targets by identifying suitable Fact and Dimensional tables for the schema.
  • Defined Environment variables for the Projects by using Administrator.
  • Developed DataStage server/Parallel jobs to extract, transform and load data into data Warehouse from various sources like relational databases (DB2)
  • Used the DataStage Designer to develop processes for extracting, cleansing, transforming, integrating, and loading data into data warehouse database.
  • Generations of Surrogate IDs for the dimensions in the fact table for indexed, faster data access.
  • Created the test cases to identify bugs.
  • Involved in Integration, testing and functional testing.
  • Tuned performance to cut down the DataStage process time.
  • Developed BO reporting universes and BI reports.
  • Conducted User Acceptance Testing (UAT) to support the UAT process and answer/clarify any questions raised by business users, testing team and functional architects.
  • Re designed and enhanced data model to cut down processing time of business critical Cognos reporting applications.

Confidential, Auburn Hills, MI

ETL/DataStage Developer

Responsibilities:

  • Led end to end implementation of this warehousing project. Have been involved in each phase of project development cycle starting from requirement gathering from business, design analysis, development, UAT meeting and launch.
  • Document all necessary KPI metrics and their business rules by conducting recursive meetings with business.
  • Logical/Physical data model design. ETL business rule mapping, ETL data flow diagram.
  • Used the ETL Data Stage Designer to develop processes for extracting, cleansing, transforms, integrating and loading data into data warehouse database.
  • Developed Parallel Jobs using various Development / Debug Stages (Peek Stage, Head and Tail Stage, Row generator stage, Column generator stage, Sample stage) and Processing Stages (Aggregator, Change Capture, Change Apply, Filter, Sort and Merge, Funnel Remove Duplicate Stage).
  • Extract data from Operational source systems to staging area.
  • ETL Jobs development to pull data from staging area, ODS, process and load into warehouse/mart tables.
  • Unit and Integration testing of DataStage Jobs as per the test cases provided by client.
  • Creation of Business Objects universes/reports from these data marts. These reports will have the live data would be accessed by all Confidential dealer through Dealer Connect portal.

Confidential, Auburn Hills, MI

ETL Hadoop Developer

Responsibilities:

  • Performed Data analysis, developed strategy to integrate data from Order processing and allocation systems.
  • Worked as Technical lead for end to end implementation of this warehousing project. Have been involved in each phase of project development cycle starting from requirement gathering from business, design analysis, development, UAT meeting and launch.
  • Used DataStage Designer for developing various jobs to extract, cleansing, transforming, integrating and loading data into Data Warehouse.
  • Prepared ETL flow, mapping design document.
  • Created Data model for Hive tables to store data coming from different operational data stores.
  • Used Hive to analyze the partitioned and bucketed data and compute various metrics for reporting.
  • Wrote SQOOP jobs for data landing from various RDBMS source systems into HDFS filesystem.
  • Used Pig as ETL tool to do Transformations, even joins and some pre-aggregations before storing the data onto HDFS.
  • Developed workflow in Oozie to automate the tasks of loading the data into HDFS and pre-processing with Pig.
  • Written Spark applications using Scala to interact with the MySQL database using Spark SQL Context and accessed Hive tables using Hive Context.
  • Conducted user acceptance testing by arranging meeting with business clients.
  • Created of Qlik Sense visualization dashboards from created external HIVE tables.

Confidential, Auburn Hills, MI

ETL DataStage Developer

Responsibilities:

  • Led end to end implementation of this warehousing project. Have been involved in each phase of project development cycle starting from requirement gathering from business, design analysis, development, UAT meeting and launch.
  • Analysis of business requirement, source system analysis. Document all necessary KPI and their business rules.
  • Extracted data from text files, using FTP Stage and loaded into different databases.
  • Designed Parallel jobs using various stages like Join, Merge, Remove Duplicates, Filter, Lookup, Modify, Aggregator and Funnel stages.
  • ETL flow diagram, mapping. Created Logical/Physical data model.
  • Extract data from different RDBMS and Operational source systems to staging area.
  • ETL Jobs development to pull data from staging area, ODS, process and load into warehouse/mart tables.
  • Unit and Integration testing of DataStage Jobs as per the test cases provided by client.
  • Creation of Cognos Part Promotion Analyzer and Forecasting dashboards from these data marts. These reports will have the live data would be accessed by all Confidential dealer through Dealer Connect portal.

Confidential, Auburn Hills, MI

Qlik Sense Developer

Responsibilities:

  • Developed different dashboard with a complex database system behind it, which includes extracting data from the database, storing into QVD files, write load scripts, and develop UI according to user requirements
  • Connected to different ODBC, OLE DB data sources (SQL Server, Oracle) and flat files to create and schedule different complex reports as per given business requirement by leveraging the basic components of QlikView.
  • Worked on modelling data as per business requirements. Eliminated Synthetic keys, ambiguous relationships and closed loops.
  • Experience in development of ETL scripts for Data Modeling along with resolving Synthetic Key and Circular Loop issues.

Confidential, Auburn Hills, MI

ETL/DataStage Developer

Responsibilities:

  • Analysis of business requirement, source system analysis,
  • Developed LDM/Physical data model using Sybase-Power designer. Warehouse, Mart table creation.
  • Preparation of ETL design /mapping document. Extract data from 29 different PDCs/DVIEWs to staging area.
  • ETL Jobs development to pull data from staging area, process and load into warehouse/mart tables.
  • Unit and Integration testing of DataStage Jobs as per the test cases provided by client.
  • Creation of Business Objects reports from these data marts.
  • Provide support program changes/enhancements during Client production run of project.

Confidential

ETL DataStage Developer

Responsibilities:

  • Providing support program changes/enhancements during Client production run of project.
  • Analysis of business requirement, source system analysis.
  • Extract data from Operational source to staging area.
  • Used AUTOSYS to Schedule the DataStage ETL batch jobs on a daily, weekly and monthly basis.
  • ETL Jobs development to pull data from staging area, process and load into warehouse/mart tables.
  • Unit and Integration testing of DataStage Jobs as per the test cases provided by client.
  • Creation of Business Objects reports from these data marts.

Confidential

ETL/DataStage Developer

Responsibilities:

  • Requirement gathering, source system identification.
  • Developed LDM/Physical data model using Sybase-Power designer
  • Preparation of ETL design /mapping document.
  • ETL Jobs development to extract and transform and load data into mart tables.
  • Unit and Integration testing of DataStage Jobs as per the test cases provided by client.
  • Creation of Business Objects universes / reports from these data marts.

Confidential

Data Analyst

Responsibilities:

  • Analysis of business requirement, source system analysis.
  • ETL Jobs development to extract data from source system, process and load into warehouse/mart tables.
  • Unit and Integration testing of DataStage Jobs as per the test cases provided by client.
  • Understand and Development of Reporting universes in Business objects based on requirements.
  • Providing support program changes/enhancements during Client production run of project.

Hire Now