We provide IT Staff Augmentation Services!

Senior Data Engineer Resume

4.00/5 (Submit Your Rating)

CA

PROFESSIONAL SUMMARY:

  • Over 15 years of IT experience in BIDW, Teradata, Big Data, Talend, Automic, Informatica, Ab - Initio, Oracle, Sql Server, BO and Tableau.
  • Experience in Analyzing, Designing and Implementation of Data warehouse systems (OLAP) using Teradata, Talend, Automic, Informatica, and other Data warehouse tools.
  • Worked as Lead/Teradata Developer/ DW Architect/ Business Analyst/ ETL Developer/ETL Tester/Data analyst in DWHs and Data Marts in Retail, eComm Banking, Finance, Risk, Credit Card, Healthcare and Energy & Utility domain.
  • Strong working experience with customer in terms of requirement gathering, Analysis and Design of Table/View using Teradata, Business user communication.
  • Designed data Mapping documents, ETL architecture documents and specifications.
  • Excellent Experience in Designing, Developing, Prod support, Documenting, Testing of ETL jobs and mappings using Teradata, Automic, Informatica and Talend to populate tables in Data Warehouse and Data marts.
  • Experience with working on multiple environments like Production, Development and Testing.
  • Expertise in writing yaml scripts, stored procedure and Macro in Teradata.
  • Extensively worked with Teradata utilities like BTEQ, FastExport, FastLoad, MultiLoad, TPump and yaml scripts to export and load data to/from different source systems including flat files.
  • Expertise in writing large/complex queries using SQL.
  • Experienced in Database programming for Data Warehouses (Schemas), proficient in dimensional modeling (Star Schema modeling, and Snowflake modeling).
  • Expertise in all the phases of System development life Cycle (SDLC) using methodologies like Agile .
  • Exposure to Hadoop, Hive, Spark, Hbase, Sqoop, MongoDB.

TECHNICAL SKILLS:

ETL Tools: Automic, Informatica, Talend, Ab-Initio, IRIS

Big data: Hadoop, Hive, Spark, Hbase, Sqoop, MongoDB, Data Lake.

Languages : PL/ SQL, VB, Paython, R

Operating systems: Windows 7, Windows 2000/2003/NT/XP/Vista, MS-DOS , Unix

Databases : Teradata, Oracle (SQL), SQL Server

Tools: SQL Assistant, Toad, BOXI, Tableau, GitHub, IRIS, HP ALM, JIRA, Autosys

Confidential Tools : MS office Suite (Word, Excel, PowerPoint), Adobe Acrobat Reader.

Methodologies: Software Development Life Cycle (SDLC), Agile Methodology.

PROFESSIONAL EXPERIENCE:

Confidential, CA

Senior Data Engineer

Environment: Teradata16, Bigdata, Hive, Spark, DataLake, Tableau, Automic, GitHub, Unix.

Responsibilities:

  • Extensively worked on Teradata utilities BTEQ, Fastload, Multiload to load data.
  • ETL loads and Analytical scripts are executed through Automic tool using yaml scripts and hive queries.
  • Perform Coding, performance improvement, identifying & fixing bugs.
  • As part of the Global Data Analytics team provided various solution and fixes to the business.
  • Having good exposure and working experience in Tableau.
  • Good understanding of data for Order, Return, Refund and Ship-tracking related information.

Confidential, WA

Tech Lead / Developer

Environment: Azure, Hbase, SQL server 2016, Visual Studio 2017, GIT, Azure, PowerShell

Roles and Responsibilities:

  • Extensively worked on stored procedure.
  • Build logic for KPI in Dynamic 365 for Customer Insights.
  • Perform Coding, performance improvement, identifying & fixing bugs, configuring continuous Integration.
  • Implement continuous integration using Jenkins.

Confidential, OK

Lead Teradata / ETL Architect

Environment: Teradata14.10/15.0, Informatica, Talend, BIBO, Unix

Responsibilities:

  • Working as a Team lead, architect for the Project.
  • Wrote Requirement design document, Prepare the database design and mapping document, Review the ETL design documents.
  • Preparation of Unit Test cases, Unit Test plans, Performance Testing, Sub System Testing and UAT.
  • Extensively worked on stored procedure, macro and view creation in Teradata to data load and view report.
  • Used Teradata utilities BTEQ, Fastload, Multiload to load data.
  • Worked on query and performance improvement.
  • Created ETL jobs using Informatica, Talend to load the data into stage and target tables.
  • Played the key role in defining the coincident peak logic for the transformers in Confidential project which will return the more accurate value for each transformer.
  • Migration of ETL code and Teradata objects from Dev, QA to Prod environments.
  • Responsible for end to end delivery of project and change requests.
  • Coordinate with internal and external customers as necessary on the deliverables and issues.
  • Responsible for guiding the offshore development team.
  • Responsible for estimation, planning and execution with specific focus on requirement analysis.

Confidential, WI

Technical Lead/Teradata Architect

Environment: Teradata13/14.10, BOXI, Tableau

Responsibilities:

  • Extensively worked on stored procedure, macro and view creation in Teradata to data load and view report.
  • Unit Testing, Integration Testing and Performance Testing of Stored procedures.
  • Interacting with Business Analysts for the Table-To-Table mapping of the business flows.
  • Helping team on their report query build and performance tuning.
  • Analyzing the mappings and optimizing them.
  • Define and maintain naming standards, attributes and data types.
  • Creating Technical Design Documentation.
  • Prepare technical specification documents for ETL and database.
  • Creating Unit Test Plan Scenarios.
  • Managing Team, Planning and scheduling activities.
  • Business Development by identifying opportunities and proposing solutions.

Confidential, CT

Technical Lead/Teradata Architect

Environment: Teradata 13/ 14.10, Informatica, Talend, IRIS Tool, SQL Assistant, BO, Unix

Responsibilities:

  • Worked as a Tech Lead/ Team Member, architect for the above given Projects.
  • Wrote Requirement design document, Prepare the database design and mapping document, Review the ETL design documents.
  • Preparation of Unit Test cases, Unit Test plans, Performance Testing, Sub System Testing and UAT.
  • Extensively worked on stored procedure, macro and view creation in Teradata for data load and view report.
  • Used Teradata utilities BTEQ, Fastload, Multiload to load data.
  • Unit Testing, Integration Testing and Performance Testing of Informatica, Talend, IRIS tool jobs and stored procedures.
  • Created ETL jobs using Informatica, Talend, IRIS tool to load the data into stage and target tables.
  • Worked on the many performance improvement both in the query and ETL job level.
  • Migration of ETL code and Teradata objects from Dev, QA to Prod environments.
  • Responsible for end to end delivery of project and change requests.
  • Coordinate with internal and external customers as necessary on the deliverables and issues.
  • Responsible for guiding the offshore development team.
  • Responsible for estimation, planning and execution with specific focus on requirement analysis.
  • Serve as a focal point to communicate and resolve interface and integration issues with other teams.
  • Provide gap analysis on existing Data-warehouses in supporting new business areas.
  • Managing Team, Planning and scheduling activities.

Confidential

Technical Lead/ Module Lead/ETL Developer

Environment: Oracle 10G, 8i/9i, Ab-Initio (ETL), BO, Toad, Unix

Responsibilities:

  • Worked on all phases of data warehouse development lifecycle, from gathering requirements to testing, implementation, and support.
  • Extracted data from Flat files and transformed it in accordance with the Business logic mentioned by the client and loaded data into the staging tables.
  • Used the Ab-Initio tool to develop jobs for extracting, cleansing, transforming, integrating, and loading data into data warehouse database
  • Involved in performance tuning for several ETL jobs to reduce runtime in daily batch cycle.
  • Worked on the query performance tuning for different jobs.
  • Used several partitioning techniques in various stages to gain best performance on parallel jobs.
  • Involved in migration and implementation of ETL code from development to Test and Production environment
  • Prepare documentation for project estimates for all new developments to be done.
  • Created Low Level Design Documentation of mapping/ETL Specs for business functionality

Confidential

Team Lead and Developer

Environment: ASP.Net, VB.6, SQL Server 2000, Crystal Report 10, HTML

Responsibilities:

  • Design and development of the web page.
  • Writing Technical Specifications.
  • Creating user controls and writing reusable codes.
  • Preparing HLDD for new modules.
  • Unit testing and debugging.

We'd love your feedback!