Senior Data Engineer Resume
CA
PROFESSIONAL SUMMARY:
- Over 15 years of IT experience in BIDW, Teradata, Big Data, Talend, Automic, Informatica, Ab - Initio, Oracle, Sql Server, BO and Tableau.
- Experience in Analyzing, Designing and Implementation of Data warehouse systems (OLAP) using Teradata, Talend, Automic, Informatica, and other Data warehouse tools.
- Worked as Lead/Teradata Developer/ DW Architect/ Business Analyst/ ETL Developer/ETL Tester/Data analyst in DWHs and Data Marts in Retail, eComm Banking, Finance, Risk, Credit Card, Healthcare and Energy & Utility domain.
- Strong working experience with customer in terms of requirement gathering, Analysis and Design of Table/View using Teradata, Business user communication.
- Designed data Mapping documents, ETL architecture documents and specifications.
- Excellent Experience in Designing, Developing, Prod support, Documenting, Testing of ETL jobs and mappings using Teradata, Automic, Informatica and Talend to populate tables in Data Warehouse and Data marts.
- Experience with working on multiple environments like Production, Development and Testing.
- Expertise in writing yaml scripts, stored procedure and Macro in Teradata.
- Extensively worked with Teradata utilities like BTEQ, FastExport, FastLoad, MultiLoad, TPump and yaml scripts to export and load data to/from different source systems including flat files.
- Expertise in writing large/complex queries using SQL.
- Experienced in Database programming for Data Warehouses (Schemas), proficient in dimensional modeling (Star Schema modeling, and Snowflake modeling).
- Expertise in all the phases of System development life Cycle (SDLC) using methodologies like Agile .
- Exposure to Hadoop, Hive, Spark, Hbase, Sqoop, MongoDB.
TECHNICAL SKILLS:
ETL Tools: Automic, Informatica, Talend, Ab-Initio, IRIS
Big data: Hadoop, Hive, Spark, Hbase, Sqoop, MongoDB, Data Lake.
Languages : PL/ SQL, VB, Paython, R
Operating systems: Windows 7, Windows 2000/2003/NT/XP/Vista, MS-DOS , Unix
Databases : Teradata, Oracle (SQL), SQL Server
Tools: SQL Assistant, Toad, BOXI, Tableau, GitHub, IRIS, HP ALM, JIRA, Autosys
Confidential Tools : MS office Suite (Word, Excel, PowerPoint), Adobe Acrobat Reader.
Methodologies: Software Development Life Cycle (SDLC), Agile Methodology.
PROFESSIONAL EXPERIENCE:
Confidential, CA
Senior Data Engineer
Environment: Teradata16, Bigdata, Hive, Spark, DataLake, Tableau, Automic, GitHub, Unix.
Responsibilities:
- Extensively worked on Teradata utilities BTEQ, Fastload, Multiload to load data.
- ETL loads and Analytical scripts are executed through Automic tool using yaml scripts and hive queries.
- Perform Coding, performance improvement, identifying & fixing bugs.
- As part of the Global Data Analytics team provided various solution and fixes to the business.
- Having good exposure and working experience in Tableau.
- Good understanding of data for Order, Return, Refund and Ship-tracking related information.
Confidential, WA
Tech Lead / Developer
Environment: Azure, Hbase, SQL server 2016, Visual Studio 2017, GIT, Azure, PowerShell
Roles and Responsibilities:
- Extensively worked on stored procedure.
- Build logic for KPI in Dynamic 365 for Customer Insights.
- Perform Coding, performance improvement, identifying & fixing bugs, configuring continuous Integration.
- Implement continuous integration using Jenkins.
Confidential, OK
Lead Teradata / ETL Architect
Environment: Teradata14.10/15.0, Informatica, Talend, BIBO, Unix
Responsibilities:
- Working as a Team lead, architect for the Project.
- Wrote Requirement design document, Prepare the database design and mapping document, Review the ETL design documents.
- Preparation of Unit Test cases, Unit Test plans, Performance Testing, Sub System Testing and UAT.
- Extensively worked on stored procedure, macro and view creation in Teradata to data load and view report.
- Used Teradata utilities BTEQ, Fastload, Multiload to load data.
- Worked on query and performance improvement.
- Created ETL jobs using Informatica, Talend to load the data into stage and target tables.
- Played the key role in defining the coincident peak logic for the transformers in Confidential project which will return the more accurate value for each transformer.
- Migration of ETL code and Teradata objects from Dev, QA to Prod environments.
- Responsible for end to end delivery of project and change requests.
- Coordinate with internal and external customers as necessary on the deliverables and issues.
- Responsible for guiding the offshore development team.
- Responsible for estimation, planning and execution with specific focus on requirement analysis.
Confidential, WI
Technical Lead/Teradata Architect
Environment: Teradata13/14.10, BOXI, Tableau
Responsibilities:
- Extensively worked on stored procedure, macro and view creation in Teradata to data load and view report.
- Unit Testing, Integration Testing and Performance Testing of Stored procedures.
- Interacting with Business Analysts for the Table-To-Table mapping of the business flows.
- Helping team on their report query build and performance tuning.
- Analyzing the mappings and optimizing them.
- Define and maintain naming standards, attributes and data types.
- Creating Technical Design Documentation.
- Prepare technical specification documents for ETL and database.
- Creating Unit Test Plan Scenarios.
- Managing Team, Planning and scheduling activities.
- Business Development by identifying opportunities and proposing solutions.
Confidential, CT
Technical Lead/Teradata Architect
Environment: Teradata 13/ 14.10, Informatica, Talend, IRIS Tool, SQL Assistant, BO, Unix
Responsibilities:
- Worked as a Tech Lead/ Team Member, architect for the above given Projects.
- Wrote Requirement design document, Prepare the database design and mapping document, Review the ETL design documents.
- Preparation of Unit Test cases, Unit Test plans, Performance Testing, Sub System Testing and UAT.
- Extensively worked on stored procedure, macro and view creation in Teradata for data load and view report.
- Used Teradata utilities BTEQ, Fastload, Multiload to load data.
- Unit Testing, Integration Testing and Performance Testing of Informatica, Talend, IRIS tool jobs and stored procedures.
- Created ETL jobs using Informatica, Talend, IRIS tool to load the data into stage and target tables.
- Worked on the many performance improvement both in the query and ETL job level.
- Migration of ETL code and Teradata objects from Dev, QA to Prod environments.
- Responsible for end to end delivery of project and change requests.
- Coordinate with internal and external customers as necessary on the deliverables and issues.
- Responsible for guiding the offshore development team.
- Responsible for estimation, planning and execution with specific focus on requirement analysis.
- Serve as a focal point to communicate and resolve interface and integration issues with other teams.
- Provide gap analysis on existing Data-warehouses in supporting new business areas.
- Managing Team, Planning and scheduling activities.
Confidential
Technical Lead/ Module Lead/ETL Developer
Environment: Oracle 10G, 8i/9i, Ab-Initio (ETL), BO, Toad, Unix
Responsibilities:
- Worked on all phases of data warehouse development lifecycle, from gathering requirements to testing, implementation, and support.
- Extracted data from Flat files and transformed it in accordance with the Business logic mentioned by the client and loaded data into the staging tables.
- Used the Ab-Initio tool to develop jobs for extracting, cleansing, transforming, integrating, and loading data into data warehouse database
- Involved in performance tuning for several ETL jobs to reduce runtime in daily batch cycle.
- Worked on the query performance tuning for different jobs.
- Used several partitioning techniques in various stages to gain best performance on parallel jobs.
- Involved in migration and implementation of ETL code from development to Test and Production environment
- Prepare documentation for project estimates for all new developments to be done.
- Created Low Level Design Documentation of mapping/ETL Specs for business functionality
Confidential
Team Lead and Developer
Environment: ASP.Net, VB.6, SQL Server 2000, Crystal Report 10, HTML
Responsibilities:
- Design and development of the web page.
- Writing Technical Specifications.
- Creating user controls and writing reusable codes.
- Preparing HLDD for new modules.
- Unit testing and debugging.
