Senior Etl Developer - Lead Resume
Newark, CA
PROFESSIONAL SUMMARY:
- 7+ Years of IT experience designing and implementing data warehousing solutions.
- Extensive IT experience with prime focus on Analysis, Design, Development, Testing and Implementation of Data warehousing projects using Teradata and Vertica.
- Expertize on Teradata SQL Performance Tuning.
- Good knowledge in designing ETL frameworks using Perl and Shell scripts.
- A very good understanding of Enterprise Data warehouse architecture and DW concepts.
- Good knowledge in data profiling, development, SQL coding, documenting design documents and Unit Test Cases.
- Experience in implementing complex business rules using views, materialized views, macros, stored procedures, PL/SQL and Teradata BTEQ scripts.
- Optimizing BTEQ, Teradata Stored Procedures, PL/SQL and SQL scripts for better performance and efficiency.
- Worked on data profiling, analytics and validation via Hive queries
- Implemented Oozie workflows in Hadoop.
- Expertise in entire SDLC of Data warehousing and Business Intelligence Projects which includes requirements gathering, planning, requirements analysis, Data Modeling, design, implementation, testing, maintenance, and support.
- Highly inclined towards technology and updates with industry advancements. Enthusiastic in taking up challenging and technology oriented tasks with high scaling up capability.
- Experience in leading a team and providing technical leadership.
- Performing extensive Data Analysis and reporting data issues.
- Very good debugging, analytical and logical skills.
- Excellent presentation, documentation and communication skills.
- Highly motivated and can work independently or part of a team, with Experience in Onsite and Offshore co - ordination model
TECHNICAL SKILLS:
Database Systems: Teradata Vertica Oracle MySQL
Operating Systems: UNIX Linux Windows
ETL Tools and Languages: Teradata Stored Procedures Teradata BTEQ SQL PL/SQL Shell Scripting Perl Informatica
Visualization Tools: Tableau (Knowledge 1/5)
Big Data Technology: Hadoop Hive Oozie
PROFESSIONAL EXPERIENCE:
Confidential, Newark, CA
Environment: Data Warehouse Domain • HPE Vertica • MySQL • Oracle • Perl • UNIX
Senior ETL Developer - Lead
Responsibilities:
- Manage client engagement from requirement gathering to change management efforts including ETL and Transformation Design.
- Lead the on and off-shore ETL development Team, monitoring production issues, and coordinate with Reporting Team as well as Business Analysts during the entire lifecycle of the project.
- Coordinate with Business for requirement gathering, and document user stories and translate them into functional and technical specifications.
- Creating data models and entities, and designing relationships between them.
- Data Profiling, Feasibility and Technical Analysis of the Business Requirements.
- Setting up Automation for pulling data from various source systems in Oracle, MySQL, MS SQL Server and load into Vertica, and design a platform for data analytics, for reporting team to create visualizations and monitor trends.
- Create Scripts in Shell and Perl for implementing the business logic as well as automation scripts for validating the data based on business scenarios.
- Design ETL scripts to automate email notifications on failure
- Work on performance analysis and tuning the SQL used in ETL scripts as well as Microstrategy Reports for better performance.
- Unit Testing, Functional Testing and Integration Testing for the entire process.
- Coordinate with Upstream and Downstream Applications for Integration Testing.
- Coordinate with Business during UAT & signing off the project requirements.
Confidential, Sunnyvale, CA
Environment: Data Warehouse Domain • Teradata • UNIX • Tableau • Autosys • Hive • Oozie
Senior ETL Developer - Lead
Responsibilities:
- Migrated technical support and advanced services including the modelling, design, and delivery of final products. Improved data quality through fine grain reporting and designed solutions for manual adjustments.
- Setting up Automation for various business areas like Confidential Online Store, Applecare, Customer Relation Management System etc., to implement Fraud decisioning and Fraud analytics based on business rules decided by data scientists.
- Coordinate with Business for requirement gathering, and documenting the same.
- Data Profiling, Feasibility and Technical Analysis of the Business Requirements.
- Detailed analysis of the existing data flow, logic and ETL for the end-to-end flow of data for the requested reports.
- Create Stored procedures in Teradata to implement the business rules.
- Implement transaction processing using Teradata temporal tables.
- Create Hive queries and design Oozie workflows for analyzing and profiling the data in Hadoop and implementing business rules.
- Work on performance analysis and tuning the SQL and Teradata stored procedures.
- Create wrapper scripts using shell scripts to call the Teradata stored procedures and schedule the same through autosys.
- Unit Testing, Functional Testing and Integration Testing for the entire process.
- Coordinate with Upstream and Downstream Applications for Integration Testing.
- Coordinate with Business during UAT & signing off the project requirements.
- Providing Demo to Business for the processes to configure the entries to setup a new semantic through the User Interface, and the corresponding actions in the back end.
- Creating Tableau Dashboards for analysis and presenting data and volume patterns for data flowing from Athena to GBI, as well as data processed in Fraud semantic
- Providing Post Production Support and Transition to Production Support Team.
Confidential, Norwalk, CT
Environment: Data Warehouse Domain • Teradata • BTEQ • UNIX • Tableau • Informatica • ER Studio
Senior ETL Developer & Data Analyst
Responsibilities:
- Detailed analysis of the existing data flow, logic and ETL for the end to end flow of data for all GECA businesses.
- Design of a new Regulatory risk layer to accommodate the data from EDW Core for all the GECA businesses to ensure that business users can view the data and update the same if required.
- Design of a common data structure which would be approved by GECA as well as HQ to hold the Risk Data.
- Design of the data flow, logic and ETL between EDW Core to ERISK.
- Create the ETL specifications for the build.
- Design of control tables and BTEQ scripts to implement the logic to implement the logic between EDW Core and ERISK.
- Coordinate with the Data Architects in order to design the changes and the data flow as per the existing industry standards.
- Coordinate with the Business Users for uploading of override data (if required).
- Managing the Entire Offshore team and coordinating with the cross vendor Build Team for the build and migration.
- Validation of the data and the ETL process, and close gaps found in the build (if any).
- Parallel testing of data between the data as part of existing and proposed flow to ERISK.
- Solve the bugs raised by QA team.
- Root Cause Analysis of issues identified during UAT, and closing the gaps.
Confidential
Environment: Data Warehouse Domain • Teradata • BTEQ • UNIX • Informatica
ETL Developer
Responsibilities:
- Responsible for the day to day deliverables.
- Analyzing the requirements provided by business.
- Data profiling of the source, target and the various intermediate staging areas, and hence developing the logic to map the final attribute in EDW CORE.
- Create the design specifications for architecture review of an attribute (in case of a new attribute being mapped into EDW).
- Create the ETL specifications, based on which the ETL Team would proceed with the build.
- Solve the bugs raised by QA team.
- Issue analysis raised by Production team.
- Impact Analysis