Sr. Datawarehouse Engineer, Dba Resume
San Jose, CA
SUMMARY:
- Data Warehouse Engineer with extended experience in ETL, architecting, modeling and development of back - end ETL on Oracle, Vertica, SQLServer, MySQL, Aster (Teradata).
- Experienced in ETL on Hadoop using MapReduce batch to load data into HBase and Hive.
- Have solid experience in:
- Writing of ETL jobs using Pl/SQL, SQL, T-SQL, Java. Writing MapReduce jobs for load and extract of Big Data on Hadoop environment.
- Data Marts and Data Warehouse Start Schema design and development.
- Conducted full development life cycle of DW/BI projects;
- Collection and analysis of the business requirements;
- Definition of the business metrics and their mapping to the raw data;
- Row data profiling, cleansing, logical mapping and integration;
- Conceptual, logical and physical design of the DataMarts and Data Warehouse;
- Collection of the metadata and building metadata repositories;
- Selection of the vendors and DW project budgeting;
- Preparation of development documentation such as Requirement Documents, Development Standards, Design Documents and Functional Specifications, QA test cases, relational diagrams and user manuals;
- Performance tuning, troubleshooting and debugging of implemented ETL;
- Production support of running applications;
- Have prolong experience in writing ETL jobs for Oracle, Vertica, MySQL, SQLServer using SQL, Pl/SQL, T-SQL, Bash.
- Solid practical experience in writing complex SQL queries, writing bash scripts, PL/SQL programs;
- Over 8 years in writing of batch automation and process monitoring scripts using shell.
- Have some experience in using DataStage and Pentaho for ETL, Tableaux for reports, Erwin and Visio for design.
- About three years of experience in writing of Map Reduce batch ETL jobs in Java.
- About three years of experience in using Java for ETL. Troubleshooting and enhancement of the existing processes. Refactoring and adding new processes to the existing frameworks.
- Deep understanding and use of relational and dimensional models, star and snowflake models and multidimensional cubes.
- Proficient in using Oracle tuning techniques.
- Solid experience in reverse engineering and remodeling of legacy systems and ETL processes.
- Participated in migration of DW from the legacy systems to the new environments over 5 times.
- Impact analysis, development and maintenance of processes with complex dependencies;
- Practical knowledge in preparing test cases and conducting QA testing on various stages of development cycle including unit test, integration test, regression and system rests.
- Strong analytical and problem-solving skills.
- Strong conceptual thinking, analytical abilities with attention to details combined with the business knowledge.
- Small projects management experience.
- Solid familiarity with business KPI and marketing metrics.
- Familiarity with unstructured data processing using Hadoop framework.
- Good writing and verbal communication skills.
- Knowledge of corporate finance and accounting, cloud services, telecommunication and banking industries.
- PC literal and proficient in working with MS Office including Word, Excel, Power Point, Outlook and various IT development tools. Hands-on experience with TOAD, SQL Developer, DB Visualizer.
- Experienced working in agile environment with rapid changing requirements.
- Excellent interpersonal skills; goal and business oriented, achiever, easy learner, self-starter and self-motivated; reliable and dependable.
- Willing and able to learn new technologies and acquire new skills.
- Able to work independently and in a team environment.
TECHNICAL SKILLS:
Programming languages: PL/SQL, SQL, T-SQL, Java 1.7, JDBC, Perl, XML, PHP, HTML, Bash, awk.
Data Base environments: Vertica, Oracle 10g/9i/8i on Unix Confidential, RedBrick, MS SQL Server 7.0/2005, Aster (Teradata), DB2, SQL*Loader, Oracle Application Server, MySQL, MS Access.
Operating systems: UNIX, Linux (Su-Se, Red Hat), Windows NT/95/98
Development tools: TOAD, Eclipse, DBVisualizer, VSQL, SQL/Plus, Aster cli, CygWin, PuTTy, WinSCP, SQL-Navigator, MS SQL Server Manager and Query builder, Profile Stage, Meta Data, Data Stage, Oracle Financial Suite, ClearCase, VSS, Oracle Designer, Oracle Discoverer, JDeveloper, Cognos, Tableau, Business Objects.
Modeling tools: ErWin, Visio
MS Office applications: MS Office Suite including Excel, Access, Power Point, Word and Outlook. Open Office.
EXPERIENCE:
Confidential, Foster City, CA
Advisory Engineer. Data Architect.
Responsibilities:
- Support, maintenance, enhancement and tuning of the existing ETL and Reporting applications on Oracle and Aster (Teradata).
- Development and adding of new functionalities to the of Best Practice and Coremetrics reports.
- Personally, developed data retention application to increase performance of the Data Warehouse in compliance with the client requirements.
- Participated in migration of the client databases from Oracle to Aster, and later, from the legacy systems to the Orion on Hadoop.
- Lead group of three developers to refactor a legacy client data Import application, as well as adding new data feeds to the new environment. Reverse engineered load of Registrations data into legacy system and developed an ETL to load this data into new environment.
- Developed, and coded Data-retention project as part of the tuning, Holiday season initiative.
- Participated in design and implementation of the DDR (Dimension Data Repository) for Orion/Hadoop. Personally, coded the load of User Registrations data into HBase and integration of the DDR into Orion-scheduler framework.
- Refactored the Client Data Import from the legacy ESB and integrated it in to Orion-scheduler. The refactoring included capture, validation of the client imports and load it into the DDR HBase.
- Integrated new data source from Call Center into the refactored Import flow.
- Improved, enhanced and implemented the Baseline application for migration of the client data from the legacy system to Orion Hapood.
- Few smaller tasks on validation, troubleshooting and fixing production bags.
Environment: Oracle 10/11g, Aster (Teradata), Linux, Java, Spring, Hadoop, HBase, Hive, Jira, Parature, GitLab, Jenkins
Confidential,, Sunnyvale, CA
Sr. Data Warehouse Engineer, Architect
Responsibilities:
- Performed analysis and derived the structure of the Corporate OLTP systems on Salesforce CRM, SQLServer, Dynamic GP and WTS Paradigm ERP systems.
- Completed design and presented EDW solution, including configuration of hardware, vendor’s selection and project budget estimation.
- Created demo version of ETL and Reporting, including BI dashboard for KPI and Trend Analysis on SQLServer.
Environment: SQLServer 2005, Salesforce CRM, Dynamic GP, WTS Paradigm ERP. T-SQL, Windows.
Confidential, San Jose, CA
Sr. Datawarehouse Engineer, DBA
Responsibilities:
- Hands on design and development of ETL process for a corporate DW.
- Developed and coded ETL to extract business data from Hadoop Hive into the Vertica DW to produce trend and KPI client reports.
- Supported data base and performed DBA duties like back-up, tuning and upgrades of Vertica.
Environment: Vertica 5.2, Oracle 10g, Linux, Pentaho, Hadoop, Hive, Python.
Confidential, Sunnyvale, CA
Sr. DW Technical Lead, Sr. Software Engineer
- Full development cycle of Cloud Services BI-Data Warehouse and Data Storage.
- Collection and analysis of business requirements, KPI and client metrics;
- Analysis of the existing OLTP and future unstructured data sources.
- Conceptual design and proof of concept of DW;
- Selection of platform and physical design;
- Logical and physical design and hands on development of ETL and load framework, including database objects, transformation procedures and batch processes.
- Physical mapping of business metrics and entities to the data source;
- Migration of the historical data from OLTP system;
- Designed different data marts for the reporting.
- Worked in team of two other contractors.
Environment: MySQL, Vertica, Red Hat Linux, Tomcat/Catalina log files, device context upload files, Visio, Toad, Bash, awk, SQL.
Confidential, Concord, CA
Sr. Application Engineer
Responsibilities:
- Daily duties included development of user-requested reporting and analytical applications, maintenance and enhancement of the existing application.
- Scope analysis of user request, projects sizing and planning.
- Collection and analysis of business requirements.
- Impact analysis.
- Modeling, logical and physical design of the applications.
- Development, programming and deployment of ETL processes and user-defined reports using SQL and PL/SQL.
- Application smog and system integration and UAT testing.
- Preparation of technical documentation and user documentation.
- Batch processes on-call support of production applications on rotating bases.
- Main projects and achievements:
- Played key role in migration of STS Data Mart from legacy environment to Oracle 10g.
- Performed reverse engineering and re-modeling of legacy Data;
- Developed and deployed ETL processes using DataStage;
- Developed set of scorecard and trend ad-hoc and cyclical reports;
- Reengineered and migrated two major Sale’s subject areas and built set or user defined reports.
- Completed development and enhancement of Oracle packages that generate Web-based dashboard and scorecard reports.
- Participated as application analyst and modeler in full cycle of development of BBG Data Warehouse.
- Performed logical and physical design of ETL from FDR, coded and deployed ETL batch using Data Stage.
- Performed data profiling using ProfileStage.
- Played key role in migration of BBG CIRM Data Mart for Oracle 9i to 10g. Performed following tasks:
- Completed requirement analysis and logical modeling of legacy application;
- Participated in physical design and coding of ETL processes of Data mart using OWB;
- Developed set of cyclical reports for external users.
- Designed and led technical development of cross-sell and customer behavior scorecard analytical repository.
- Initiated re-engineering and completed development of Compliance analytical repository from old code to use latest features of Oracle 9i.
- Designed and developed a Data Warehouse meta-data repository.
- Work independently and in groups with other team members.
Environment: Oracle 10g, DB2, Teradata, RedBrick, MS SQL Server, ERWin, Visio, Toad, Cronacle, AutoSys, VSS, Ascential ETL Suite, SQL, PL/SQL, JDBC, shell, Perl, Confidential -Unix, Windows XP
