SUMMARY:

• Data Engineer/Architect wif extensive experience working on data warehousing projects wif companies like Confidential, Confidential, Confidential, Confidential, Confidential and Confidential .
• Currently working wif Confidential (startup in virtual medical consulting business) as a senior data engineer/architect.
• Like problem solving and find solutions to challenging technical problems.

TECHNICAL SKILLS

• Design/develop data pipeline for data warehousing projects.
• Data modelling (dimensional & normalized)
• Redshift, Oracle, MySQL, Linux, Erwin(modelling tool), Informatica(ETL), Tableau(reporting).
• SQL, Python, Javascript, AngularJS, PHP, Bootstrap, AWS S3, Git
• Lead development team.

PROFESSIONAL EXPERIENCE

Confidential, CA

Sr. Data Engineer / Architect

Responsibilities:

• Confidential is involved in the business of providing virtual medical consultancy to individuals and enterprises.
• Involved in the design and development of the data pipeline using SQL (Redshift, MySQL) and Python for the data warehouse project. The primary objective of dis project is to take data from multiple sources and create transformed/standardized/cleansed/validated and easy to consume format of data. The pipeline is built wif data quality and operational robustness in mind. dis system is used downstream by the reporting and analytic system in Tableau.
• Interface wif backend team, product managers and management to understand the source data and the reporting requirements.

Confidential, San Ramon, CA

Sr Data Engineer/ Architect

Responsibilities:

• Involved in the design/development of Enterprise Data Warehouse of the bank. dis system was designed to be the central repository of all bank instruments (process 10+ million transactions daily) and is used extensively for various reporting and regulatory requirements. The data pipeline was developed in SQL, Informatica and Oracle.
• Developed an informatica mapping generator dat halped in the creation of informatica mappings. dis was done using Python, SQL and Informatica. dis halped in creating production quality informatica mapping in less than a hour, for sourcing data from files and then transforming and loading into Oracle database.
• Designed/developed data quality and batch framework. Batch framework is used to run/monitor all batch processes. dis was done in PL/SQL (Oracle), korn shell scripts and Informatica. These frameworks are used extensively in the production and development environments in the bank for the last 5+ years.
• Involved in the design of data mart (Treasury Operations Mart) for the Finance department. It involved analysis, design (including ER diagram,logical and physicaldimensional model using star schema,as per best practices suggested by Ralph - Kimball). dis data-mart is designed to enable analytics of various products like saving/checking accounts, time deposits, commercial/mortgage loans,FX, interest rate swaps,etc., for various departments like Treasury, Risk Management, Treasury Operations, etc.
• Involved in the setting of standards and naming conventions for database and data pipeline components.
• Served as subject matter expert for various financial systems in the bank.
• Was leading a team of 2-10 members during various projects.

Confidential, San Francisco, CA

Data Engineer

Responsibilities:

• Confidential being an investment bank, needs to load various kinds of files containing financial data obtained from external vendors. As most of the investment options are time-sensitive, it is important to operationalize the loading process in the shortest possible time. dis used to be handled by having several developers work on each of the vendor files. Various operational issues were handled manually and was not operationally efficient.
• Did proof of concept for generating informatica mappings using PL/SQL. We were able to generate production quality code in less than 2 hours, dat could load and handle all operational issues for a new vendor file. dis significantly improved the time to market and enabled the bank to take time-sensitive decisions much more efficiently.
• Involved in the review of various data models and provide feedback relating to its design, ability to satisfy user requirements, ease of loading, maintenance, scalability, performance, adherence tobest practices and standards.

Confidential, San Jose, CA

Data Engineer/ Architect

Responsibilities:

• Primary task was to re-architect an existing system dat dealt wif test and repair data relating to manufacturing process. Theexistingsystem hadpoor performance (5+ hours for processing daily) and had data-integrity and maintainability issues. The re-architected system had improved performance(processing timeless thana hour) and conformedto existing dimensions used by other systems. It was easy to maintain/enhance and aligned wif the reporting requirements.

Confidential, San Jose, CA

Data Engineer/ Architect.

Responsibilities:

• dis project involves sourcing data (of 10-12 million transactions per day) from various OLTP systems and enhancing/maintaining a data warehouse system dat would be used for merchant reporting.
• Lead a team of five.
• Involved inthe development of data pipeline using SQL, Informatica and shell scripts.

Confidential, San Bruno, CA

Data Engineer /Architect.

Responsibilities:

• dis project involved creation ofoperational data store (ODS) and enterprise data warehouse (EDW) using Retek ERP as the source data.
• Involved in the analysis, design (including ER diagram,logical and physicaldimensional model using star schema; Erwin wasused asthedata-modeling tool) for the development of ODS and EDW.
• Involved in design/development of data pipeline to populate and maintain the fact and dimensional tables keeping in mind the volume of data (12-15 million transactions per day), operational robustness and performance criteria to adhere to SLA(service level agreement).
• Lead a team of two to ten people at various stages.