SUMMARY

• Having a total of 7+ years’ experience in the IT industry.
• Having 5+ years of experience in Microsoft Azure Cloud Technologies
• Having 2+ years of experience in Oracle Business Objects
• A Self - starter with a positive attitude, willingness to learn new concepts/technology and acceptance of challenges.
• Excellent Technical, Interpersonal and Management skills.
• Experienced in Azure Data Factory and preparing CI/CD scripts, DevOps for the deployment.
• Very strong experience in ETL design.
• Exposure to Azure Cloud computing technologies.
• Hands-on experience in Azure Services - Azure Data Lake Store (ADLS), Azure Data Lake Analytics (ADLA), Azure Data Factory (ADF).
• Prepared Project Documentations, Such as Setup Documents, Test Scripts and Functional specification Documents.
• Hands-on experience in Azure Data factory and its Core Concepts like Datasets, Pipelines and Activities, Scheduling and Execution
• Excellent knowledge of ADF building components - Integration Runtime, Linked Services, Data Sets, Pipelines, Activities
• Designed and developed data ingestion pipelines from on-premises to different layers into the ADLS using Azure Data Factory (ADF V2)
• Experience with integration of data from multiple data sources
• Experience in building Azure Data Bricks (ADB) Spark-python Notebooks to perform data transformations.
• Good exposure to Spark RDDs, DataFrames, and Spark SQL.
• Good knowledge on polybase external tables in SQL DW.
• POC using AZCOPY for copying files to Azure storage (blob, file share).
• POC using ADLCOPY to copy bob to ADLS and ADLS to ADLS.
• Designed Azure Logic apps application to send pipeline success/failure alert emails, file unavailability notifications etc.
• Knowledge on Data Extraction from On-Premises Sources and Delta Extraction methods from Source Systems to ADLS
• Extensively Worked on Copy Data activity
• Worked on Get Metadata Activity, look up, Store Procedure, Foreach, IF and execute Pipeline activities
• Orchestrated data integration pipelines in ADF using various Activities like GetMetadata, Lookup, ForEach, Wait, Execute Pipeline, Set Variable, Filter, until, etc.
• Implemented dynamic pipeline to extract the multiple files into multiple targets with the help of single pipeline.
• Manage data recovery for Azure Data Factory Pipelines
• Monitor and manage Azure Data Factory
• Experience in SQL - Joins/co-related queries/sub-queries etc.
• Good knowledge of stored procedures, functions, triggers, views, etc.
• Involved in Configuration of the system, Functional Testing of the application, Integrity of the modules, Managing Business Users.
• Possess sound knowledge of Business process and Data flow.
• Able to work within an aggressive and demanding project schedule and environment.
• Experience in working with extended teams to investigate and resolve critical problems with systems identified during system Implementation.
• Experience in code reviews, integration and end-user support.
• Have strong working knowledge on SQL, PL/SQL procedures, functions.
• Automated execution of ADF pipelines using Triggers
• Experience in Production support

TECHNICAL SKILLS

Operating System: Unix and Windows

ETL Tools: Azure Data Factory, Azure Data Bricks, Azure Data Lake Analytics

Language Tools: Python

Database Tools: Oracle, SQL Server, AZURE DW

PROFESSIONAL EXPERIENCE

Confidential, Pittsburgh, PA

Azure Data Engineer

Responsibilities:

• Created pipelines to extract data from on premises source systems to azure cloud data lake storage; Extensively worked on copy activities and implemented the copy behavior’s such as flatten hierarchy, preserve hierarchy and Merge hierarchy. Implemented Error Handling concept through copy activity.
• Exposure to Azure Data Factory activities such as Lookups, Stored procedures, if condition, for each, Set Variable, Append Variable, Get Metadata, Filter and wait.
• Create dynamic pipeline to handle multiple sources extracting to multiple targets; extensively used azure key vaults to configure the connections in linked services.
• Configured and implemented the Azure Data Factory Triggers and scheduled the Pipelines; monitored the scheduled Azure Data Factory pipelines and configured the alerts to get notification of failure pipelines.
• Implemented delta logic extractions for various sources with the help of a control table; implemented the Data Frameworks to handle the deadlocks, recovery, logging the data of pipelines.
• Reviewing individual work on ingesting data into azure data lake and provide feedbacks based on reference architecture, naming conventions, guidelines and best practices.
• Developing Spark (Python) notebooks to transform and partition the data and organize files in ADLS.
• Working on Azure Databricks to run Spark-Python Notebooks through ADF pipelines.
• Using Databricks utilities called widgets to pass parameters on run time from ADF to Databricks.
• Involved End-End logging frameworks for Data factory pipelines.
• Implemented delta logic extractions for various sources with the help of a control table; implemented the Data Frameworks to handle the deadlocks, recovery, logging the data of pipelines.
• Extracted data from different sources such as Flat files, Oracleto load into SQL database.
• Involved in preparation and execution of the unit, integration and end to end test cases.
• Used COPY to bulk load the data.
• Created internal and external stage and transformed data during load.
• Used FLATTEN table function to produce lateral view of VARIENT, OBECT and ARRAY column.
• Identifying areas for modification in existing programs and subsequently developing these modifications.
• Used Temporary and Transient tables on diff datasets.
• Cloned Production data for code modifications and testing.
• Shared sample data using grant access to customer for UAT.

Confidential, Austin, TX

Azure Data Engineer

Responsibilities:

• Monitored the pipelines and debug the issues which we have fixed.
• Worked with Pegasus support team for REST API failures.
• Created pipelines to extract data from on premises source systems to azure cloud data lake storage; Extensively worked on copy activities and implemented the copy behavior’s such as flatten hierarchy, preserve hierarchy and Merge hierarchy. Implemented Error Handling concept through copy activity.
• Exposure to Azure Data Factory activities such as Lookups, Stored procedures, if condition, for each, Set Variable, Append Variable, Get Metadata, Filter and wait.
• Create dynamic pipeline to handle multiple sources extracting to multiple targets; extensively used azure key vaults to configure the connections in linked services.
• Configured and implemented the Azure Data Factory Triggers and scheduled the Pipelines; monitored the scheduled Azure Data Factory pipelines and configured the alerts to get notification of failure pipelines.
• Implemented delta logic extractions for various sources with the help of a control table; implemented the Data Frameworks to handle the deadlocks, recovery, logging the data of pipelines.
• Reviewing individual work on ingesting data into azure data lake and provide feedbacks based on reference architecture, naming conventions, guidelines and best practices.
• Developing Spark (Python) notebooks to transform and partition the data and organize files in ADLS.
• Working on Azure Databricks to run Spark-Python Notebooks through ADF pipelines.
• Using Databricks utilities called widgets to pass parameters on run time from ADF to Databricks.
• Involved End-End logging frameworks for Data factory pipelines.

Confidential, Houston, TX

Technical Consultant

Responsibilities:

• Configuration and Setup for Inventory, PO and OM.
• Prepared SET-UP documents (BR-100) taking TO - BE (BP-080) documentation into consideration.
• Involved in Writing Test Scripts (TE-040) and Performed System Testing.
• Collected requirements for customized components from core users. Custom components include customized reports and forms.
• Mapping the data from legacy to Oracle ERP.
• Conducted CRP and UAT for the Key users.
• Involved in the Setups and configuration for OM, PO, INV and Advance Pricing.
• Setting up purchasing configurations with Approval Hierarchy.
• Coordinating with the onsite People to understand the requirement.
• Identifying Report Requirements Documents to guide technical team in developing reports and forms.
• Developed & tested along with technical team custom reports like PO printing.
• Developed several customizations on the PO forms in order to meet the business requirements.
• Worked on standard PO report customization (PO Communication report) to add additional columns and change the format as per client requirement.
• Developed PO Data Extract for Logistics Report.
• Worked on PO Report customization Open Purchase Orders Report to change the output as excel format.
• Worked on standard AP report customization (Invoice Validation) to add additional parameters and change the output format as Excel.

Confidential, Houston, TX

Technical Consultant

Responsibilities:

• Prepared the procedures, functions and packages to migrate the data into legacy systems to Oracle.
• To ensure successful flow of Business processes, providing technical support and working with Business Users daily.
• Developed the SQL Queries, Procedures, Functions and packages.
• Used various transformations like Query, SQL, Case, Map Operation, Table Comparison, Pivot, Merge, etc.
• Responsible for service management activities like incident management and change management, which included incident categorization, RCA preparation & validation, change approvals & follow-ups, mentoring & giving technical assistance to sub-ordinate.
• Involved in production support activities.