We provide IT Staff Augmentation Services!

Sr. Data Engineer Resume

4.00/5 (Submit Your Rating)

PROFESSIONAL SUMMARY:

  • Around 5 years of experience in Analysis, Design, Development, and Implementation as a Data Engineer,SQL BI developer.
  • Extensive experience in Data Modeling, Design, Development, Implementation & Administration of Database systems using
  • Plan and Develop roadmaps and deliverables to advance the migration of existing solutions on - premises systems/applications to Azure cloud
  • Experienced in gathering the requirements from stake holders and generating the reports based on their needs.
  • Experience with Azure transformation projects and Azure architecture decision making Architect and implement ETL and data movement solutions using Azure Data Factory (ADF), SSIS.
  • Experienced in Migrating the dats from Oracle cloud to Azure Warehouse using Oracle BICC, UCM and ADF pipelines.
  • MSSQL 2008/2012/2014 for both OLTP (Batch Processing, Online Processing) & Data warehousing Systems (SSRS, SSIS, SSAS)
  • Experience in SDLC methodologies & Agile/Waterfall project methodologies in Analysis, Design, Development, Testing and Implementation of client-server-based applications.
  • Experience in writing COSMOS scripts and dumping data into databases using COSMOS streams.
  • Experience in using Maestro tool for processing the data into COSMOS DB.
  • Experience in database programming in writing Stored procedures, User Defined Data Types, Triggers, Constraints, Indexes, CTEs and Batch Scripts using T-SQL/PL-SQL
  • Excellent knowledge of performance tuning in stored procedures and queries, using tools like SQL Profiler, Execution Plans, Database Tuning Advisor, DMV's with efficient coding standards.
  • Experience on Migrating SQL database to Azure data Lake, Azure data lake Analytics, Azure SQL Database, Data Bricks and Azure SQL Data warehouse and Controlling and granting database access and Migrating On premise databases to Azure Data lake store using Azure Data factory.
  • Strong knowledge and experience in error handling of SSIS packages. using transactions, check points (package restart ability features), break points and error logging procedures.
  • Architect & implement medium to large scale BI solutions on Azure using Azure Data Platform services (Azure Data Lake, Data Factory, Data Lake Analytics, Stream Analytics, Azure SQL DW, Databricks, NoSQL DB)
  • Extract Transform and Load data from Sources Systems to Azure Data Storage services using a combination of Azure Data Factory, T-SQL and Azure Data Lake Analytics. Data Ingestion to one or more Azure Services - (Azure Data Lake, Azure Storage, Azure SQL, Azure DW) and processing the data in In Azure Databricks.
  • Highly experienced in full cycle of DTS/SQL server integration services (SSIS 2008/2012/2014 ) Packages (Developing, Scheduling, Configuring, Troubleshooting and monitoring) for performing data transfers and ETL Purposes across different servers.
  • Interpreting and working with data models, data flows and data dictionaries, logical & physical Data modeling, Normalization and De-Normalization techniques for both OLTP and OLAP systems.
  • Implemented Subscription, schedule refresh, data alert utilizing Power BI Gateway.
  • Highly skilled in developing OLAP cubes using SSAS 2008/2012/2014, calculating measures, measure groups and dimension members in SQL Server Analysis Services using multi-dimensional expression (MDX), mathematical formulae, and user-defined functions.
  • Good knowledge on Azure Data Factory (ADF) and implementing various operations or techniques involved in Azure Data Factory.
  • Good understanding and self-paced learning on, Azure Data Bricks and Data Mart.
  • Expert in Data Extraction, Transforming and Loading (ETL) using various tools such as SQL Server Integration Services (SSIS), DTS, Bulk Insert and BCP.
  • Worked on performing various SSIS data transformation tasks like Lookups, Fuzzy Lookups, Conditional Splits and Event Handlers, Error Handlers etc.
  • Extracted, transformed and loaded data from various heterogeneous data sources and destinations using several SSIS components.
  • Experience in Error and Event Handling, Logging for SSIS Packages.
  • Strong experience in performance tuning and query optimization using tools like SQL Server Profiler, Query execution plan etc.

PROFESSIONAL EXPERIENCE:

Sr. Data Engineer

Confidential

Responsibilities:

  • Design and implement database solutions in Azure SQL Data Warehouse, Azure SQL
  • Migration of on-premises data (Oracle/ SQL Server/ DB2/ MongoDB) to Azure Data Lake Store (ADLS) using Azure Data Factory (ADF).
  • Created Pipelines which pulls data from Oracle BICC to Data Warehouse using Azure Data Factory (ADF) using Azure functions in it.
  • Created Azure SQL database, performed monitoring and restoring of Azure SQL database. Performed migration of Microsoft SQL server to Azure SQL database.
  • Direct interactions with Stakeholders/Directors of different groups for requirements gathering and generating the reports as per their needs.
  • Performed as Lead by managing the Offshore team and onsite team members.
  • Developed and maintained multiple Power BI dashboards/reports and content packs
  • Created POWER BI Visualizations and Dashboards as per the requirements
  • Experience in working with M language query in Power BI.
  • Develop dashboards and visualizations to help business users analyze data as well as providing data insight to upper management with a focus on Microsoft products like SQL Server Reporting Services (SSRS) and Power BI.
  • Engage with business users to gather requirements, design visualizations, and provide to use self-service BI tools.
  • Developed and maintained multiple Power BI dashboards/reports and content packs
  • Created POWER BI Visualizations and Dashboards as per the requirements
  • Used various sources to pull data into Power BI such as SQL Server, Excel, Oracle, SQL Azure etc.
  • Experience managing Azure Data Lakes (ADLS) and Data Lake Analytics and an understanding of how to integrate with other Azure Services. Knowledge of USQL and how it can be used for data transformation as part of a cloud data integration strategy
  • Created offerings in Oracle BICC based on the business requirements and pulled those data into Azure Cloud by designing an ADF pipeline.
  • Develop and implement new process and preparing documentation for it.
  • Worked on SQL Server Integration Services (SSIS), SSAS, SSRS, T-SQL skills, stored procedures, triggers
  • SQL Server Analysis Services (SSAS) and SQL Server Reporting Services (SSRS) and Familiarity with Excel PowerPivot, Power View, and Power BI

Environment: Microsoft Azure, Azure Data Factory (ADF), Azure Data Bricks (ADB), Azure Functions, MS SQL Server 2014/2012, SSIS/SSAS/SSRS, Data Modeling, T-SQL, Visual Studio 2010/2012, Oracle UCM, Oracle HCM, Project

Sr. Data Engineer

Confidential

Responsibilities:

  • Responsible to lead the team and support the Migrating efforts for different line of business groups.
  • Used SSIS for performing ETL operations and created SSIS packages to schedule them to run based on requirements.
  • Designed ETL packages dealing with different data sources (SQL Server, Flat Files) and loaded the data into target data sources by performing different kinds of transformations using SSIS.
  • Designed and tested (Unit, Integration and Regression) packages to extract, transform and load data using SQL Server Integration Services (SSIS).
  • Loaded flat files into SQL Server tables and vice versa using SSIS.
  • Modifying scripts to handle automated Loading/Extraction and Transformation (ETL) of data using SSIS.
  • Played a Key role in Data analysis and the design and development activities to ensure software requirements are met.
  • Migrated reports from EDI to Tableau and created new reports in Tableau along with the statistics.
  • Served as a Senior Data Engineer (LEAD) within the MIS/Custom Development arm of the Collaboration and Reporting group.
  • Migrated all the existing reports from EDI to Tableau.
  • Responsible for complete end to end reporting solution analysis, gather business requirements, and develop portable reporting solutions.
  • Responsible as highest level technical role as an individual contributor and/or team lead for the most complex MIS Data Engineering applications and/or application initiatives.
  • During implementations (usually at night), responsible for validation and support of the implementation. Acted as On-Call Tier 3 support.
  • Utilizes a thorough understanding of available technology, tools, and existing designs.
  • Work on the most complex problems where analysis of situations or data requires evaluation of intangible variance factors.
  • Plan, perform, and act as the escalation point for the most complex platform designs, coding, and testing.
  • Build reports and dashboards using SQL coding in Tableau.
  • Acted as technical resource to project team in the development, testing, and implementation process.
  • Performance tuning MDX and dimensions design and scaling to large numbers of users in SQL Server Analysis Services (SSAS).
  • Developed various dashboards using Power BI to facilitate informed decision making.
  • Involved in Mock testing, Unit Testing and Integration testing in SSIS, SSAS.

Environment: MS SQL Server 2014/2012, SSIS/SSAS/SSRS, Data Modeling, Big Data, T-SQL, Visual Studio 2010/2012, C#, SQL Server Profiler, Oracle 10g, Power BI, Power Query, SSMS, Team Foundation Server (TFS), SQL Server Data tools, Business Objects, SharePoint 2012.

Sr. SQL/ BI Developer

Confidential

Responsibilities:

  • Responsible for Design, Development, and testing of SSIS Packages to load data from various Databases and Files.
  • Worked on Azure pricing analysis & Office 365 Subscriptions and its pricing.
  • Used MAESTRO tool to load the data into SQL servers by creating the cost jobs.
  • Responsible to design COSMOS code to generate data and load them into servers.
  • Used COSMOS streams to load the data into databases using Maestro and generated reports using that data bases on the stake holders' requirements.
  • Designed ETL packages dealing with different data sources (SQL Server, Flat Files) and loaded the data into target data sources by performing different kinds of transformations using SSIS.
  • Modifying scripts to handle automated Loading/Extraction and Transformation (ETL) of data using SSIS.
  • Responsible for coding SSIS processes to import data into the Data Warehouse from Excel spreadsheets, Flat Files and OLEDB Sources.
  • Implemented data partitioning to improve the performance of large table reduces contention and increases availability of data.
  • Worked on various tasks and transformations like Execute SQL Task, Execute Package Task, and Conditional split, Script Component, Merge and Lookup while loading the data into Destination.
  • Performed Incremental load with several Dataflow tasks and Control Flow Tasks using SSIS.
  • Organized Error and Event Handling by giving Precedence Constraints, Break Points, Check Points, logging to send the result files to the clients and vendors.
  • Created stored procedures, Triggers, User-defined Functions, Views for both Online and Batch requests handling business logic and functionality of various modules.
  • Involved in performance tuning using Activity Monitor, Performance Monitor, SQL Profiler, SQL Query Analyzer and Index tuning wizards.
  • Implemented batch processing using Jobs and DTS.
  • Designed the user interface screens and implemented application logic under the Microsoft .NET framework using C# to use .NET features powered with CLR.
  • Involved in implementing Key Performance Indicator (KPI) Objects in SSAS and Created calculate member in OLAP cube using MDX in SSAS.
  • Involved in Mock testing, Unit Testing and Integration testing in SSIS, SSAS.

Environment: MS SQL Server 2014/2012, SSIS/SSAS/SSRS, ADF, ADB, ADL, Data Modeling, Big Data, T-SQL, Visual Studio 2010/2012, C#, SQL Server Profiler, Power BI, Power Query, SSMS, Team Foundation Server (TFS), SQL Server Data tools, SharePoint 2012.

BI Developer

Confidential

Responsibilities:

  • Worked closely with Stakeholders for gathering the requirements and developed the reports based on requirements.
  • Involved in reviewing the Investments application and interacting with business users to understand the user requirements and involved in all phases of SDLC.
  • Responsible for coding SSIS processes to import data into the Data Warehouse from Excel spreadsheets, Flat Files and OLEDB Sources.
  • Created and maintained database mapping document which mapped the old tables to the new ones.
  • Developed stored procedures, user-defined functions, triggers, indexes and views.
  • Involved in query optimization for faster processing of queries.
  • Created allocation and other reports using SQL Server Reporting Services (SSRS).
  • Designed and tested (Unit, Integration and Regression) packages to extract, transform and load data using SQL Server Integration Services (SSIS).
  • Loaded flat files into SQL Server tables and vice versa using SSIS.
  • Designed packages which utilized tasks and transformations such as Execute SQL Task, Data Flow Task, Sequence Container, For Each Loop Container, Lookup, Aggregate, and Expression.
  • Created XML configuration files to dynamically alter package properties.
  • Developed error handling routines for packages using both script tasks as well as in the error handling tab.
  • Developed Unit Test Plans for SSIS packages.
  • Responsible for allocating responsibilities and coordinating ETL efforts among team members to ensure best practices are used.
  • Involved in regular code inspections to ensure business and system requirements are met.
  • Scheduled package execution using SQL Server Management Studio to execute packages on a daily/weekly basis.
  • Documented ETL processes and prepared project status report updates/audit reports/ list of issue items that need to be reviewed.
  • Involved in project scope, schedule planning and project impact assessments.
  • Created stored procedures, Triggers, User-defined Functions, Views for both Online and Batch requests handling business logic and functionality of various modules.
  • Involved in performance tuning using Activity Monitor, Performance Monitor, SQL Profiler, SQL Query Analyzer and Index tuning wizards.

Environment: MS SQL Server, MS SQL Server Reporting Services, MS SQL Server Analysis Services, Data Modeling, Big Data, T-SQL, Power BI, MS SQL Server Integration Services, Visual SourceSafe, Erwin v7.2, ASP.Net, C#, SCRUM, MS Project, SharePoint, MS Visio.

SQL Developer

Confidential

Responsibilities:

  • Performed data migration from SQL server 2005 to SQL Server 2008.
  • Created SSRS reports for the provider and vendor and making sure the payments were processed correctly
  • Performed data conversion from flat files into a normalized data structure.
  • Defined many constraints, indexes and views.
  • Scheduled multiple jobs for SSIS packages and which performed integration from different flat files/excel files into the database.
  • Worked on backup of master and system databases and restored them whenever necessary.
  • Created SSIS packages to validate, extract, transform and load data into the database and make necessary actions by keeping the stored procedures in the execute SQL tasks.
  • Executed data validation stored procedures in SSIS packages in Business Intelligence Development Studio (BIDS).
  • Worked in Agile development methodology environment.
  • Worked on normalizing the data by making sure there is no redundancy over multiple tables and placed them in a single table.
  • Applied necessary indexes based on the execution plan.

Environment: Visual Studio 2005, MS SQL Server 2005/2008/2008 R2 SQL Server 2005/2008, SSRS 2005, SSIS 2005, BIDS, MS Visio.

We'd love your feedback!