We provide IT Staff Augmentation Services!

Senior Data Engineer Resume

4.00/5 (Submit Your Rating)

Boston, MA

SUMMARY

  • Microsoft BI leader and evangelist. Hands on working knowledge of current and pipeline technologies, BI Semantics, Data warehouse,Data Quality Services, PowerPivot and PowerView, SharePoint Services, metrics\KPI\scorecard driven analytics and management.
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, AWS Cloud and Azure technologies
  • Architect the process on AWS platform for processing advertising data using S3, AWS Data pipeline and Redshift.
  • Configured AWS account security in such a way that it user has minimum privileges and still be able to do what engineers need to do for their project. Defined the Design roles and groups using AWS Identity and Access Management (IAM).
  • Defined and outlined the EDW strategic planning including roadmap, context diagrams, and process maps.
  • Designed, developed, and architected complete and integrated BI on demand single version of corporate data that has been portioned, aggregated, highly indexed, portioned and secured for use through SharePoint, Excel Services, and Excel Pivot tables through the use of SSAS cubes
  • Lead the definition, requirements, architecture,master data managementand development of corporate post bind, corporate data marts and defined / maintained corporate standards, access, definitions, and integration (Informatica, MS SQL Server SSIS/DTS jobs/packages) for new data and reporting.
  • Technical leadership and has hands on design. Development, monitoring, tuning, and management of integrated ETL (SSIS), Aggregations\Cubes\MDX (SSAS), reporting (SSRS), Excel Pivot Tables, Analysis and Forecasting, SharePoint, Data Governance, and Team Foundation Server.

TECHNICAL SKILLS

Azure Technologies: Azure Data lake, Azure Data Factory, Azure Analysis Services, Azure Databricks, Azure Synapse Analytics

AWS: AWS EC2, AWS Data Pipeline, AWS Redshift, AWS S3, IAM

ETL Tools: SQL Data Tools, SQL Server Integration Service (SSIS), SQL Server DTS, Informatica Cloud

OLAP/Reporting: SharePoint Business Intelligence 2013 and PowerPivot, PowerView, PerformancePoint, SQL Server Analysis Service (SSAS), SQL Server Reporting Service(SSRS), Cognos, Tableau, Looker

SQL Server Tools: Business Intelligence Development Studio, Enterprise manager, Query Analyzer, SQL Profiler, Export and Import (DTS), SSIS, Visio, SQL Navigator

Languages: Python 3, T - SQL, PL/SQL, C, C++, C#

RDBMS: MS SQL Server 2018, 2017, 2008, Oracle 10g, MS-Access, PostgreSQL

NoSQL Database: MongoDB

CRM: Microsoft Dynamics CRM, Salesforce

Big Data Technology: HDFS, Hive, Pig, MapReduce

Version Control System: GitHub, SVN, Bitbucket, Tortoise Git

PROFESSIONAL EXPERIENCE

Confidential, Boston, MA

Senior Data Engineer

Responsibilities:

  • Formulated next generation analytics environment, providing self-service, centralized platform for all data-centric activities which allows full 360-degree view of members and provider data from raw medical and pharmacy claims, enrollment, providers, member demographics.
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, AWS Cloud and Azure technologies.
  • Work with our Data Science team to assist with data prep and data enrichment for predictive modelling work with and provide updates to the customer success team.
  • Design and develop automated data pipeline for data ingestion, cleansing, enrichment, profiling, unification, etc.
  • Provide technical leadership and work with client data teams to gain an understanding of inbound data
  • Lead advancement of engineering practices such as code and design reviews and the definition of source control strategy, environment strategy, and build and deployment pipeline.

Confidential, Boston, MA

Data Engineer

Responsibilities:

  • Created an AWS Data pipeline to load advertising data into AWS Redshift.
  • Create Dimension and fact table tables in Amazon Redshift using sortkeys, distkeys and primary-foreign key references to optimize performance.
  • Understanding of creating a Databricks ELT using SQL notebook on spark cluster.
  • Worked in Informatica Cloud for the Extraction, Transformation and Loading from various sources (SQL server, Salesforce and Redshift) to the enterprise data warehouse Developed and tested extraction, transformation and load (ETL) processes.
  • Scripted advanced SQL queries in Postgresql for Redshift and MySQL leveraging Common Table Expressions, sub-queries, correlated sub-queries, window functions and complex join logic.

Confidential, Boston, MA

Sr. Business Intelligence Developer - Team Lead

Responsibilities:

  • Responsible for architecting and developing ETL strategy and framework for migrating data from the operational data sources to master data repository - coding, testing and deployment
  • Lead the BI effort to provide reports to internal and external customers generated through SQL Server Reporting Services to ensure the accuracy of the reports, especially total dollar amounts as reported across varying dimensions.
  • Defined scope and requirements for a project to integrate Best Doctor’s insurance system with new acquired company’s policy and claim system.
  • Facilitated meetings with the various business department. Established change control process for this project to control scope.

Confidential, Worcester, MA

Sr. Database Developer

Responsibilities:

  • Developed numerous SSIS ETL extracts from Data warehouse data merged with external sources; requiring reference between OLAP and OLTP data sources, for use by external clients like MASSHEALTH and contracted providers.
  • Developed hundreds of custom stored procedures to support custom data requirements and complex logic to calculate claim data for claim analytics department.
  • Assess existing and available data warehousing technologies and methods to ensure our Data warehouse/BI architecture meets the needs of the business unit and enterprise and allows for business growth.

Confidential

Business Intelligence Developer

Responsibilities:

  • Perform the tasks of gathering and compiling health data as well as transform them into accurate information for future reference.
  • Interfacing with the application development team to review/approve/develop and implement all database changes.
  • Created a medical claim vs policy utilization reports for different matrix and review the same for quality assurance of data.

Confidential, NYC, NY

SQL Server Developer

Responsibilities:

  • Worked with various business groups while developing their applications, assisting in database design phasing from development to QA and to Production environment.
  • Developed User defined functions, store procedure, view, CTE and dynamic SQL code for manipulation of existing application.
  • Collaborated with the front-end developer to put in the business rules. Wrote procedure to check some of the rules at the backend at the time of entering data.

Confidential, Linden, NJ

Business Intelligence Developer

Responsibilities:

  • Created SSIS Packages to migrate the data from different database sources (Text files, Excel Spreadsheets) to SQL Server Database using SSIS.
  • Responsible for Query optimization and Performance tuning, tuned SQL queries using Show Plans and Execution Plans

Confidential

Database Developer

Responsibilities:

  • Wrote various Stored Procedures, User-Defined Functions, Triggers, Cursors, and Views.
  • Involved in Design, Development, Testing, Data Migration, Parallel Systems and Deployment.
  • Database designing of new applications and database changes to existing applications.

We'd love your feedback!