We provide IT Staff Augmentation Services!

Senior Data Engineer Resume

5.00/5 (Submit Your Rating)

SUMMARY

  • 13+ years of professional IT experience which includes experiences in databases and Data Warehousing in large volume data processing and expertise in ingestion, storage, querying, processing and analytics of structured and unstructured data on SQL Server BI, Analysis Services, and Hadoop/Spark Ecosystem
  • Expertise in Python 3.3, numpy, scipy, pandas, matplotlib, spark, Cloudera Hadoop, HDFS
  • Extensive experience in SQL SERVER 2017/2016, SSIS, SSRS, SSAS, SQL Azure, Azure Analysis Services, Azure Data Factory, Power BI
  • Cloudera Certified Developer on Spark and Hadoop ( CCA175 )
  • Experience in AWS cloud - AWS Certified Cloud Practitioner
  • Contributor on StackOverflow, author on Mssqltips and my blog
  • Experience in C# and Microsoft Azure - Microsoft certified Azure Architect with specialization on data
  • Expert in dimensional modeling and designing SSAS tabular cube as per Kimball group of dimensional modeling techniques
  • Experience in Microservices architecture using C# and Azure services
  • Experience in designing and implementing relational database model as per business needs using Erwin Data Modeler and MS Visio
  • Proven ability to implement and adhere to SDLC, AGILE (SCRUM) methodologies
  • Experience in Functional Solution Architecture for ETL & Business Intelligence projects in Enterprise Data Warehouse space
  • Extensive Consulting Experience, architectural capabilities with presales ability
  • Extensive experience in sizing, scoping, estimation, risk management, release management and change management on BigData and DataWarehousing projects

TECHNICAL SKILLS

Databases: SQL Server 2017/16/14/12/2008 (R2)/2008, SQL Azure, DB2, Oracle

Big Data: Python 3.3, Hadoop(2.6), Apache Spark (1.6.2), Spark SQL, HDFSMap Reduce, Hive, Numpy, Pandas, Matplotlib

BI Tools: SSIS, SSAS, Azure Data Factory, Microsoft Internal ETL Tool MeTAL3.0Azure Analysis Services, Azure Data warehouse, Amazon Redhshift

Data Visualization: SQL Server Reporting Services(SSRS), Power BI, Tableau, Quicksight

Data Modeling Tools: Erwin, Visio

NoSQL: Azure Document DB

Version Control: Visual Studio Online, Source Tree, VSTF, Visual Source Safe, SVN, Git

Development Tools: Visual Studio 2013, 2015, 2017, Eclipse, Intellij, VSO

PROFESSIONAL EXPERIENCE

Confidential

Senior Data Engineer

Responsibilities:

  • Design and development of end to end Data warehousing from data extraction, transformation and loading to DataMart along with reports generation
  • Analysis of business requirement and generating Source to Target mapping
  • Implemented dimensional modeling by defining dimensions, facts along with relationships based on reporting analytical requirements
  • Analysis and design of slowly changing dimensions based on the requirements
  • Design and Development of ETL using SSIS, cube using Analysis Services and Analytics reporting using SSRS and Power BI
  • Implemented custom security (my blog) with single sign-on authentication based on SAML 2.0 using C# and SSRS

Confidential

Sr. Software Development Engineer

Responsibilities:

  • Developed end to end SSIS with Fuzzy lookup component for company matching with existing Microsoft Sales information for enrichment.
  • Messages we receive from Marketo to Azure Service Bus and experience in processing messages in separate Services. Overall project is in MicroServices and one of the service is to enhance customer data
  • Involved in designing high volume Tabular model cube in SSAS 2016 to provide hot path analytics solution
  • Designed Row level security using existing User dimension in SSAS Tabular model
  • Design and development of SSRS reports to showcase BI and analytics for healthcare
  • Integrated SAML based single-sign on authentication in SSRS
  • Developed data ingestion using SQOOP to ingest data from SQL Server to Hadoop Distributed File System (HDFS)
  • Developed email and domain fuzzy matching using Python and Map Reduce and stored matched data into HDFS
  • Implemented continuous Integration and continuous deployment using Powershell and Visual Studio Online for SQL and SSIS deployments

Confidential

Sr. Software Development Engineer

Responsibilities:

  • Interviewing clients to understand and gather business requirements and assist in creating Business Requirement Document (BRD)
  • Designed and developed SSIS and T-SQL stored procedures to transfer data from transactional databases to staging area and finally transfer into reporting data structure
  • Designed and developed Archival framework for large volume of transactional data which provides online/offline data movement and purging
  • Developed SSIS packages to ingest data into Azure DocumentDB to process NoSQL data
  • Designed and developed In-Memory OLTP for SQL Server 2014 for faster transactional data
  • Proof of concept to migrate data from SQL Server 2012 IaaS server to Azure SQL PaaS database
  • Designed and developed solution for scrubbing data by masking production PII information on development and test environments
  • Implemented Continuous Integration-Continuous delivery(CICD) using SQL DACPAC and Powershell
  • Involved in performance tuning for large volume of transactional data
  • Involved in migrating data from SQL Server 2012 to SQL Server 2014

We'd love your feedback!