Data Engineer Resume
SUMMARY
- Over all 6+ years of experience as MSBI Consultant with a demonstrated history of working in Healthcare, Banking and Insurance. Skilled in Business Intelligence, ETL Technologies, Data warehousing, SQL, Data Analysis, Agile Methodologies and Business Analysis.
- Expertise in Data Warehousing, Data Migration, Data Integration and Reporting using SQL Service Integration Services, SQL Server Analysis Services, SQL Server Reporting Services and Tableau.
- Expertise in Software Development encompassing requirement analysis, architectural & technical design, POC creation, estimation, code review, technical discussion, implementation, re - factoring, deployment & documentation.
- Implemented various Data warehouse projects and supported those using Ralph Kimball and Bill Inmon methodologies.
- Experience in Extract, Transform, Load (ETL) of data into Data Warehouse using SSIS 2012, 2013
- Experience in designing Workflows, Mappings and scheduling them using SQL Agent Job in SSMS and JAMS.
- Performed data profiling and analysis using Data Profiling Task in SQL Server Integration Services and ERWIN tool.
- Experience in SQL Query Optimization and Performance Tuning using Indexes
- Experience driving in-person discussions with senior personnel regarding best practices, project management and risk mitigation for data warehousing.
- Extracting and loading data from various sources (Oracle, Flat Files, XML, and Excel) into MS SQL Server by using BCP Utility.
- Experience in developing Inbound and Outbound process for file import and export through FTP and SFTP by using SSIS
- Hands on experience on logical and physical data modelling, code review process, data normalization processes, data integration methods, Agile SDLC and production support.
- Experience in coordination with Data Integration, Network, DBA, Server Systems and Storage Systems for cross-team projects, resource procurement, system maintenance and upgrades and change management.
- Experience working in all phases of the Software Development Life Cycle (SDLC). Worked in Kanban and Agile with frequent releases and providing immediate solutions for business needs.
- Worked on programming languages such as VB.NET, C#.NET, Java.
- Script Experience in writing Expressions in SSRS and Expertise in Fine Tuning the reports. Created many Drill Through and Drill Down reports using SSRS and created Subscriptions to deliver reports.
- Possess effective analytical and problem-solving skills to work in multicultural environment for delivery excellence.
TECHNICAL SKILLS
Data Warehousing /ETL Tools: SQL Server Integration Services 2008, BI2012, 2013(Source Analyzer, Data Warehouse Designer, Mapping Designer, Transformations, Workflow Manager, Workflow Monitor)SQL Server Reporting Services 2014, SQL Server 2008 R2 Reporting ServicesTableau
Databases: SQL Server 2014/2012/2008 R2, Oracle, MS Access 2013
Languages: SQL, TSQL, PL/SQL, VB Script, C#, HTML
SDLC: Agile, Scrum, Waterfall, Kanban
Source Control: Team Foundation Server (TFS), SharePoint
Scripting Languages: VB Script, C#, Java
PROFESSIONAL EXPERIENCE
Confidential
Data Engineer
Responsibilities:
- Develop enterprise-level software that meets business needs using primarily Microsoft technologies.
- Conform to industry best practices for code construction, software security, data security, scalability, and performance.
- Meticulously created and supported Inbound and Outbound process of data.
- Provide reliable estimation of work and commit best efforts to delivering work in alignment with those estimates.
- Consistently maintain a high level of quality in developed code.
- Collaborate with other technology professionals (e.g., developers, testers, infrastructure personnel, DBAs, external vendors, etc.) on key architectural decisions and delivery of work.
- Demonstrate diligence, initiative, and follow-through in the execution of job duties.
- Develop and maintain SSIS packages and workflows, SQL queries, VB//C# script components, schedules, etc. using TFS for version control.
- Understand and maintain appropriate data release documentation and approvals according to company policies and procedures.
- Develop processes to identify and analyse data quality issues and recommendations to resolve.
- Provide analysis and troubleshooting support to QA, Developers, Support and others allowing them to complete their assignments.
- Tune queries and stored procedures for optimal performance.
- Actively helping in existing workflows for performance optimization.
- Converted existing DTS packages to SSIS 2013, moving database from SQL 2004 to SQL 2016
- Provided alternative solutions to reduce execution time from 2+ hours to 10 min.
Environment: MS SQL Server 2012,2014 TSQL, SSIS 2013, Tableau, Erwin, SQL Profiler, Excel, Share Point, TFS, MDX, Tabular Cube
Confidential
ETL Developer
Responsibilities:
- Collaborated with project teams to organize JRD meetings and gather business requirements from business users and SMEs.
- Performed analyses of OLTP databases and created an ETL mapping document.
- Maintained referential, domain, and entity integrities with available options such as constraints and triggers.
- Incorporated database objects with T-SQL such as stored procedures, UDFs, triggers, and indexes to create complex scripts and batches.
- Utilized CTEs, views and temporary tables to store intermediate results of complex queries for further operations.
- Implemented different indexing strategies for query optimization such as covering indexes, indexed views, and index defragmentation.
- Identified different dimensions and fact tables to be included within the target OLAP system.
- Utilized various connection managers in SSIS package such as OLEDB, Flat file, and Excel to extract data from different kind of sources and transferred them into staging area.
- Created stored procedures and utilized data profiling task in SSIS to profile data and understanding potential problems with data quality.
- Created SSIS packages to implement various transformations such as lookup, data conversion, derived column and fuzzy lookup for data cleansing.
- Utilized Execute SQL Task in SSIS to call different stored procedures from TSQL created for profiling and incremental load.
- Incorporated error redirection during ETL loads in SSIS packages with row redirect in data flow task.
- Configured and deployed SSIS packages to the production server with parameters in the SSISDB catalog.
- Implemented and documented unit testing and system testing of the entire ETL process.
Environment: MS SQL Server 2012,2014, TSQL, SSIS 2013, Tableau, Erwin, SQL Profiler, DAX, Excel, Share Point, TFS, MDX, Tabular Cube
Confidential
SQL ETL Developer
Responsibilities:
- Worked with the business analysts for requirements gathering and project coordination.
- Developed functional/technical specifications based on business requirement document.
- Enhanced the old logical and physical database design to fit new business requirement, and implemented new design into SQL Server.
- Created stored procedures to implement complex business logic and preserving execution plan for improved performance.
- Developed various views and materialized views that will be accesses by both the end users and the database administrators.
- Designed and implemented clustered and non-clustered indexes on tables ensuring the efficiency and latency of queries.
- Optimized the performance of slow running SQL queries utilizing multitude of SQL constructs such as joins, CTEs, enforcing indexing/partitioning strategies and utilizing SQL Profiler/DTA as part of optimization process.
- Created pre-staging and staging databases as intermediate stages for populating data mart and to perform ETL operations.
- Designed several complex SSIS packages utilizing different transformations like fuzzy lookup, fuzzy grouping, conditional splits, multicasting and audit.
- Involved in the troubleshooting of SSIS packages and solved several issues related to execution, development and performance.
- Implemented event handlers, loggings, and data viewers for effective debugging of SSIS packages.
- Configured the SSIS packages properties and deployed on production server.
- Created SQL agent jobs for execution of SSIS packages per requirements.
- Collaborated with cross-functional team members utilizing TFS (Team Foundation Server) as a part of version control tool.
Environment: MS SQL Server 2012, TSQL, SSIS, SSAS, SSRS, Erwin, SQL Profiler, DTA, Excel, Share Point, TFS, MDX, DAX