Data Engineer Resume
SUMMARY
- Over all 6+ years of experience as MSBI Consultant with a demonstrated history of working in Healthcare, Banking and Insurance. Skilled in Business Intelligence, ETL Technologies, Data warehousing, SQL, Data Analysis, Agile Methodologies and Business Analysis.
- Expertise in Data Warehousing, Data Migration, Data Integration and Reporting using SQL Service Integration Services, SQL Server Analysis Services, SQL Server Reporting Services and Tableau.
- Expertise in Software Development encompassing requirement analysis, architectural & technical design, POC creation, estimation, code review, technical discussion, implementation, re - factoring, deployment & documentation.
- Implemented various Data warehouse projects and supported those using Ralph Kimball and Bill Inmon methodologies.
- Experience in Extract, Transform, Load (ETL) of data into Data Warehouse using SSIS 2012, 2013
- Experience in designing Workflows, Mappings and scheduling them using SQL Agent Job in SSMS and JAMS.
- Performed data profiling and analysis using Data Profiling Task in SQL Server Integration Services and ERWIN tool.
- Experience in SQL Query Optimization and Performance Tuning using Indexes
- Experience driving in-person discussions with senior personnel regarding best practices, project management and risk mitigation for data warehousing.
- Extracting and loading data from various sources (Oracle, Flat Files, XML, and Excel) into MS SQL Server by using BCP Utility.
- Experience in developing Inbound and Outbound process for file import and export through FTP and SFTP by using SSIS
- Hands on experience on logical and physical data modelling, code review process, data normalization processes, data integration methods, Agile SDLC and production support.
- Experience in coordination with Data Integration, Network, DBA, Server Systems and Storage Systems for cross-team projects, resource procurement, system maintenance and upgrades and change management.
- Experience working in all phases of the Software Development Life Cycle (SDLC). Worked in Kanban and Agile with frequent releases and providing immediate solutions for business needs.
- Worked on programming languages such as VB.NET, C#.NET, Java.
- Script Experience in writing Expressions in SSRS and Expertise in Fine Tuning the reports. Created many Drill Through and Drill Down reports using SSRS and created Subscriptions to deliver reports.
- Possess effective analytical and problem-solving skills to work in multicultural environment for delivery excellence.
Core Competencies
- Database Administration / Management
- SQL Performance Tuning
- Performance Improvement
- Solution Architecture & Design
- Requirement Gathering & Analysis
- Technical & Business Analysis
- Change Management / Risk Management
- People Management & Training
TECHNICAL SKILLS
Data Warehousing /ETL Tools: SQL Server Integration Services 2008, BI2012, 2013(Source Analyzer, Data Warehouse Designer, Mapping Designer, Transformations, Workflow Manager, Workflow Monitor), SQL Server Reporting Services 2014, SQL Server 2008 R2 Reporting Services, Tableau
Databases: SQL Server 2014/2012/2008 R2, Oracle, MS Access 2013
Languages: SQL, TSQL, PL/SQL, VB Script, C#, HTML
SDLC: Agile, Scrum, Waterfall, Kanban
Source Control: Team Foundation Server (TFS), SharePoint
Scripting Languages: VB Script, C#, Java
PROFESSIONAL EXPERIENCE
Confidential
Data Engineer
Responsibilities:
- Develop enterprise-level software that meets business needs using primarily Microsoft technologies.
- Conform to industry best practices for code construction, software security, data security, scalability, and performance.
- Meticulously created and supported Inbound and Outbound process of data.
- Provide reliable estimation of work and commit best efforts to delivering work in alignment with those estimates.
- Consistently maintain a high level of quality in developed code.
- Collaborate with other technology professionals (e.g., developers, testers, infrastructure personnel, DBAs, external vendors, etc.) on key architectural decisions and delivery of work.
- Demonstrate diligence, initiative, and follow-through in the execution of job duties.
- Develop and maintain SSIS packages and workflows, SQL queries, VB//C# script components, schedules, etc. using TFS for version control.
- Understand and maintain appropriate data release documentation and approvals according to company policies and procedures.
- Develop processes to identify and analyse data quality issues and recommendations to resolve.
- Provide analysis and troubleshooting support to QA, Developers, Support and others allowing them to complete their assignments.
- Tune queries and stored procedures for optimal performance.
- Actively helping in existing workflows for performance optimization.
- Converted existing DTS packages to SSIS 2013, moving database from SQL 2004 to SQL 2016
- Provided alternative solutions to reduce execution time from 2+ hours to 10 min.
Environment: MS SQL Server 2012,2014 TSQL, SSIS 2013, Tableau, Erwin, SQL Profiler, Excel, Share Point, TFS, MDX, Tabular Cube
Confidential
ETL Developer
Responsibilities:
- Collaborated with project teams to organize JRD meetings and gather business requirements from business users and SMEs.
- Performed analyses of OLTP databases and created an ETL mapping document.
- Maintained referential, domain, and entity integrities with available options such as constraints and triggers.
- Incorporated database objects with T-SQL such as stored procedures, UDFs, triggers, and indexes to create complex scripts and batches.
- Utilized CTEs, views and temporary tables to store intermediate results of complex queries for further operations.
- Implemented different indexing strategies for query optimization such as covering indexes, indexed views, and index defragmentation.
- Identified different dimensions and fact tables to be included within the target OLAP system.
- Utilized various connection managers in SSIS package such as OLEDB, Flat file, and Excel to extract data from different kind of sources and transferred them into staging area.
- Created stored procedures and utilized data profiling task in SSIS to profile data and understanding potential problems with data quality.
- Created SSIS packages to implement various transformations such as lookup, data conversion, derived column and fuzzy lookup for data cleansing.
- Utilized Execute SQL Task in SSIS to call different stored procedures from TSQL created for profiling and incremental load.
- Incorporated error redirection during ETL loads in SSIS packages with row redirect in data flow task.
- Configured and deployed SSIS packages to the production server with parameters in the SSISDB catalog.
- Implemented and documented unit testing and system testing of the entire ETL process.
Environment: MS SQL Server 2012,2014, TSQL, SSIS 2013, Tableau, Erwin, SQL Profiler, DAX, Excel, Share Point, TFS, MDX, Tabular Cube
Confidential
SQL ETL Developer
Responsibilities:
- Worked with the business analysts for requirements gathering and project coordination.
- Developed functional/technical specifications based on business requirement document.
- Enhanced the old logical and physical database design to fit new business requirement, and implemented new design into SQL Server.
- Created stored procedures to implement complex business logic and preserving execution plan for improved performance.
- Developed various views and materialized views that will be accesses by both the end users and the database administrators.
- Designed and implemented clustered and non-clustered indexes on tables ensuring the efficiency and latency of queries.
- Optimized the performance of slow running SQL queries utilizing multitude of SQL constructs such as joins, CTEs, enforcing indexing/partitioning strategies and utilizing SQL Profiler/DTA as part of optimization process.
- Created pre-staging and staging databases as intermediate stages for populating data mart and to perform ETL operations.
- Designed several complex SSIS packages utilizing different transformations like fuzzy lookup, fuzzy grouping, conditional splits, multicasting and audit.
- Involved in the troubleshooting of SSIS packages and solved several issues related to execution, development and performance.
- Implemented event handlers, loggings, and data viewers for effective debugging of SSIS packages.
- Configured the SSIS packages properties and deployed on production server.
- Created SQL agent jobs for execution of SSIS packages per requirements.
- Collaborated with cross-functional team members utilizing TFS (Team Foundation Server) as a part of version control tool.
Environment: MS SQL Server 2012, TSQL, SSIS, SSAS, SSRS, Erwin, SQL Profiler, DTA, Excel, Share Point, TFS, MDX, DAX