Data Engineer Resume
Dallas, TX
SUMMARY
- More than 15 years of IT experience in Extract Transform Load (ETL) as a Tech Lead, Design, Develop and Implementation of Batch and Event based in Relational data solutions. Experienced working in Life sciences, Airlines, Banking and Financial services domains with Exposure to Data warehousing Tools such as like MSBI, Teradata and Oracle. Strong understanding of the Data Modeling, Design, and development.
- Good experience in data analysis, processing data and attempt to find insights using Python.
- Implemented plan configurations, rules, rate tables and quotas in Xactly Incent.
- Integrated various external and internal data for analytics into Xactly Incent.
- Expert in Extracting and Transforming Data (ETL) from various heterogeneous sources (Db2, Oracle, Access and MySQL) and creating package using SSIS, Import - Export wizard, Bulk Inserts and Bulk copy utilities.
- Solid experience in working with MS SQL Business Intelligence tools like SSIS (Integration Services), SSAS (Analysis Services) and SSRS (Reporting Services).
- Well versed in the usage of SSIS Control flow items, Data flow items and Incremental loads.
- Experience in Enhancing and Deploying the SSIS packages from development server to Production server.
- Hands on experience working with SSIS, for ETL process ensuring proper implementation of Event handlers, Logging, Checkpoints and Package Configurations.
- Experience as a Team Lead managing team of 4 to 8 members.
- Strong RDBMS concepts including expertise in Transact-SQL queries like DML, DDL, Views, user-defined functions (UDFs) and Cursors.
- Good understanding of ACID Properties, RDBMS, Normalization/De-Normalization and database modeling.
- Experience in SQL Optimizing by using SQL Profiler, Index tuning wizard, Database tuning advisor, DBCC commands, DMV, DMF and query execution plans.
- Possess good analytical, interpersonal, communication, problem solving skills and also an active team player.
- Excellent communication and interpersonal skills and has ability to handle multiple tasks; can take initiative to handle responsibilities independently as well as a proactive member of a team.
TECHNICAL SKILLS
Programming Languages: C#, ASP.net, VB .Net, Hive
Web/XML Technologies: HTML, XML,CSS
Tools: & Utilities: SQL Server Management studio, Toad, SSDT, Teradata SQL assistant, Master Data Management, Visual Studio, Microsoft Visual Source safe 6.0, HP ALM center, JIRA
BI Tools: SQL Server Reporting Tools (SSRS), SQL Server Integration Services(SSIS), SQL Server Analytical Services (SSAS), SQL Server Data Tools.
RDBMS: Oracle, MS SQL Server, Teradata
Source Control: Microsoft Visual Source safe 6.0
Operating Systems: Windows, UNIX
PROFESSIONAL EXPERIENCE
Confidential, Dallas TX
Data Engineer
Responsibilities:
- Works directly with Data science team from Product and pricing department, to understand the kind of data requirements for day-to-day analysis.
- Designed and developed pipelines to source data from various existing applications/systems into pricing team clusters on Hadoop, according to the data needs.
- Works with multiple business partners to understand the data received from Teladoc related to Virtual primary care registrations and Utilizations, and then build scripts to analyze the utilization patterns and providing support in quarterly report generation.
- Developed scripts for analyzing the In-patient utilizations and costs related to diabetic members and coming up with cost optimization scenarios.
Environment: Hadoop, Hive
Confidential, Dallas TXData Engineer
Responsibilities:
- Works with HR Compensation team in replacing the traditional system (with Relational DB and ETL infrastructure) with a new Sales compensation software, Xactly Incent, by providing various Data solutions.
- Designed and developed pipelines to source data from various existing applications/systems into this new Incentive compensation tool Xactly, according to the data needs by analyzing the various Compensation models.
- Also developed processes to extract final compensation numbers from Xactly and built analytical charts/reports that will be helpful in solutions with commission estimator, quota assignments/management, and budgeting.
- With the expertise gained from understanding the previous compensation models in traditional system, designed new compensation model from scratch in the new ICM tool, helping the client in saving the additional vendor costs.
- Worked with other application developers and DBAs to diagnose and resolve query performance problems.
- Develop, refine, and scale data management and analytics procedures, systems, workflows, and best practices.
Environment: Xactly Incent, Xactly Connect, SQL server, MS Business Intelligence, SSIS, SSRS
Confidential, Dallas TXData Integration analyst
Responsibilities:
- I am involved in business discussions with multiple levels of Crew scheduling teams and understand the Business strategies behind the different scheduling patterns for Pilots and flight attendants.
- I have used this knowledge to develop a Validation strategy for the CPA system on monthly basis.
- For every release, I will develop the Test plan and all required validation scripts focusing on the scheduling strategy used by the scheduling team.
- I will also co-ordinate with ETL team in understanding the Base line schema of the Datawarehouse and come up with Script for transforming the base line data into the 3-dimensional cubes of data for final analytics implementation.
- After every deployment, I will perform all the Validations and produce defect sheet document along with test results.
- I will also co-ordinate with business team in presenting the validations results and present any foreseen risks with the scheduling strategy.
- I will monitor and support the ETL code migrations to higher environments. I used to create UNIX shell scripts for FTP, Merge and send the success/failure notifications.
Environment: Teradata, Oracle, Ab-initio, and HP ALM Center.
Confidential, Dallas TXData Integration analyst
Responsibilities:
- Involved in Requirement gathering from Business users, design and develop the workflows.
- Created tables, complex stored procedures, UDFs, Triggers etc. to support the application.
- Created complex SSIS packages to Extract, Transform and load data from variety of sources like SQL Server, Oracle, MySQL, Excel, Flat files etc. to OLEDB/flat file destinations.
- Involved in tuning the SSIS packages for better performance.
- Managing team of 4 offshore and 4 onshore.
- Onshore-Offshore Coordination.
- Responsible for management of deliverables, solving technical issues faced by ETL team during coding and unit testing
- Deployment of code deliverables to UAT and PRODUCTION.
- Performed Administrative tasks like creating SQL Agent Jobs to perform log cleanup, Index rebuild, stored procedures recompiling etc.
- Deploy product enhancements using Microsoft Visual Studio Team Foundation Server
- Part of SQL Server 2016 Migration team.
- Perform Peer to Peer code reviews.
Environment: SSIS, T-SQL, SSRS.
ConfidentialBI ETL
Responsibilities:
- Was a near shore lead for the project, leading three resources in offshore.
- Worked with the development team from CTS, other competitor company and China development teams in understanding the system fully and received all the knowledge to start supporting these newly developed applications.
- Interacting with client time to time basis regarding monthly and weekly data loads.
- Validating the data loads during the load and post the completion. Make sure the is consumable by final web portals.
- Providing emergency fixes during the data loads, as well as implementing a permanent solution to avoid the issues in future loads.
- Delegating the work to offshore resources properly and validating their work. And helping them to find out the solution in a quickest way by explaining the system functionalities and business rules.
- Providing assessments and risk analysis for the new enhancements to the systems. Also implementing them in parallel to production cycles, without affecting regular deliveries.
Environment: SQL Server 2008, Oracle, Unix, ESP job scheduler, Dot Net.
ConfidentialDB developer
Responsibilities:
- I was involved in the design and development part during the initial stage of the project. Later on, started to lead the project and successfully implemented in production.
- Due to its criticality, I report directly to the Vice President of Client on the status of the implementation and project progress. Also I received “Associate of Quarter” for successfully implementing it.
- This project requires involvement of other systems/teams like DDMS, WWS support, LO (User Group in Onsite). I was constantly liaising with these teams and have coordinated the CRT with other system in such a way that the task and deadline didn’t deviate from the planned schedule. It was a major challenge and I have delivered/implemented it on time.
- Some of My Major Roles were database administrator and database developer. As database administrator I used to set up the new database for one time load, taking backup and restore the databases in UAT and Production servers. Giving permissions to the existing users and creating new users.
- As database developer I created service broker elements and enabled the messaging service in database. I configured the service broker services and implemented a batch process which will do all data validation and processing of data between different stages.
- I created stored procedure using dynamic SQL queries which will use the settings from system configuration table and other process tables to process the data.
- I implemented the Bridging, Look-up and acceptance rules using stored procedure on the data provided.
- As part of data cleansing, certain rules and formatting were laid down. I wrote the stored procedure which will execute and imply the rules on the data as part of cleansing.
Environment: MS SQL Server, SQL Server Integration Services (SSIS), ASP.NET, C#.NET.
ConfidentialSharePoint developer
Responsibilities:
- As part of development team, my role was creating and deploying SharePoint custom workflows, custom features, and web pages.
- As part of the custom workflow development I used SharePoint designer to create workflows. As part of the requirement, we need to trigger custom mails, which we achieved as part of custom workflow creation.
- I created one share point document library which will store the issues raised by different customers (issue originators) under a particular category. I attached a Custom workflow, which will start on the creation of an item in the library.
- As part of workflow, tasks will be created for each participant of the process from Unit head to issue editors. Issue originator will be able to track the progress continuously. He will be notified once the issue gets resolved.
- As part of SharePoint custom feature development, I created some features with a scope at item level in SharePoint document libraries. On enabling this feature, we will have new action item at item level for a particular document library.
- As part of the webpage creation and deployment I created web pages which will show the details particular to that user based on user permission level, like for issue originators the details about his/her issues and for the issue owners the details about the issues they are handling.
Environment: Share point 2007, ASP.NET, C#.NET.