Sr. Data Engineer (ms T-sql, Ssis, Teradata) Resume
Nashville, TN
SUMMARY:
- Around 8+ Years of extensive IT experience as a Microsoft SQL Server Developer in creating Business Intelligence Solutions like SSIS, SSAS, SSRS and expertise in designing and implementing Relational Database model as per business needs in different domains like Insurance, Banking, Retail, Finance and HealthCare.
- Excellent backend skills in creating SQL objects like Tables, Stored Procedures, Views, Indexes, Triggers, Functions, User Defined Data-Types, Change Data Capture (CDC).
- Experience in writing complex Stored Procedures, Indexed Views and Triggers for data consistency and manipulation.
- Good experience in working with Spark SQL.
- Migrated MS SQL project to AWS Redshift.
- Experience in working with Databricks, IICS, Amazon S3.
- Good hands on in writing complex logic with Python language.
- Explore data in a variety of ways and across multiple visualizations using power BI.
- Working experience on SSIS, SSRS, SSAS, Data Cleansing, Data Scrubbing and Data Migration.
- Proficient in designing highly flexible Database Architectures and Data Modeling, Data Mapping, Table Normalization, Optimization and Tuning.
- Experience using performance optimization tools like Database Engine Tuning Advisor, SQL Profiler, and Index Tuning Wizard.
- Experience with C# and VB.Net scripting when using SSIS packages.
- Experience in Crystal Reports, Reporting Services for MS SQL Server and SQL Server Agent in Support Services and MDX technologies of Analysis services.
- Created stored procedures to build the Fact tables in the data mart for Multi-Dimensional analysis. --
- Worked on the data warehouse design and analyzed various approaches for maintaining different dimensions and facts in the process of building a data warehousing application.
- Experience in report writing using SQL Server Reporting Services (SSRS) and creating various types of reports like Table, Matrix, Drill Down, Drill Through, Parameterized and Cascaded reports. Working knowledge of Tableau.
- Good experience in Creating, Populating and maintaining Data marts. Thorough knowledge of Features, Structure, Attributes, Hierarchies, Star and Snow Flake Schemas of Data Marts.
TECHNICAL SKILLS:
Operating Systems: Windows Server 2012/2018. MS Windows 8 /10
Database Tools: MS SQL Server 2017 & 2019. SSIS, SSAS, SSRS.AWS Redshift, Apache Hive, Presto, Databricks, Power BI, Tableau.
Languages: Spark SQL, MDX/DMX, VB.Net, VB Script, Transact-SQL, PL/SQL, HTML, DHTML, XML.
Data Modeling Tools: Erwin, MS Visio.
Methodologies: Agile, SCRUM, Waterfall.
PROFESSIONAL EXPERIENCE:
Confidential, Nashville, TN
Sr. Data Engineer (MS T-SQL, SSIS, Teradata)
Responsibilities:
- Migrated store procedures, Views and Tables from SQL server to Teradata.
- Installed Teradata drivers for the Teradata utilities.
- Split SSIS package into two to improve performance.
- Responsible for writing SQL queries, stored procedures, views in T-SQL and Teradata.
- Used SSIS features like package event handlers, property expressions, and package configurations, transactions in packages, checkpoints and protection levels.
- Co-ordinated with business partners regarding the patient’s data.
- Involved in optimizing code and improving efficiency in databases including re-indexing, updating statistics, recompiling stored procedures and performing other maintenance tasks.
- Scheduled Jobs in Doclib. worked on Internal company tools for loading data from SQL to Teradata.
- Troubleshooting database issues related to performance, queries, store procedures.
Environment: MS SQL 2018, SSIS, Doclib, Teradata, Jira, Github, service now.
Confidential, Nashville, TN
Sr. Data Engineer (MS T-SQL, AWS Redshift, AWS S3, Apache Hive, Databricks, Spark sql, Presto, IICS, Denodo, Python)
Responsibilities:
- Migrated MS SQL Database objects(Tables / views/ stored procedures ) to AWS Redshift.
- Migrated the SSRS reports from Sql Server to AWS cloud using Denodo as a virtualization Tool.
- Migrated Oracle PL-SQL procedures to AWS Redshift.
- Created External Tables in Hive/presto on top of AWS S3.
- Migrated IICS Task flows to Redshift.
- Migrated Redshift Datamart’s to Databricks using spark sql.
- Migrated AWS reports to Databricks using spark sql.
- Created project documents as part of release. This involves preparation of Functional document, Design documents, Technical documents and database design documents.
- Developed custom python code to connect to Denodo environment and extracting data and moving to Amazon S3 environment.
- Developed Python script which migrates data from flat files to Redshift Tables and finally to Hive Tables.
- Created Hive tables which load the data from files available in AWS S3 location.
- Did extensive configuration of Active batch tool to schedule the Jobs which perform the ETL / executing python scripts/ sql stored procedures.
- Used Active batch to Automate the File Transfer from company shared location to AWS S3.
- Scheduled the SSRS Reports existing in AWS environment to be delivered to the business users through email.
- Created Task flows, Mappings and Mapping Tasks in IICS. The flows are used to transform the data from Source to Destination.
- Automated the IICS Task flow for loading huge Amount of data from source to Destination with IICS.
- Worked on Scheduling the IICS Task flows. The scheduled jobs run automatically as configured.
- Communicating with users regarding the data Transformation with IICS.
Environment: MS SQL 2018, MS SSRS, IICS, Databricks, Spark Sql, Python 2.7, Dbeaver 7.0.4, AWS, Denodo 6.0, Jira, ServiceNow.
Confidential, Seattle, WA
Sr.BI Developer (SSRS/SSIS/SSAS)
Responsibilities:
- Analyzed data by creating simple SQL queries and identified fact and dimension tables.
- Designed mapping using various transformations such as source qualifier, expression, joiner, sorter, union, etc.
- Performed data analysis primarily Identifying data sets, source data, source meta data, data definitions and data formats.
- Designed Physical and Logical Data model and Data flow diagrams.
- Designed, constructed, and tested ETL processes. Created SSIS packages to extract data from the transactional and/or operational databases, transformed the data according to analytical / reporting business needs, and loaded the data into a data warehouse or data mart.
- Converted Data Transformation Services (DTS) application to SQL Server Integrated Services (SSIS) as assigned.
- Creating reports using SQL Reporting Services (SSRS) for customized and ad-hoc Queries.
- Developed DTSX packages to extract, transform and load into the Campaign database from OLTP database using of SQL Server Integration Services (SSIS)
- Experience in Developing and Extending OLAP Cubes, Dimensions and data source view.
- Assisted in production OLAP cubes, wrote queries to produce reports using SQL Server 2005/2008 Analysis Services (SSAS) and Reporting service (SSRS)
- Designed dynamic SSIS Packages to transfer data crossing different platforms, validate data during transferring, and archived data files for different DBMS.
- Developed dashboard reports using Reporting Services, Report Model and ad-hoc reporting using Report Builder.
- Experience in creating Parameterized reports and Linked reports with thorough knowledge of report serving architecture. (Table, chart and matrix report)
- Used SSIS to unite data from existing system and performed transformations on MS SQL 2008
- Extract Transform Load (ETL) development Using SQL server 2008, SQL 2008 Integration Services (SSIS).
- Generated several drills down and drill through reports using SSRS.
- Used Azure SQL Data Warehouse as a development environment for performing quick POCs.
- Create test data, that can be used in Unit testing most effectively.
- Perform load testing, with huge amounts of data to validate the performance of mapping.
Environment: MS SQL Server 2012/2014, SQL server Integration services (SSIS), SQL server Reporting services, SQL server Analysis Services (SSAS), Azure, Windows 2008 Server.
Confidential, Los Angeles, CA
SQL BI Developer (SSIS/SSRS/SSAS)
Responsibilities:
- Installed and Configured MS SQL Server successfully.
- Expertise in Database creation (DDL, DML, DCL), database tuning, SQL tuning, performance planning.
- Involved in designing database using MS Visio.
- Extensively used Joins and Sub-Queries to simplify complex queries involving multiple tables.
- Developed tabular queries for efficient analysis of report using Pivot/Un pivot in T-SQL.
- Responsible for writing SQL queries, stored procedures, views, triggers, T-SQL and DTS/SSIS
- Responsible for creating SQL datasets forpower BIand Ad-hoc Reports.
- Expert on creating multiple kind ofpower BIReports and Dashboards.
- Created, Maintained & scheduled various reports inpower BIlike Tabular Reports.
- Worked as a developer in creating complex Stored Procedures, triggers, cursors, Indexes, tables, and views and other SQL joins for building various applications.
- Created and managed Clustered indexes and Non Clustered indexes and optimized queries using execution plan.
- Experience in writing complex queries and table joins using Oracle
- Implemented High availability concepts, Data base Mirroring, Replication and log shipping.
- Involved in Normalization and De-Normalization of existing tables for faster query retrieval.
- Involved in development, enhancement, testing and performance tuning of the application.
- Created complex Stored Procedures and Functions for integrity checks of transferred data.
- Extensively worked with SSIS tool suite, designed and created mappings using various SSIS transformations like OLEDB Command, Conditional Split, Lookup, Aggregator, Multicast and Derived Column.
- Designed dynamic SSIS to transfer data crossing different platforms, validate data during transferring, and archived data files for different RDBMS.
- Involved in writing stored procedures and User Define scalar Functions (UDFs) to be used in the SSIS packages and SQL scripts.
- Used SSIS features like package event handlers, property expressions, and package configurations, transactions in packages, checkpoints and protection levels.
- Utilized SSRS reporting services to generate different types of reports from the database.
- Created Report Subscription using SSRS.
- Involved in scheduling, creating snapshots and subscriptions for the reports (SSRS).
- Performed Data Analysis for automating various Customers Order Reports utilizing SQL Reporting Services.
- Designed, developed, debugged and tested SSIS packages, SSRS reports and T-SQL Stored Procedures.
- Skilled in design of logical and physical data modeling using Erwin data modeling tool.
- Building dashboards using SSRS.
- Designed/Implemented a reporting dashboard for use by the SQL Reporting Services group using Visual Studio.
Environment: MS SQL Server 2008/2012/2014 , SSRS, Power BI, SSIS, SSAS, Business Intelligent Studio, SQL Server Management Studio, Crystal Report, T-SQL, Oracle 11g, TFS.
Confidential, Fort Wayne, IN
MS SQL BI Developer (SSRS/SSIS/SSAS)
Responsibilities:
- Created databases and schema objects including tables, indexes and applied constraints, connected various applications to the database and written functions, stored procedures and triggers.
- Monitoring SQL Server performance using SQL Server Profiler to trace the slow running queries and optimized query execution with the use of Index Tuning Wizard and Rebuild indexes if necessary.
- Created ETL packages with different data sources (SQL Server, Flat Files, Excel source files, XML files etc.) and then loaded the data into destination tables by performing different kinds of transformations using SSIS packages.
- Expertise level of knowledge as a data analyst in data conversion and data cleansing from the raw data sources.
- Developed several data mapping (DB2 to SQL Server 2005) documents and data mining (SSIS transformation) documents.
- Intensive testing on improving performances of databases. Hands on experience in controlling Jasper repositories and handed data processing.
- Wrote complex T-SQL queries for data analyzing, research, unit testing and identifying and resolving bugs.
- Huge experience in working with complex stored procedures, joins, taking advantage of set based approach in order to replace time taking cursors, indexes and many more.
- Proficient in usage of SSIS Control Flow items (For Loop, Execute package/SQL tasks, Script task, send mail task) and SSIS Data Flow items (Conditional Split, Data Conversion, Fuzzy lookup, Fuzzy Grouping, Pivot).
- Wrote ad-hoc T-SQL queries for data analyzing, research, unit testing and identifying and resolving bugs.
- Experience in building SSIS packages (.dtsx) involving ETL process, extracting data from various flat files, Excel files, legacy systems and loading into SQL server.
- Hands on experience working with SSIS, for ETL process ensuring proper implementation of Event Handlers, Loggings, Checkpoints, Transactions and package configurations.
- Created SSIS/DTS packages to copy tables, schemas, views to extract data from Excel, Oracle.
- Designed ETL packages dealing with different data sources (SQL Server, Flat Files, and XMLs etc.) and loaded the data into target data sources by performing different kinds of transformations using SQL Server Integration Services (SSIS).
- Designed high level ETL architecture for overall data transfer from the source server to the Enterprise Services Warehouse.
Environment: Windows Advanced Server, MS SQL Server 2008/2012, TSQL, PL/SQL, MS Visio, SSRS, SSAS, SSIS, T-SQL, Visual Studio 2008, Jasper Reports 6.1.0 API, Cognos
Confidential, Richfield, MN
SQL/Crystal Report Developer (SSRS/SSIS/SSAS)
Responsibilities:
- Developed complex T-SQL stored procedures using joins and unions to create crystal reports and also optimized SQL queries for efficiency and the front end developer with their queries and procedures.
- Developed crystal reports using Crystal Reports 10 for detail information to the sales team regarding sales of all stores according to the criteria given, which helped the sales team to take their decisions.
- Developed E-R diagram for reports which gives all the relationships of the tables from huge De-normalized database using Microsoft Visio.
- Involved in optimizing code and improving efficiency in databases including re-indexing, updating statistics, recompiling stored procedures and performing other maintenance tasks.
- Developed various functions using SQL Server 2008 for the interfaces which were automatically run on daily, weekly and monthly basis using SQL server task in SSIS.
- Responsible for optimization of the T-SQL queries to give the faster results from whole bunch of data using SQL Profiler and also provided 24/7 Support for Production, Development & Test Servers of MS SQL Servers.
- Developed Demo Results of the reports which are useful for the UAT phase to get the approval from the key users.
Environment: MS SQL Server 2008, Windows Server, DTS, SQL profiler, SSAS, SSIS, SSRS, T-SQL, Microsoft Visio 2007, MS Visual Studio 2008, Crystal Report 10.
Confidential, Columbus, OH
SQL Server Developer (SSRS/SSIS)
Responsibilities:
- Involved in Planning, Defining and Designing data based on business requirements and provided documentation.
- Build and strengthen current relationships with clients and agents by providing excellent customer experiences.
- Writing complex queries and generating reports.
- Extracting queries from multiple databases like Teradata and AS 400
- Optimized the performance of various SQL scripts, stored procedures and triggers by using embedded UDFs, CTEs and System stored procedures.
- Worked on troubleshooting and maintaining large (terabyte-size) clustered databases.
- Created Sub-Reports, Drilldown-Reports, Summary Reports, and Parameterized Reports in SSRS.
- Generated ad-hoc reports using MS Reporting services and Crystal reports.
- Debug and analyze VBA code/ SQL stored procedures.
- Develop and modify stored procedures/ VBA code.
Environment: MS SQL Server 2008, SSIS, SSRS, SSAS, MS Reporting Services 2008, MS-Excel, MS Access, MS Visio, Teradata, T-SQL, Erwin, LDAP, Visual Studio 2008.