We provide IT Staff Augmentation Services!

Sql Developer/data Engineer Resume

4.00/5 (Submit Your Rating)

New York New, YorK

SUMMARY

  • Microsoft MSBI developer with 7 + years of professional experience in SQL Server database development, extensively worked in Production, Test, Development using Microsoft technologies like SQL server, SSIS, SSRS, PowerBI, AZURE Data Factory and Python and Domain Knowledge on HealthCare, Insurance & Payments.
  • Strong experience in developing and deploying SSIS packages using dataflow and control flow components, creating SQL mail alerts and job scheduling using SQL Server/TWS Agent.
  • Hands on experience in creating indexed Views, complex Stored Procedures, effective functions, CTE’s to assist efficient data manipulation and data consistency.
  • Had exposure on Python, Pandas, Numpy, Statistics and Creating Machine learning models using Python and Flask.
  • Involved on administration tasks such as disaster recovery with Backup and Restore Strategies, Data Loading, Batch Jobs, Data Unloading, Upgrades, Creating Databases, Files, File groups, Transaction logs, dimensional database environments.
  • Expertise in solving Dead Locks/Long running queries using Performance Monitor and SQL Profiler
  • Expert in Microsoft SQL Server 2012 and 2008 backend programming, Extensive experience in creating database objects on MS SQL Server 2012 and 2008.
  • Strong understanding of the principals of Data ware housing concepts using Fact tables, Dimension Tables, And Star/Snowflake Schema modeling
  • Involved in Huge data migrations, transfers using utilities like SSIS, Bulk Copy Program (BCP) and Bulk Insert.
  • Designed and developed security framework to provide fine grained access to objects in AWS s3 using AWS S3 using AWS Lambda, DynamoDB
  • Hands on experience in designing complex reports using SQL Server Reporting Services (SSRS) and Proficient in all phases of Data warehousing concepts, and experience in dimensional modeling using Star Schema and Snowflake Schemas.
  • Ability to create SSIS Packages using various Transformation like Lookup, Derived Columns, Conditional Split, Data Conversion, Aggregate, Merge Join, Sort, Execute SQL Task, Data Flow Task, and Execute Package Task etc.
  • Clustering, Replication, Data Mirroring, Linked Servers, SQL Profiler, Log Shipping and Re - Indexing.
  • To generate underlying data for the reports and to export cleaned data from an Excel Spreadsheet, Flat file, MS Access and CSV files to the data warehouse.
  • Database development for both OLTP and OLAP systems using MSSQL Server.
  • A well organized, flexible, enthusiastic, and project-oriented team player, to develop creative solution for challenging client needs and strong in management and leadership skills.
  • Good logical, analytical, interpersonal skills and commitment to perform quality work as well as an excellent team player.
  • Experience in publishingPowerBIDesktop reports created in Report view to thePowerBIservice. designing and implementing a fully operational production grade large scale data solution on Snowflake Data Warehouse.

TECHNICAL SKILLS

RDBMS/Databases: MSSQL Server 2008/2012/2014 , Azure database, cosmos Db, Neo4J, Snowflake

ETL Tools: SQL Server Integration Services (SSIS), BCP, Azure Data factory. Talend open studio, AWS

Platform & skills: SQL Server Management Studio, ETL, Visual Studio SQL Server Reporting services (SSRS), Power BI, Tableau, Active Batch, ECG, HPSM, Service Now.

Performance Tuning Tools: SQL Profiler, DTA (Data Tuning Advisor), Erwin, TOAD, PL/SQL, T-SQL, VMware,Hive,Azure,Postgresql.

Job scheduling: Shell Scripting, Autosys, Tidal, Control-M

Programming Languages: SQL, Java, PL/SQL, T-SQL, UNIX Shell Scripting

PROFESSIONAL EXPERIENCE

Confidential, New York, New York

SQL developer/Data Engineer

Responsibilities:

  • Involved in analyzing business requirements and understanding the functional workflow of information from source systems to destination systems.
  • Developing ETL pipelines in and out of data warehouse using combination of Python and Snowflake Writing SQL queries against Snowflake
  • Developed Stored Procedures, functions and database triggers and maintained referential integrity and implemented complex business logic to generate different market claims for different types of accounts.
  • Used AWS EMR to transform and move large amounts of data into and out of other AWS data stores and databases, such as amazon simple storage service (amazon S3) and amazon DynamoDB hands-on programming actively or snowflake and SQL query
  • Created and executed SQL Server Integration Service packages to populate data from the various data sources, created packages for different data loading operations for many applications.
  • Created SSIS Packages using SSIS Designer for exporting heterogeneous data from OLE DB Source, Excel Spreadsheet to SQL Server.
  • Migrated DTS packages to SSIS packages and modified the packages with new features of SQL SSIS.
  • Designed ETL packages dealing with different data sources (SQL Server, Flat Files, and XMLs etc.) and loaded the data into target data sources by performing different kinds of transformations using SQL Server Integration Services (SSIS).
  • Developed a web application (dashboard) using python, Flask, html which simplified a lot of the job monitoring and received a lot of accolades.
  • Developed python code to extract data from Elastic search and create custom reports send them as email attachment.
  • Worked on Hadoop, data load using scoop, Scala, data validation using Hive, impala, Hue
  • Clara bridge (speech to text conversion and sentiment analysis): creating large scale (s ql) data warehouse for data ingestion, data scrubbing, manipulation of billions of records and loading to Big data systems.
  • Scale up and Scale down Azuring Scaling jobs to reduce the cost of resource utilization.
  • Generated ad-hoc reports in ExcelPower Pivot and sheared them using Power BI to the decision makers for strategic planning.
  • Created reports utilizing SSRS, Excel services,Power BI and deployed them on SharePoint Server as per business requirements.
  • Performed data analysis using SQL Reporting, prepared datasets supporting development of data products.
  • Responsible for creating and changing the visualizations in Power BI reports and hierarchies using Bar charts and Pie charts according to the client requests. designing and implementing a fully operational production grade large scale data solution onSnowflakeData Warehouse.
  • Design, deployment, and maintenance of various SSRS Reports in SQL Server.
  • Designed and implemented Parameterizedand cascading parameterized reports using SSRS.
  • Built MDX queries and Data Mining Expression (DMX) queries for Analysis Services & Reporting Services.
  • Created multiple reports (SSRS) in Drill mode using tables, financial tables, crosstabs and chart.
  • Implemented AWS step functions to automate and orchestrate the Amazon sagemaker related tasks such as publishing data to S3, training ml model and deploying it for prediction.
  • Used SQL Profiler for troubleshooting, monitoring, and optimization of SQL Server and non-production database code as well as T-SQL code from developers and QA.
  • Backing up, restoring system & other databases as per requirements, and also scheduled those backups.
  • Used SQL Server Profiler to trace the slow running queries and tried to Optimize SQL queries for improved performance and availability.
  • Extensive use of Data Analysis Expressions (DAX) expressions in tabular models as per business requirements.
  • Developed anExecutive level dashboardsusing Tableau 9.0.
  • Designed and createdReport templates, bar graphsandpie chartsbased on the financial data.
  • Developed various types ofcomplex reportslikeDrill Down, Drill through, Cross tab reports.
  • Designed and developed security framework to provide fine grained access to objects in AWS s3 using AWS S3 using AWS LAmda, DynamoDB.

Confidential, Nashville, TN

SQL developer/Data Engineer

Environment: SQL Server 2008R2, 2014, SSIS, T-SQL, Azure Data factory, Excel, Microsoft SQL Reporting Services (SSRS), SSAS, SQL Server Analysis Services (SSAS), C#, Snowflake, T-SQL, XML, MS Excel.

Responsibilities:

  • Participated in gathering User Requirements and System Specifications.
  • Used various SSIS tasks such as Conditional Split, Derived Column, Look-Up that were used for Data validation Scrubbing, Data checks during Staging, before loading the data into the Data Warehouse.
  • Experience in azure machine learning.
  • Created T-SQLscripts, which generated tables, relationships, based on the finalized ER-diagram.
  • Identified source, destination, staging area per ETL strategy and performed data cleansing and data profiling.
  • Modified ETL mapping document per changes in business requirement.
  • Designed the ETL process to pull and populate data from OLTP sources such as flat files, XML and Excel to the data mart.
  • Deployed the SSIS Packages to DEV and QA Environments and provided the proper instructions to DBA to deploy into Production
  • Designed drill through, drill down, linked, sub reports and parameterized reports utilizing SSRS.
  • SSRS reports formatting by applying parameters, assigned default values and data types.
  • Using ETL (SSIS) to develop jobs for extracting, cleaning, transforming and loading data into data warehouse.
  • Designed Database Maintenance Planner for the Performance of SQL Server, which covers Database Integrity Checks, Update Database Statistics and Re-indexing.
  • Developing ETL pipelines in and out of data warehouse using combination of Python and Snowflakes Writing SQL queries against Snowflake
  • Created many SSIS packages using Import/Export Wizard. Designed many Packages using SSIS Designer by using Control Flow and Data Flow Tasks with ETL Tool.
  • Designed and developed SSIS Packages toimport and export datafrom MS Excel, SQL Server 2014andFlat files.
  • Created date and string expressions in SSIS packages and passed them to create dynamic queries for SSIS source SQL commands.
  • As part of the ETL process new stored procedures as created using MERGE command for doing insert and updates at the same time and hence increasing performance.
  • Involved indaily batch loads (Full & Incremental)intoStagingandODS areas, troubleshooting process, issues anderrors using SQL Server Integration Services (SSIS) 2012.
  • Involved in completeSSIS life cyclein creatingSSIS packages, building, deployingandexecuting the packagesin both the environments (Development and Production).
  • Involved in ETL architectureenhancementsto increase the performance using query optimizer
  • ImplementedEvent HandlersandError HandlinginSSISpackages.
  • Created and developed the stored procedures, triggers to handle complex business rules, history data and audit analysis.
  • Created and monitored SQL Agent/TWS jobs for SSIS packages
  • Used views, procedures and functions process staged data and loaded the final tables. Created tables, added columns to existing tables.
  • Bulk Loading from the external stage and internal stage to snowflake cloud using the copy command.
  • Wrote many adhoc queries for testing the old verses new architecture data to determine if the new system could meet the requirement of minimal loan failure.

Confidential, Memphis, TN

SQL developer/Data Engineer

Responsibilities:

  • Worked on extracting the data from OLTP Systems to DWH using SQL Server Integration Services (SSIS).
  • Have used BCP, Bulk Insert to transfer data from and to SQL server database.
  • Responsible for Database and Log Backups & Restoration, Backup Strategies and Scheduling Backups.
  • Created Packages, Jobs and Sending Alerts using SQL Mail, database Backup, Recovery and Disaster Recovery procedures.
  • Analyzed business requirements and build logical data models that describe all the data and relationships between the data.
  • Created new database objects likeProcedures, Functions, Packages, Triggers, IndexesandViewsusingT-SQLinSQL Server 2008/2012.
  • Developed Snowflake procedures for executing branching and looping.
  • Promoted database objects from test/develop to production. Coordinated and communicated production schedules within development team.
  • Modified database structures as directed by developers for test/develop environments and assist withcoding,designandperformance tuning.
  • Managed user access. Created and managed new security accounts.
  • Backupandrestoredatabases.
  • Developed and implemented database and coding standards, improving performance and maintainability of corporate databases.
  • Created theSSISPackagethroughETLProcess to vendors in which records were extracts from Flat file and Excel sources and loaded daily at the server.
  • Extensively used T-SQL in creating and altering stored procedures, functions, views, indexes, user profiles, relational Database models, data dictionaries, and data integrity.
  • Writing reports using Microsoft Reporting Services (SSRS)
  • Created jobs, alerts to run SSIS packages periodically. Created the automated processes for the activities such as database backup and SSIS Packages to run sequentially using SQL Server Agent job.
  • Designed, built and tested SSAS Cubes on SQL Server 2008.
  • Created Excel workbooks to enable Cube (SSAS) access for business users.
  • Used ETL (SSIS) to develop jobs for extracting, cleaning, transforming, and loading data into the data warehouse.
  • Retired SSIS 2008 server and upgraded all existing SSIS 2008 jobs to SSIS 2012.
  • Developed, designed, and deployed matrix and tabular reports with drill-down and drill-through features using SSRS.

Confidential, Alpharetta, GA

SQL developer/Data Engineer

Responsibilities:

  • Involved with Data Architects in designing New Data Model, EDW (Data Warehouse) and OLAP Data Model.
  • Created SSIS Packages to load Data from Existing Data Model to new Data Model and Data Warehouse.
  • Involved in designing complex packages moving data from various servers and environments using SSIS.
  • Performance tuning the SSIS Packages by understanding the Data Flow Buffers and by designing for parallelism.
  • Involved in loading Dimensions and Facts in newly built data warehouse which also involved in Type 1 and Type 2 slowly changing dimensions using SSIS.
  • Deploying SSIS Packages on respective server and effectively using configuration files for using same packages on other environments.
  • Scheduling the SSIS packages by creating a Job using SQL Agent in SSMS.
  • Worked with various transformations like Lookup, Fuzz Lookup, Merge, Sort, Multicast,
  • Conditional Split, Loop Containers, Execute SQL Task and lot more using SSIS.

Confidential

SQL developer/Data Engineer

Responsibilities:

  • Worked with business analysts for requirement gathering, business analysis, and translated the business requirements into technical specifications to build the Enterprise data warehouse.
  • Design and developed end-to-end ETL process from various source systems to Staging area, from staging to Data Marts.
  • Worked with DBA team on TDM process which is Data Acquisition TDM tool will help rapid development of ETL process which we can copy one or more tables from SQL server or flat files to any TD core system.
  • In the TDM Development tool which includes ABC metadata entries, creating tables/views Generation, Active batch development.
  • Analyze requirements provided, design and develop integration packages as per the client request and automate them.
  • Wrote complex queries to in corporate the business logic and retrieve all the certification and candidate details for further reporting purpose.
  • Extensively used Toad utility for executing SQL scripts and worked on SQL for enhancing the performance of the conversion mapping.
  • Created the schema, implemented all stored procedures and 4 SSIS packages Created the deployment scripts and managed the code in Microsoft Team Foundation Server.
  • Updated existing and created new reports using Microsoft SQL Server Reporting Services. Team consisted of 2 developers.
  • Converted the User Requirements into Business Requirements Document, Functional and Technical Requirements Documents.
  • Worked on developing Tables, Views, Indexes, Stored Procedures, Triggers, Queries, and Macros using MS SQL Server and Oracle databases.
  • Designed and developed efficient SSIS packages for processing fact and dimension tables using transformations like lookup, merge, merge join, script component and slowly changing dimension.
  • Created Stored Procedures and handling the Query Performance Issues. Handled clustering between two Production Servers and performed daily backups and developed recovery procedures. Experienced field Unit Testing have tested codes of T-SQL SSIS packages testing environment.
  • Administered MS SQL Server creating User Logins with appropriate Roles, dropping and locking the logins, monitoring User Accounts, granting privileges to users.

We'd love your feedback!