Etl Developer Resume
Cranbury New, JerseY
SUMMARY:
- Passionate and result - oriented SQL/BI developer with 5-year experience in BI, ETL, and reporting in healthcare, insurance, finance and logistic industry.
- Proficiency in implementing ETL with SSIS to perform data migration and integration.
- Advanced knowledge in creating complex reports using business intelligence tools such as SSRS, Power BI, and Tableau.
- Experienced in developing T-SQL scripts, stored procedures, UDFs, views, CTEs, indexes, etc.
- Solid abilities in troubleshooting, debugging, error handling and performance tuning in SQL Server related tools, including SSIS packages, SSRS reports, stored procedures, etc.
- Extensive experience in working with end users to gather business requirements for ETL and reporting solutions.
- Team player with strong communication and analytical skills, with the ability to work both independently and collaboratively.
TECHNICAL SKILLS:
Databases: SQL Server 2008 R2, SQL Server, MS Access, Oracle Database 11g R2
Development Tools: SSIS, SSDT, SSMS, Visual Studio, ZappySys, SQL Profiler
Reporting Tool: Power BI, Tableau, SSRS
Data Modeling Tool: Erwin, Visio, Lucidchart
Collaboration Tool: SharePoint
DWH: Kimball, Inmon, Star/Snowflake schema
Programming Languages: T-SQL, MySQL, C#, Visual Basic, Python, R
Source Control: TFS (Team Foundation Server)
Big Data & Cloud Service: Hadoop, Pig, Hive, AWS, Azure (Cloud Services, Azure Data Factory, Azure SQL database)
SDLC: Agile, Scrum
PROFESSIONAL EXPERIENCE:
Confidential, Cranbury, New Jersey
ETL Developer
Tools: and Environment: SQL Server 2016, T-SQL, SMSS, SSIS, SSRS, SSDT, Visual Studio, TFS
- Attended JAD sessions with BA and end users to gather business requirements.
- Created ETL mapping documents based on BRDs to map source data to target tables.
- Developed SSIS packages to migrate call and survey data from various sources (flat files, SQL Server, Oracle databases, Excel files), performed data profiling, cleansing, transformation, validation and loading into data marts / flat files.
- Implemented slowly changing dimension type 2 using SSIS for initial load and incremental load.
- Wrote C# script task in SSIS to send notification emails, to append logging information to csv files, to rename files with timestamp, and to compress files.
- Created customized loggings and error logs in SSIS using script task and execute SQL task.
- Deployed SSIS packages to the dev server using project deployment mode.
- Performed unit testing on SSIS packages, and collaborated with QA testers during the testing period.
- Maintained existing SSIS packages, including troubleshooting errors and failures, tuning stored procedures utilizing execution plan and SQL Profiler, redesigning tasks and components, configuring buffer size properties in data flow task, etc. to optimize performance.
- Redesigned and created 30+ tables and views in the call data mart to support ETL process and reporting.
- Designed T-SQL queries and stored procedures with UDFs, views, CTEs, table variables, temp tables, ranking functions, etc. to implement business logic, including data cleansing, preventive error handling, transformation, etc.
- Performed error handling in T-SQL stored procedures using try/catch, raiserror, throw, etc.
- Created indexes, including clustered index, non-clustered index, covering index, etc. to improve query performance.
- Migrated data from SQL Server to AWS Redshift with SSIS ZappySys PowerPack plug-in, including the amazon redshift data transfer task, amazon redshift executeSQL task, etc.
- Utilized healthcare data codes such as ICD-10, CPT-4, DRG, Revenue codes to retrieve medical record data.
- Generated monthly reports with SSRS utilizing techniques such as drill down, drill through, cascading parameters, conditional formatting, custom functions (VB scripts), etc.
- Supported maintenace of existing SSRS reports, including troubleshooting errors, tuning T-SQL stored procedures, redesigning SSRS components, etc.
Confidential, Dallas, Texas
SQL / BI Developer
Tools: and Environment: Microsoft SQL Server 2014/2016, T-SQL, SSIS, SSRS, SSDT, Erwin, TFS
- Redesigned ER-Diagrams using Erwin and created 20+ tables and views in current data warehouse to support ETL process.
- Created / tuned T-SQL statements, including ad-hoc queries, stored procedures, UDFs, views, CTEs, table variables, temp tables, indexes, etc.
- Performed T-SQL DML transactions to load data from staging tables to the data mart.
- Designed and developed 40+ SSIS packages to implement initial and incremental load. Extracted data from sources including flat files, Excels, and SQL Server, cleaned and transformed data according to analytical and reporting needs, and loaded the data into the patient care data mart.
- Performed customized logging and error handling in SSIS packages utilizing event handlers, send mail task / script task, execute SQL task, redirecting error output, etc.
- Wrote C# script task / script component in SSIS to fulfill purposes such as sending notification emails in HTML format, renaming file names, importing XML files, appending data to error log files, etc.
- Maintained SSIS packages, including troubleshooting errors and failures, optimizing performance of tasks and components.
- Performed unit testing on SSIS packages, and collaborated with testers during the testing period.
- Worked with DBA in package deployment and automatic job scheduling.
- Created visualization charts and dashboards using Power BI desktop. Employed stack bar charts, scatter plots, bubble charts, and maps for different dimensions to satisfy various requirements.
- Designed and created SSRS analytical and operational reports on weekly and monthly basis, using tables, matrices, lists, charts, indicators, conditional foramtting, cascading parameters, drill down, drill through, custom functions, etc.
- Worked with DBA for report deployment in native mode. Set up report subscriptions, including data-driven subscriptions via email or file share. Configured reports to be displayed in cache and snapshot mode to improve performance.
- Prepared different documentations, including FRDs, data mapping documents, scrum meeting memo, ETL project documentation, etc.
- Attended JAD sessions with end users and developers to gather requirements for ETL solutions and reports.
Confidential
BI Developer / Analyst
Tools: and Environment: Microsoft SQL Server 2012, T-SQL, SSIS, SSRS, Tableau, Python, Excel, TFS
- Designed easy to complex T-SQL stored procedures, functions, tables, views, table variables, temp tables, dynamic SQLs, and modifying existing statements to implement business logic and calculation.
- Maintained the database including performance tuning, error debugging and creating indexes and views based on new requirements.
- Developed 45+ SSIS packages to perform ETL process using script task, data flow task, execute SQL task, file system task, for each loop container, data flow task (derived column, lookup, conditional split, merge, merge join, union all,etc.), etc.
- Utilized customized and built-in loggings in SSIS for auditing and error handling.
- Maintained SSIS packages, including troubleshooting errors and failures, optimizing performance of tasks and components, tuning stored procedures.
- Deployed SSIS packages to the dev server in package deployment mode. Performed unit testing on packages, and collaborated with QA team during the testing period.
- Created weekly, monthly and annual sales reports with SSRS, utilizing techniques such as drill down, drill through, cascading parameters, conditional formatting, custom functions, dynamic matrix, etc.
- Set up SSRS report subscriptions, including data-driven subscriptions, with various rendering format for report delivery. Configured reports to be displayed in cached / snapshot mode to improve performance.
- Prepared data and performed exploratoty analysis using Python (pandas, numpy, matplotlib, seaborn). Analyzed sociodemographic and behavioral data to identify characteristics of the most valuable customers.
- Developed machine learning models (logistic regression, decision tree, random forest, adaboost model, etc.) to predict if the customers would subscribe a term deposit using Python sklearn.
- Used parameters, grouping, highlight actions, filters, data blending, calculated field in Tableau for data preparation for dashboards and worksheets, such as customer count, lending number changes, etc., for the marketing department.
- Worked on the Tableau dynamic dashboard for executive summaries with various charts like bar charts, line charts, Tree maps, geographic maps, dual axis, donut charts, etc.
- Created reports for accounting department using Excel (Pivot table, V-lookup, H-lookup, etc.).
- Collaborated with cross-functional team like key users, business analysts, front-end engineers, etc. to identify problems, resolve issues, and improve the solutions.
Confidential
SQL / BI Developer
Tools: and Environment: Microsoft SQL Server 2012, T-SQL, SSIS, SSRS, TFS
- Documented data mapping files to support the end-to-end ETL process.
- Migrated customer and delivery tracking data into the notification integration data mart using SSIS, dealing with sources including Access, SQL Server and csv files. Performed incremental load with SCD 1 and 2.
- Performed customized logging in control flow, data flow and onError event handler tab for auditing and error handling.
- Optimized existing packages using methods like increasing the memory buffer size, using fast load option and non-blocking transformations. Troubleshot package errors utilizing error logs, breakpoints, checkpoints, and data viewers in maintenance stage.
- Generate 20+ SSRS reports for the Professional Services Department to measure supply chain and delivery efficiency, using techniques like drill down, drill through, subreports, cascading parameters, conditional formatting, functions, etc.
- Worked with DBA to deploy SSIS packages and SSRS reports to different servers. Conducted unit testing in the dev server.
- Redesigned 20+ tables and views in current database and data warehouse to support ETL process and SSRS reporting.
- Created T-SQL ad-hoc queries, stored procedures and user defined functions with CTEs, temp tables, table variables, subqueries, dynamic SQL, joins, set operators, window functions, transactions, etc.
- Tuning stored procedures by using recompilation, rewriting queries and creating indexes, including clustered, non-clustered, covering and filtered indexes, to improve performance.
- Gathered and analyzed user requirements in JRD and JAD sessions for ETL and reporting needs, and created BRDs and FRDs to record business process, workflows, risks and technical approaches for the project.
- Acted as a liasion between business and the BI team, and conducted user survey to identify current pain points and future enhancement for the notification integration system.