We provide IT Staff Augmentation Services!

Msbi / Azure Data Engineer / Sr.etl Engineer Resume

Sunrise, FL

SUMMARY

  • Over 8+ years of IT experience in various sectors, including Healthcare, Banking, Financial and Retail as a MSBI Developer and Azure Data Engineer.
  • Experience in Data Modeling, Databas e Design, SQL Scripting, Development, and Implementation of Client - Server & Business Intelligence (SSIS, SSAS, SSRS) applications.
  • Expertise in scripting T-SQL queries, complex stored procedures, user defined functions (UDF), Database triggers.
  • Experience working on production environments including delivering an Internet of Things (IoT)
  • Expertise in writing and debugging Stored Procedures and Triggers in SQL Server and PL/SQL.
  • Experience in Data Extraction, Transforming and Loading (ETL) between Homogenous and Heterogeneous System using SQL tools (SSIS, DTS, Bulk Insert, BCP, and XML).
  • Experience in Performance Tuning in SSIS packages by using Row Transformations, Block and Unblock Transformations.
  • Experienced in managing and automating Control flow, Data flow, Events and Logging programmatically using Microsoft .NET framework for SSIS packages.
  • Experience in providing Logging, Error handling by using Event Handler, and Custom Logging for SSIS Packages.
  • Experience in Developing and Extending SSAS Cubes, Dimensions and data source views SSAS-Data Mining Models and Deploying and Processing SSAS objects.
  • Expert in designing complex reports using SQL Server Reporting Services (SSRS) and Excel Pivot table based on OLAP cubes which make use of multiple value selection in parameters pick list, cascading prompts, matrix dynamics reports and other features of reporting service.
  • Extensive knowledge of designing, developing, and deploying various kinds of reports using SSRS using relational and multidimensional data.
  • Experienced working with various services in Azure like Data lake to store and analyze the data.
  • Expert in generating Drilldown reports, Parameterized reports, Linked reports, Ad-Hoc reports, Sub reports and filters, charts in SSRS 2016/2012/2008 .
  • Good knowledge on data visualization and dashboard designing using Power BI.
  • Knowledge on Active Directory Administration and Good understanding of Change Control process.
  • Experience in providing SSRS server level, item level Security & Accessibility to various reports in multi-user environment.
  • Created SSIS packages with script task using .NET code to perform business requirements which are not provided by default SSIS components

TECHNICAL SKILLS

Operating Systems: Windows, Unix, Linux, Mac OS

Database Tools: SQL Enterprise Manager, Query Analyzer, SQL Server Management Studio, Business Intelligence Development Studio, SQL Server Analysis Service (SSAS)

ETL Tools: Data Transformation Services (DTS) - Export/Import, SQL Server Integration Service (SSIS), DataStage

Reporting Tools: SQL Server Reporting Services (2012/2008), Power Pivot, Power BI, Tableau, QlikView

Programming: T-SQL, PL-SQL, C, LINUX (Shell Scripting), .NET

Database: MS SQL Server 2016/2012/2008 , MS Access, Oracle 11g/10g/9i/8i, MySQL

Web Technologies: HTML, DHTML, Visual Studio.

Other Tools: MS Office Suite (Microsoft Word, Power Point, Azure Stack, MS Visio), ERWIN, Adobe Photoshop, Abode Flash, Mac Office Suite, Rational Rose

PROFESSIONAL EXPERIENCE

Confidential, Sunrise, FL

MSBI / Azure Data Engineer / Sr.ETL Engineer

Responsibilities:

  • Designed & developed an Enterprise Datawarehouse system to feed Patient level information from Multiple systems throughout the organization.
  • Developed ETL process to transform the data from different systems using the ADF pipelines and used Data Lake process in-order to perform data massaging or conversions.
  • Data governance - ensures the availability and integrity of data.
  • Organize and manage development teams for data projects including migration, integration and reporting.
  • Migrated the existing Spark jobs on to Azure Databricks
  • Involved in complete remodeling of data processing pipeline by changing the design of the data flow.
  • Created pipelines to migrate the data from on-prem resources through the data lake and load the data into the Azure SQL Datawarehouse.
  • Written complex to stored procedures to handle the incremental data and doing a merge process to handle SCD type -II.
  • Written some scripting code in Databricks notebooks to perform the Data manipulations or conversations from the source data
  • Created scripts for migrating the data bricks notebooks to various regions
  • Proficient knowledge of Data Warehousing methodologies and concepts, including star schemas, snowflakes schemas, dimensional modeling and ETL processes.
  • Generated ad-hoc reports in Excel Power Pivot and shared them using Power BI to the decision makers for strategic planning.
  • Experience in using SQL performance monitor, Database tuning, Application Tuning & performance monitoring SQL profiler and optimizing the queries, tracing long running queries and deadlocks.
  • Hands-on experience across all stages of Software Development Life Cycle (SDLC) including business requirement analysis, data mapping, build, unit testing, systems integration, and user acceptance testing
  • Expertise in extensive unit testing on the mappings, sessions and workflows by writing queries in SQL using DB Tools such as Toad, Sqlplus, SQL Management Studio, IBM Data Studio, Oracle SQL Developer to check if the data was loaded to the tables properly.
  • Involving in debugging of packages with help of breakpoints, checkpoints, event handlers and loggings.
  • Designing SSIS package templates for package development incorporating package configurations, connection managers and logging in it.
  • Incorporating GIT to keeping track of the history, merging code between the different versions of the software, check-in/check-out options.

Technology: SQL Server Management, Azure Data Factory, Power BI, Azure Data Lake Analytics, Azure Analysis Services, POS concepts, ETL, Databricks.

Confidential, Chicago, IL

MSBI Developer / ETL Lead / Azure Data Engineer

Responsibilities:

  • Designed & Created the Data modeling, SSIS ETL packages for the Extract, Transform & load into SQL Database from Access.
  • Worked on Automating the process of collecting the Medical & Dental Billing information for all the Y-employees throughout all Y-Branches.
  • Used some existing notebooks in migrating the data from existing applications to Azure DW using Databricks.
  • Analyzed Business requirements and existing software for High Level Design. Contributed in preparing System Requirement Specification (SRS) and Functional Design.
  • Participated in migrating the Data from Access Database into SQL from scratch, and actively participated in creating the Data Modeling.
  • Created ETL packages for tracking on going daily payments from all Y-Branches and generating the Invoices for each Y-Branch every month.
  • Generated reports for the Business user’s purpose on the monthly transactions happened for each Y.
  • Worked on collecting the Medical information for each Y employee and worked on making the automated process for paying the Medical bill payments for the third-party vendors.
  • Worked on automating the medical claim process from different medical companies who deal with YUSA organization and loaded them up in the Sage Business works application and generating reports using power BI depending on the data so far stored.
  • Worked on establishing a connection from Azure blob container to the third party SFTP server Bank of America. It gets triggered whenever there is a new file has been posted on the SFTP server.
  • Developed a process using the C# scripting to connect Azure blob container and retrieve the latest. bai & .xml files from the container and load them into the SQL database.
  • Worked on establishing a connection from Azure blob container to the third party SFTP server Bank of America. It gets triggered whenever there is a new file has been posted on the SFTP server.
  • Developed complex mappings using SSIS to transform and load data received from clients into the central repository.
  • Used various SSIS tasks such as Conditional Split, Derived Column, script task using visual basic which were used for Data Scrubbing, data validation checks during Staging, before loading the data into the Databases.
  • Enabled Check points in SSIS package. Created break points to view the status of data, variables and over all status of SSIS package.

Environment: Windows server 2003,Microsoft Azure, MS SQL Server-2016 Enterprise Edition, SSIS, SSAS, SSRS, T-SQL, DTS, SQL Profiler, Power BI, Erwin VB.NET, OLAP, OLTP, Erwin, UNIX, Performance Point Server, Office-2007, MS Excel, C#.NET, ProClarity Analysis, MS SharePoint, GIT, VSTS.

Confidential, Chicago, IL

MSBI Developer (SSIS/ETL/SSRS) / Azure Data Engineer

Responsibilities:

  • Designed an automated process to pull the Nielsen Daily & Monthly Data files from the Nielsen Media rating company using the .NET framework looking for an XML files posted on the shared folder and loading them into the SQL, who gives the rating for each workstation that tribune has under it.
  • The process runs every 2hrs starting from morning 8am - Evening 6pm tried to get the files from the Nielsen FTP server when the post the files.
  • Developed .Net code for the process to connect VPN & then connect to an FTP server, Unzip the files and load them up into the database and using the data in the tableau for reporting.
  • Created an automated process which connects to a Nielsen web URL & gets back the Nielsen RSS feeds for the channel they have registered for.
  • These files are used for the Business users Decisions taking purposes and keep tracking of which news is trending and which station has the largest number of hits.
  • Worked on automating an ETL process to pull the number of hits, Pageviews, screen views for each Workstation from Google API using a third party Zappysy’s.
  • Pulling the Data from the Google API into the Database and turning them up into Two different sources, one for the Tableau to generate reports for marketing and other one there is a Web Site Digital Universe which shows in a graphical view with the details like which stations as the highest number of views and what’s the latest news in the market.
  • It runs for every 20min to get the latest news and from which device we have more total number of views.
  • Worked on different platforms and played a role in migrating the SQL server from 2012 to 2016.

Environment: MS SQL Server-2016 Enterprise Edition, SSIS, SSAS, SSRS, T-SQL, DTS, SQL Profiler, Power BI, Erwin VB.NET, OLAP, OLTP, Erwin.

Confidential, Chicago, IL

MSBI Developer/ ETL / Data Engineer

Responsibilities:

  • Gathering and analyzing functional and non-functional requirements based on domain rules and requirements through conducting JRD sessions.
  • Preparing instructions and specifications such as data mapping document for data extraction and other usage of data.
  • Applying SDLC methodology, specifically Agile during the development process.
  • Creating new tables, views, functions, and stored procedures in various complexity, as well as modifying existing structures for front end applications as well as ETL processes and reports.
  • Enhancing SQL functionality with adding error handling methods such as applying try/catch and if/else blocks and fixing existing errors during execution.
  • Optimizing existing T-SQL stored procedures, functions, etc. by modifying code structure or certain statements with low performance, recompiling stored procedure, etc. with SQL Profiler and information in execution plan.
  • Built a National Data Warehouse for the Confidential organization to maintain backup of the National Wide Membership Data and about the Programs conducted by the local Y’s for every 6months at each Confidential branch.
  • Created a Thriving-Y Dashboard using Power BI Data Visualization for within the Organization People to look after every
  • Created a Metrics Data to generate the reports for the National Wide programs held in the Local Y’s Organization according to the year.
  • Managing the entire ETL process involving the extraction, analysis, transformation, loading and presentation of information to the end users.
  • Designing data mappings between sources to operational staging targets, using star schema, and designing logic for incremental load using slow changing dimension and check sum.
  • Creating SSIS packages providing specific functionality like data profiling and data cleansing for a clean ETL process and populating data-marts.
  • Involving in debugging of packages with help of breakpoints, checkpoints, event handlers and loggings.
  • Designing SSIS package templates for package development incorporating package configurations, connection managers and logging in it.
  • Incorporating GIT to keeping track of the history, merging code between the different versions of the software, check-in/check-out options.
  • Preparing SSRS reports in different levels of complexity according to specific business requirements and render to pdf or excel formats.
  • Optimizing performance of SSRS reports through avoiding sub reports, optimizing T-SQL scripts and stored procedures, implementing report subscriptions, caching reports, and/or providing snapshots on reports.
  • Deploying SSIS packages and SSRS reports to corresponding development and testing servers and testing with basic cases and/or simple data to ensure functionality.
  • Communicating with Database Administrator for instructions on deploying the SSIS packages and SSRS reports, setting up subscriptions, etc.
  • Great communication, technical and problem-solving skills, and capability of working closely with teammates and independently.

Environment: Windows server 2003, MS SQL Server- 2016/2012/2008 /2005 Enterprise Edition, SSIS, SSAS, SSRS, T-SQL, DTS, SQL Profiler, Power BI, Erwin VB.NET, OLAP, OLTP, Erwin, UNIX, Performance Point Server, Office-2007, MS Excel, C#.NET, ProClarity Analysis, MS SharePoint, GIT, VSTS.

Confidential, Dallas, TX

Sr. T-SQL/SSIS Developer / ETL Developer

Responsibilities:

  • Extensively worked on Data Flow tasks like for each Loop Container, Execute process task, Transfer SQL Server Objects task, Transfer Jobs task, Transfer Logins task.
  • Migrated data from heterogeneous data sources (Data mart, Access, Excel, Flat file) to centralized SQL server databases using SQL Server Integration Services (SSIS) to overcome transformation constraints.
  • Migrated DTS packages from SQL Server 2000 to SQL Server 2016 as SSIS packages.
  • Extracted data from various sources like MS SQL Server 2008, DB2, flat files, Excel spreadsheets, Oracle and XML files and loaded into the oracle database.
  • Excellent report creation skills using Microsoft SQL Server 2016/2012 Reporting Services (SSRS) with proficiency in using Report Designer as well as Report Builder and MS SharePoint.
  • Created calculated members and Key Performance Indicators (KPIs), perspectives and partitions with existing SSAS cube objects for better analysis.
  • Consulting for medium sized companies on how to reduce costs by using Azure Stack effectively.
  • Implemented report manager to set up roles, security, and subscripts (data driven/standard) on the existing SSRS reports.
  • Created complex reports which involve a greater number of groupings and multi-value parameters
  • Sound Experience and understanding of SSAS, OLAP and OLTP cube, Data mining and Architecture.
  • Created multiple reports with drop down menu option having complex groupings within the report.
  • Experience in working on Cube structure optimization for MDX query performance in Analysis Services 2012/2008(SSAS)
  • Designed and coded 3-tier applications with front-end development in MS VB.NET, C#.NET, ASP.NET, SQL Server
  • Rendering the reports to PDF formats as per the requirement and printing all the reports in a batch process for Monthly Statements.
  • Designed complex SSAS solutions using multiple dimensions, perspectives, hierarchies, measures groups and KPIs to analyze performance of Strategic Business Units as well as corporate centers

Environment: Windows server 2003, IIS 6.0, MS SQL Server- 2016/2012/2008 /2005 Enterprise Edition, SSIS, SSAS, SSRS, T-SQL, DTS, SQL Profiler, Power BI, Erwin VB.NET, OLAP, OLTP, Erwin, UNIX, Performance Point Server, Office-2007, MS Excel, C#.NET, ProClarity Analysis, MS SharePoint.

Hire Now