Lead Bi Developer / Reporting Analyst Resume
PROFESSIONAL SUMMARY:
- Over 8.5 years of experience in IT industry and specialized in integration with Snaplogic and Microsoft Business Intelligence Tools SSIS, SSRS, SSAS.
- Experience in developing and deploying cloud - based integration solutions using Snaplogic, Azure Data Factory and Informatica intelligent cloud services.
- Experience in MS Azure Data Analytics, Azure SQL Databases, Azure Data factory, Data lake stores, Functions and stream analytics.
- Experience in Data warehousing and Business Intelligence in analysis, design, development, testing and implementation of the reporting and ETL components using SSIS, Snaplogic and IICS.
- Experience working with various Snaplogic core snaps like Mapper, File Reader, File Writer, Copy, Filter, For Each, Head, Tail, Router, Join, Email Sender, Parser, Formatter, JSON Splitter, Sort, REST Get, Rest Post, Salesforce, Reltio, Workday, SqlServer etc. for pipeline development and configuration.
- Involved in Design, Development and Deployment of SSIS packages using SQL Server Integration Services 2016/2 R2.
- Transformed data from various data sources like Excel, Flat Files and Relational database, etc. using SSIS inbuilt connection managers by creating various SSIS Packages.
- Used For-Each Loop Container, Sequence Container, Execute SQL task, Variables and Send Mail Task at the Control Flow level and Look-up, Fuzzy lookup, Merge Join, Union all, Derived Column, Conditional Split and various other Transformations to manipulate data in SSIS package at the Data Flow level .
- Experience in Managing Package Executions, Configurations, Logging, Error handling using Event Handler, and Custom Logging for SSIS Packages.
- Experience in using Microsoft Reporting Service (SSRS) with Report authoring, Report management, Report delivery and Report security and has an ability to define and develop Report Structure with data definition, report layout and report definition language (RDL).
- Developed Tabular, Matrix and Tablix reports with and without parameters using SSRS.
- Having good exposure in Hadoop stack, HDFS, Spark, HiveQL, Sqoop, Pig, Hive, Parquet & Kafka
- Good Working Knowledge on SQL Server 2016/2014/2012, 2008 R2 and SQL Server 2005.
- Experience in using recursive CTEs, CTE, temp tables and effective DDL/DML Triggers to facilitate efficient data manipulation and data consistency as well as to support the existing applications.
- Experience in developing Custom Report and different types of Tabular Reports, Matrix Reports, and drill down reports in multiple formats using SQL Server Reporting Services (SSRS) in Business intelligence development studio (BIDS) and Data Tools.
- Experience in automating process by creating jobs and error reporting using Alerts, SQL Mail Agent, FTP and SMTP.
- Experience in T-SQL scripts, dynamic SQL, complex stored procedures, functions, triggers, constraints and Indexes using various DDL and DML commands.
- Experience in writing complex DAX functions in Power BI and Power Pivot .
- Experience in Logical, physical, and Dimensional data modeling , Data mapping, and Data normalization, Star Schema / Snowflake Schema, FACT and Dimensional Tables.
- Experience in Database Administration SQL Server, Database Designing, Backup & Recovery, Data Import & Export, Index Management, User Management, Log Shipping, Clustering, Replication and Profiler.
- Thorough knowledge of addressing Performance Issues and Involved in query tuning, Index tuning, Data Profiling and other database related activities.
- Experience in Troubleshooting of Report Processing, Subscription Delivery and Configuration Problems.
- Experience in Cube designing in Business Intelligence Development Studio (SSAS) to edit various properties of a cube, including the measure groups and measures, cube dimensions and calculations created SSAS storage partitions and aggregations.
- Experience with designing and implementing MDX queries, OLAP architecture, MOLAP, ROLAP and HOLAP.
- Having experience of maintaining project documentation on Confluence
- Experience and Understanding of Software development life cycle (SDLC), And Testing life cycle
- Experience publishing reports using Power bi desktop, share dashboard with Power bi service, publishing reports for mobile apps, giving access to the end users like developers, stake holders, managers and clients
- Good team player, strong interpersonal and communication skills combined with self-motivation, initiative and the ability to think outside the box.
TECHNICAL SKILLS:
ETL Tools: SSIS, Snaplogic, Azure Data Factory, Informatica Cloud (IICS), Informatica Power Center 9.1
Data Modeling: Erwin, Power BI, SSAS, MS Visio
Databases: Teradata, Oracle, MS SQL Server, MS Access, DB2, SAP Hana, ADLS, Apache Ambari, HIVE, SPARK
Reporting Tools: Power BI, SSRS, Tableau, QlikView
Languages: SQL, PL/SQL, Shell Scripting, Python
Operating Systems: Windows, Unix, Ubuntu, MAC OS, Linux
Autosys, Azure Functions, Control: M
Domain: Telecommunication, Healthcare, Banking, Finance, Retail
Other: TOAD, SVN, TFS, GIT, Workday, Json, Salesforce, Reltio MDM, HDP Hadoop, Ambari, PySpark, AWS, RedShift
PROFESSIONAL EXPERIENCE:
Confidential
Lead BI Developer / Reporting Analyst
Responsibilities:
- Involved in developing ETL workflow to extract, transform and load the data using various integration solution like SSIS , Snaplogic , Azure Data Factory (ADF) and IICS.
- Leverage Azure Blob storage accounts via azure storage explorer for storing the different types of data like Blob storage, Table storage, Queue storage and File storage.
- Preparing and uploading the source data via azure storage explorer.
- Designed Tabular data models for various Business requirements, applied Row level security, used DAX functions, automating the partitions to ingest the data to deliver updated and latest self-service BI reports.
- Created and managed multiple Accounts, Workspaces in PowerBI Service to publish reports online to be shared within the team.
- Create ADF accounts for the resource groups, created linked services to connect to Azure Storage, on-premises SQL Server.
- Created and managed Integration Runtime (IR) Services on the designated servers.
- Develop and maintain a real-time streaming pipeline in the Microsoft Azure platform to schedule, monitor and manage copy and transform activities via VS-2015/2016, Azure portal.
- Build ELT process using Azure Data Factory and Azure Databricks Notebook.
- Design and develop SQL procedures, views, functions, and triggers to fetch data from different tables by using joins.
- Build automated ETL processes in SQL Server Integration Services (SSIS), test and implement for applications.
- Perform ETL tasks and load data from various data sources like SQL Server, Excel, Text files, CSV files etc.
- Developed automated packages to fetch data files from FTP servers and load into tables.
- Created Data driven Tabular, Drill-down, Charts, Parameterized, Linked, Aggregate reports using SSRS Report Builder.
- Troubleshoot and resolve complex issues and Error Handling in SSIS.
- Responsible for creating Databases, Tables, Cluster/Non-Cluster Index, Unique/Check Constraints Views, Stored Procedures, Triggers, Rules.
- Created reports in SSRS, Power BI with different type of properties like chart controls, filters, Interactive Sorting, SQL parameters etc.
- Created notifications and alerts, subscriptions to reports in the Power BI service.
- Used Sqoop to import the data from relational database (MSSQL) to hive and hdfs .
- Used Spark Python API to extract the data from different databases like Hive, MS SQL.
- Transformed the data by using various dataframe , rdd operations along with spark SQL.
Environment: SQL Server Integration Services (SSIS), SSMS, SSRS, Azure Data Factory, Azure Databricks, Azure Data Warehouse, Azure portal, Power BI, ETL, T-SQL, Windows, Linux, MDX, OLTP, OLAP, XML, Tableau, Power BI Desktop, Share Point 2013, Master Data Management (MDM), Import Export Wizard.
Confidential
MS Azure data factory developer
Responsibilities:
- Analyze business requirements and understanding business process flow about data vault.
- Understand the business scenario and provide the right solution to end user to implement the unified data modeling.
- Implemented the Microsoft data factory V2 pipelines to import the data from SQL databases to file systems/data lake store using Microsoft cloud services.
- Worked on activities like U-SQL, Copy, Stored Procedure, Lookup, Foreach etc.
- Provide the feasible solution for the reading/writing data to data lake store using data lake analytics.
- Worked on stream analytics to fetch the data from azure blob store/data lake store to Azure Cosmos DB like document DB.
- Created logic apps to monitor the folder and move (or copy) the files to blob storage.
- Loading data from Azure Cosmos document DB to Azure Cosmos table DB.
- Performance tuning of existing pipeline activities.
- Designed data integration tasks using assets like Mapping Task, Synchronization Task and Replication Task.
- Configured source, target connections like Salesforce, Sql Server, Oracle, Rest 2, Flat file, JDBC etc. using IICS administrator service.
- Implemented mapping transformations like Filter, Expression, Aggregator, Joiner, Lookup, Normalizer, Rank, Router, SQL and Union etc. for loading data from source to target systems.
Environment: Azure Data Factory, Azure Databricks, Azure portal, Power BI, SQL Server Integration Services (SSIS), U-Sql, SSMS, Informatica Intelligent Cloud Services (IICS), ETL, T-SQL, Windows Server, MDX, OLTP, OLAP.
Confidential
Senior SnapLogic Developer
Responsibilities:
- Requirement understanding and design documentations with proposed solutions.
- Development of Snaplogic pipelines for source and target integration using various Snaplogic Snaps.
- Unit testing and integration testing of Snaplogic pipelines and performance improvements.
- Created scheduled and triggered tasks for Snaplogic pipelines.
- Consumed Restful APIs to load the incremental data from the source systems.
- Configured the Reltio MDM to accommodate the all required entities with respective attributes for load and consuming Customer and Supplier data.
- Created project folders and accounts required for individual project deliverables.
- Developed a generic Audit and error notification that can be plugged into any pipeline.
- Developed a generic configuration implementation that can be shared across all pipelines.
- Building the release artifacts for deployments and working with the release team for the smooth deployment.
- Monitor and troubleshoot the pipeline issues, data issues and Reltio platform issues.
- Maintained Snaplogic pipeline implementation flows on Confluence each pipeline with details.
- Lead offshore development and testing team for delegating the tasks and making sure the deliverables are met as per the timelines.
- Production support and validation of errors.
Environment: SnapLogic, Reltio MDM, Workday, DB Visualizer, Salesforce, Sql Server, MySQL, SSIS, SSRS, SSAS, Confluence, Jira, GIT, Windows, Linux
Confidential
SnapLogic Developer
Responsibilities:
- Analyse business requirements and design the technical solutions for architectural reviews.
- Involved in design and development of database model for the data warehouse.
- Created Snaplogic pipelines to read and extract source data for various Dimensions and Facts from Workday application.
- Performed various business validations on the staged data and ingested the valid data into production.
- Involved in development and unit testing of analysis services cube.
- Created task for scheduling the ETL pipelines in Snaplogic.
- Created and configured the SSIS packages to load the Fact tables.
- Design and develop SQL procedures, views, functions, and triggers to fetch data from different tables by using joins.
- Build automated ETL processes in SQL Server Integration Services (SSIS), test and implement for applications.
- Perform ETL tasks and load data from various data sources like SQL Server, Excel, Text files, CSV files etc.
- Developed automated packages to fetch data files from FTP servers and load into tables.
- Created Data driven Tabular, Drill-down, Charts, Parameterized, Linked, Aggregate reports using SSRS Report Builder.
- Troubleshoot and resolve complex issues and Error Handling in SSIS.
- Responsible for creating Databases, Tables, Cluster/Non-Cluster Index, Unique/Check Constraints Views, Stored Procedures, Triggers, Rules.
- Created reports in SSRS, Power BI with different type of properties like chart controls, filters, Interactive Sorting, SQL parameters etc.
- Developed tableau dashboards using the Fact and Dimensional data incremented in Data warehouse tables.
- Prepared Unit Test cases as per the business and Supported the QA test phases.
Environment: Snaplogic, SSIS, Sql Server, SSDT (Data Tools), Workday, Anaplan, TFS, XML, Tableau, Power BI Desktop, Share Point 2013, Master Data Management (MDM), Import Export Wizard, Windows, G-suit
Confidential
Sr. BI Developer
Responsibilities:
- Analysed and transformed complex business logic into Database design and maintaining it by using SQL objects like Stored Procedures, User Defined Functions, and Views to facilitate efficient data manipulation and data consistency.
- Successfully implemented clustered and non-clustered indexes on tables for optimum performance. Extensively used Joins and CTE’s for complex queries involving multiple tables from different databases
- Created BRD’s, FRD’s, Technical Design documents and other sort of documents like mapping documents as part of the project.
- Prepared the complete data flow and data mapping for all the migrated jobs using SSIS.
- Created stand-alone packages for data extraction using SQL Server Integration Services and have experience on creating dynamic packages through Script task components.
- Created ETL packages with different data sources (CSV files, SQL Server, Flat files, Excel source files) and loaded the data into target tables by performing different kinds of transformations using SSIS.
- Created SSIS script tasks, look up transformations and data flow tasks using T- SQL and Visual Basic (VB) scripts.
- Used Change data Capture logics to implement merge statements to capture changes made at the data source to deal with the data changes.
- Created SQL agent jobs and scheduled, maintained SSIS packages in SSIS Server.
- Developed packages in SSIS Designer using Control Flow Tasks and Data Flow Transformations to insert various formats of source data in to destination database.
- Created the packages using transformations such as the Derived Column, Union All, and Conditional Split, etc.
- Used Control Flow Tasks like For Loop Container, For Each Loop Container, Sequential Container, Execute SQL Task, Email Task, and Data Flow Task.
- Used different debugging tools like data viewers and break points to debug the Data Flow tasks and Controls Flow tasks.
- Created Sql server agent jobs for scheduling the SSIS packages as per the LOB requirements.
- Involved in Configuring and deploying packages.
- Develop Error Handling process for each SSIS Package.
- Involved in creation of Tabular and Matrix reports using SSRS.
- Prepared Unit Test cases as per the business logic.
- Supported the SIT, UAT test phases.
Environment: SQL Server 2008R2/2012, Visual Studio 2010, T-SQL, PL/SQL, Sql Server Integration Services (SSIS), Sql Server Reporting Services (SSRS), BIDS, Windows, Report Builder, Report Manager, SVN, TFS
Confidential
MSBI Developer / DB Developer
Responsibilities:
- Analyzed business requirements and involved in designing the technical solutions using Microsoft BI stack.
- Created complex Stored Procedures, Triggers, Functions, Indexes, Tables, Views, SQL joins and other T-SQL code to implement business rules
- Created packages to validate, extract, transform and load data to a centralized SQL server using OLEDB providers from the existing diversified data sources through ETL tool
- Created packages in SSIS Designer using Control Flow Tasks and Data Flow Transformations to implement Business requirement.
- Created the packages using transformations such as the Derived Column, Union All, and Conditional Split, etc.
- Used Control Flow Tasks like For Loop Container, For Each Loop Container, Sequential Container, Execute SQL Task, Email Task, and Data Flow Task.
- Used different debugging tools like data viewers and break points to debug the Data Flow tasks and Controls Flow tasks.
- Perform unit testing to ensure the requirements are met and support all phases QA testing.
- Involved in Configuring SSIS packages for different environments like Dev, Test, Prod and deploying SSIS package Dtsx files to respective locations in each environment. .
- Develop Error Handling process for each SSIS Package.
- Involved in creation of Tabular and Matrix reports using SSRS.
Environment: SQL Server 2012/2008R2, Microsoft Visual Studio, SQL server Integration Services (SSIS), SQL server Reporting Services (SSRS), SQL server Analysis Services (SSAS), MS Office 2007/2010, Pivot, Power Pivot, Business Intelligence Development Studio (BIDS), Report Builder, Report Manager, SVN, Windows
Confidential
DB Developer
Responsibilities:
- Involved in designing of initial package, keeping in view implementing appropriate SSIS controls.
- Created the packages using transformations such as the Derived Column, Union All, and Conditional Split, etc.
- Created and modified the existing stored procedures, Functions, views and queries to have effective reporting. Wrote CTEs in the stored procedures to minimize the logic in the Reporting Services.
- Optimize the query performance by using Query optimizer, execution plan, SQL Server Profiler and optimizing techniques.
- Designed new SSIS Packages and worked on existing various transformations to transfer data from various sources like Text Files, XML (Extensible Markup Language) Files, SQL Server, Excel and Access to SQL Server using Business Intelligence Development Studio.
- Used Control Flow Tasks like For Loop Container, For Each Loop Container, Sequential Container, Execute SQL Task, Email Task, and Data Flow Task.
- Used different debugging tools like Break points, data viewers, and break point windows to debug the Data Flow tasks and Controls Flow tasks.
- Involved in Scheduling and deploying packages. Provided on call support to monitor the daily load jobs and find the root cause (RCA) in case of any failures.
- Involved in creation of Tabular and Matrix reports using SSRS.
- Deploying and managing the SSRS reports to Report server.
Environment: SQL Server 2012/2008R2, Microsoft Visual Studio, SQL server Integration Services (SSIS), SQL server Reporting Services (SSRS), SQL server Analysis Services (SSAS), MS Office 2007/2010, Pivot, Business Intelligence Development Studio (BIDS), Report Builder, Report Manager, SVN, Windows.