17 years of experience in designing architecture, analysis, design and development of database development, database administration, maintenance using Microsoft SQL Server and BI suite (SSAS, SSIS, SSRS) and application development using dot net technologies (c#, asp.net, WCF, WinForms, web services, RESTful Web Services). I am Certified Cloudera CDH 5 Big Data Hadoop Administrator
Extensive experience in Relational and Dimensional Data modeling of Data ware house for creating Logical and Physical Design of Database and ER Diagrams using data modeling tools like MS Visio, Erwin.
Expertise in merging data from various heterogeneous data sources like Excel, text files, SharePoint Lists, data extracted through Cosmos (Big data) and merging, populating dimension and fact tables in data warehouse, Cleansing and Standardizing data loaded into OLTP and DW databases using SSIS.
Cleansing of data when extracted from different sources like flat & csv files, data conversion, error handling and logging and inserting into staging tables and then in Data Warehouse.
Maintenance of historical data using Slowly Changing Dimensions (SCD 2) and marking of records as inferred members in case of early arriving facts.
Experience in creating package configurations like XML, SQL Server Configurations and Logging using text, XML and Windows event log.
Expert in using Data Profiling task in cleaning the data.
Scheduling of ETL packages through SQL Agent jobs. Skilled in SQL 2005 Business Intelligence tools, Data Warehousing and ETL processes & strategies using SQL server Analysis and Integration Services.
Created and Configured Data Source & Data Source Views, named query, named calculations and Dimensions, Cubes, Measures, Partitions, KPI’s & MDX Queries using SQL Server 2008 Analysis Services.
Excellent knowledge in Developing SSAS Cubes (OLAP & Tabular), Aggregation, KPIs, Measures, Partitioning Cube, and Deploying and Processing SSAS objects.
Created and Configured Data Source & Data Source Views, Dimensions, Cubes, Measures, Partitions, DAX queries, KPI’s & MDX Queries using SQL Server 2008 Analysis Services.
Experience in maintaining database, including updating statistics, table partitioning, re - indexing, structure modifications, and index analysis.
Proficiency in database backup and recovery methodologies.
Experienced in database administration activities - log shipping, replication and mirroring.
Experience in database performance monitoring and tuning.
Well experienced in executing the project management life cycle (PMLC). Planning and executing the project successfully.
Involved in making System Requirement Specification (SRS) and Functional Technical Specification (FTS), to make sure, task is achieved and meets the requirements.
Understand the requirements in detail and making the architecture of the data pipeline using Big Data Hadoop, Kafka, Spark (using Scala), Hive,Sqoop & SQL Server.
AS400 data is fed into hive database and some data comes through Kafka brokers and is fed into Hive tables.
Then the selected data is fed into SQL Server using sqoop for some selected case types. Data is cleansed using SSIS ETL.
Fetching data from Kafka brokers.
Data processed using Spark & Scala as input for Hive tables.
Defining tables' schema in Hive.
Inserting data into Hive tables
My role is to analyze the 8 of the pre-existing cubes and increase the performance of the cubes and rectifying some of the critical issues.
Technologies: Hive, Sqoop, Kafka, Hadoop, SQL Server, Linux
Designing of View Switching used to change the database source for report users while the other database is loading data.
Designing of ETLs using SSIS to populate data in dimensions and Fact Tables.
Writing stored procedures and user defined functions.
Requirement gathering from business.
Designing of Data Warehouse (Dimensions and Fact Tables).
Designing of ETLs using SSIS to populate data in dimensions and Fact Tables.
Writing stored procedures and user defined functions to calculate AOCs for metrics.
Developed reports using Tableau for various metrics across different periods, monthly and weekly.
Designed SSIS ETLs to process data from XML files into staging tables and in dimensions and fact tables.
Made SQL jobs to schedule ETLs.
Designed reports using SSRS and Tableau which takes its input data from DW and cubes.
Wrote stored procedures and fine - tuned SQL Queries.
Designed SSAS cubes using STAR schema.
Designed SSIS packages and maintained existing ETL packages.
Scheduling SSIS ETL jobs and troubleshooting in case jobs fail.
Writing stored procedures and maintenance of Data ware house.
Designing of new cubes using STAR schema and maintenance of existing SSAS cubes and responsible for checking processing.
Used MOLAP and ROLAP partition storage modes.
Deployed cubes on production using XMLA file.
Making dashboards using SSRS and reports using data from cubes using MDX queries and uploading reports on SharePoint portal.
Backup and restoration of database.
Fine tuning of database and improving the performance of db.
Designed SSIS Packages to transfer data from flat files to SQL Server using Business Intelligence Development Studio.
Used ETL (SSIS) to develop jobs for extracting, cleaning, transforming and loading data from cubes and flat files (from COSMOS Big Data Microsoft Proprietary ) into data warehouse.
Maintenance of Slowly Changing Dimensions Type 2 and handling of Early Arriving Facts in Dataware House.
Prepared the complete data mapping and Report Definitions for the project.
Used ETL tools like SSIS/DTS for data flow from source files like XML, Excel, Tables and views to other databases or files with proper mapping.
Based on business requirement, developed the Complex SQL queries with Joins and T-SQL, Stored procedure, Views, Trigger to implementing the business rules and transformations.
Monitored performance and optimized SQL queries for maximum efficiency.
Designing of cubes and automated the processing of cubes using SSIS.
Allows Microsoft to analyze issues faced by customers using SQL products across the globe.
Information is captured; incident is assigned a ticket based on client subscription type of customer.
Depending upon the information, a decision is taken whether the problem has any workaround or needs a hot fix i.e. it is a RFC or RFH. Used SSAS,SSIS, SSRS and SQL Server, Silverlight 4.0, Entity Framework
Used SSIS to unite data from existing system and performed transformations on MS SQL 2008.
Designed Cubes with Star Schema using SQL Server Analysis Services 2008 (SSAS). Created several Dashboards and (iii) Scorecards with Key Performance Indicators (KPI) in SQL Server 2005 Analysis Services (SSAS).
Automated cube processing and partition creation using SSIS packages.
Enhancing and deploying the SSIS packages from development server to production server.
Involved in designing, developing and deploying reports in MS SQL Server environment using SSRS-2008 in Business Intelligence Development Studio (BIDS)
Designed cubes using SSAS and used as input in SSRS. Data movement from OLTP Database to Data warehouse is done by ETL (SSIS) packages. Business Data is processed to OLAP storage by implementing cubes.
Designed OLTP and Detaware House.
Designed SSIS Packages to extract, transfer, load (ETL) existing data into SQL Server from different environments for the SSAS cubes.
Involved in Analyzing, designing, building &, testing of OLAP cubes with SSAS 2008 and in adding calculations using MDX.
Designed and implemented data mart, facts, dimensions and OLAP cubes using dimensional modeling standards in SQL Server 2005/2008 that maintained data.
Involved in the complete data warehouse development life cycle.
Actively supported business users for change requests.
Designed and developed SSIS Packages to extract data from various data sources such as Access database, Excel
Spreadsheet and flat files into SQL server 2005 for further Data Analysis and Reporting.
Responsible for performing T-SQL tuning, optimizing queries for reports which take longer time in execution with SQL Server 2008.
Designing of cubes and using MDX queries for SSRS reports.
Sr. Software Engineer
Responsible for creating stored procedures, views, user defined functions, triggers, indexes.
ETL packages for pushing data into Data Warehouse’s dimensions and fact tables using Slowly Changing Dimension (SCD) transformation.
Worked on MDX Queries, Calculated Members, Aggregations and KPI’s after building Cubes in SSAS.