SUMMARY

• 15+ years of IT experience, including 1+ year of experience in dealing with Apache Hadoop Ecosystem like HDFS, Hive, Sqoop, Oozie, Yarn, HBase, Spark, andBigDataAnalytics and 10+ of experience in Database System Analysis, Design, and Implementation.
• Good understanding of Hadoop Architecture and underlying Hadoop framework.
• Hands on experience in configuring, and using Hadoop components like HDFS, HBase, Hive, Sqoop and PySpark.
• Manageddatacoming from different sources and involved in HDFS maintenance and loading of structured and unstructureddata.
• Exposed in working with SparkDataFrames and optimized the SLA’s.
• Experience in importing and exportingdatausing Sqoop from HDFS to RDBMS and vice - versa.
• Experience in working with NoSQL database HBase
• Hands on experience in Linux Shell Scripting.
• Good understanding in Machine Learning concepts classification, regression, clustering and statistical algorithms ALS, Kmeans, Bisecting KMeans
• Extensive knowledge of Relational Database Management Systems.
• Development experience on Database Design and Development in SQL server 2005/2008/2008 R2/2012/2016 system in OLTP environment.
• Experience in data warehousing such as dimensional modeling, star and snowflake schemas, data marts, fact and dimension tables identification.
• Experienced with T-SQL in constructing Tables, Triggers, User Function, Views, User Profiles, Relational Database Models, Data Dictionaries and Data Integrity.
• Expert in writing complicated SQL Queries and database analysis for good performance.
• Created ETL packages using SSIS to move data from various heterogeneous data sources.
• Experienced in SSIS to create ETL packages to validate, extract, transform and load data to data warehouse databases, data mart databases.
• Well versed in data Extraction, Transformation and Loading (ETL) using SQL Server Integration Services (SSIS) for data migration.
• Experience in developing, monitoring, extracting and transforming data using SSIS/DTS Import Export Data, Bulk Insert and SSIS/DTS.
• Experience using SSRS in deploying, upgrading, managing various operational, regulatory and analytical reports (SSRS).
• Experience in creating Data Analysis and Reporting, Parameterized Reports, Drill through and Drill Down reports, Tabular reports.
• Hands-on working experience with analyzing query plans, using extended Stored Procedures, managing indexes and locks, troubleshooting deadlocks.
• Good understanding ofNormalizationandDe-Normalizationconcept for faster query retrieval.
• Conversant with all phases of Software Development Life Cycle (SDLC) involving Systems Analysis, Design, Development, and Implementation. Experience in Integration and User Acceptance testing. Good Experience working in the Agile methodology
• Strong problem-solving skills, quick learner and able to work independently as well as a team member of varying sized teams. Strong interpersonal and communication skills combined with self-motivation, initiative, and the ability to think outside the box.

TECHNICAL SKILLS

Languages: Python, SQL

Hadoop Distributions: Cloudera (CDH5)

Hadoop Ecosystem: HDFS, MapReduce, Hive, Sqoop, Oozie, HBase, Kafka, Spark, YARN, Zookeeper, Linux

Databases: MS SQL 2012/2016, Access 2010, Oracle 18.4

Database management tool: SQL Server Management Studio, Oracle SQL developer

BI and Reporting tools: Power BI, Power Pivot, SSRS

ETL: SSIS

AWS Services: AWS EC2, S3

Version Control: SVN, GitHUb, Bitbuket, TFS, VSS

Other Tools: MS Visual Studio, MS-Visio, Eclipse, Jupyter, JIRA, Service-Now

PROFESSIONAL EXPERIENCE

Confidential

Senior MSBI Developer/ETL Developer

Responsibilities:

• Involved in writing Spark applications using PySpark to perform various data cleansing, validation, transformation and summarization activities according to the requirement.
• Load the data into Spark RDD and perform in-memory data computation to generate the output as per the requirements.
• Developed data pipelines using Spark, Hive and Sqoop to ingest, transform and analyze operational data.
• Worked on performance tuning of Spark application to improve performance.
• Worked on different file formats like Text, Sequence files, Avro, Parquet, JSON, XML files and Flat files using Map Reduce and Hive.
• Analyzed the SQL scripts and designed the solution to implement using Spark.
• Exported the analyzed data to the relational databases using Sqoop for visualization and to generate reports.
• Extensively used Hive/HQL or Hive queries to query data in Hive Tables and loaded data into HBase tables.
• Extensively worked with Partitions, Dynamic Partitioning, bucketing tables in Hive, designed both Managed and External tables, also worked on optimization of Hive queries.
• Created complex T-SQL queries, stored procedures, and user defined functions (UDF’s).
• Performing in-depth analysis on the legacy data to ensure the business rules, documented and undocumented are accurately reflected and developing data quality instance and audit reports using SQL Server Integration Services (SSIS).
• Resolving individual instances of data issues identified during the data profiling process.
• Lead the ETL team providing support and reviewed the code and the packages that team members developed.
• Created Stored Procedures, User Defined functions, Tables and also modify already existing stored procedures, triggers, views, indexes depending on the requirement.
• Creating Drill Down, Drill Through, Linked, Customized and Ad-Hoc reports using SQL Server Reporting Services (SSRS) and SQL Server Management Studio (SSMS).
• Using SQL Server Integration Services (SSIS) for Import/Export of large data and other data modifications.
• Experience in dynamic configuration of packages in SSIS.
• Experience in creating Interactive Reports using Power Pivot and Power BI.
• Experienced into Tested, Cleaned and Standardized Data meeting the business standards using Fuzzy /exact lookups in SSIS.
• Organized Error and Event handling by giving Precedence Constraints, Break Points, Check Points, Logging and viewers in SSIS.
• Report/Data migration from Heterogeneous Data stores and Legacy System implementing SSIS on the System.
• Involved in designing the new packages & also modified the existing packages for the ELT Load using SSIS 2008/2012 to load data to and from various sources.
• Optimized the performance of queries with modifications in T-SQL queries, removed unnecessary columns, eliminated redundant and inconsistent data, established joins and created indexes whenever necessary.
• Verification of SQL queries and Data results along with operation of UAT Testing.
• Converting data housed in one or multiple formats into a different data storage format.
• Work cross-functionally with various business owners to perform in-depth analysis on the legacy data to ensure the business rules and meet their reporting and analytics needs.
• Develop code, mappings, and data transformations utilizing SSIS ETL.

Environment: HDFS, Sqoop, Hive, Oozie, Tableau, HBase, Python, Yarn, OBIEE Spark, MobaxTerm, MS SQL server 2016, SSIS, SSRS.

Confidential

Onsite Project Lead/BI Developer/MSBI

Responsibilities:

• Created complex T-SQL queries, stored procedures, and user defined functions (UDF’s).
• Created User Defined Functions to encapsulate frequently and commonly used business logic making the system more modular, secured and extensible.
• Modified stored procedures to implement the complex business needs.
• Generated test data and tested database to meet the functionalities deliverables in the project documentation and specifications.
• Created Database Objects like Tables, Stored Procedures, Views, Triggers, Rules, Defaults, user defined data types and functions.
• Designing of Database and Tables.
• Implemented complex business requirement in backend using efficient stored procedures and flexible functions, and facilitated easy implementation to the front end application.
• Optimized the performance of queries with modifications in T-SQL queries, removed unnecessary columns, eliminated redundant and inconsistent data, established joins and created indexes whenever necessary.
• Experience in writing Adhoc queries for Business analysts to extract required daily data, analyzing existing data and performing the data migration.
• Used SQL Profiler for troubleshooting, monitoring, and optimization of SQL Server and non-production database code as well as T-SQL code from developers and QA.
• Experience in generating on-demand and scheduled reports for business analysis or management decision
• Developed custom reports and deployed them on server using SQL Server Reporting Services (SSRS).
• Generated parameterized/Drilldown, Drill through & Cascaded reports using SSRS.
• Documented all database objects, procedures, views, functions & packages for future references.
• Created SSIS package to extraction and load data into the Data warehouse and Report-Data mart.

Confidential

Project Lead/BI Developer/MSBI

Responsibilities:

• Created complex T-SQL queries, stored procedures, and user defined functions (UDF’s).
• Created User Defined Functions to encapsulate frequently and commonly used business logic making the system more modular, secured and extensible.
• Modified stored procedures to implement the complex business needs.
• Generated test data and tested database to meet the functionalities deliverables in the project documentation and specifications.
• Created Database Objects like Tables, Stored Procedures, Views, Triggers, Rules, Defaults, user defined data types and functions.
• Designing of Database and Tables.
• Implemented complex business requirement in backend using efficient stored procedures and flexible functions, and facilitated easy implementation to the front end application.
• Optimized the performance of queries with modifications in T-SQL queries, removed unnecessary columns, eliminated redundant and inconsistent data, established joins and created indexes whenever necessary.
• Experience in writing Adhoc queries for Business analysts to extract required daily data, analyzing existing data and performing the data migration.
• Used SQL Profiler for troubleshooting, monitoring, and optimization of SQL Server and non-production database code as well as T-SQL code from developers and QA.
• Experience in generating on-demand and scheduled reports for business analysis or management decision
• Configuration of report server and report manager scheduling, give permissions to different level of users in SQL Server Reporting Services (SSRS).
• Developed custom reports and deployed them on server using SQL Server Reporting Services (SSRS).
• Generated parameterized/Drilldown, Drill through & Cascaded reports using SSRS.
• Documented all database objects, procedures, views, functions & packages for future references.
• Created SSIS package to extraction and load data into the Data warehouse and Report-Data mart.
• Created SSIS packages (ETL) to migrate data from heterogeneous sources such as MS Excel, Flat Files, .CSV files, Oracle etc.
• Created VB.Net Script for Data Flow and Error Handling using Script component in SSIS.
• Created SSIS package to load data from Flat File to Flat File and Flat File to Data warehouse and Report-Data mart using Lookup, Fuzzy Lookup, Derived Columns, Condition Split, Term Extraction, Aggregate, Pivot Transformation and Slowly Changing Dimension.
• Experience in Developing, Monitoring and Deploying SSIS packages.
• Experience in dynamic configuration of packages in SSIS.

Confidential

BI Developer/MSBI

Responsibilities:

• Developed SQL Server ETL processes to combine patient claims from 16 Health Insurance companies to the CVS Caremark Corporate Data Warehouse.
• Redesigned the data extraction processes for implementation of new drug studies in Accordant’s SQL Server clinical database. Redesigned and reduced stored procedure execution time. The stored procedure code was greatly simplified and executed more quickly.
• Designed tables and ETL processes to combine patient drug assessment data from multiple drug companies and formats into a standard set of tables for the support of business analysis reports.
• Converted SQL Server 2000 DTS Packages to SQL Server 2008 Packages.
• Loaded data into different destination, SQL Server, MS Excel, MS Access etc. using SSIS.
• Successfully extracted data from FTP locations using FTP tasks using SSIS.
• Transformed data using various transformations like Lookup, Derived Columns, Pivot, Unpivot etc. using SSIS.
• Involved in analyzing business requirements and design documents.
• Involved in interacting with business people on daily basis for better understanding and implementation.
• Created reports from data warehouse using SQL Server Reporting Services (SSRS).
• Involved in complete software development life cycle (SDLC) of the project.
• Performed tuning and optimization of complex SQL queries.
• Created SSIS Packages, Jobs and Sending Alerts using SQL Mail.
• Created stored procedures, Triggers, User-defined Functions, Views for both Online and Batch requests handling business logic and functionality of various modules.

Environment: MS SQL SERVER 2008R2, MS SQL Server 2008, SSIS, SSRS, Business Intelligence Studio, SQL Profiler, Microsoft Visio, MS Office.

Confidential

SQL Server/SSRS/SSIS Developer | MSBI

Responsibilities:

• Involved in Designing, Developing and Testing of the ETL strategy to populate the data from various source systems feeds using SSIS.
• Designed ETL packages dealing with different data sources (SQL Server, Flat Files) and loaded the data into target data sources by performing different kinds of transformations using SQL Server Integration Services (SSIS).
• Involved in building and maintaining SSIS Packages to import and export the data from various data sources using BIDS based on the design data models.
• Worked on various tasks and transformations like Execute Sql Task, Execute Package Task, and Conditional split, Script Component, Merge and Lookup while loading the data into Destination using SSIS.
• Created stored procedures, Triggers, User-defined Functions, Views for both Online and Batch requests handling business logic and functionality of various modules.
• Creating Ad Hoc and parameterized various Reports using SQL server 2005 Reporting Services.
• Created various ad-hoc SQL queries for customer reports, executive management reports and types of report types like tables, matrix, sub reports etc.
• Have used BCP, BULK INSERT to transfer data from and to SQL server database.
• Implemented security to restrict the access to users and to allow them to use only certain reports.

Environment: MS SQL SERVER 2005, MS SQL Server 2008, SSIS, SSRS, Business Intelligence Studio, SQL Profiler, Microsoft Visio, MS Office.