PROFESSIONAL SUMMARY:

• Over 7 years of working knowledge in SQL Server (SQL, SSIS, SSRS, SSAS) and Hadoop Eco - system using: HDFS, MapReduce, Apache Spark, Apache Hive and Apache Sqoop.
• Good knowledge of Hadoop architecture and its components like HDFS, MapReduce, Job Tracker, Task Tracker, Name Node and Data Node
• Good knowledge on relational databases like MySQL, Oracle and SQL databases
• Implemented SQOOP for large dataset transfer between Hadoop and RDBMS.
• Hands on experience writing UDFS in pig and hive.
• Experience in UNIX shell scripting.
• Experience working on Data Warehouse (using Dimensional and Fact Tables)
• Experience working on Agile Methodologies and Water Fall environment
• Efficiently involved in the Software Development Life Cycle (SDLC) processes including Analysis, Design, Development, Testing and Implementation.
• Experiences in analyzing data using HiveQL and T-Sql and custom MapReduce programs in Java.
• Experienced in importing and exporting data from relational database into HDFS using Sqoop.
• Over 1 year of experience in developing application using Scala.
• Hands on experience in Application Development using Scala, Hadoop, RDBMS and Linux shell scripting.
• Excellent knowledge in Hadoop and SQL in application development and deployment.
• Excellent knowledge working on Textfile, ORC, Parquet, Avro and Json files
• Demonstrate professionalism, attention to details, collaborative nature and a quick learner.
• Strong communicator exhibited by working closely with users to identify and resolve problems. In addition to working well individually, an effective team player.
• Strong analytical and problem-solving skills, Ability to work to deadlines, Results oriented Flexible, and Adaptable.
• Experience processing data using MapReduce and Spark
• Experience in Data Modeling: Analyzed and Created structure for Data.
• Experience in Normalization and De-normalization
• Excellent T-SQL development skills to write complex queries involving multiple tables, great ability to develop SQL Objects and maintain Stored Procedures and User defined functions.
• Experience in migration of Data from various Data Sources such as Excel, Flat file, XML and SQL to MS SQL Server by using SQL Server Integration Services (SSIS) and DTS utility.
• Experienced in handling Slowly Changing Dimensions while loading data into data warehouse.
• Experience in Building cubes using SSAS
• Experience developing Analyst report using Tableau, Report Builder and Orca

TECHNICAL SKILLS:

Operating Tools: SQL Server, Visual Studio, Hadoop, Orca, Tableau, Intellij idea

Languages: T-SQL, PL-SQL, HiveQL and Scala

Methodologies: Agile, waterfall.

Database: SQL Server, Oracle and MySQL

IDE / Testing Tools: Eclipse and Intellij

Operating System: Windows, UNIX, Linux

Source Control Tools: Visual Source Safe 2015, Team Foundation Server 2010

PROFESSIONAL EXPERIENCE:

Confidential, Texas

Software Developer

• Worked with internal or external business partners.
• Worked in an Agile (sprint and scrum) environment.
• Analyzing and build structure to save Data using Data Modeling
• Installed and configured Hadoop 0.20 Cloudera version
• Installed and configured Hadoop and Hadoop stack on a 7node cluster.
• Setup and configured VMware based Linux environment.
• Experience implementing data Warehouse by loading the Dimension and Fact tables.
• Created multiple Managed and Non-Managed tables in Hive to save data.
• Used Sqoop to dump data from relational database into HDFS for processing.
• Extracted data from different Data sources like (SQL, Oracle, Local-file, MySQL…) into HDFS using Sqoop and import into Hive tables.
• Developed MapReduce programs to parse the raw data, populate staging tables and store the refined data in partitioned tables.
• Used Spark for faster and efficient processing data.
• Wrote Scala code using Intellij to connect on the file and process.
• Worked with different type of files: Textfile, Xml, Json, ORC and Parquet files,
• Using Sqoop to extract data from RDBMS (MySQL and SQL server) to Hadoop and from Hadoop to RDBMS.
• Involved in the creation of SQL tables and indexes and also wrote queries to read/manipulate data.
• Creating multiple queries to retrieve, split and store data using Hive in HDFS
• Creating Partitioning (Dynamic / Manually) and Bucketing tables in HDFS using Hive.
• Experience working with Structure and non-Structure data types (Arrays and Struct)
• Developed Oozie Workflows for daily incremental loads, which gets data from Teradata and then imported into hive tables.
• Efficiently involved in the Software Development Life Cycle (SDLC) processes including Analysis, Design, Development, Testing and Implementation.
• Understanding of systems development life cycle including issue, risk and scope management.
• Experienced in documenting business, process and data flows.
• Analyzing data using various tools: Orca, Tableau and Report Builder(SSRS)

Environment: Hadoop, Spark, MapReduce, Hive, Sqoop, Oozie, SQL, SSIS, Linux SQL Server, MySQL, Visual Studio, ORCA, Python, Tableau

Confidential, Dallas, Texas

SQL Server - BI - Developer (SSIS, SSRS, SSAS)

• Worked with internal or external business partners to recommend business intelligence solutions.
• Worked in an Agile (sprint and scrum) environment.
• Created database objects, complex queries and stored procedures to support the ETL process of loading data files received from clients.
• Automated the ETL process from T-SQL queries to SSRS for dynamic reporting using SSIS.
• Experience on developing a Data Modeling Process.
• ETL Development, Database design, data storage and management of data that can be used for analysis and presentation.
• Designed efficient ETL processes using Microsoft SQL Server stored procedures & SQL Server Integration Services that imports Claims data from various sponsors.
• Identified cause for ETL job failures and rectify the issues using Log in SSIS.
• Optimized SSIS packages and stored procedures that improve the processing speed of large files.
• Involved in complete SSIS life cycle in creating SSIS packages, building, deploying and executing the packages in both the environments (Development and Production).
• Used various Transformations and Tasks in SSIS Dataflow, Control Flow to load and manipulate data.
• Involved in ETL architecture enhancements to increase the performance using query optimizer. Implemented Event Handlers and Error Handling in SSIS packages.
• Implemented Slowly Change Dimensions in SSIS to update data.
• Built dimensional and Fact tables in SSMS.
• Defined relationship between Tables using Data Model.
• Troubleshooting ODBC and OLEDB connection issues in SSIS packages.
• Extensively used SSIS transformations such as Lookup, Derived column, Data conversion, Aggregate, Conditional split, SQL task, Script task, Merge and Merge join, Union All, Lookup, and Send Mail task etc.
• Used ETL (SSIS) to develop jobs for extracting, cleaning, transforming and loading data into data warehouse.
• Carried out edit checks to edit data based on certain conditions like filtering records with nulls, bad/incomplete SSN, incomplete phone numbers and zip codes.
• Utilized SSRS Reports from different source formats and satisfying clients by representing reports and presentations.
• Administrated and scheduled mailing subscriptions on SSRS reporting server.
• Build Multi-Dimensional Cube with KPI (Key Performance Indicator).
• Generated OLAP Cube for Analyst propose.
• Produced parameter driven, matrix, sub-reports and integrated report hyperlink functionality to access external applications.
• Generated matrix reports, tabular, drill-down, drill-through, sub reports, chart reports, multi parameterized reports.
• Developed parameterized dashboards and reports with SQL Server Reporting Services (SSRS).
• Administrated and scheduled mailing subscriptions on SSRS reporting server.
• Build Multi-Dimensional Cube with KPI (Key Performance Indicator).
• Generated OLAP Cube for Analyst propose.
• Understanding of systems development life cycle including issue, risk and scope management.
• Experienced in documenting business, process and data flows.
• Relational database experience.

Environment: SQL Server 2012/2014/2016 (SSMS), SQL Server Business Intelligent Development Studio 2008R2(BIDS), .NET Scripting, MS Excel 2016.

Confidential, Laurel, Maryland

SQL Server BI/SSIS/SSRS ETL Developer

• Analyze source system data to determine the data model and ETL solution that will meet business requirements.
• Develop conceptual, logical, and physical data models for some of the large and complex data warehouses and data marts.
• Formulated and documented the physical ETL process design based on business requirements and system specifications with strong ETL design skills, including source to target mappings, transformations, lookups, aggregations and expressions.
• Create packages in SSIS with error handling as well as created complex SSIS packages using various data transformations like conditional split, fuzzy look up, for each loop, multi cast, data conversion, fuzzy grouping, script components.
• Create complex scripts to massaging, scrubbing and cleansing of legacy data in staging area.
• Write Stored Procedures to populate various dimensional tables and the fact tables for the Data Warehouse.
• Create various Stored Procedures to validate the data from the source and update/insert the records into target tables.
• Create technical specifications, test plans and test data to support ETL processes.
• Implemented Event Handlers and Error Handling in SSIS packages and notified process results to various user communities.
• Extracted Data from various Heterogeneous Databases such as Access database, flat files to SQL server 2008 using SSIS.
• Designed and developed report with running value, interactive sorting as well as conditional formatting, created sub-reports to present more detailed information about the summary.
• Developed various DTS packages to export and import data between databases.
• Create/monitor scheduled data warehouse jobs using SQL Server Agent jobs.
• Troubleshooting ODBC and OLEDB connection issues in SSIS packages.
• Worked with internal or external business partners to recommend business intelligence solutions.
• Wrote queries to develop new, ad hoc and modified existing reports in SSRS and Excel using charts, graphs, tables and matrices.
• Worked closely with Compliance Managers to develop graphs, Matrix reports, drilldown, drill through, sub reports, dashboards and presentations for quality activities, patterns or trends and operational metrics.
• Experience in creating reports using stored procedures. Involved in scheduling, creating snapshot and subscription for the reports.
• Work with users and business analysts to design and develop tabular, matrix, gauges, chart, and drill down reports as well as interactive reports according to business requirements.
• Deployed reports to report manager and troubleshooting for any error occur in execution.

Environment: SQL Server 2012/2014(SSMS), Visual Studio

Confidential, Washington DC

SQL SERVER Developer

• Applied data program techniques and procedures Created database objects like Tables, Views, Indexes and Stored Procedures.
• Have developed and maintained T-SQL Stored Procedures, Data Models with Primary Keys and Unique Keys according to the business requirements.
• Implemented complex SQL queries using joins, CTE’s, and T-SQL Stored Procedures with Parameters.
• Developed complex Stored Procedures and views to generate various reports using slicers and line graphs.
• Optimized Stored Procedures and long running queries using indexing strategies and query-optimization techniques.
• Database Administrative skills including, backups, recovery, database maintenance.
• Created various Stored Procedures to validate the data from the source and update/insert the records into target tables.
• Used SQL to analyze, query, sort and manipulate data according to defined business rules and procedures.
• Extracting data using Import/Export wizard in SSMS.
• Troubleshoot and Schedule Jobs in SSMS.
• Generated database SQL scripts and deployed databases including installation and configuration.
• Wrote various T-SQL stored procedures and Triggers to carry out various tasks
• Created Database Maintenance Planner for the Performance of SQL Server, which covers Database Integrity Checks, Update Database Statistics and Re-indexing.
• Used SQL Profiler for troubleshooting, monitoring, optimization of SQL Server and non-production database code as well as T-SQL code from developers and QA

Environment: SQL Server 2012/2008R2, T-SQL, SQL Profiler, Query Analyzer, Microsoft Source Safe.