SUMMARY

• Having 12 + years of professional experience in software design, development, testing and documentation of Applications.
• More than 3 years of experience on Big Data Technologies. Good Understanding of the Hadoop Distributed File System and Hadoop Ecosystem.
• Strong understanding of Hadoop Daemons and MapReduce concepts. Good knowledge on Hadoop Cluster architecture and monitoring the cluster.
• Extensive working knowledge on AWS, working with EC2, RDS, Dynamo DB, Lambda, S3 and Cloud watch and AWS SDK.
• Created and maintained various DevOps related tools for the team such as provisioning scripts, deployment tools, and development and staging environments on AWS cloud.
• Hands on experience in developing Spark jobs using Spark Core, Spark SQL.
• Design and develop Spark transformations, applied spark actions on RDD’s and Dataframes.
• Experienced in working with Spark SQL to analyze structure data queries
• Experience on Azure Data Factory, Azure Data Lake, Azure SQL and Azure App service.
• Extensive experience on Azure HDInsight, Azure Cosmos DB, Azure Databricks, Azure Stream Analytics.
• Experience in developing applications using C#, VB.NET, ASP.NET, ADO.NET, LINQ, Entity Framework, WCF, HTML 5, VB 6.0 and CSS.
• Excellent work experience using Object Oriented Programming (OOP).
• Experience in building API integrations using Logic Apps, Functions, Service Bus and Micro Services
• Expert in analyzing, designing, developing, installing, configuring and deploying MS SQL Server suite of products with Business Intelligence in SQL Server Reporting Services 2005/2008, SQL Server Analysis Services of 2005/2008 and SQL Server Integration Services.
• Expertise in writing T - SQL Queries using Joins and Sub Queries in MSSQL Server.
• Experience in Extracting, Transforming and Loading (ETL) data from Excel, Flat File to MS SQL Server by using BCP Utility, DTS and SSIS services.
• Strong Knowledge of the MVC (Model-View-Controller) architecture.
• Ability to work in-groups as well as independently with minimum supervision and initiative to learn new technologies and tools quickly.

TECHNICAL SKILLS

Big Data Technologies: Hadoop (HDFS & MapReduce), Pig, Hive, HBase, Oozie, Sqoop, Spark

Cloud Technologies: Microsoft Azure (ADLS, Databricks), Amazon Web Services (S3, EMR)

Web Technologies: ASP.NET MVC, ASP.NET, HTML5, XML, XSLT, XPATH, JSON, MVC Web API

Application Framework: Microsoft .NET 1.0/2.0/3.5/4.0/4.5 , Silverlight.

Services: RESTful Services, ASP.NET Web API, WCF, WPF and Windows Services.

Programming Languages: C#, C, VB.Net, Python, LINQ

Scripting Languages: JavaScript, jQuery

Source Control & Version Management: MS - VSS, GitHub, MS - Team Foundation Server.

Test Driven Development: Visual Studio MS Test, NUnit with TestDriven.NET.

Reporting Technologies: Microsoft Crystal Reports.

Web Servers: IIS 5.0, IIS 5.1, IIS 6, IIS 7.5, IIS 8.5.

PROFESSIONAL EXPERIENCE

Confidential, Portland, OR

Cloud Engineer

Responsibilities:

• Created Azure Databricks (Spark) notebook to extract the data from Datalakes, storage accounts and Blob storage accounts to load on premises SQL server database.
• Developed various Azure Databrick notebooks to migrate the data from Data lake storage to Maple lake system.
• Created Python functions to transform the data from Azure storage to Azure SQL on Azure Databricks platform.
• Imported data from ADL into Spark RDD, Performed transformations and actions on RDD's.
• Created spark jobs to write data into Azure Blob storage from Azure SQL.
• Worked with Spark eco system using Spark SQL queries on different file formats like Text, CSV, JSON & Parquet.
• Developed application log functions using telemetry packages.
• Monitor and share the performance log report to management using Azure App Insights.
• Involved in Automation scheduling Azure Databricks jobs and build SSIS packages to push data from Azure SQL to on-premises server.
• Build CI/CD pipeline for scripts to deploy in Dev, QA & Prod environments.

Environment: Azure Data Lake, Spark, SparkSQL, Python, SSIS, SQL Server 2018, Hive, Visual studio 2019.

Confidential, Shelton, CT

AWS Developer

Responsibilities:

• Worked extensively with Sqoop for importing and exporting the data from HDFS to Relational Database systems like Oracle and vice-versa.
• Migrated MapReduce programs to Spark and Spark SQL to parse the raw data, populate staging tables and store the refined data in partitioned tables in the EDW.
• Created Hive queries that helped market analysts spot emerging trends by comparing fresh data with EDW reference tables and historical metrics.
• Developed business specific custom UDF's in Hive.
• Developed workflows in Oozie to automate the tasks of extraction of data from warehouses and weblogs into HDFS and pre-processing with Spark.
• Created Hive tables on top of HBase to load large sets of structured, semi-structured and unstructured data coming from NoSQL and a variety of portfolios.
• Worked with cloud services like Amazon S3 and Elastic MapReduce (EMR).
• Hands on experience in creating RDD’s using Apache Spark and applying operations like Transformations and Actions on them.
• Developed Spark jobs written in Python to perform operations like data aggregation, data processing and data analysis.
• Implemented a POC on building a data pipeline using Apache Kafka and Spark Streaming to run analytics on the web log files.

Environment: Hadoop, HDFS, MapReduce, Spark, SparkSQL, Python, AWS S3, Sqoop, Hive, Linux.

Confidential, Sandy Hook, CT

Sr .Net Developer

Responsibilities:

• Developed the new UI interface using MVC ASP.NET 4.0, HTML Razor andVB Script.
• Implemented fluid-responsive design using Bootstrap.
• Converted existing asp.net web form application to MVC application.
• Wrote custom executable applications to update database tables.
• Implemented Entity Framework 5.0 application blocks for event logging and exception handling
• Design roles and groups for users and resources using AWS Identity Access Management (IAM).
• Participating in functional, regression, End-to-End, System, and User Acceptance Testing (UAT) to ensure that requirements are met.
• Performed Extract Transform Load (ETL) development using SQL Server 2005 Integration Services (SSIS).
• Worked on creating various types of indexes on different collections to get good performance in Mongo database and dealing with JSON data from Mongo DB database .
• Utilized Telerik extensions for MVC extensively to implement Add/Edit/Delete functionality via Telerik grid s with efficient paging, sorting and filtering accomplished via Ajax data binding, JSON data and IQuery able.
• Provided high availability for IaaS and PaaS role instances for access from other services in the C #.Net with Azure Internal Load Balancer.
• Implemented and administered a source code control and versioning system using Team Foundation Services (TFS).
• Provided estimates, daily & weekly status report to the client on progress of the tasks.

Environment: C#, ASP.NET MVC 2, HTML Razor, VB Script, CSS, Handlebar.net, SQL Server, SSIS, WCF, LINQ to SQL, LINQ to Objects, Microsoft VS 2010, IIS 6.0/7.0, Windows 7.