SUMMARY

• Around 11 years of application design development in Cloud/Bigdata/Java/J2EE
• 5+ years of Experience in Bigdata Ecosystems
• Around 4 Years of Experience in Azure - HDInsight, Blob, V2, ADLS GEN 1/ADLS GEN2,Key-Vault,TSI,Logic App, ARM Templates, Data Bricks
• Experience in Spark, Scala Kafka, Pig, Python, PySpark, Hive, MapReduce, Sqoop, Oozie
• Experience in NoSQL databases (HBase, Cassandra)
• Experience in the Cloud Era and AWS (EMR, S3, Athena) distribution
• Experience in End to End deliver of Products, migration and application porting in various environments.
• Extensive experience in analysis, design, development, testing, maintenance, performance tuning and deployment of internet, e-commerce and client-server applications.
• Delivered multiple end to end products from scratch to production andCollaborate with Product Owner and Stakeholders to identify Use cases, User Stories, guide scrum teams for agile development practices.
• Build POC’s, Team leads, mentor junior developers, QA teams and production support on and off-shore.
• Expertise in executing UML artifacts (Use Case, BRD etc.), JIRA and project management tools.
• Expertise in MVC frameworks ( Struts 1.2, Struts2, Spring MVC, Spring Webservices, Struts-Spring integration ) JSP and Core Spring module, JBDC templates, spring DAO support.
• Data modeling and ORM mapping technology (Hibernate, Ibatis), building cache and writing SQL in DB2, SQL/Stored.
• Procedures in Oracle 9i, 10,11g PL/SQL, Web logic 8, 9 Tomcat 5.xx, WAS 6.0/7.0
• Experience in UNIX, shell scripting,
• Expertise in the Webservices( SOAP, RESTful)
• Experience in SPLUNK, ITRS log monitoring tools
• Experience in the Banking Domain (Credit Cards/Mutual Funds, Core Banking)
• Good Knowledge on Apache-NiFi

TECHNICAL SKILLS

• JSP
• Servlets
• Struts
• AJAX
• Spring
• Hibernate
• Ibatis
• JUnit
• Sqoop
• Oozie
• SOAP
• REST
• Development
• Java
• JDBC
• J2ee
• Scala
• Python
• Spark
• PySpark
• Kafka
• MapReduce
• Hibernate
• JMS1.0.2
• JNDI
• Servers
• Tomcat
• IBM Web Sphere
• WebLogic
• Configuration Management Tools
• CVS
• SVN
• CM Synergy
• GIT
• Process
• Agile
• Waterfall
• Build Tools
• Ant
• Maven
• SBT
• Tools
• ServiceNow
• ITRS
• SPLUNK
• Log4J
• IDE
• Eclipse
• IntelliJ
• PyCharm
• OS
• Windows
• Linux
• Cloud
• Azure
• Blob/V2
• ADLS
• ADF
• Databricks
• HDInsight
• ARM templates
• AWS
• EC2
• EMR
• S3
• Athena
• RDS
• Databases
• Oracle
• SQL Server
• HBase
• Cassandra

PROFESSIONAL EXPERIENCE

Confidential, Windsor, CT

Cloud Bigdata Developer

Responsibilities:

• Coordinating with BI team to gather requirements for various regions tags.
• Implemented for North Sea, Angola, AGT, Gulf of Mexico, North Africa, Middle East regions
• Responsible for design and architecture optimize pipeline architecture using Azure Databricks
• Implemented different Azure Data Factories for ETL/ELT load
• Implemented different Notebooks using Spark, PySpark Scala, Python using Azure Databricks
• Used various Azure Cloud features (Azure- Databricks, Azure Data Lake Gen1/ Azure Data Lake Gen2, B, Blob, Azure Storage v2, ADF
• Implemented Joins, Views, Stored Procedures for building various complex queries and movement of the stage data to the model.
• Responsible for design and delivering IoT Data Model for PI Tag stream data
• Responsible for design and architecture delivering Time Series Instance for Hierarchy, Types, and instances.
• Used various Spark Transformations and Actions for cleansing the input data.
• Load and transform large sets of structured, semi structured, and unstructured data.
• Involved in the CI/CD -Azure ARM templates
• Involved in the development of webservices using Scala for connecting TSI endpoints

Environment: Azure, Databricks, Apache Spark, PySpark, Scala, Python, Microsoft SQL Server

Confidential, Dallas, TX

Bigdata Developer

Responsibilities:

• Coordinating with BI team to gather requirements for various data mining projects.
• Configured Spark streaming to get ongoing information from the Kafka and stored the stream information to HDFS and HBase.
• Used Spark-Streaming APIs to perform necessary transformations and actions on the data got from Kafka and Persists into Cassandra.
• Designed, developed data integration programs in a Hadoop environment with NoSQL data store HBase for data access and analysis.
• Used various Spark Transformations and Actions for cleansing the input data.
• Load and transform large sets of structured, semi structured and unstructured data.
• Used Spark Streaming APIs to perform transformations and actions on the fly for building common learner data model which gets the data from Kafka in near real time and persist it to HBase.
• Processed the real time steaming data using Kafka, Flume integrating with Spark streaming API.
• Consumed JSON messages using Kafka and processed the JSON file using Spark Streaming to capture UI updates.
• Experienced in writing live Real-time Processing and core jobs using Spark Streaming with Kafka as a data pipe-line system.
• Used Kafka Streams to Configure Spark streaming to get information and then store it in HDFS.
• Worked extensively with Sqoop for importing metadata from MySQL and assisted in exporting analysed data to relational databases using Sqoop.
• Involved in the Migration from On-premises to Azure Cloud
• Worked on Hive optimization techniques using joins, sub queries and used various functions to improve the performance of long running jobs.
• Optimized Hive QL by using execution engine like Spark.

Environment: Azure HDInsight,Apache Spark, Apache Kafka, Scala, PySpark, HBase, Hive, Sqoop, Flume, Hadoop, HDFS, Scala, Oozie, MySQL, Oracle 10g

Confidential

Senior Software Engineer

Responsibilities:

• Experienced in migrating HiveQL into Spark SQL into Spark engine to minimize query response time.
• Used Spark Streaming to divide streaming data into batches as an input to Spark engine for batch processing, development, and production.
• Handled importing of data from various data sources, performed transformations using Hive, Spark and loaded data into HDFS.
• Developed multiple spark Jobs in Scala for data cleaning and pre-processing.
• Used flume, Sqoop,Hadoop, spark and Oozie for building data pipeline.
• Cluster coordination services through Zookeeper.
• Automated all the jobs, for pulling data from FTP server to load data into Hive tables using Oozie workflows.
• Experience with AWS- IAM,S3,EMR,Anthena

Environment: Apache Spark, Scala, Cassandra, Hive, Sqoop, Flume, Hadoop, HDFS, Scala, Oozie, Oracle 10g, AWS-IAM,S3,EMR,Anthena.

Confidential

Senior Software Engineer

Responsibilities:

• Involved in analysing client’s online shopping site’s product reviews and Comments of Users.
• Making an API call and get the client’s data.
• Ingesting XML in Hive using XPath.
• Fattening JSON files using PIG and storing the data in HIVE tables.
• Involved in importing and exporting data from existing Teradata and DB2 systems to Hadoop file system using SQOOP.
• Involved in writing Hive queries to load and process data as per the business requirement in Hadoop File System.
• Scheduling the system to manage Apache Hadoop jobs in Oozie workflow.
• Modifying the Data Model as per current Sprint Requirements
• Finding solutions for upcoming Sprints by doing POCs.

Confidential

Sr. Java Developer

Responsibilities:

• RTB (Run the Business) activities i.e. design, develop, test and deploy the new enhancements of future releases of Master Pass & PM3 Projects.
• PM3 is a platform that accelerates Product time-to-market. PM3 provides an enterprise scale solution for Customer, Product, and Order life cycle management that can be easily extended for customer
• Specific requirements. Taking care of defining the new process and onboarding to the new applications through the PM3 tool.
• Coordinate with business clients, support the application and implement the process as per
• Specifications provided.
• Involved in the Build process and continuous integration by using Maven Builds.
• Involved in the single and multilevel Maven builds
• Involved in the Development of web services (JAX WS)
• Involved in the development of Module (Spring IOC, DAO, ORM.MVC, JDBC….)

Environment: Spring 4, Hibernate 3, Tomcat 7, JIRA and SCRUM, GIT, Bamboo, postgres 1.2, Oracle 11, SOAPUI, REST, Angular