SUMMARY

• Experienced Professional wif 10+ years in Information Technology wif current focus on Big Data Development.
• Databricks certified (#1308833) Spark Developer wif experience in working wif PySpark.
• Excellent experience in working wif Spark Data frames and Spark SQL.
• Good Experience in working wif Spark Streaming.
• Good Experience in working wif cloud computing platforms (Azure and AWS).
• Experience wif Databricks Platform.
• Experience wif Azure Synapse and Azure Data factory.
• Experience in working wif Hadoop, Hive, HDFS, Sqoop, Oozie, Kafka.
• Good noledge on Hadoop architecture and various components like HDFS, Name Node, Data node, MapReduce concepts.
• Good experience in importing and exporting data using SQOOP from RDBMS to HDFS and vice versa.
• Strong experiences in writing complex HQL/SQL to satisfy different business needs.
• Good experience in creating Hive tables and optimization of Hive queries.
• Good experience in Python, Java programming languages.
• Experience in shell scripting.
• Excellent problem - solving skills wif a strong technical background, good interpersonal skills and immense experience, Quick learner and excellent team player, ability to meet tight deadlines and work under pressure.

TECHNICAL SKILLS:

Database and Tools: Oracle, DB2, SQL Server, Hive, Mongo DB, Dynamo DB, RedShift, Postgres, Cosmos

File systems: HDFS, Amazon S3, DBFS, Azure Blob

Programming Languages: Python, Java, Scala, Unix, Mainframe (COBOL), VB Script

Big Data Ecosystems: Spark, Hadoop Hive, HUE, HDFS, Sqoop, Oozie, Kafka

Testing Frameworks: Junit, TestNG, Cucumber, and Jasmine

Web services: XML, SOAP UI, REST UI

Agile Project management Tools: JIRA, TFS 2010 (Team Foundation Server)

Source Control Tools: SVN, GIT

Methodologies: Agile, Waterfall model

Domain Experience: Banking, Retail, Auctions/Remarketing

PROFESSIONAL EXPERIENCE

Confidential Indianapolis, IN

Azure Data Engineer

Responsibilities:

• Importing from Azure Data lake/Blob storage and create External table over it for transform and analysis.
• Analyze data stored in Azure Data lake/Blob storage using SQL pool wifin Synapse.
• Analyze data stored in Azure Data lake/Blob storage and Cosmos DB using Spark pool wifin Synapse.
• Use Azure Data factory for different ETL related workflows wifin Synapse and independently.
• Load teh aggregated/transformed data into destination tables for teh business to view in dashboards.
• Integrate Power BI report by creating power BI dataset on top of teh aggregated or transformed data.

Confidential, Indianapolis, IN

Big Data Developer

Responsibilities:

• Importing data using SQOOP from Oracle RDBMS database to HDFS/HIVE tables.
• Involved in writing complex HQL’s/SQL’s to satisfy different business needs.
• Exporting data from HDFS to teh Target tables.
• Develop streaming application in Pyspark to process teh log/streaming data from Kafka and save teh processed data to HDFS.
• Develop programs in Python and spark using PySpark module by leveraging Spark SQL and Data frames to satisfy different business algorithms for faster results.
• Run teh Spark modules in distributed cloud environments using AWS EMR.
• Prepare Status report and send to managers on a Daily and Weekly Basis.

Environment: Hadoop, HDFS, Hive, Sqoop, Spark, Python, Kafka, Oracle DB, Mongo DB, AWS

Confidential, Bentonville, AR

Lead Consultant

Responsibilities:

• As a Consultant, me is managing/guiding a team and driving teh delivery of multiple modules wifin teh project.
• Importing data using SQOOP from SQL Server database to HDFS/HIVE tables.
• Involved in writing complex HQL’s to satisfy different business algorithms.
• Exporting data from HDFS to teh Target dashboards.
• Experienced in working wif HUE and creating Oozie workflows.
• Experienced in Python programming and implemented Spark modules.
• Converted teh map reduce programs to Spark modules and enhanced teh response time by 20 timesdelivering huge business value.
• Automated teh Big data validations through Python Scripts along wif teh Panda modules.
• Actively participated in defect triage meeting for defect remediation.
• Responsible for KT (Knowledge Transfer) to teh Team and New Joiners.
• Prepare Status report and send to managers on a Daily and Weekly Basis.
• As a lead, me is managing/guiding a team of developers and driving teh delivery of multiple modules wifin teh project.
• Coding Cobol-DB2 modules, Develop /enhance CICS related screens.
• Used various IBM utilities like DFSORT, IEBGENER, and IDCAMS to write various jobs depending on requirements.
• Maintenance of JCLs, PROCs, PARMs and Loads for application.
• Write complex queries using SPUFI to perform various operations on database.
• Create unit test plan and execute Unit Testing.
• Worked on teh development and enhancements of REST API’s for teh backend Java Services layer which connects to DB2.
• Provide root cause analysis of defect and resolution of it in System testing phase.
• Used XPEDITOR to debug both online and batch programs.
• Responsible for KT (Knowledge Transfer) to teh Team and New Joiners.
• Prepare Status report and send to manager as Daily and Weekly Basis.

Environment: Java/JSP, MSSQL, Mainframe, UNIX, DB2, JIRA, ALM Quality Center 11.0, SOAPUI, POSTMAN, Agile Methodology

Confidential

Sr. Developer

Responsibilities:

• Coordinated a team of three members.
• Involved in requirement analysis, effort estimations, planning and tracking of tasks.
• Preparation of technical specification document, develop test plan and test data, Involved in Coding, unit testing and review of programs.
• Create new COBOL DB2 programs, Create new online CICS programs and screens wif DB2 as database.
• Monitoring of overall quality and timeliness of deliverables. Ensuring that teh Overall process is documented.
• Conducted peer reviews.
• Actively participated in defect triage meeting for defect remediation.
• Prepare Status report and send to manager on a Daily and Weekly Basis.

Confidential

Sr. Developer

Responsibilities:

• Involved in requirement analysis, effort estimations, planning and tracking of tasks.
• Preparation of technical specification document, developed test plan and test data, Involved in Coding, unit testing and review of programs.
• Create new COBOL DB2 programs, Create new online CICS programs and screens wif DB2 as database.
• Resolving issues in SIT, UAT and production phases.
• Played an important role in teh implementation of conversion modules of SB and ML (Investment Related).