PROFESSIONAL SUMMARY:

• Software Engineer having 7+ years of pioneering experience and high performance in entire lifecycle of software development
• Experienced in Hadoop Ecosystems - HDFS, Hive and Sqoop
• Familiar with big data architecture including data ingestion pipeline design and Hadoop architecture
• Expert in data warehousing concepts and experienced in all the phases of the DWH lifecycle involving data analysis, design, development and testing using Big Data Technologies
• Designed and executed data ingestion using Sqoop
• Hands on experience in writing Hive-QL queries, Pig Latin Scripts
• Knowledge on various HDFS file storage format as Parquet & Avro
• Extracted data from various sources such as Relational Sources (Oracle, SQL Server, Teradata) and File formats.
• Hands-on in developing scripts using UNIX Shell Scripting
• Sound knowledge in Object Oriented Concepts, Collections Framework and Multithreading and worked extensively on the same.
• Performed data quality validation, cleansing and transforming the data
• Proficient in interaction with the business users and transforming the requirements to technical requirement
• Experienced in Agile scrum and waterfall development frameworks
• Owning responsibility of end-to- end project defect free delivery

TECHNICAL SKILLS:

Big Data Ecosystems: Hadoop, MapReduce, HDFS, Hive, Pig, Sqoop, Spark

Languages/Scripts: Shell Scripting, Scala

Database: Oracle, Teradata

Tools: Eclipse, Git, Jira, ServiceNow, Confluence, Control-M, Putty, Iterm2, WinScp, BO6.5

PROFESSIONAL EXPERIENCE:

Confidential

Application Developer

Responsibilities:

• Involved in detail discussions, analysis, feasibility research of the project, estimation and enhancements
• Responsible for importing data to HDFS using Sqoop and Stream sets from different sources.
• Processing the flat files received from different sources and stored them for analysis
• Creating tables using HiveQL and performing insert and update operations on the table.
• Developed an automated process using Shell script and Control-M for scheduling and data processing
• Performing unit test validation.
• Participating in daily standup meeting, review, retrospective meetings, sprint planning and sprint refinement meetings.

Confidential

Sr. Developer

Responsibilities:

• Involved in detail discussions, analysis, feasibility research of the project, estimation and enhancements
• Responsible for importing data to HDFS using Sqoop from different RDBMS servers and exporting data using Sqoop to the RDBMS servers for end user reporting
• Processing the flat files received from different sources and stored them for analysis
• Developed an automated process using Shell script and Control-M for scheduling and data processing
• Performing DQ checks on the data loaded to HDFS
• Highly involved in creating tables on Hive, views for the data
• Created Partitioning, Bucketing and Map side join
• Designing, executing unit test cases for validating requirements.
• Participating in daily scrum meetings, review, retrospective meetings, sprint planning and backlog groom sessions
• Status reporting to client and stakeholders

Confidential

Developer

Responsibilities:

• Actively participated in project for data analysis, data profiling, data discovery and low-level system designing.
• Technical analysis for each job data stream, including identify source systems, their connectivity, the related tables and fields and ensured that data was appropriate for mapping.
• Designing and development application solution for the technical requirements.
• Performed data ingestion using Sqoop
• Working with data extraction, transformation and load using Hive, and Pig
• Highly involved in creating tables on Hive, views for the data
• Created partitioning, bucketing and map side join
• Designing, executing unit test cases for validating requirements.
• Participating in daily scrum meetings, review, retrospective meetings, sprint planning and backlog groom sessions
• Peer to peer review and Unit testing
• Status reporting

Confidential

Developer

Responsibilities

• Understanding the Business requirements
• Creating solution design document
• Creating Universe, Dashboard as per needs
• Unit testing, E2E testing and UAT Support
• Preparation of support and release document
• Transition to support teams
• Interaction and status reporting to stake holders and data analysts

Confidential

Developer

Responsibilities:

• Understanding the requirements for reporting
• Creating Universe, Dashboard as required for each module of the application
• Functionality validation
• Preparation of support and release document and to end user
• Interaction and status reporting to stake holders