SUMMARY

• 13 years of total IT experience out of which 4 years into Big Data technologies using Hadoop and Spark frameworks.
• Strong working knowledge with a range of big data components such as HDFS, Hive, Sqoop, Impala, Pig and Oozie
• Solid understanding of Scala on Spark to process HDFS data.
• Experience in working with Hive query tuning to improve better throughput.
• Expertise working with Cloudera distribution and production implementation.
• Good knowledge on AWS platform with S3 and SQS.
• Domain knowledge of Banking - close to eight years: Fee systems, Currency Systems, Interest systems, Customer systems, Account systems and Mobile pay banking.
• Domain knowledge of Retail - more than two year: Employee benefits, Employee payroll and Employee details
• Extensive experience in handling complete SDLC - that covers analyzing, requirement capturing, software designing, developing, testing (end-to-end), and preparing Test scripts, in strict conformity with the Quality guidelines as prescribed by the Company quality policy.
• Actively involved end-to-end in establishing EDW concepts (including collect and analyze information, Identify business process, Construct data model, plan data transformations and execution) on Hadoop platform.
• Experience in interacting with onsite designers and business analyst for gathering and understanding client’s requirements, and transforming them into System and Technical Design.
• Knowledge of Enterprise Architecture, Solution conception and Database design and architecture. Also involved with Quality Management and Process Improvement.
• Provide technical and programming support and mentoring to team members. Imparted training to the new joiners in team and Organization related to Mainframes and Big data technologies.
• Good exposure in handling defects as part of Production Support Team.
• Expertise in Incident management and Problem management using Service center.
• Experience in Onsite-Offshore coordination, initiating new projects and managing teams.
• Certified ITIL ITIL® 2011 - Foundation Examination - APMG-International

TECHNICAL SKILLS

Big Data Ecosystem: HDFS, MapReduce, Hive, Impala, HBase, Pig, Sqoop, Flume, Kafka, Spark SQLAirflow, Oozie and Hue

AWS: AWS S3 and SQS

Operating Systems: Linux, Windows, MVS, z/OS

Programming Languages: Java, Scala, Python, Bash Shell, COBOL, PL1, CICS and JCL

Data bases: MySql, DB2, MSSQL and Oracle

Data formats: CSV, Parquet, Avro, JSON and XML

Frameworks: Apache Hadoop, Spark and Microsoft Visual Studio

Tools: GitHub, Jira, File-Aid, File-Manager, DB2 Utilities, RSM, RDz. OPC, CA-7 and MQ series

QC tools: HP Quality Center

IDE: Eclipse and IntelliJ

Incident Management: Service Manager

Methodologies: Agile model.

PROFESSIONAL EXPERIENCE

Confidential

Hadoop Developer

Responsibilities:

• Understand AS-IS system and its calculations and data formats from sources like RTF, RATEMATE, MYRATES and conceptualizing high-level architectural framework and Design.
• Involved in transformation of business requirements to technical design
• Pulling data from AWS SQS to Hadoop and apply calculations.
• Responsible for handling ad-hoc requests from vendors by using Pig scripts.
• Involved in UDF designs and testing.
• Involved in designing and implementation of initial load, incremental and bulk request jobs.
• Participate in designing import and export jobs.
• Experience in scheduling and monitoring jobs using Airflow (python based job scheduler) scheduler.
• Involved in Log analysis, fixing issues and error log maintenance.
• Exploring the feasibility of using Spark framework to improve the performance of the product using Spark SQL.
• Generating weekly and monthly reports to customers.

Environment: and Tools: Unix, Eclipse, HDFS, Hive, Impala, Pig, Sqoop, Python, Java, AWS S3, AWS SQS, MSSQL, Spark SQL and Scala

Confidential

Team Lead

Responsibilities:

• Involved in design and development of transformation framework components to support ETL process.
• Supported code/design analysis, strategy development and project planning
• Involved in designing data model and tables creation in Hive.
• Involved in writing Shell scripts to extract data from DB2 to HDFS/Hive using pull mechanism (Sqoop).
• Created monthly, quarterly and annually reports for BI team.
• Handled ad-hoc tasks from BI team by writing Pig scripts.
• Written Shell scripts that involve execution of queries using Impala-shell and Hive-shell.
• Handled ad-hoc web requests from business users.
• Responsible project/ tasks documentation as per the process.
• Involved in Task Planning using Agile-Sprint methodology.

Environment: and Tools: Unix, Eclipse, HDFS, Hive, Impala, Java, Pig, Sqoop, DB2 and MySql

Confidential

Team Lead

Responsibilities:

• Involved in gathering of project requirements and maintain a log to trace the new requirements.
• Involved with estimation and creating the high-level Work Breakdown Structure (WBS), helping in identifying the deliverable tasks and artifacts required for the project.
• Involved in preparation of low level and high level design documents and technical specifications.
• Coded (online/batch) programs and modules based on the change requests and new enhancements, using PL1 and COBOL.
• Worked as a task manager/team lead in the maintenance and enhancement team, involved in training new joiners technically as well as helping them understand the processes.
• Preparation of test data specific to a system and Integration testing for a particular change/task.
• Helped in managing the release scope along with the planning, tracking and changing control aspects of the project.
• Worked closely with the management to streamline the progress of the releases by involving in the RCA (Root Cause Analysis) and giving inputs for improvement to processes.
• Good experience in Batch scheduling, monitoring and performance tuning along with root cause analysis in strict time-frame.
• Understanding the Development Model 2.0 to prepare the documents.
• Involved in preparing the functional and process maps using RSM and WBM.
• Played a role of SME for some of the applications such as currency exchange rates, verification processes.
• Good experience at ITIL framework and Change management, while working for support projects.
• Review of codes for changes handled by other team members.
• Participate actively in reporting, presentation and quality-aspects of the project.
• Involved in producing monthly Project Performance Report.
• Managed a team of 10 resources.

Environment: and Tools: z/OS, COBOL, PL1, CICS, EGL, DB2, JCL, VSAM and Gemini

Confidential, Cincinnati

Sr Software Engineer

Responsibilities:

• Preparation of system appreciation document and understanding the process in KERMIT.
• Understanding the requirements from the client / onsite team and prepare business and technical document for further development.
• Played a key role in Transition phase including understanding the work and documenting the details of the same.
• Involved in coding the requirements using PL1 and COBOL for the given task
• Involved in writing test cases which can be used for unit/system testing.
• Delivering codes within scheduled time, confirming with the quality guidelines.
• Handling incidents (Production support and Bug Fixing)
• Timely delivery of service tickets and change requests.
• Providing knowledge transfer to new team members
• Maintain the Quality Documents as per Organization standards.
• Estimation of efforts, preparation of specifications and Documentation for service requests.
• Communication with the client and on-site SME’s (Subject Matter Experts) when a clarification is necessary.
• Manage regular team activities like status updates and organizing team meetings etc.
• Extensive interaction with quality team to bring the project to CMM 4.

Environment: and Tools: z/OS, COBOL, PL1, DB2, JCL and VSAM

Confidential, St. Louis

Team member

Responsibilities:

• Preparation of SAD (system Appreciation Document) and understanding the process in Confidential .
• Understanding the requirements from the client side and coordinating with the onsite team members.
• Played a key role in Transition phase including understanding the work and documenting the details of the same.
• Coding, Unit testing and preparing test plan documents
• Responsible for creating test environments to run the monthly and quarterly batch cycles.
• User Acceptance Testing and System Integration Testing
• Preparing KT documents and providing knowledge transfer to team members.
• Preparing weekly status reports.
• Extensive interaction with the quality team

Environment: and Tools: z/OS, COBOL, DB2, JCL and VSAM