We provide IT Staff Augmentation Services!

Hadoop/big Data Developer Resume

5.00/5 (Submit Your Rating)

Columbus, OH

SUMMARY:

  • 10+ years of extensive IT experience in Banking/Insurance domain and 3 years of experience in Hadoop Technologies.
  • MapR Certified Hadoop Developer.
  • Expertise in Hadoop echo systems HDFS, Sqoop and Hive for scalability, distributed computing and high - performance computing.
  • Good exposure working on Spark with Python.
  • Having good knowledge on Single Node and Multi-Node cluster configurations.
  • Involved in Scrum methodology, Software Development Life Cycle (SDLC) starting from requirements gathering.
  • Strong Analytical, Problem Solving, Debugging and Interpersonal skills with excellent understanding of system development metrics, techniques and tools.
  • In-depth Understanding of the Banking Domain particularly in Customer Data management, Deposits applications in Retail Banking Sector.
  • Have good experience in converting Legacy system to Hadoop platform
  • Efficient team Lead with strong technical, logical, analytical and problem-solving abilities.
  • Good experience with Client Interaction, Onshore - Offshore working model.
  • Experience in exporting/importing the data using Sqoop and Active Archive from HDFS to Relational Database systems / Mainframe and vice-versa.
  • Worked on writing Unix shell scripts for execution of parallel jobs. Also generated Hive HQL scrips to execute from the shell.
  • Experience in SQL and good knowledge in SQL programming and developed Stored Procedures and Triggers. Worked on creating PL/SQL both external and internal procedures and cursors in Oracle (10g/11i).
  • Provided various Re-engineering ideas for optimization of existing Assessment.
  • Experienced in all facets of Software Development Life Cycle (Analysis, Design, Development, Testing and Maintenance) using Waterfall and Agile methodologies.

TECHNICAL SKILLS:

Hadoop Ecosystem: Hadoop, HDFS, HIVE, Hbase, Sqoop, Ambari, Hadoop Active Archive, Hue, CA7 Scheduler, Atomic Scheduler, Ambari, DBeaver, Squirrel.

Programming Languages: Python, Core Java, SQL, PL/SQL, Cobol, JCL, Easytrieve, CICS an d Unix Shell Scripting.

Databases: Oracle 10g/11i, DB2, IMS DB.

Tools: SQL Loader, Tivoli, Toad, PVCS, DMT, Expeditor, SPUFI, FileAid, QMF, CA7, Atomic, Panvalet, Changeman, Control-M.

Hardware: Hortonworks Hadoop Cluster, IBM Big Insights, IBM System Z and HP Server

Methodologies: Agile and Waterfall

PROFESSIONAL EXPERIENCE:

Hadoop/Big Data Developer

Confidential, Columbus, OH

Responsibilities:

  • Working as Sr. Developer/Analyst/Module lead, closely working with the clients to analyze business requirements and system specifications to apply to the project SPARK development.
  • Data Analysis of the Claims Legacy Systems and understanding the Nationwide’s business required for Data Mapping.
  • Developing use cases Spark in SQL context.
  • Worked on setting up spark jobs/python programming.
  • Responsible for performing extensive data validation using Hive.
  • Worked on Sequence files, RC files, Map side joins, bucketing, partitioning for Hive performance enhancement and storage improvement.
  • Importing and exporting data into HDFS and Hive using Sqoop and Active Archive.
  • Using Active Archive tool scheduling the jobs for Data Ingestion.
  • Worked in tuning Hive and Unix scripts to improve performance.
  • Knowledge on handling Hive queries using Spark SQL that integrate Spark environment.
  • Involved in loading the created HFiles into HBase for faster access of large customer base without taking Performance hit.
  • Conduct Unit and Integration Testing. Performing code-walkthroughs and reviews.

Environment: Hortonworks/Biginsights Hadoop Platform, CA7 Scheduler, Spark, HDFS, Python, Hive, Sqoop, Active Archive, HBase, Linux, Oracle 11g/10g, XML, DBeaver, UNIX Shell Scripting, Ambari, Squirrel, Beeline.

Hadoop Administrator/Developer

Confidential, Columbus, OH

Responsibilities:

  • Data Analysis of the Donor Bank and understanding the Huntington’s business required for Data Mapping. Developing the transformations programs based on Data Mapping
  • Worked as Developer/Analyst, closely working with the clients to analyze business requirements and system specifications to apply to the project as part table loads in to Hive.
  • Prepared the shell script jobs and tested these jobs for migrating Db2 tables between source and target (HIVE).
  • Developed the Sqoop scripts in order to make the interaction between Hive and source DB2 Database.
  • Coordinate and participate in data mapping sessions for deposit system & create and maintain data mapping documents for legacy system.
  • Conducting Subject matter expert reviews and finalize the design approaches.
  • Manage & coordinate with both offshore team for the development and testing activities. Make sure deliverables are fine.
  • Performing code-walkthroughs and reviews. Finding the Business/Process improvements.

Environment: Hortonworks Hadoop Platform, Atomic Scheduler, HDFS, Hive, Sqoop, Linux, Ambari, Tableau.

Technical Lead

Confidential, Plantation, FL

Responsibilities:

  • Involved in POC for migration of tape data from Mainframe to Hadoop.
  • Written use case requirements based on business requirements.
  • Designed HIVE tables and developed both one time and Delta load of Mainframe database to HIVE tables.
  • Implemented MapReduce classes for processing Bureau file and storing in HBase tables.
  • Implemented process for one-time data storing in HBase tables.
  • Implemented SQL Scripts to modify the data to resolve assigned defects.
  • Performance tuning of the database and SQL queries.
  • Tuned SQL queries and indexed database tables wherever necessary and also partitioned databases
  • Developing the transformations programs based on Data Mapping.
  • Involved in migrating the data from development cluster to QA cluster and from there to production cluster.
  • Created the developer Unit test plans and executed unit testing in the development cluster.

Environment: MapR Hadoop Framework, HDFS, Map Reduce, Hive, Sqoop, HBase, SQL Server 2012, UNIX Shell Scripting, Hue, Corner Stone, Drools, IBM Mainframe, IMS DB, COBOL, JCL, DB2, Syncsort, Changeman, Expeditor, SPUFI, FileAid, QMF, Control-M, Easytrieve, CICS.

Technical Lead

Confidential, Parsippany, NJ

Responsibilities:

  • Analysis and design of the Enhancements.
  • Involved in requirement gathering along with the business analysts group.
  • Gathered all the Sales Analysis report prototypes from the business analysts belonging to different Business units
  • Prepare Analysis and High Level Design for the Change Requests and Enhancements. Design and Code Documentation.
  • Documenting the Enhancements and new Business Functionalities.
  • Adhoc analysis based on business requirements and handling client queries.
  • Conduct Unit and Integration Testing.
  • Daily interactions with Client for Reporting/resolutions of Tickets.
  • Support for QA team and UAT.
  • Coordinate and Communicate between customers and offshore team.
  • Performing code-walkthroughs and reviews. Finding the business/process improvements. Preparing Review Checklist.
  • Preparing the code fixes to reduce the Production Job abends
  • Implemented SQL Scripts to modify the data to resolve assigned defects.
  • Performance tuning of the database and SQL queries.
  • Process improvement of batch jobs in Production.
  • Tuned DB2 queries and indexed database tables wherever necessary and also partitioned databases
  • Developing the transformations programs based on Data Mapping.
  • Created the developer Unit test plans and executed unit testing in the development cluster.

Environment: IBM Mainframe, IMS DB, Cobol, JCL, DB2, Changeman, Expeditor, SPUFI, FileAid, QMF, Control-M, Syncsort, Easytrieve, CICS, VSA, TSO/ISPFM, CA7, PANVALET.

Developer

Confidential

Responsibilities:

  • Analysis and design of the Enhancements.
  • Involved in requirement gathering along with the business analysts group.
  • Gathered all the Sales Analysis report prototypes from the business analysts belonging to different Business units
  • Prepare Analysis and High Level Design for the Change Requests and Enhancements. Design and Code Documentation.
  • Understanding the business problems and documenting them.
  • Converting Business problems into Functional requirements.
  • Converting the Functional requirements into Technical requirements.
  • Analysis and design of the new requirements.
  • Design and Code Documentation.
  • Development of programs to meet the Business requirements.
  • Conduct Unit and Integration Testing.
  • Performing code-walkthroughs and reviews.
  • Finding the Business/Process improvements.
  • Support for QA team and UAT.
  • Production Support with handling P1 issues.
  • Coordinate and Communicate between customers and team.

Environment : MF Cobol, Pro-Cobol Oracle 10g/11i, Unix Shell Scripting, PVCS, ISQL Plus, TOAD, HP - UX11i, Windows - 2000/XP.

We'd love your feedback!