We provide IT Staff Augmentation Services!

Big Data Hadoop Developer Resume

5.00/5 (Submit Your Rating)

Strongsville, OH

SUMMARY:

  • 8+ years IT professional experience in software Analysis, Design, Development, Enhancement, Testing, Integration and Support.
  • More than 4 years of experience in Big Data Hadoop - HDFS, IMPALA, HIVE, OOZIE & SQOOP
  • More than 3 years of experience in PYTHON, UNIX & SHELL SCRIPTING, SQL and RDBMS
  • Worked on migrating data from various database sources like ORACLE, TERADATA, MYSQL and DB2.
  • Worked on BZIP2, GZIP, SNAPPY compression techniques and AVRO, PARQUET file formats on Hadoop.
  • Worked on moving the data in and out of Hadoop from various RDBMS sources using SQOOP and other traditional data movement technologies.
  • Worked on various operating systems - Window, UNIX, IBM ZOS and scheduler tools like ENDEVOR CA-7, CONTROL M.
  • Proficient in Technical, Business Process Flow, people management and Business Analysis.
  • Extensive Knowledge in requirement gathering, analysis, design, development, implementation, testing, integration deployment, documentation and maintenance.
  • Experience in Credit Cards and Retail Core Bankingin banking domain.
  • Possess excellent analytical, debugging and problem solving skills.

TECHNICAL SKILLS:

  • HDFS
  • Hive
  • Pig
  • Sqoop
  • Impala
  • Hbase
  • Map-Reduce
  • Pyspark.
  • MySQL
  • Python
  • Shell Scripting
  • COBOL
  • JCL
  • VSAM
  • DB2
  • File-Aid
  • Endevor
  • CA7
  • NDM
  • FTP
  • HP Quality Center
  • HP ALM
  • GIT Bitbucket
  • Jenkins
  • IBM UrbanCode uDeploy
  • Toad Data Point
  • WinSCP
  • Putty
  • Anaconda Spyder
  • Word
  • Excel
  • PowerPoint
  • Outlook
  • Visio

PROFESSIONAL EXPERIENCE:

Confidential, Strongsville, OH

Big Data Hadoop Developer

Responsibilities:

  • Analyze business requirements and conduct feasibility study.
  • Understanding the source system & business logic.
  • Develop and maintain ETL (Data Extraction, Transformation and Loading) mapping to extract data from multiple sources that comprises of database like Oracle, Teradata, MySQL and flat files and CSV files.
  • Create customized Hive tables and implement partitioning and bucketing in Hive tables and loading and analyzing data using Hive queries.
  • Schedule Oozie jobs to run multiple Hive scripts.
  • Load data from IBM Mainframe DB2 database and Mainframe datasets including VSAM and Flat files.
  • Develop data pipeline and ingest data using SQOOP from Relational Database systems to Data Lake.
  • Involved in developing data ingestion framework using Python and Unix Shell Scripts to schedule and triggers Oozie workflows.
  • Develop and maintainSQL scripts and complex queries for data analysis and extraction.
  • Tuning of SQL queries for better performance along with maintaining and enhancing the developed components.
  • Executed Map-Reduce jobs on data stored on HDFS file system to generate reports.
  • Create SQOOP programs to import and export data from Oracle to Hive Tables. Perform SQOOP eval commands to analyze the source data.
  • Create Oziee workflows for HIVE scripts and configure and set up OZIEE workflows using CA-7 scheduling.
  • Deploy codes to Production using GIT Bitbucket, Jenkins and IBM UrbanCodeuDeploy

Confidential, Phoenix, AZ

Mainframe Developer

Environment: COBOL, JCL, DB2, PS Files, DB2, File Aid, Endevor, Xpediter, REXX, Mainframes z/OS

Responsibilities:

  • Involved with all the phases of Software Development Life Cycle (SDLC) methodologies throughout the project life cycle.
  • Guiding the processes and standards to be followed by the design, development and testing teams.
  • Created HLD(High Level Design) and TSD (Tec Spec Design) documents.
  • Developed COBOL-VSAM as well as COBOL-DB2 programs as per the technical design document.
  • Modified COBOL online programs and CICS screens to add new functionalities.
  • Developed JCLs as required for program execution.
  • Developed NDM jobs for file transmission to various 3rd party vendors.
  • Used SPUFI to query and analyze the DB2 tables.
  • Create test environment using Endevor, Changeman and CA-7 tools
  • Deploy and install components using ServiceNow.
  • Perform Unit (CIT) and System (SIT)testing. Log and track defects through HP ALM.
  • Interacting with project stakeholders during project walkthroughs.
  • Communicating with the Manager on issues pertaining to implementation and suggesting appropriate solutions to the client.
  • One-point contact for all cross functional teams in determining critical path items and ensuring these are always on track.
  • Overseeing real time changes in requirements and project execution strategies.

We'd love your feedback!