Big Data Hadoop Developer Resume
5.00/5 (Submit Your Rating)
Strongsville, OH
SUMMARY:
- 8+ years IT professional experience in software Analysis, Design, Development, Enhancement, Testing, Integration and Support.
- More than 4 years of experience in Big Data Hadoop - HDFS, IMPALA, HIVE, OOZIE & SQOOP
- More than 3 years of experience in PYTHON, UNIX & SHELL SCRIPTING, SQL and RDBMS
- Worked on migrating data from various database sources like ORACLE, TERADATA, MYSQL and DB2.
- Worked on BZIP2, GZIP, SNAPPY compression techniques and AVRO, PARQUET file formats on Hadoop.
- Worked on moving the data in and out of Hadoop from various RDBMS sources using SQOOP and other traditional data movement technologies.
- Worked on various operating systems - Window, UNIX, IBM ZOS and scheduler tools like ENDEVOR CA-7, CONTROL M.
- Proficient in Technical, Business Process Flow, people management and Business Analysis.
- Extensive Knowledge in requirement gathering, analysis, design, development, implementation, testing, integration deployment, documentation and maintenance.
- Experience in Credit Cards and Retail Core Bankingin banking domain.
- Possess excellent analytical, debugging and problem solving skills.
TECHNICAL SKILLS:
- HDFS
- Hive
- Pig
- Sqoop
- Impala
- Hbase
- Map-Reduce
- Pyspark.
- MySQL
- Python
- Shell Scripting
- COBOL
- JCL
- VSAM
- DB2
- File-Aid
- Endevor
- CA7
- NDM
- FTP
- HP Quality Center
- HP ALM
- GIT Bitbucket
- Jenkins
- IBM UrbanCode uDeploy
- Toad Data Point
- WinSCP
- Putty
- Anaconda Spyder
- Word
- Excel
- PowerPoint
- Outlook
- Visio
PROFESSIONAL EXPERIENCE:
Confidential, Strongsville, OH
Big Data Hadoop Developer
Responsibilities:
- Analyze business requirements and conduct feasibility study.
- Understanding the source system & business logic.
- Develop and maintain ETL (Data Extraction, Transformation and Loading) mapping to extract data from multiple sources that comprises of database like Oracle, Teradata, MySQL and flat files and CSV files.
- Create customized Hive tables and implement partitioning and bucketing in Hive tables and loading and analyzing data using Hive queries.
- Schedule Oozie jobs to run multiple Hive scripts.
- Load data from IBM Mainframe DB2 database and Mainframe datasets including VSAM and Flat files.
- Develop data pipeline and ingest data using SQOOP from Relational Database systems to Data Lake.
- Involved in developing data ingestion framework using Python and Unix Shell Scripts to schedule and triggers Oozie workflows.
- Develop and maintainSQL scripts and complex queries for data analysis and extraction.
- Tuning of SQL queries for better performance along with maintaining and enhancing the developed components.
- Executed Map-Reduce jobs on data stored on HDFS file system to generate reports.
- Create SQOOP programs to import and export data from Oracle to Hive Tables. Perform SQOOP eval commands to analyze the source data.
- Create Oziee workflows for HIVE scripts and configure and set up OZIEE workflows using CA-7 scheduling.
- Deploy codes to Production using GIT Bitbucket, Jenkins and IBM UrbanCodeuDeploy
Confidential, Phoenix, AZ
Mainframe Developer
Environment: COBOL, JCL, DB2, PS Files, DB2, File Aid, Endevor, Xpediter, REXX, Mainframes z/OS
Responsibilities:
- Involved with all the phases of Software Development Life Cycle (SDLC) methodologies throughout the project life cycle.
- Guiding the processes and standards to be followed by the design, development and testing teams.
- Created HLD(High Level Design) and TSD (Tec Spec Design) documents.
- Developed COBOL-VSAM as well as COBOL-DB2 programs as per the technical design document.
- Modified COBOL online programs and CICS screens to add new functionalities.
- Developed JCLs as required for program execution.
- Developed NDM jobs for file transmission to various 3rd party vendors.
- Used SPUFI to query and analyze the DB2 tables.
- Create test environment using Endevor, Changeman and CA-7 tools
- Deploy and install components using ServiceNow.
- Perform Unit (CIT) and System (SIT)testing. Log and track defects through HP ALM.
- Interacting with project stakeholders during project walkthroughs.
- Communicating with the Manager on issues pertaining to implementation and suggesting appropriate solutions to the client.
- One-point contact for all cross functional teams in determining critical path items and ensuring these are always on track.
- Overseeing real time changes in requirements and project execution strategies.
