We provide IT Staff Augmentation Services!

Sr Hadoop Developer Resume

0/5 (Submit Your Rating)

Bentonville, AR

SUMMARY

  • 12+ years of experience in IT industry comprises of development, maintenance and support, mitigation projects in Big Data, Java and Mainframe technologies.
  • Over 9+ years of client facing skills and working experience at client location, USA.
  • Excellent business knowledge and work experience in Retail, Health Insurance (BCBS), Logistics, and Manufacturing.
  • Cloudera certified Hadoop and Spark developer - CCA175
  • Over 3.5 years of extensive experience in BigData analytics including Hadoop MapReduce, HDFS, Hive, Python, Sqoop, Cassandra, HBase, Flume, Kafka, Strom, Spark, Avro, Github, Nexus, Jenkins, Pig etc.
  • Have experience in various Hadoop distributions like Cloudera, Horton work etc.
  • Experience in ingesting streaming data into Hadoop using Spark and Scala.
  • Good Experience in POC Projects, Played a key role in execution of POC projects.
  • Good experience in Hadoop cluster monitoring tools like Ambari.
  • Good experience in UNIX and shell scripts.
  • Good understanding of HDFS Designs, Daemons, federation and HDFS high availability (HA).
  • Good experience in Hive tables design, loading the data into hive tables.
  • Good experience in Data analysis, ETL Development, Data warehousing.
  • Good exposure in Data Modeling with expertise in creating Star & Snow-Flake Schemas, FACT and Dimensions Tables.
  • Good experience on Agile and Scrum methodologies.
  • Co-ordinate work requests among team members, sizing, work allocation, status reporting, defect tracking, change management, issues clarification.
  • System Study, Analysis, of Business requirement, preparation of Technical design, UTP and UTC, Coding, Unit testing, Integration testing, System testing and Implementation
  • Added Business value to the application like
  • Restructuring the application jobs improved the application availability extensively,
  • Reduce the job cost by running the jobs in off peak time, DASD utilization.
  • Reusing the existing services and functionalities, decommission of elements and preparing the internal tools for data validation.
  • Reduce the ticket volume by performing root cause analysis/preventive analysis.
  • Extensively supported the client Sr management by providing the complex reports which helps them in making the critical decisions.
  • Worked with DBA’s to understand the restrictions, standards and database architecture for all DB objects related activities.
  • Good working knowledge and extensive experience in performance tuning of DB2 components and batch programs,

TECHNICAL SKILLS

Big Data Ecosystem: HDFS, HBase, Spark Framework, Hadoop Map Reduce, Hive, Pig, Flume, Hue, Kafka, Sqoop, Horton works Distribution, zoo keeper, Oozie.

Languages: Core Java, Scala COBOL, JCL, SQL, PL/SQL.

Methodologies: Agile, V-model.

Database: Oracle 10g, DB2, IMS DB, My SQL, No SQL.

IDE / Testing Tools: Eclipse.

Operating System: Windows, UNIX, Linux.

Scripts: Bash Shell Scripting.

Others: Git, Nexus, Jenkins, VSAM, Endeavor, Change man, CONTROL-M, Expediter, MS-Office.

PROFESSIONAL EXPERIENCE

Sr Hadoop Developer

Confidential, Bentonville, AR

Responsibilities:

  • Written Spark Jobs to convert JSON files to PARQUET files.
  • Involved in developing Spark SQL scripts to query data in Hive Tables.
  • Assisted Data Science Team in sharing the knowledge in spark and solving technical issues in spark.
  • Involved in creating Oozie workflow and Coordinator jobs to kick off the jobs on time for data availability.
  • Developed multiple map reduce jobs in java for data cleaning and pre-processing.
  • Developed simple to complex map reduce jobs using hive.
  • Involved in creating hive tables loading and analyzing data using hive queries.
  • Optimizing the Hive Queries using the various files format like JSON, Avro, ORC, and Parquet.
  • Responsible for creating Hive tables, loading the structured data resulted from map reduce jobs into the tables and writing hive queries to further analyze the logs to identify issues and behavioral patterns.
  • Responsible for managing data from multiple sources
  • Used Hive connections to analyze data from Oracle.
  • Devolved in running Hadoop jobs for processing millions of records of text data.
  • Assisted in exporting analyzed data to relational databases using sqoop.
  • Involved in loading data from UNIX file system to HDFS.
  • Created HBase tables to store different data formats.
  • Experience in managing and reviewing Hadoop log files.
  • Export the analyzed data to the relational databases using sqoop for visualization and to generate reports for the BI team.
  • Analyzed large amounts of datasets to determine optimal way to aggregate and report on it.
  • Supported in setting up QA environment and updating configurations for implementing scripts with pig and sqoop.
  • Established connections to ingest data in and from HDFS
  • Fetched data from DB2 and written into HDFS
  • Involved cluster migration activities.

Environment: Hadoop, HDFS, Spark, MapReduce, Hive, Flume, HBase, Sqoop, Java (JDK 1.7),scala, Eclipse, MySQL, DB2, Mainframe Datasets, Teradata, Zookeeper, Oozie, Hortonworks Distribution.

Java Developer

Confidential, Bentonville, AR

Responsibilities:

  • Provide Estimates for the requirements.
  • Have been involved preparation of TDD.
  • Coding for the MIM restful service.
  • Implemented DAO’s, Exposing Restful web service, Swagger API implementation
  • Audit, Debug logging mechanism implementation for MDM Associate master application.
  • Performance enhancement to the application
  • Coordinate with the cross-commit teams
  • Design and Code Review of the code
  • Have strong experience in trouble shooting business end user issues.
  • Eextensively worked on SDLC life cycle for each release in MDM Associate master application.

Environment: Java, Swagger, Jax-WS,Db2, Eclipse, Soap UI, QMF

Mainframe Lead Developer

Confidential, Plano, TX

Responsibilities:

  • Coordinate with the client and offshore resources.
  • Requirement gathering and writing technical specifications.
  • Interacting with users to get the signoffs and change requests.
  • Impact analysis and estimation for the work request.
  • Providing the value added services to the application.
  • Review of Design/Approach documents and Quality Control Activities.
  • Coding, unit testing, systems testing and User acceptance testing
  • Developed COBOL DB2 programs
  • Developed Batch programs
  • Involved in handling the Development / Enhancement / Maintenance work requests

Environment: s: - MQ Series, CICS, COBOL, DB2, JCL, CA -7, Platinum, Change man.

Mainframe Lead Developer

Confidential, Bentonville, AR

Responsibilities:

  • Coordinate with the client and offshore resources.
  • Requirement gathering and writing technical specifications.
  • Interacting with users to get the signoffs and change requests.
  • Impact analysis and estimation for the work request.
  • Providing the value added services to the application.
  • Review of Design/Approach documents and Quality Control Activities.
  • Coding, unit testing, systems testing and User acceptance testing
  • Developed CICS MQ programs and written CICS Web service programs
  • Developed COBOL-CICS- DB2 programs
  • Developed Batch programs.
  • Involved in handling the Development / Enhancement / Maintenance work requests

Environment: - COBOL, DB2, MQ Series, HR-XML Schema, CICS Web service, JCL, CA -7, Platinum, Librarian, EXPEDITER.

Mainframe Lead Developer

Confidential, Chester brook, PA

Responsibilities:

  • Coordinate with the client and offshore resources.
  • Requirement gathering and writing technical specifications.
  • Interacting with users to get the signoffs and change requests.
  • Impact analysis and estimation for the work request.
  • Providing the value added services to the application.
  • Review of Design/Approach documents and Quality Control Activities.
  • Coding, unit testing, systems testing and User acceptance testing
  • Involved in handling the Development / Enhancement / Maintenance work requests

Environment: - COBOL, DB2, JCL, CA -7, Platinum, Change man, EXPEDITER.

Mainframe Developer

Confidential

Responsibilities:

  • Production support and test region support activities.
  • Preparation of Impact Analysis documents
  • Preparing RCA documents and defective prevention
  • Communicating with client for gathering the requirements
  • Analysis, detail design and code reviews
  • Coding, unit testing and integration testing

Environment: - COBOL, JCL, DB2, CA -7, Platinum, Librarian.

We'd love your feedback!