Hadoop Developer Resume
NY
SUMMARY
- Having 8+ Years of IT experience in the roles of Application Design and Building using Hadoop, Core Java, XML Parsing, XSLT, Message Queue, Shell scripting and COBOL languages.
- Strong experience and knowledge of processing BigData using Hadoop ecosystem components HDFS, Map Reduce, Hive, Pig, Sqoop, Oozie, Flume, NoSQL databases.
- Strong experience on Hadoop distributions like Cloudera.
- Having good experience in End - to-end in Big Data.
- Expertise in developing applications using Eclipse IDE.
- Knowledge on GreenPlum.
- Extensive experience in developing Stored Procedures, Functions, Triggers, Views, Cursors, Packages, Sequences, Synonyms, Exceptions, Joins, Sub Queries and Set Operators.
- Strong experience in conducting Code, UTP and UTR reviews
- Excellent Analytical and Coding skills
- Strong experience in Design and Execution based on the Requirements provided by System Analysts.
- Have experience in Java, Oracle-sql, pl/sql.
- Getting involved in all the steps of development life cycle of the project
- Providing support to System Analysts to prepare CSD
- QA and Post Implementation support
- Involving in weekly status meetings and sending weekly status of the project to the Project Manager Assisted the upper level for any kind of information in the business process and technical things.
- Good Experience on MB development Version 7.0.
- Good Knowledge on Compuware data ware housing tool.
- Very Good experience on Unix, Linux, QSHELL scripting.
- Expertise in Designing, coding, testing, and documenting the results as per the Quality standards.
- Quick learner with the ability to grasp new technologies.
- Maintain good co - ordination with the team members.
- Working extensively with the Onsite - Offshore model possessing good user communication skills and debugging skills.
- Ability to convert client requirements to technical specifications.
- Good documentation skills implemented Wiki library documentation in our project successfully.
- Assist in process planning and providing status reports to upper management daily.
- Assisted business in service improvements and system enhancements using the latest technologies.
- Ensure deliverables are made within the agreed time lines with high quality standards.
TECHNICAL SKILLS
O.S & RDBMS: OS/400, Windows, DB2, Oracle 9i, NoSQL.
LANGUAGES: PIG, MapReduce, Java SQL, PL/SQL, Shell Script & Cobol
TOOLS: & UTILITIES MQ, Aldon LMi, Altova XML Spy.
PROFESSIONAL EXPERIENCE
Confidential, NY
Hadoop Developer
ENVIRONMENT: & TOOLS: Cloudera Hadoop PIG, OOZIE, MR, HDFS.
Responsibilities:
- Moved all crawl data flat files generated from various retailers to HDFS for further processing.
- Written the Apache PIG scripts to process the HDFS data.
- Created Hive tables to store the processed results in a tabular format.
- Developed the sqoop scripts in order to make the interaction between Pig and MySQL Database.
- Completely involved in the requirement analysis phase.
- Worked on pulling the data from MySQL database into HDFS using Sqoop
- Provided ad-hoc queries and data metrics to the Business Users using Hive, Pig.
- Developed the UNIX shell scripts for creating the reports from Hive data.
Confidential, NY City, NY
Hadoop Developer
ENVIRONMENT: & TOOLS: Cloudera Hadoop PIG, OOZIE, MR, HDFS.
Responsibilities:
- Coding of the programs against the Program specifications.
- Working with Subject Matter Experts and understanding the system requirements, and creating project processes and documenting
- Implement a proof of concept for the system to be developed on BIGDATAHadoopframework HDFS, MAPREDUCE, HIVE and manage the development of the product using an existing framework built using J2EE, Oracle databases 10G/11i with RAC
- Strong expertise on MapReduce programming model with XML, JASON, CSV file formats
- Design and implementation of migrating customer.
- Expertise in SQOOP to bring the smaller set of dimension tables from Oracle EDW required for Analytics processing.
- Design and develop PIG code for ETL/ELT to process the Customer and Transaction data according to Business rules
- Strong expertise in internal and external tables of HIVE
- Worked with business teams and created Hive queries for ad hoc accessimplemented MR programs for getting the required results.
- Created Hive tables to store the processed results in a tabular format.
- Developed the sqoop scripts in order to make the interaction between Pig and MySQL Database.
- Completely involved in the requirement analysis phase.
Confidential, NY City, NY
Java Architect & Hadoop Developer
Responsibilities:
- Implemented new tool using applets.
- Designing the screens and options.
- Created the programs for fetching the data from tables from AS400 system and insert the data to AS400 tables in SMS system.
- Verification of the code against the Program specifications given to co-developers and preparing the review record for each program.
Confidential, NY City, NY
Java Architect & Developer
Responsibilities:
- Prepare the design and documented Technical specification document.
- Prepare the quality documents and deliver them.
- Interact with the SA’s while design phase and check the design meets all the business requirements by preparing CO-Matrix.
- Providing changes to the system as per the client specification.
- Involved in unit testing
- Resolving the Bugs raised by the testing team.
Confidential, NY City, NY
QShell script developer
Responsibilities:
- Provide the design and documenting the Technical specification document.
- Interact with system analysts in understanding the requirements.
- Worked with Admins and gather the requirements.
- Specified new environments for change management cycle.
- Created 1 script which can be useful for all the environments. Earlier we use 6 scripts for different environments.
- Helped the Admins to run one pilot project for implementing the tool.
- Prepare the quality documents and deliver them.
- Providing changes to the system as per the client specification
- Involved in unit testing
- Resolving the Bugs raised by the testing team.
- Gave the KT sessions to team members in using the new tool.
Confidential, NY City, NY
Java Architect & developer
Responsibilities:
- Fundserv sends xml file every month to the Franklin Templeton which consists the dealer ps of receiving the feed files.
- This file is processed using XSLT, JAVA and COBOL to update the dealer ps.
- Created a utility in Java to receive the files from Fundserv and process the data according to the business requirements.
- Prepare the Technical specification document.
- Prepare the quality documents and deliver them.
- Providing changes to the system as per the client specification
- Involved in unit testing
- Resolving the Bugs raised by the testing team.
Confidential, NY City, NY
Java Architect & Developer
Responsibilities:
- Provided the design for the application for picking up and creating the extracts.
- Implemented new java programs for generating extracts using Java, AS400 & MQ.
- Created the programs in AS400 for fetching the data from tables in DB2 system and create XMLs out of that data and transmitted that to Queues.
- Extract the data from queues and create the extract files out of it.
- Verification of the code against the Program specifications given to co-developers and preparing the review record for each program.
Confidential
Java, AS400, MQ Architect & Developer
Responsibilities:
- Analyze the Requirements and fixing the issues
- Delivery of the Work Packs with Test result documents
- Providing changes to the system as per the client specification
- Involved in unit testing
- Conducting Sessions to the New Comers
- Knowledge sharing with the Team in new technologies
- Resolving the Bugs raised by the client.
- Created screens using SDA.
- Work with sub files.
- Developed Test Cases for Unit Testing and Integration testing
- Analyzing the objective and preparing documentation for particular fields
- Generating reports preparing system maintenance documentation.
- Involved in report generation
