Hadoop Developer Resume
Seattle, WA
SUMMARY
- Overall 8+ years of experience in development of Web & Enterprise applications using JAVA and J2EE Technologies.
- Expertise in Object Oriented Programming using Java and J2EE related technologies.
- Good Knowledge on Hadoop architecture and MapReduce.
- Good Knowledge on Hadoop ecosystems, MapReduce jobs in Pig for data cleansing and storing data using Hive.
- Diverse experience utilizing Java tools in business, Web, and client - server environments including Java Platform, Enterprise Edition (Java EE), Enterprise Java Bean (EJB), Java Server Pages (JSP), Java Servlets, Struts, and Java database Connectivity (JDBC) technologies.
- 4+ years of experience including hands on experience as a Big-Data developer.
- Knowledge on Spark framework.
- Knowledge and experience in Software Development Life Cycle (SDLC), and Agile Scrum.
- Willing to update my knowledge and learn new skills to perform efficiently.
- Experience in Configuring, managing & tuning of HDFS with MapReduce version 1.0 and Yarn version 2.0 Architecture.
- Hortonworks Certified Hadoop Developer and Sun Certified Programmer for java.
- Expertise in JAVA/J2EE, Oracle, My-SQL technologies. Good exposure to plan and execute all the phases of software development life cycle, which include Analysis, design, development, testing. Main responsibilities include, understanding of client requirements, develop solutions, designing and architecture of applications.
- Hands on experience in Core Java, Servlets, JSP, JDBC.
- Knowledge on Struts and SpringFramework.
- Knowledge on streaming services architecture using Kafka.
- Used Clear Quest to test and track the Issues and Bugs related to software or Application.
- Experience with Agile / Scrum and Waterfall Methodologies.
- Involved in resolving Production Support tickets.
- Assisted in responding to emergency support calls and submitting weekly Reports to Team.
- Responsible for compiling and submitting an error report for management each week.
- Excellent critical and creative problem solving ability and analytical thinking with quick learning, interpersonal and client interfacing skills.
- Research-oriented, motivated, proactive, self-starter with strong technical, analytical and interpersonal skills.
TECHNICAL SKILLS
Big Data Ecosystems: Hadoop, MapReduce, HDFS, HBase, Zookeeper, Hive, Pig, Sqoop, Oozie, Flume, Kafka and spark.
Programming / Scripting: Java, J2EE, Shell Scripting and Python
Messaging Services: MQ, MQ-Broker, JMS, Web Services and SOA
Platform/O.S: Ubuntu Linux and windows
Database: Oracle 10g, MySQL and MS-access
Tools: Eclipse, CVS, Clear Quest, ClearCase, Jira, MS Visual Studio, Apache Tomcat, ERDAS Imagine 8.6, Arc GIS 9.0
Testing Tools: NetBeans, Eclipse, RAD, JCreator
Methodologies: Agile, UML
PROFESSIONAL EXPERIENCE
Confidential, Seattle, WA
Hadoop Developer
Responsibilities:
- Installed and configured HIVE, PIG, SQOOP, FLUME and the HDFS implemented CDH4 Hadoop cluster on windows.
- Utilized Apache Hadoop environment by Horton works using AWS.
- Created Hive tables to load large sets of structured, semi-structured and unstructured data coming from Flume, Sqoop and a variety of ecosystem.
- Developed multiple MapReduce jobs in Pig for data cleaning and preprocessing.
- Developed various scripts for DI (Data Ingestion) and DL (Data Loading).
- Developed automated data ingest process to handle the Inserts, Updates and Deletes during the Incremental loads.
- Experience on deployment of Hadoop based technologies on cloud using AWS.
- Experience in writing Mapreduce jobs for a production grade application using Pig and Hive.
- Extensively worked on HDFS, HIVE & Java.
- Worked on Avro, parquet file format to ingest the data from source to target.
- Responsible for ingest framework using Sqoop and store in HDFS Designed.
- Developed MapReduce programs to parse the raw data, populate staging tables and store the refined data in partitioned tables using HCatalog.
- Enabled speedy reviews and first mover advantages by using Oozie to automate data loading into the Hadoop Distributed File System and PIG to pre-process the data.
- Managed and reviewed Hadoop log files.
Environment: Hadoop, Pig, Hive, Sqoop, Flume, Oozie, Java, HiveQL scripting, Ubuntu shell scripting,Horton works 2.3, AWS,JDK1.7.
Confidential, Chicago, IL
Hadoop Developer
Responsibilities:
- Worked on analyzing Hadoop cluster and different big data analytic tools including Pig, Hive database and Sqoop.
- Installed and configured HadoopTez, HDFS, Developed multiple MapReduce jobs in Pig for data cleaning and pre-processing.
- Utilized Apache Hadoop environment by Hortonworks.
- Applied MapReduce framework jobs in Sqoop for data injection into Hadoop, HDFS.
- Involved in creating Hive tables, loading with data and writing hive queries which will run internally in map reduce way.
- Worked on assisting integration of Hadoop process to IT infrastructure.
- Load and transform large sets of structured and unstructured data.
- Build/Tune/Maintain Hive QL and Pig Scripts for user reporting.
- Experience on deployment of Hadoop based technologies on cloud using AWS.
- Experience in writing Mapreduce jobs for a production grade application using Pig and Hive.
- Used Sqoop to import and export data from HDFS to RDBMS and vice-versa.
- Experienced in defining job flows.
- Experienced in managing and reviewing Hadoop log files.
- Worked on Avro, parquet file format to ingest the data from source to target.
- Participated in meetings with business people for requirements gatherings and addressing the issues and changes in existing system.
- Load data from UNIX file system to HDFS.
- Worked with Flume to load log data into HDFS.
- Created Hive queries for data analysis to meet the business requirements.
- Created Hive tables and working on them using Hive QL.
Environment: Hadoop, HDFS, Map Reduce,AWS, Pig, Hive, Sqoop, Flume, Oozie, Java, SQL scripting, Ubuntu shell scripting, Eclipse and Horton works 2.0, git,JDK1.7.
Confidential, Lansing, MI
Message Broker Developer
Responsibilities:
- Installed, configured WebSphere MQ andWebSphere Message Broker 9.0 on Windows.
- Created Configuration manager, Brokers, Queue Managers, define Objects, channels, shared channels, shared objects.
- Configured the Oracle as the database for Broker runtime environment.
- Designed and developed XML and MRM basedMessage flows and Message sets.
- Prepared mapping documents for each individual interface.
- Developed Message Flows, ESQL Statements and Message Sets.
- UsedXSLTfor the transformation of XML documents into other XML documents and formats.
- UsedXMLSpyto develop and debugXMLandXSLTbased applications.
- Coded theESQLforWMBmessage flow nodes.
- Troubleshooting and debugging messages flows using Trace nodes and error handling nodes.
- Developed message flows which done XML/XSLT transformations, from one format to another, SOAP/HTTP XML to MRM mappings and transformations.
- Configured theOracleas the database for Broker runtime environment.
- Adopted agile methods for development and delivery of the solution.
- Processed XML messages with exceptions and performed Message transformations, translation, validation for incoming messages, XML File lookups and database inserts.
- Designed and developed XML Message flows.
- Created bar file and deployed on execution group.
- Wrote numerous test cases for unit testing of the code using JUnit testing framework.
- Used Jira to test and track the Issues and Bugs related to software or Application,
- Used Concurrent Version system (CVS) for version control.
- Troubleshooting and debugging routing and data conversion issues.
- Involved in planning process of iterations under the Agile Scrum methodology.
- Handled web customization requests, maintenance/support for all the products.
- Fixing the bugs if raised in Integration, System Testing and User Acceptance Testing.
- Providing regular and accurate project reports to project manager as appropriate.
- Developed test cases for Common flows and tested those test cases in SIT.
Environment: MQSeries 7.5, WMB 9.0, ESQL, Oracle 11,SQL Developer, XML, IBM Integration Console, Eclipse Tool Kit, Jira, CVS, Altova XML Spy, SOAP UI 5.0 and Windows,JDK1.6.
Confidential, Lansing, MI
Java Developer
Responsibilities:
- Developed functional specifications document based on the user requirements and also developed high level and detailed design documents.
- Analyzed functional requirements, use cases and technical specifications
- Design and develop Servlets, Session and Entity Beans to implement business logic and deploy them on the Web Sphere Application Server
- Developing and coding J2EE Components with JSP, Java Beans, business objects with JDBCand Java.
- Extensively used RAD IDE for the development.
- Done the Data Fixes for code issues and prepared documentation.
- Production Support Primary Contact on rotation basis.
- Used Oracle to access database and implemented of connection pooling.
- Wrote Functional requirements using J2EE standards and developed the data base connection using JDBC.
- Proficient in testing Web Pages functionalities and raising defects.
- Participated in Code Reviews for better quality assurance and Debugged the application Module.
- Wrote numerous test cases for unit testing of the code using JUnit testing framework.
- Used Clear Quest to test and track the Issues and Bugs related to software or Application.
- Used ClearCase (CC) for version control.
- Deployed the application on WebSphere server.
- Involved in planning process of iterations under the agilemethodology.
- Handled web customization requests, maintenance/support for all the products.
- Fixing the bugs if raised in Integration, System Testing and User Acceptance Testing.
- Providing regular and accurate project reports to project manager as appropriate.
Environment: JDK 1.6, RAD 8, XML, WebSphere 8, PLSQL Developere9.2, Servlet, JSP, ClearCase, JDBC, Clear Quest 8, JUnit, Windows.
Confidential, OH
Java Developer
Responsibilities:
- Involved in all the phases of SDLC including Requirements Collection, Design & Analysis of the Client Specifications, Development of the Application and Interaction with users to analyze the requirements with Agile (Scrum) Methodology.
- Participated in meetings with business people for requirements gatherings and addressing the issues and changes in existing system.
- Developed the User Interface using JSP, HTML.
- Designed, developed and implemented Change Requests based on (MVC) - architecture using Struts framework.
- Implemented the architecture with Struts-Config, Action Form classes and Action classes.
- Used Hibernate framework to access MySQL database and implemented of connection pooling.
- Created several JSP’s and populated them with data from databases using Hibernate.
- Developed the presentation layer using JSP, HTML.
- Used Web Sphere Application Server
- Involved in testing, debugging, bugs fixing and documentation of the system.
- Used VSS for version control.
Environment: Java1.6,windows,Eclipse 3, HTML, Struts 2.0,VSS, JSP, Hibernate 4, MySQL 5.7 Workbench, XML, Web Sphere 8.
Confidential
Internship as Jr. Java Developer
Responsibilities:
- Involved in designing and development of the project using java and J2EE technologies by following MVC architecture of which JSP's are views and Servlets as controllers.
- Using StarUML designed network and use case diagrams to monitor the work flow.
- Used JDBC to store and retrieve the data from oracle database.
- Involved in writing test cases for the application using Junit.
- Handled web customization requests, maintenance/support for all the products.
- Fixing the bugs if raised in Integration, System Testing and User Acceptance Testing.
- Providing regular and accurate project reports to project manager as appropriate.
Environment: Java 1.5, JSP, Servlets, Oracle 9, UML, Git, Apache Tomcat 5, ERDAS Imagine 8.6, Arc GIS 9.0, JCreator.
