Hadoop / Java Developer Resume
State Of, MinnesotA
SUMMARY:
- Total 12+ Years of ITS Industry Experience as Hadoop and Java/J2EEDeveloper.
- 4+ years’ experience in developing various Map Reduce applications, spark, spark Streaming, UDFs for Hive/Pig to perform ETL workloads on terabytes of data.
- Expertise in Hadoop Eco - system(HDFS, Map Reduce,, Hive, Pig, Sqoop, HBase, Oozie, Flume) and various other ecosystem components(Spark, Kafka, Storm, Impala) and AWS Kinesis
- Installing, deploying, configuring & troubleshooting Hadoop/Big Data ecosystem components.
- Experience working with Cloudera Distributions of Hadoop
- Converted Map Reduce applications to Spark.
- Handled messaging services using Apache Kafka.
- Supported data analysis projects using Elastic Map Reduce on the Amazon Web Services (AWS) cloud. Exporting and importing data into S3.
- Experience in working on AWS, Flume to load the log data from multiple sources directly into HDFS & running Pig and Hive scripts.
- Involved in deployment of Hadoop cluster, addition/removal of nodes, troubleshooting when job is hung/failed, configured and tuned the cluster, find the bottlenecks, monitoring cluster, configured name-node high availability, configured schedulers, took data backups.
- Worked with BI team and transform big data requirements into Hadoop centric technologies.
- Worked in performance tuning of Hadoop cluster by gathering and analyzing the existing infrastructure.
- Written MR Unit and unit Test cases and submitted Unit test results as per the quality process.
- Involved in production monitoring using workflow monitor and experience in development and support environments
- 8+ years of Experience with Java/J2EE technologies using Core Java, JSP, Servlets, JDBC, XML, Web services, PL-SQL, Oracle, Shell Scripting and Confidential WAS .
- Experience in Agile Methodology, Water Fall Methodology and Test Driven Development framework.
- Experience in software configuration management using VSS, CVS and Subversion.
TECHNICAL SKILLS:
Hadoop Technology: HDFS, Map reduce, Pig, Hive, HBase, Sqoop, Oozie, Zookeeper, Hue, Spark, Cloudera Manager,AWS Kinesis
Java Technology: JSP, applets, AWT, Swing, Beans, EJB, J2EE, JMS, JDBC/ODBC, JNDI and RMI
Operating Systems: Windows 9X/XP/2003 ServerUNIX (SUN OS 5.9,HP-UX 10.20,AIX 5.7),Red hat Linux
Development Frameworks: Struts v1.2/1.3,Spring framework v3.0, Log4J, Ant, Maven, JUnit
Scripting Language: Shell script, SQL scripts, CGI Scripts, JavaScript
Middleware: Confidential WebSphere Application Server 8.x/7.x/6.x, Confidential HTTP Server 8.x/7.x/6.x, MQ 7.x, Apache HTTP, Tomcat Apache
WORK EXPERIENCE:
Confidential, State of Minnesota
Hadoop / Java Developer
Responsibilities:
- Involved in software detailed design, coding, testing application.
- Involved in importing data from Weblog and Apps log using Flume and Spark Streaming.
- Involved in importing data from Oracle to HDFS using SQOOP and spark streaming.
- Involved in writing Map Reduce program and spark program and Hive queries to load and process data in Hadoop File System.
- Involved in creating Hive tables, loading with data and writing hive queries which will run internally in map reduce way.
- Involved in Hadoop installation and Configuration on Dev/IT/TEST Env
- Providing End to End support for the testing activities during System Testing, UAT.
- Maintain source code using SVN.
Environment: Hadoop, Hive, Pig, Spark, Scala, Oozie, Hue, HBase, Flume, AWS, S3, EMR, Kafka, Hdfs, Sqoop, Cloudera distribution, Unix Shell scripting
Confidential, Hoffman Estates, IL
Senior Software Engineer
Responsibilities:
- Involved in software detailed design, coding, testing application.
- Performing Code reviews with the team, design reviews with the Architects.
- Developed application using Java/J2EE Technologies, Web services.
- Delivered new and complex high quality solutions to clients using Confidential Products/Tools, J2EE, EJB, Servlets, JSP, HTML, JavaScript and XML
- Involved in importing data from Weblog and Apps log using Flume.
- Involved in Map Reduce and Hive Optimization.
- Involved in importing data from Oracle to HDFS using SQOOP.
- Involved in writing Map Reduce program and Hive queries to load and process data in Hadoop File System.
- Involved in creating Hive tables, loading with data and writing hive queries which will run internally in map reduce way.
- Preparing builds, deploy and Co-ordinate with the release management team to ensure that the proper process is followed during the release.
- Involved in Hadoop installation and Configuration on Dev/IT/TEST Env
- Providing End to End support for the testing activities during System Testing, UAT.
- Maintain source code using SVN.
Tools: & Technology used: Core java,J2EE, Hibernate, Struts Framework, Servlets, XML, Web services, SVN, Windows XP/ UNIX, Linux, Eclipse, WAS 7.x,8.5, WPS 7.5, BPM 8.5, HTML, CSS, Spring JDBC, Hibernate, Oracle10g, PL/SQL, Cloudera Hadoop CDH4 (Classic Framework), Map Reduce, HDFS, HIVE, Sqoop, Flume, Oozie, HUE
Confidential
Senior Software Engineer
Responsibilities:
- Developed application using Java/J2EE Technologies, Web services.
- Provided End to End support for the testing activities during System Testing, UAT.
- Delivered new and complex high quality solutions to clients using Confidential Products/Tools, J2EE, EJB, Servlets, JSP, HTML, JavaScript and XML.
- Developed the web applications using Struts, Spring Framework.
- Applied Spring Framework for transaction Management and Spring JDBC, and for AOP and Dependency Injection.
- Developed Spring DAO to integrate with Hibernate ORM.
- Developed Hibernate mapping with Spring, Hibernate queries (HQL) and criteria queries.
- Developed the Web Services using Jersey framework based on REST Architecture, which are used by other Applications
- Wrote SQL queries and Stored procedures for the application.
- Wrote Test cases using JUnit.
- Implemented Log4j framework for logging mechanism.
Tools: & Technology used: J2EE, Struts Framework, Servlets, JSP, log4J, Ant, XML, SOAP, POJO, Web services, SVN, Windows XP/ UNIX, Eclipse, JBOSS, Junit, Python, Java Script, JQuery, HTML, CSS, Spring JDBC, Hibernate, SOAP,REST,WSDL, XSD, Oracle10g, PL/SQL
Confidential
Software Engineer
Responsibilities:
- Analysis the Requirements preparing estimate and preparing the documentation (Impact Analysis, detail design document, Implementation plan).
- Preparing the Test plan, Test cases (unit testing, System Testing) and also involving in unit testing of all development and modifications and support for UAT
- Involved in bug fixing by debugging the existing codes
- Worked on production tickets of the application
Tools: & Technology used: Informix 4GL Unix (HP-UX 10.20) Environment, UNIX shell scripts, Informix 7.24, Oracle, Connect Direct, GDB,Java, gcc, SCME, C++, ESQL
Confidential
Software Engineer
Responsibilities:
- Developed application using Java/J2EE Technologies, Web services.
- Provided End to End support for the testing activities during System Testing, UAT.
- Delivered new and complex high quality solutions to clients using Confidential Products/Tools, J2EE, EJB, Servlets, JSP, HTML, JavaScript and XML.
- Developed the web applications using Struts, Spring Framework.
- Applied Spring Framework for transaction Management and Spring JDBC, and for AOP and Dependency Injection.
- Developed Spring DAO to integrate with Hibernate ORM.
- Developed Hibernate mapping with spring, Hibernate queries (HQL) and criteria queries.
- Developed the Web Services using Jersey framework based on REST Architecture, which are used by other Applications
- Wrote SQL queries and Stored procedures for the application.
- Wrote Test cases using JUnit.
- Implemented Log4j framework for logging mechanism.
Tools: & Technology used: J2EE, Struts Framework, Servlets, JSP, log4J, Ant, XML, SOAP, POJO, Web services, SVN, Windows XP/ UNIX, Eclipse, JBOSS, Junit, Python, Java Script, JQuery, HTML, CSS, Spring JDBC, Hibernate, SOAP,REST,WSDL, XSD, Oracle10g, PL/SQL