Sr.hadoop Developer Resume
Warren, NJ
SUMMARY:
- 7+ years of IT experience with complete project lifecycle development (SDLC) in Big Data Hadoop, Java J2EE technologies (Requirements analysis, Design, Implementation, Testing and Deployment of software applications).
- Implementation and extensive working experience of several Big Data technology stack in recent project of Financial Domain.
- Extensive Knowledge and experience in Big Data Hadoop technologies including MapReduce, Yarn, Hive, Pig, Flume, Sqoop, Oozie, HBase, MRUnit.
- Extensive Knowledge in MapReduce, YARN, Tez and Cascading frameworks.
- Well experienced in developing web applications with MVC architecture using Struts framework, JSF, Spring Framework, Hibernate.
- Expertise in working with Application Servers including Jboss4.0, WebLogic10.0, Web Sphere Application Server.
- Design large and complex modules and components of larger system designs. Completely design low to medium complexity systems.
- Proficiency in backend development using SQL, PL/SQL, Views, Triggers and Stored procedures in Oracle10g/9i, Sybase, DB2.
- Proficient in with GUI plug - ins like Tiles Framework, Customer Tag Libraries, validation plug-ins like Validator Framework.
- Troubleshooting experience in bug fixing, code review, Integration and unit testing, using various testing methodologies and tools like Junit and logging using Log4j.
- Expertise in Client Side Designing and Validations using HTML, Java Script, JQuery, JSP, Struts Tag Library, JSTL.
- Strong experience with XML technologies like XSLT, SAX parser, DOM parser.
- Strong understanding of Object Oriented Analysis and Design (OOAD) concepts, Service Oriented Architecture (SOA), various Design Patterns (J2EE) and project documentation.
- Experience in planning, designing and implementations of Enterprise level CM Infrastructure, Build and Integration Automation environment in UNIX/Windows using Clear Case, CVS.
- Familiar with all aspects of technology projects including Business Requirements, Technical Architecture, Design Specification, Development and Deployment.
- Extensive experience in developing applications using Java and related technologies using methodologies like AGILE SCRUM, TEST DRIVEN.
- Designed Use case Diagrams, Class Diagrams, Sequence Diagrams, Flow Charts and Deployment diagrams using Rational Rose, Microsoft Visio.
- Well acquainted to working on different operating systems like Windows 2000/NT, Windows XP, UNIX.
- Through knowledge in writing complex SQL &PL\SQL stored procedures in Sybase, Oracle and DB2 databases.
- Good experience in Developing and Deploying Enterprise Java Beans on Application Servers like Web Logic, Web Sphere and JBoss.
- Writing scripts for automating the builds and deployments using ANT Scripts.
- Proactively participated with QA team to discuss about the test plan and test approach.
- Able to communicate comfortably and effectively with people at any level. Result oriented, well organized, can be counted on to get the job done successfully on time.
TECHNICAL SKILLS:
Big Data Stack: Hadoop, Hive, Pig, HBase, Oozie, Sqoop, Flume, Yarn, Zookeeper, Cascading
Big Data Distributions: CDH 4, Hortonworks
Languages: Core Java, J2EE, SQL*Plus, PL/SQL, C, UNIX Shell Scripting
Databases: Oracle10g/9i, Sybase, DB2, DB visualizer, RapidSQL, TOAD, SQL Developer Tool, HBase
Web Technologies: Servlets, JSP, HTML, XML, XSLT, EJB, Struts1.2, JSF1.2JSR168Portals.
Frameworks Middleware: Struts1.2, Struts2, Spring MVC, Spring Integration, Spring BatchHibernate,JUnit4.0, Log4j, Tiles Framework.
Development Tools: RationalApplicationDeveloper6.0, 6.0.1, Eclipse, JDeveloper, SOAPUI.
App/Web Servers: Jboss4.0, IBMWebSphereApplicationServer6.0, WebLogic Application Server10.0, Apache Tomcat 6.0.
Web sphere Tools: Web Sphere PortalServer5.1, Web Sphere Portal Server6.0, Web Sphere Application Server6.0,Web Sphere Message Broker.
Version Control Tools: CVS, Clear Case, VSS, SVN, PVCS, Mercurial.
Scripting Languages: JavaScript, JQuery, UNIX Shell Scripts.
OOA, OOD: UML, Use-case diagrams, Class/process-flow diagrams, Design patterns, Rational Software Architect.
Operating Systems: Sun Solaris, HP-UX, AIX, Windows 95/ NT, Windows 2000, Windows XP, Ubuntu.
PROFESSIONAL EXPERIENCE:
Confidential, Warren, NJ
Sr.Hadoop Developer
Responsibilities:
- Developed data pipeline using Flume, Sqoop, Pig and Java map reduce to ingest customer behavioral data and financial histories into HDFS for analysis.
- Involved in POC for developing Data applications using Cascading Framework.
- Involved in writing Map Reduce jobs.
- Involved in SQOOP, HDFS Put or CopyFromLocal to ingest data.
- Used Pig to do transformations, event joins, filter bot traffic and some pre-aggregations before storing the data onto HDFS.
- Involved in developing Pig UDFs for the needed functionality that is not out of the box available from Apache Pig.
- Used Hive to analyze the partitioned and bucketed data and compute various metrics for reporting.
- Involved in developing Hive DDLs to create, alter and drop Hive TABLES.
- Involved in developing Hive UDFs for the needed functionality that is not out of the box available from Apache Hive.
- Involved in using HCATALOG to access Hive table metadata from Map Reduce or Pig code.
- Computed various metrics using Java Map Reduce to calculate metrics that define user experience, revenue etc.
- Used Eclipse and ant to build the application.
- Involved in using SQOOP for importing and exporting data into HDFS and Hive using Sqoop.
- Involved in processing ingested raw data using Map Reduce, Apache Pig and Hive.
- Involved in developing Pig Scripts for change data capture and delta record processing between newly arrived data and already existing data in HDFS.
- Involved in pivot the HDFS data from Rows to Columns and Columns to Rows.
- Involved in emitting processed data from Hadoop to relational databases or external file systems using SQOOP.
- Involved in developing Shell scripts to orchestrate execution of all other scripts (Pig, Hive, and MapReduce) and move the data files within and outside of HDFS.
Environment: Hadoop, MapReduce, Yarn, Hive, Pig, HBase, Oozie, Sqoop, Flume, Cascading, Oracle 11g, Core Java.
Confidential, Indianapolis, IN
Hadoop Developer
Responsibilities:
- Extensively used scrum methodology.
- Involved in writing MapReduce Jobs.
- Involved in using SQOOP for importing and exporting data into HDFS and Hive using Sqoop.
- Involved in SQOOP, HDFS Put or CopyFromLocal to ingest data.
- Used Pig to do transformations, event joins, filter bot traffic and some pre-aggregations before storing the data onto HDFS.
- Involved in developing Pig UDFs for the needed functionality that is not out of the box available from Apache Pig.
- Used Hive to analyze the partitioned and bucketed data and compute various metrics for reporting.
- Involved in developing Hive DDLs to create, alter and drop Hive TABLES.
- Involved in developing Hive UDFs for the needed functionality that is not out of the box available from Apache Hive.
Environment: Hadoop, MapReduce, Hive, Pig, Oozie, Sqoop, Flume, Oracle 11g, Core Java.
Confidential, McLean, VA
Sr.JAVA Developer
Responsibilities:
- Analyzing the requirements and preparing Design documents, Sequence and Class Diagrams, using Rational Rose.
- Involved in Development of Advanced Rules Reporting module presentation Layer using JSP, Struts tag libraries and Confidential specific tag libraries.
- Involved in enhancements of Confidential selling system key processes like (Import/Export Loans, Certify Loans, ProcessLoanDataChanges)to support MISMO Standards using Struts MVC Framework
- Consumed JAX-RPC web services and persisting response xml files into database using JMS and Message Driven Beans.
- Used JAXB to manipulate response xml.
- Implemented complex search functionality for Reporting Module using SQL queries in DB2 database. Provided the flexibility to the user to view the reports in different formats like XML, Excel and PDF using iText Framework.
- Configured tiles-def.xml, struts-config.xml according to the application flow.
- Developed business layer using Struts MVC architecture and Enterprise Java Beans.
- Involved in migration of Loan Purchase Rules Module using Spring MVC Framework.
- Developed Spring Controller classes and configured model objects in servlet.xml
- Used HP Quality Center (Mercury) for effective defect tracking, Clear Quest for Project tracking.
- Used Log4j Framework for logging and debugging the application and to create the log files in development and production servers.
- Designed and developed the Application using Agile methodology.
- Implemented Unit and Integration test cases with JUNIT Framework based on Functional Flow.
- Used Clear Case for Version Control. Created development streams, views and deliver the code to Integration stream.
- Supporting build approaches, deployments and working closely with QA team to ensure that allocated defects are resolved.
- Produced detailed and accurate documentation for assigned tasks when necessary.
- Implemented build files using ant scripts to deploy WAR/EAR artifacts to Weblogic10.0 application server.
Environment: Struts1.2,DB2,JSP,Log4J,WebServices,RationalClearcase,QualityCentre,Eclipse,Weblogic10.0,ANT,Rational ClearQuest,Jquery,JavaScript,JMS,Spring MVC3.
Confidential, Windsor, CT
JAVA Developer
Responsibilities:
- Analyzed requirements and came up with the Estimation and Plan for releases.
- End to end Management and Coordination of all phases (Requirements to Release to production) from Onsite.
- Worked on multiple projects like My Retirement outlook, Pricing Rewrite, Admin tools using JSP and Tiles framework.
- Developed the business logic using struts, IA3 Framework (ING Internal Framework). Used Spring Framework for dependency injection.
- Consumed JAX-RPC web services and modifying the existing service to generate the Fund Performance reports and tested using tools like SOAP UI.
- Involved in implementation of security for the web services using XML Data Appliance
- Used SAX parser to parse the XML files comes from different environments.
- Involved in Development of Fund Operations extract module to export the data into text files from Sybase,DB2 database tables using Java Programs, SQL queries, Unix shell scripts, and Ftping the files to different Servers.
- Wrote complex SQL &PL\SQL stored procedures in Sybase and DB2 databases.
- Used HP Quality Center (Mercury) for effective defect tracking, ClearQuest for Project tracking.
- Used Log4j Framework for logging and debugging the application and to create the log files in development and production servers.
- Designed and developed the Application using Agile methodology.
- Implemented Unit and Integration test cases with JUNIT Framework based on Functional Flow.
- Performed code re-factoring and root cause analysis, JNDI lookup for stateless session beans and using design patterns like Session Facade, Singleton, Business Delegate and DAO patterns
- Used ClearCase for Version Control. Created development streams, views and deliver the code to Integration stream.
- Worked with QA team to discuss about the test plan and test approach.
- Building WAR/EAR files and Deploying build artifacts to Jboss and Weblogic application servers with clustered environment.
Environment: Struts1.2,Sybase,DB2,JSP,Log4J,Spring,WebServices,SOAPUI,RationalClearcase,QualityCentre,Eclipse,Jboss4.0WebLogic9.
Confidential
JAVA Developer
Responsibilities:
- Involved in all phases of the Software development life cycle (SDLC) that includes Development,
- Testing, Implementation and Maintenance Support.
- Involved in Development UI screens using Java Server Pages and used various Struts taglibs extensively
- (Html, logic).
- Responsible for developing presentation layer using Tiles Framework to achieve reusability.
- Developed client request validations and processing using JavaScript and HTML.
- Developed Action Forms and DataTransfer Objects.
- Developed resource property files to display Error Messages.
- Implemented JavaMail API to send the mails to the customer.
- Involved in the development of Business Layer using Enterprise JavaBeans.
- Developed Session facades to execute smoother BusinessLogic & deployed Weblogic Server.
- Configured Struts-config.xml according to application flow.
- Involved in implementing Value Object Pattern, MVC & Singleton Pattern.
- Developed Action classes to integrate with Framework.
- Configured and used JDBC mechanism to interact with database.
- Written and executed various SQL Queries to retrieve the data from the database.
- Created and Executed unit, Integration test cases based on Client requirements.
- Created test cases, test scenarios based on the functional and business requirements.
- Provided assistance to the test executioners during Test Execution in the form of knowledge transition, mentoring, management and coordination of the execution effort.
- Performed version control management using VSS.
Environment: J2EE1.3,Struts1.1,JSP1.2,JavaScript,EJB1.1,JavaMailAPI,Weblogic7.1,Oracle8i,MyEclipse,VSS, Windows2000 Professional