Hadoop Developer Resume
Irving, TX
SUMMARY
- 8+ years of experience as a programmer in Object Oriented Analysis and Design, developing, testing and maintenance of distributed and Client /Server Java applications and programming in Core Java.
- 3+ years of experience in development of Big Data projects using Big data analytics, Hadoop, Hive, Teradata, and other open source tools/technologies.
- Experience in Telecom, Insurance, E - Commerce, Health and Retail domains.
- Excellent experience in installing, configuring and using ecosystem components like Hadoop MapReduce, HDFS, Hbase, Hive, Pig, Zoo Keeper, Oozie, Cassandra, Flume, Chukwa, Avro, Pentaho Kettle and Horton Works.
- Hands-on experience with "productionalizing" Hadoop applications (e.g. administration, configuration management, monitoring, debugging, and performance tuning)
- Excellent analytical, problem solving, communication and interpersonal skills with ability to interact with individuals at all levels and can work as a part of a team as well as independently.
- Good experience with writing Elastic Search indexes and Elastic queries.
- Worked with application teams to install operating system,Hadoopupdates, patches, version upgrades as required.
- HadoopDeveloper with 7 years of overall IT experience in a variety of industries, which includes hands on experience in Big Data technologies
- Experience in installing, configuring and maintaining theHadoopCluster
- Knowledge of administrative tasks such as installingHadoop(on Ubuntu) and its ecosystem components such as Hive, Pig, sqoop.
- Good knowledge about YARN configuration.
- Passionate towards working in Big Data and Analytics environment.
- Expertise in writingHadoopJobs for analyzing data using Hive QL (Queries), Pig Latin (Data flow language), and custom MapReduce programs in Java.
- Wrote Hive queries for data analysis to meet the requirements
- Created Hive tables to store data into HDFS and processed data using Hive QL
- Expert in working with Hive data warehouse tool-creating tables, data distribution by implementing partitioning and bucketing, writing and optimizing the HiveQL queries.
- Good knowledge in creating Custom Serdes in Hive
- Developed Pig Latin scripts using operators such as LOAD, STORE, DUMP, FILTER, DISTINCT, FOREACH, GENERATE, GROUP, COGROUP, ORDER, LIMIT, UNION, SPLIT to extract data from data files to load into HDFS.
- Extending Hive and Pig core functionality by writing custom UDFs
- Experience in working with MapReduce programs using ApacheHadoopfor working with Big Data
- Good knowledge in Linux shell scripting or shell commands.
- Hands on experience in dealing with Compression Codecs like Snappy, Gzip.
- Good understanding of Data Mining and Machine Learning techniques.
- Experience in importing and exporting data using Sqoop from HDFS to Relational Database Systems and vice-versa.
- Hands on experience in configuring and working with Flume to load the data from multiple sources directly into HDFS.
- In depth understanding/knowledge ofHadoopArchitecture and various components such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node and MapReduce concepts.
- Extensive experience with SQL, PL/SQL and database concepts.
- Knowledge of NoSQL databases such as Hbase, Cassandra.
- Also used Hbase in accordance with PIG/Hive as and when required for real time low latency queries.
- Knowledge of job workflow scheduling and monitoring tools like Oozie (hive, pig) and Zookeeper (Hbase).
- Experience in developing solutions to analyze large data sets efficiently.
- Good understanding of XML methodologies (XML, XSL, XSD) including Web Services and SOAP
- Strong experience as a senior Java Developer in Web/intranet, Client/Server technologies using Java, J2EE, Servlets, JSP, EJB, JDBC.
- Strong analytical and Problem solving skills.
- Good Inter personnel skills and ability to work as part of a team. Exceptional ability to learn and master new technologies and to deliver outputs in short deadline
- Business knowledge on Banking and Financial
- Expertise in various open source framework like Apache Struts framework, Spring framework with modules like IOC, AOP, Hibernate, JNDI, JMS, JPA and ExactTarget, Servlets.
- Experienced in deploying and maintaining J2EE applications in WebSphere, WebLogic, JBoss, Tomcat servers, Spring microservices.
- Experience in RESTful and SOAP web services, Jasper and SOA architecture with Java
TECHNICAL SKILLS
Languages: Java SE 7, Java EE 7,Core Java, C++, C.
Big Data Technologies: Hadoop, Hive, Pig, Elastic Search, Teradata,HDFS, HBase, Zookeeper, Hive, Pig, Sqoop,Flume, Chukwa, Pentaho Kettle and Talend, Map Reduce, Cassadra.
Frameworks: Swing, Struts, Spring framework, Servelets (IOC, AOP, MVC, ORM), ExactTarget, JavascriptMVC Hibernate3.0, JPA, RESTful, SOA, Jasper.
Application /Web Servers: IBM WebSphere, Oracle WebLogic, Apache Tom cat, JBoss.
Application IDE(s): IBM WSAD (v4.0.3 & v5.0), Eclipse (Kepler, Indigo, Luna), RAD7, STS (Spring ToolSuite), Flex builder 3.
Web Technologies: Elastic Search, AngularJS, JavaScript, KnockoutJS, Ajax, Backbone JS, JSP, Servlet, Bootstrap, NodeJS, JSF, Web Services, AWS, HTML, DHTML, JavaScript, DOJO, JQuery
Databases: Oracle, DB2, T-SQL, MySQL, PL/SQL, SQL and MS-Access, DBMS
UML Tools: Rational Rose, Microsoft Visio
Design Patterns: Singleton, MVC, Data Access Object, Value Object, Controller, View Helper, Session Façade, Factory, HLD, LLD.
Version Control System: CMVC, WinCvs 1.3, Sub Version, Clear case, Maven and Serena Dimensions
Operating System: Windows NT/95/2000/XP, UNIX, SUN Solaris, Mac OSX
Other Technologies: XML, JDOM, SAX, XSL, XSD, LDAP, Log4J, Ant Build Script, Junit, Jasmine, Mockito, JAXB, Maven, ANT, Jenkins, Splunk, JMS, JNDI, JPA, JSON-RPC.
PROFESSIONAL EXPERIENCE
Confidential, Irving, TX
Hadoop Developer
Responsibilities:
- Worked on analyzing, writingHadoopMapReduce jobs using Java API, Pig and Hive.
- Responsible for building scalable distributed data solutions usingHadoop.
- Involved in loading data from edge node to HDFS using shell scripting.
- Worked on installing cluster, commissioning & decommissioning of datanode, namenode high availability, capacity planning, and slots configuration.
- Created HBase tables to store variable data formats of PII data coming from different portfolios.
- Implemented a script to transmit sysprin information from Oracle to Hbase using Sqoop.
- Implemented test scripts to support test driven development and continuous integration.
- Worked with application teams to install operating system,Hadoopupdates, patches, version upgrades as required.
- Load and transform large sets of structured, semi structured and unstructured data
- Experience in managing and reviewingHadooplog files.
- Responsible for cluster maintenance, adding and removing cluster nodes, cluster monitoring and troubleshooting, manage and review data backups, manage and reviewHadooplog files.
- Installed Oozie workflow engine to run multiple Hive and pig jobs.
- Analyzed large amounts of data sets to determine optimal way to aggregate and report on it.
Environment: ApacheHadoop, Java (jdk1.6), HBase, MapReduce, HDFS, Cassandra, Flat files, Oracle 11g/10g, mySQL, Toad 9.6, Windows NT, UNIX, Sqoop, Hive, Oozie.
Confidential, San Ramon, CA
Hadoop Developer
Responsibilities:
- Installed and configured Hadoop MapReduce, HDFS, Developed multiple map reduce jobs in java for data cleaning and preprocessing.
- Importing and exporting data into HDFS and Hive using Sqoop
- Experienced in defining job flows
- Experienced in managing and reviewing Hadoop log files
- Experienced in running Hadoop streaming jobs to process terabytes of xml format data
- Load and transform large sets of structured, semi structured and unstructured data
- Responsible to manage data coming from different sources
- Supported Map Reduce Programs those are running on the cluster.
- Involved in loading data from UNIX file system to HDFS.
- Installed and configured Hive and also written Hive UDFs.
- Involved in creating Hive tables, loading with data and writing hive queries which will run internally in map reduce way
- Gained very good business knowledge on health insurance, claim processing, fraud suspect identification, appeals process etc.
Environment: Hadoop, MapReduce, HDFS, Hive, Java (jdk1.7), Hadoop distribution of HortonWorks, Cloudera, MapR, DataStax, IBM DataStage 8.1(Designer, Director, Administrator), Flat files, Oracle 11g/10g, PL/SQL, SQL*PLUS, Toad 9.6, Windows NT, UNIX Shell Scripting, Autosys r11.0.
Confidential, Campbell, CA
Sr. Java Developer
Responsibilities:
- Involved in requirement analysis and played a key role in project planning.
- Designed and developed web components and business modules through all tiers from presentation to persistence.
- Developed the web pages using JSP, JavaScript, CSS, AJAX and servlets.
- Developed the application using JPA and used JPQL for mapping with the rational DB
- Used Kanban agile technology for development process.
- Developed UI layout using Tiles.
- Developed java beans to interact with UI & db.
- Created the end-user business interfaces.
- Designed and developed standalone module using swing and netbeans.
- Developed Web Service application using XML and SOAP.
- Integrated JMS with Weblogic.
- Frequent interaction with client and delivered solution for their business needs.
- Developed XML/XSL with JAXB.
- Development and enhancement applications with Adobe Flex.
- Developed EJBs and Customized Tag Libraries for JSP to reduce the complexity of application.
- Involved in designing XML documents for efficient message transfer between subsystems.
- Used GitHub repositories.
- Developed ANT script for building and packaging J2EE components.
- Wrote T-SQL and PL/SQL queries and Stored procedures for data retrieval.
- Created and modified Oracle Schema objects like Tables, Indexes.
- Created Test Plan, Test Cases & scripts for UI testing using Selenium.
- Selenium Grid for distributed Testing and Load testing.
Environment: JDK1.5 (Netbeans 5.0), J2EE (EJB, JSP, servlets, XML, JAXB), Core Java, JDBC, JPA, JMS, Struts, T-SQL, PL/SQL, FLEX, HTML, XML, XSL, XSLT, CSS, AJAX, DHTML, Adobe Flex, GitHub repositories, Weblogic, DB2, SWING, ANT, Oracle9, Windows XP.
Confidential, Eden Prairie,MN
Sr. Java Developer
Responsibilities:
- Class Design & Development for MVC (Model-View-Controller) Architecture and Design Patterns.
- Involved in the development of the application. The application is built using J2EE technologies and Struts 2.0 Framework and Hibernate .The application is based on Service Oriented Architecture System Analysis and Design methodology as well as Object Oriented Design and Development using OOAD methodology to capture and model business requirements.
- Required a solid understanding of distributed, multi-tiered environments and XML. Java RMI, XML, XSLT, XSL and Postages were among the technologies used to provide a robust, fault tolerant, scalable, cross-platform, enterprise-level Java application. Problem-solving skills and team player abilities essential.
- Required knowledge of human factors and best GUI design principles coupled with business analysis skills to create attractive, intuitive, and user friendly screens.
- Developed Servlets, XML and Java classes in J builder using Borland Application Server.
- Developed JSP using Struts Libraries, Tiles and Java Scripts.
- Used Quartz and Translet libraries to schedule jobs and J Probe for profiler and memory leak debugs.
- Developed Test classes using JUnit framework to test unit applications.
- Defect tracking using Multi-User TIR Tool.
- Maintains Mainframe program in CAM that pushes SQL data into IBM UDB DB2.
Environment: JSP 1.2, Core Java 1.4, EJB 2.0, XML, JDBC, Apache Tomcat Server, Borland Application Server, Struts 2.0, IBM Web Sphere 4.0, IBM UDB DB2 7.0, OS-390 & Windows 2000.
Confidential, NY
Java Developer
Responsibilities:
- Responsible for preparing software requirement specification
- Involved in the Design and Development using MVC Framework.
- Involved in development of Servlets and JSP using Apache Struts 2.0 framework, Session Bean, Entity Bean.
- Developed user interfaces using JSP, HTML and JavaScript.
- Used JPA for object relational mapping to the DB.
- Used Visual Source Safe for version controlling
- Involved in writing the test cases for the application using JUNIT
- Extend the existing framework as per application requirements.
- Involved in Design Reviews and Code Reviews.
- Used server side programming using C++.
- Provided end-user training and production support.
Environment: Core Java, JDBC, C++, JPA, Servlets, JSP, Struts 2.0, JavaScript, Oracle, Tomcat and CVS.
Confidential, San Roman, CA
Java Developer
Responsibilities:
- Business Analysis and Requirements Gathering from R&D department
- Developed Use Case, Sequence and Class diagrams
- Used Jakarta Struts 1.1 Framework, Tiles and Tag Libraries to develop the JSP pages.
- Involved in Installation and configuration of Apache Tomcat server
- Used JavaScript for Client Side Validation.
- Generated User interface screens using JSP, JavaScript, CSS, HTML and DHTML.
- Database implementation in SQL.
- Used C++ for programming on the server side for web scalability and Core Java for application development.
- Implemented Struts Form beans, Action classes for different modules.
- Used log4j and commons logging for application logging.
- Involved in Unit Testing of developed module
- Conducted design and code walkthroughs/reviews
Environment: Core Java, JSP, Servlets, C++, Java Beans, Struts, JavaScript, Tomcat Server and SQL.
