Hadoop Developer Resume
FloridA
SUMMARY
- Around 10 years of extensive IT experience in which 2 years as a Hadoop developer experience with Software analysis, design, development, testing, deployment and maintenance.
- Extensive experience in JAVA, J2EE, Spring and Web Services technologies.
- Around 2 years experience in Hadoop Ecosystems.
- Experience with Hadoop Ecosystem: Hortonworks 2.0/2.2/2.3,CDH 4.3.2/5.2, HDFS, MapReduce, YARN, Sqoop, Flume, Oozie, Pig, Hive, Scala, HBase, Avro, Cassandra, Solr, Spark, Storm and Kafka.
- Experience in importing and exporting the data using Sqoop from HDFS to Relational Database systems and vice - versa.
- Experience in managing and reviewing Hadoop Log files.
- Experience with Oozie Workflow Engine in running workflow jobs with actions that run Hadoop Map/Reduce and Pig jobs.
- Experience in Database Design, ER modeling, SQL, PL/SQL, procedures, functions, triggers
- Experienced the integration of various data sources like Java, RDBMS, Shell Scripting, Spreadsheets, and Text files.
- Experience in both Web services and RESTfull Web services using XML, JAXB, SOAP, Apache Axis2, Apache CXF, SOAP UI and Postman.
- Good experience in developing a build script using Ant, Maven
- Proficient in development methodologies such as Agile, Scrum and Waterfall.
- Having knowledge on IBM Netezza
- Worked with customers, end users to formulate and document business requirements.
- Worked extensively on Business Requirements Analysis, Functional and Non-Functional requirements analysis, Risk Analysis and UAT.
- Hands-on experience on varies areas of telecom spaces like Fixed Line, Broadband, Service Provisioning, GSM Prepaid and Postpaid, Roaming, Mediation, Rating and Billing.
- Good communication, inter-personal skills, team player and contributor who delivers on schedule under tight schedules.
TECHNICAL SKILLS
Hadoop Distribution: Apache, Cloudera CDH, Hortonworks HDP
Big Data Technologies: Apache Hadoop (MRv1,MRv2), Hive,Pig,Sqoop,HBase,Flume,Zookeeper,Oozie, Ambari, Spark, Kafka and Storm
Operating Systems: Windows, Linux & Unix
Languages: C,C++, Java, PL/SQL, Unix Shell
Frameworks: Struts, Spring and Hibernate
Web Technologies: HTML, JSP, CSS, JavaScript
IDEs: Eclipse, IBM Web Sphere
Web Servers /App Servers: Apache Tomcat 6.0/7.0, IBM WebSphere 6.0/7.0, JBoss 4.3
Database: Oracle 8i/9i/10g, MySQL,HBase(NoSQL), MongoDB(NoSQL), LDAP
Test Management Tool: Quality Center, BugZilla, JIRA
PROFESSIONAL EXPERIENCE
Confidential, Florida
Hadoop Developer
Responsibilities:
- Understand the business needs and objectives of the system and interacted with the end client/users and gathered requirements for the integrated system
- Worked with the user group for requirement gathering, planning and implementation
- Involved in various activities of the project like information gathering, analyzing the information, documenting the functional and nonfunctional requirements
- Developed MapReduce jobs for data cleaning and preprocessing.
- Responsible for data movement from relational database to HDFS using Sqoop.
- Created external tables using hive to access the data from reporting tools using hive ODBC connectors
- Created Hive queries for data analysis to meet the Business requirements.
- Involved writing Pig Latin for data Processing as per Use cases
- Handled importing of data from various data sources, performed transformations using Spark and loaded data into HDFS.
- Involved in converting Hive QL queries into Spark transformations using Spark RDD and Scala.
- Used DataFrame API in Scala for converting the distributed collection of data organized into named columns.
- Generating Scala and Java classes from the respective APIs so that they can be incorporated in the overall application.
- Writing entities in Scala and Java along with named queries to interact with database.
- Writing scala classes to interact with the database.
- Written Kafka Producer and Consumer code to collect events from various sources and store it in HDFS.
Environment: Hadoop 2.6.2, Java 1.7, Eclipse, Cloudera (CDH 4.3.2), MapReduce, Sqoop, Hive and Pig.
Confidential, Florida
Software Developer
Responsibilities:
- Responsible for understanding the scope of the change request and requirement gathering.
- Responsible for developing detailed functional specifications and be a key part of the user acceptance phase of an engagement by extensive interaction with the client.
- Act as an interface between client, business heads and the technical team where functional / process knowledge is key to developing specifications.
- Involved in Use Case modeling, Use Case Reviews, Design Reviews
- Responsible for answering queries / helping teams understand functional requirements of a project by syndicating appropriate prototypes / documentation.
- Created IDD/DDD/LDD/STP for a change request.
- Support project teams in user testing / acceptance and deployment phase of the projects.
- Performed GAP and Risk analysis of existing system and evaluated benefits of new system.
- Prioritized outstanding defects and system problems, ensuring accuracy and deadlines were met.
- Developed Resources using Spring with Rest API
- Configured Resources as beans in spring configuration file using DI
- Tested Resources using Postman plug in and SOAP UI.
- Developed resources using Spring with REST.
Environment: Java 1.7, Eclipse, Spring 2.5, Hibernate, VAX VMS, Web Services, AXIS 2, Apache CXF, RESTfull Web Services and Tomcat 7.0
Confidential
Software Developer
Responsibilities:
- Involved in designing and implementation of MVC design pattern using Spring framework for Web-tier.
- ImplementedSOAbased web services, designed and builtSOAPweb serviceinterface, implemented usingSOAP &ApacheAxis.
- Developed business components and configured as beans using Spring DI.
- Made proficient use ofWSDLfiles. UsedSOAPUIfor testing the web services.
- Involved working onOracleat the back-end.
- Involved in developing Unit test framework usingJUnit. Written JUnit test cases for every java class.
Environment: Java 1.5, Spring, Web Services, Tomcat 5.0, Oracle 10g, and XML
Confidential
Software Developer
Responsibilities:
- Responsible for all aspects of software development including requirements, design, coding, testing and maintenance.
- Analyzed BRD (Business Requirement Document) for the QW (QuickWin) and given estimation (FPQ - Fixed Price Quote) for impact analysis, design, development and testing.
- Analyzed IMACS (Insurance Management And Claims System) application which is developed by JAVA, Struts and EJB for QW development.
- Developed DDD for each QW based on the application analysis.
- Written pseudo code and unit test cases for the QW.
- Developed QW by using JAVA, Struts, EJB and UNIX Shell.
- Tested the developed application in locally based on the test cases.
- Participated Kick-Off calls for the QW with related QW Business Analyst before estimation.
- During the development, closely worked with the onsite tech leads for technical implementation of the QW.
- Closely worked with other development team for sharing the project information.
Environment: Java, Swings, EJB, Struts, UNIX, Clear Case, UNIFACE and Oracle 10g
Confidential
Software Developer
Responsibilities:
- Development and implementation for different releases before and after implementation of launch.
- Monitor the running of the rating processes
- Develop automation scripts for rating processes in UNIX shell
- Check call rejects on a daily basis and recycle the rejected CDRs
- Module implementation and customization based on the Change Requests
- System integration test planning and execution for the newly developed/implemented modules
- Configuration of new product plans and services for GSM-Voice, GSM-Data, Mobile TV, GPRS, Fixed Line and Internet
- Monitoring the Credit Check processes and actions on subscribers.
Environment: BSCS iX Billing, Oracle 9, Quality Center, UNIX &TOAD
Confidential, Dallas
Software Developer
Responsibilities:
- Liaising the client for capturing requirements and redressing issues.
- Analyzing the system and preparing technical documents as per client’s requirements
- Integrated code with Hibernate, Java and Oracle 9i
- Front-end GUI in Struts for monitoring the updates and correcting broken values.
- Integrating Log4j for logging all the system level errors
- Reviews the Test Plans, Test Cases and Test scenarios and suggesting appropriate changes
- Preparing the Test cases and Status reports.
Environment: Java, Struts, Hibernate, XML, Oracle 9i, Log4j, UNIX.
