We provide IT Staff Augmentation Services!

Hadoop Developer Resume

St Louis, MO

SUMMARY:

  • 7+ years of professional experience in IT and Enterprise Application Development in multiple industries, which includes hands on experience in Big Data/Hadoop ecosystem and related technologies. 3 years of comprehensive experience on Big Data Technologies.
  • Excellent understanding / knowledge of Hadoop Architecture, its components Map Reduce & HDFS. Good understanding on various deamon processes like Job Tracker, Task Tracker, Name Node, Data Node.
  • Experience in working with Hadoop/BigData storage and analytical frameworks over Amazon AWS Cloud using tools like SSH, Putty.
  • Experience in installing, configuring, and administrating Hadoop cluster for distributions like Cloudera and Horton works.
  • Very good understanding of NOSQL database HBase
  • Designed and implemented Cassandra, a NoSQL based database and associated RESTful web service that persists high - volume user profile data for vertical teams.
  • Experience in building large scale highly available Web Applications .Working knowledge of web services and other integration patterns.
  • Hands-on experience writing MapReduce Jobs
  • Experience in managing and reviewing Hadoop log files.
  • Experience in using YARN,Pig, Hive, Scoop.
  • Experience in importing and exporting data using Sqoop from HDFS to Relational Database Systems and vice-versa.
  • Hands-on experience in RDBMS, and Linux shell scripting
  • Experience in extending Hive and Pig core functionality by writing customUDFs
  • Experience in analyzing data using HiveQL, Pig Latin and Map Reduce.
  • Knowledge in job work-flow scheduling and monitoring tools like oozie and Zookeeper.
  • Knowledge of data warehousing and ETL tools like Informatica and Pentaho.
  • Experience coding with Eclipse.
  • Good knowledge on scripting languages like PYTHON
  • Expertise in RDBMS like MS SQL Server, MySQL, and DB2.
  • Extensive experience in using MVC architecture, Struts, Hibernate for developing web applications using Java, JSPs, JavaScript, HTML, jQuery, AJAX, XML and JSON
  • Excellent Java development skills using J2EE, Spring, J2SE, Servlets, JSP
  • Have good experience testing the code using JUnit, MRUnit,
  • Techno-functional responsibilities include interfacing with users, identifying functional and technical gaps, estimates, designing custom solutions, development, leading developers, producing documentation, and production support.
  • Excellent interpersonal and communication skills, creative, research-minded, technically competent and result-oriented with problem solving and leadership skills

TECHNICAL SKILLS:

Bigdata Ecosystem: MapReduce, HDFS, Hive, PigHBase, Zookeeper, Sqoop, Oozie,Flume,Spark,Kafka,Storm

Java/J2EETechnologies: Java, J2EE, Servlets, JSP, XML, AJAX, SOAP, WSDL

SDLC Methodologies: Agile, UML, Design Patterns (Core Java and J2EE)

Enterprise Frameworks: Ajax, MVC, Struts 2/1, Hibernate 3, Spring 3/2.5/2

Version and Source Control: CVS,SVN

Programming Languages: C,C++,Java, XML, Unix Shell scripting, SQL and PLSQL

WebTechnologies: HTML, DHTML, XML, XSLT, JavaScript, CSS

Modeling Tools: UML on Rational Rose 4.0

IDE Tools: Eclipse, Netbeans, WinSCP.

WebServices: WebLogic, WebSphere, JBoss

Databases: Oracle DB2, MS - SQL Server, MySQL, MS - Access, Apache Cassandra

Frameworks: MVC, Struts, Log4J, Junit, Maven, WebServices.

Operating Systems: Windows 9x/NT/XP, UNIX, Linux,Centos

PROFESSIONAL EXPERIENCE:

Confidential, St louis, MO

Hadoop Developer

Responsibilities:

  • Co-ordinated with business customers to gather business requirements
  • Extensively involved in Design phase and delivered Design documents
  • Good working knowledge of YARN Map Reduce V2 and its daemons Resource Manager and Application Master.
  • Experience in loading data from Teradata database into HDFS using SQOOP
  • Experience in moving large amount of log data from different servers
  • Experience in writing transformer/mapping Map-Reduce pipelines
  • Wrote map reduce programs to cleanse and pre-process the data coming from different sources.
  • Implemented various output formats like Sequence file and ORC format in Map reduce programs.
  • Worked on AVRO data serialization system to work with JSON data formats
  • Responsible for creating Hive tables, loading the structured data resulted from Map Reduce jobs into the tables and writing Hive Queries to further analyze the data
  • Implemented Hive Generic UDF’s to implement business logic. Also designed and implemented incremental imports into Hive tables
  • Implemented Partitioning, Dynamic Partitions, Buckets in Hive for efficient data access. Also designed both Managed and External tables in Hive for optimized performance
  • Developed Hadoop streaming Map/Reduce works using Python.
  • Developed Pig Latin Scripts and used ETL tool, informatica to do transformations, event joins, filter and some pre-aggregations
  • Good hands-on experience using Informatica
  • Expertise in ETL development best practices and standards
  • Used spark for iterative processing
  • Implemented test scripts to support test driven development and continuous integration.
  • Developed oozie workflow for scheduling & orchestrating the ETL process
  • Involved in Unit testing and delivered Unit test plans and results documents using JUnit and MRUnit
  • Performed data analysis with HBase using Hive External tables
  • Exported the analyzed data to HBase using Sqoop and to generate reports for the BI team.
  • As a POC we have installed Cassandra on the Amazon EC2
  • Created tables, inserted data and executed various Cassandra Query language (CQL 3) commands on tables using cqlsh
  • Used DataStax OpsCentre, a web based tool to monitor and to simplify administration tasks.

Environment: Coudera CDH4 & 5, Python, MapReduce, Cassandra, AWS, HDFS, Hive, Pig, Hue, Spark, Oozie, Core Java, Eclipse, Hbase, Flume, Informatica, SQL*PLUS, Toad, Putty, UNIX Shell Scripting, Linux 5,, Eclipse, Java SDK 1.6

Confidential, Austin, TX

Hadoop Developer

Responsibilities:

  • Installed & maintained cloudera Hadoop distribution.
  • Worked on analyzing Hadoop cluster and different big data analytic tools including Pig, Hive, HBase & Sqoop
  • Involved in loading the data from Linux file system to HDFS
  • Exported the analyzed data to the relational databases using sqoop for virtualization and to generate reports for the BI team
  • Involved in running Hadoop jobs for processing millions of records of text data.
  • Supported in setting up QA environment and updating configurations for implementing scripts with pig and sqoop
  • Involved in defining job flows, managing and reviewing log files.
  • Monitored workload, job performance and capacity planning using Cloud era Manager.
  • Installed Oozie workflow engine to run multiple Map Reduce, Hive and Pig jobs.
  • Implemented Map Reduce programs on log data to transform into structured way to find user information.
  • Responsible for loading and transforming large sets of structured, semi structured and unstructured data.
  • Collected the log data from web servers and integrated into HDFS using Flume.
  • Responsible to manage data coming from different sources.
  • Extracted files from HBase and placed into HDFS using Sqoop and pre-process the data for analysis.
  • Gained experience with NoSQL database.
  • Created and maintained Technical documentation for launching HADOOP Clusters and for executing Hive queries and Pig Scripts.

Environment: Cloudera, JDK 1.5, J2EE 1.4, Struts 1.3, JSP, Spring, Servlets 2.5, WebSphere 6.1, HTML, XML, JavaScript, Hadoop, HDFS, Pig, Hive, MapReduce, HBase, Sqoop, Python, Oozie, Ganglia, Flume, Toad, Putty, Windows NT, UNIX Shell Scripting, Linux, SQL.

Confidential - Alpharetta, GA

Java/J2EE developer

Responsibilities:

  • Designed and developed Struts like MVC 2 Web framework using the front-controller design pattern, which is used successfully in a number of production systems.
  • Spearheaded the "Quick Wins" project by working very closely with the business and end users to improve the current website's ranking from being 23rd to 6th in just 3 months.
  • Normalized Oracle database, conforming to design concepts and best practices.
  • Resolved product complications at customer sites and funneled the insights to the development and deployment teams to adopt long term product development strategy with minimal roadblocks.
  • Convinced business users and analysts with alternative solutions that are more robust and simpler to implement from technical perspective while satisfying the functional requirements from the business perspective.
  • Applied design patterns and OO design concepts to improve the existing Java/JEE based code base.
  • Identified and fixed transactional issues due to incorrect exception handling and concurrency issues due to unsynchronized block of code.

Environment: Java 1.2/1.3, Swing, Applet, Servlet, JSP, custom tags, JNDI, JDBC, XML, XSL, DTD, HTML, CSS, Java Script, Oracle, DB2, PL/SQL, Web logic, JUnit, Log4J and CVS.

Confidential, Memphis, TN

Java/J2EE Developer

Responsibilities:

  • Involved in various phases of Software Development Life Cycle (SDLC) as design development and unit testing.
  • Developed and deployed UI layer logics of sites using JSP, XML, JavaScript, HTML/DHTML, and Ajax.
  • CSS and JavaScript were used to build rich internet pages.
  • Agile Scrum Methodology been followed for the development process.
  • Designed different design specifications for application development that includes front-end, back-end using design patterns.
  • Developed proto-type test screens in HTML and JavaScript.
  • Involved in developing JSP for client data presentation and, data validation on the client side with in the forms.
  • Developed the application by using the Spring MVC framework.
  • Collection framework used to transfer objects between the different layers of the application.
  • Developed data mapping to create a communication bridge between various application interfaces using XML, and XSL.
  • Spring IOC being used to inject the parameter values for the Dynamic parameters.
  • Developed JUnit testing framework for Unit level testing.
  • Actively involved in code review and bug fixing for improving the performance.
  • Documented application for its functionality and its enhanced features.
  • Created connection through JDBC and used JDBC statements to call stored procedures.

Environment: Spring MVC, Oracle 11g J2EE, Java, JDBC, Servlets, JSP, XML, Design Patterns, CSS, HTML, JavaScript 1.2, JUnit, Apache Tomcat, My SQL Server 2008.

Confidential

Java Developer

Responsibilities:

  • Involved in software development life cycle (SDLC) of the project (analysis, design, development, testing and implementation).
  • Used MS-Visio for analysis & design flow and monitored the initial applications prototype development for the project.
  • Leading a team of 4 developers and point of contact for onshore / offshore communication.
  • Designed and developed web pages using JSP, JDBC, Servlets, ASP and ASP.NET.
  • Developed modules using core java, C#, VB.Net and VB6.0.
  • Used HTML, CSS, XML and JavaScript to design a page.
  • Successfully migrated legacy application written in VB6.0 to VB.Net.
  • Developed Web Services to get data from the external system in terms of .txt file to load into the database.
  • Developed DTS/SSIS packages to load employee details into row Mony tables of the SQL server for further processing.
  • Wrote Stored Procedures, functions and complex SQL queries for database operations.
  • Used Java Scripts to perform client side validations.
  • Worked on performance tuning of queries.
  • Developed reports using Crystal Reports reporting tool.
  • Have used DataGrid and GridView Controls to display data in a customized format in the ASP.NET web pages.
  • Have used LDAP and Active Directory Search Interface (ADSI) to authenticate and authorize user.
  • Involved in unit testing and production support of the application.
  • Defects were managed through the Remedy

Environment: Java, J2EE, JSP, Servlets, .Net Framework 2.0, ASP.NET, C#, VB.NET, ADO.NET, Oracle9i, SQL Server 2005, T-SQL/PL-SQL, HTML, XML, Web Services, JavaScript, Windows 2000, IIS, Tomcat, Visual Source Safe (VSS), Remedy and Crystal Reports.

Confidential

Java Developer & Support

Responsibilities:

  • Provide L3 application support as primary on call.
  • Involved in the development of Report Generation module which includes volume statistics report, Sanctions Monitoring Metrics report, and TPS report.
  • Implemented Online List Management (OLM) and FMM module using spring and Hibernate.
  • Wrote various SQL, PL/SQL queries and stored procedures for data retrieval.
  • Created Configuration files for the application using Spring framework.
  • Used HTML, CSS, XML and JavaScript to design a page.
  • Successfully migrated legacy application written in VB6.0 to VB.Net.
  • Developed Web Services to get data from the external system in terms of .txt file to load into the database.
  • Developed DTS/SSIS packages to load employee details into row Mony tables of the SQL server for further processing.

Environment: Core Java, J2EE, JSP, Servlets, JQuery, JavaScript, CSS, HTML, SQL.

Hire Now