We provide IT Staff Augmentation Services!

Java Hadoop Developer Resume

0/5 (Submit Your Rating)

Bentonville, AR

SUMMARY

  • More than 12 years of Java development experience with 5+ years in big data environment.
  • Diverse background in many software engineering disciplines, including software development, quality assurance and sales engineering.
  • Expertise around different Hadoop projects like HBase, Hive, Flume, ZooKeeper, Oozie, Pig.
  • Good experience writing NoSQL and Hadoop MapReduce jobs.
  • In - depth understanding and knowledge of Hadoop Architecture, HDFS, MapReduce programming paradigm, HIVE, PIG, Sqoop, Oozie and HBASE.
  • In-depth knowledge of web application development technologies gained while managing, improving and leading QE teams in time-critical, fast paced environments both in small start-ups and large enterprise organizations.
  • Vast experience in installing, configuring, testing Hadoop ecosystem components as well as building automation test framework.
  • Excellent interpersonal and organizational skills, comfortable working with people at any level in the organization.
  • Strong background in collaborating with all major stakeholders including development, product management, support, sales and customers.

TECHNICAL SKILLS

Development Tools: J2EE, Java, Spring, Cucumber, Visual Basic, HTML, XML, SQL, XML, XSL, XSLT, Bash, JavaScript, JSP, HTML, RPT, RFT, RQM, RTC

Big Data: Apache Hadoop, HDFS, MapReduce, HIVE, PIG, Sqoop, Oozie, Flume, HBASE.

Databases: MySQL, Oracle, Microsoft SQL Server, MySQL, DB2, Microsoft Access

Platforms: Windows, Mac, Linux, Agile, Eclipse, ANT, Jenkins, Maven, IIS,.NET, Certifications SCJP 7, HortonWorks Certified Apache Hadoop Java Developer, PMP, Certified Scrum Master (CSM)

PROFESSIONAL EXPERIENCE

Java Hadoop Developer

Confidential, Bentonville, AR

Responsibilities:

  • Worked in the BI team in the area of Big Data Hadoop cluster implementation and data integration in developing large-scale system software.
  • Developed MapReduce programs to parse the raw data, populate staging tables and store the refined data in partitioned tables in the EDW.
  • Capture data from existing databases that provides SQL interfaces using Sqoop.
  • Worked extensively with Sqoop for importing and exporting the data from HDFS to Relational Database systems/mainframe and vice-versa. Loading data into HDFS.
  • Develop and maintain complex outbound notification applications that run on custom architectures, using diverse technologies including Core Java, J2EE, SOAP, XML, JMS, JBoss and Web Services.
  • Created Hive queries that helped market analysts spot emerging trends by comparing fresh data with EDW reference tables and historical metrics.
  • Enabled speedy reviews and first mover advantages by using Oozie to automate data loading into the Hadoop Distributed File System and PIG to pre-process the data.
  • Provided design recommendations and thought leadership to sponsors/stakeholders that improved review processes and resolved technical problems.
  • Managed and reviewed Hadoop log files.
  • Tested raw data and executed performance scripts.
  • Shared responsibility for administration of Hadoop, Hive and Pig.
  • Developed Hive queries for the analysts.

Java Hadoop Developer

Confidential, Naperville, IL

Responsibilities:

  • Responsible for Cluster maintenance, adding and removing cluster nodes, Cluster Monitoring and Troubleshooting, Manage and review data backups and log files.
  • Analyzed data using Hadoop components Hive and Pig.
  • Worked on analyzing Hadoop stack and different big data analytic tools including Pig, Hive, HBase database and Sqoop.
  • Worked on installing cluster, commissioning & decommissioning of DataNodes, NameNode recovery, capacity planning, JVM tuning, map and slots configuration.
  • Installed and configured Hadoop ecosystem like HBase, Flume, Pig and Sqoop.
  • Loaded log data into HDFS using Flume. Work extensively in creating MapReduce jobs to power data for search and aggregation.
  • Cluster co-ordination services through ZooKeeper.
  • Responsible for running Hadoop streaming jobs to process terabytes of xml's data.
  • Load and transform large sets of structured, semi structured and unstructured data using Hadoop/Big Data concepts.
  • Involved in loading data from UNIX file system to HDFS.
  • Responsible for creating Hive tables, loading data and writing hive queries.
  • Handled importing data from various data sources, performed transformations using Hive, MapReduce, and loaded data into HDFS.

Dev QA Lead

Confidential, Cambridge, MA

Responsibilities:

  • Spearheaded testing multiple Cloud Engineering projects for the development of mobile products and services.
  • The solutions were targeted towards enhancing mobile internet and accelerate mobile browsing. The solutions resulted in increased business in specific business lines by 25%.
  • Reduced legal exposure 50% by standardizing services, procedures and products by reaching PCI Compliance in coordination with other product teams. .
  • Led team of five QA engineers in testing Clojure-based application platform that generated query type language to be utilized by professional services in building mobile websites.
  • Led effort to implement QA infrastructure, including automation framework, nightly regression automation, continuous integration, test case library and test case template.
  • Diagnosed, debugged and performed root-cause analysis of the platform bugs.
  • Designed, developed, debugged and wrote Cucumber/ RSpec scripts for automation coverage.
  • Also a Certified Scrum Master helped teams adapt Agile/Scrum environment using daily standups, development and QE team.
  • Used Jira for test plan and bug systems. Automation ran on user agents in Firefox and Chrome.
  • As technical lead of the automation team, designed and implemented a new automation framework that is used by multiple QA and development teams worldwide using Selenium.
  • Provided training and ongoing guidance on test automation principles and use of tools to software engineers in test, as well as development engineers and manual testers, resulting in greater test coverage.
  • Collaborated with development to improve automation’s ability to interact with application under test.
  • Substantially increased effectiveness and efficiency and decreased maintenance costs of existing automation through code reuse and performance improvements.
  • Reduced development costs by automating acceptance criteria using Web Services, Java, and SoapUI.

Sr. Automation Analyst

Confidential, Fort Lauderdale, FL

Responsibilities:

  • Led the Dev QA team for successful migration of Confidential platform onto Amazon's EC2 cloud decreasing the infrastructure cost by as much as 20%.
  • Tested complete Sales Funnel and Search components of Confidential 's e-Commerce platform and provided ongoing assessment of product quality, testing progress and risk.
  • Oversaw design and implementation of automation strategies. Authored, reviewed and provided guidance on test case specifications, test plans, bug reports, and setup/configuration issues.
  • Worked on tool development and test automation tasks for regression testing Java, JSON, jQuery, Ajax and Spring based websites and components using a variety of automation frameworks built using Selenium, SQL, and QTP.
  • Developed documents, maintained, and trained staff on test automation and environment simulation tools and collected SQA metrics. Ran weekly bug triage meetings.
  • Debugged and stepped through a major component of the product being tested. Examples include the ability to identify and locate resource leaks and/or out of bounds conditions.
  • Isolated defects effectively and provide specific conditions for reproducibility to Engineering.
  • Build an application to generate JIRA issue to capture test run/result from JUnit and Selenium test executions.
  • Executed automated test cases and deployed to Jenkins/ Hudson CI. Found/logged defects in Bugzilla/ Trac.
  • Upgraded legacy QTP smoke tests to Selenium; created new acceptance and functional tests. Maintained a suite of test cases. Oversaw the architecture of the automated test system.

Automation Engineer

Confidential, Burlington, MA

Responsibilities:

  • Responsible for test harness development, testing, documentation, progress reports, user acceptance testing and user training/ support for Fortune 500 clients like Confidential, Confidential, Confidential etc.
  • Developed, managed and published release calendar and key milestones; understand risk/impact of proposed milestone changes, develop mitigation plans and communicate changes.
  • Worked on dev testing of Citrix’s projects which later translated into Citrix XenServer, XenDesktop, XenApp and XenClient virtualization products.
  • Developed and published metrics that outlined the effectiveness of the project and its quality audit.
  • Helped execute and verify product deployments.
  • Authored test outlines and provided test coverage for a wide suite of features.
  • Developed, wrote and executed automation scripts.
  • Assisted in creating test harness to execute JavaScript test scripts.
  • Helped define and implement release engineering and build processes.
  • Worked directly with product specialists, developers, sale engineers, and database administrators for various releases.
  • Lead daily Scrum meeting with the automation team

Lead Java Developer

Confidential

Responsibilities:

  • Fully responsible for over ten, full-cycle projects, where I acted as a project lead developer.
  • Each project included proposal & estimates, overseeing day-to-day activities, design & implementation as well as end-user support & documentation.
  • Gathered requirement from the clients and developed specifications.
  • Converted specs into design document using UML and ERwin.
  • Ensured that development efforts were in alignment with current business and technical strategies.
  • Designed, implemented and tested clustered multi-tiered, e-Commerce products.
  • Core technologies used include IIS, SQL Server, ASP, XML/ XSLT, JSP, Tomcat, JavaBeans and Java Servlets.
  • Authored, executed and supported performance, load and stress testing suites.
  • Researched and diagnosed performance problems with applications in production.
  • Helped develop automated smoke test and test suite automation architecture.

We'd love your feedback!