We provide IT Staff Augmentation Services!

Sr Hadoop Developer Resume

0/5 (Submit Your Rating)

SUMMARY

  • Technically accomplished professional with 14 years of total experience in Hadoop (3 years) and java (14 years) technologies in IT industry.
  • Working experience in MapReduce programming model and Hadoop Distributed File Systems.
  • Proven knowledge of writing Hive Queries to generate reports using Hive Query Language.
  • Working experience in writing Sqoop queries for transferring bulk data between Apache Hadoop and structured data stores.
  • Good Understanding of the Hadoop Distributed File System and Eco System (MapReduce, Pig, Hive, Sqoop and HBase)
  • Working knowledge on Oozie, a workflow scheduler system to manage apache Hadoop jobs by Directed Acyclic graph (DAG) of actions with control flows.
  • Working experience in Pig Latin, a Scripting Language for Hadoop Distributed File system.
  • Good Knowledge in Flume, Avro and Zoo Keeper Architecture.
  • Working knowledge in Hadoop HDFS Admin Shell commands.
  • Good Knowledge in NoSQL databases HBASE (Column family DB).
  • Extending HIVE and PIG core functionality by using custom User Defined Function's (UDF), User Defined Table - Generating Functions (UDTF) and User Defined Aggregating Functions (UDAF) for Hive and Pig.
  • Hands on experience in installing, configuring cloudera Apache Hadoop ecosystem components like Flume, Hbase, Zoo Keeper, Oozie, Hive, Sqoop and Pig.
  • Good understanding of AVRO, JSON and experience with databases like Oracle and MySQL.
  • Hands on development experience with RDBMS, including writing complex SQL queries, PLSQL, views, stored procedure, triggers, etc.
  • Good understanding of all stages of Software Development Life Cycle (SDLC) and expertise in Design Patterns like Singleton patterns and MVC architecture.
  • Experience in Object Oriented Analysis and Design (OOAD) using UML (Use Cases, Activity, Sequence, Class Diagrams etc.).
  • Experienced in web technologies like Servlets, JSP, HTML and XML.
  • Basic Knowledge of UNIX and shell scripting.
  • Working experience on Struts, spring, hibernate.
  • Experience in deploying enterprise applications in Apache-tomcat, Web Logic, and Web Sphere.
  • Possesses good knowledge in Installing & Configuring O/S like Windows and Linux.
  • Proven ability to work creatively and analytically in a problem-solving environment.

TECHNICAL SKILLS

Operating Systems: Sun Solaris 9/10/, RHEL 4/5/6, Confidential AIX 5.3, 5.2, UNIX, Windows 2008

Hadoop EcoSystem: Hadoop, HDFS, Map Reduce, HBase, Hive, PIG, Zookeeper, Sqoop, Hue, and /or Ruby, GIT, Eclipse, Cloudera-desktop and SVN

Java Tools: Java, Map Reduce, J2EE (JSP, Servlets, EJB, JDBC, JMS, JNDI, RMI), AJAX, XSLT, HTML, JavaScript, CSS, Ant, Junit, log4J, JAVA, C#,JSP,JSF, JSON, J2EE, Web Services, taglibs, CSS,DHTML, Java script 2.0,CSS,Ajax,DOM,SAX,Jquery,XML,XSLT

Databases: Oracle 11g/10g, SQL Server 2008 R2/2005, DB2 9.x

Frameworks: Struts 1.x/2.x, Spring 3.0/2.5 and Hibernate 3.5/3.0

No SQL Databases: HBase, Cassandra

Development Tools: Eclipse, ERWIN, TOAD, MS Project

Application and Web Servers: WebSphere Application Server 5.x/6.x/7.x, BEA-Weblogic Application Server 9.x/10.x, JBOSS Application server 5.1/6.0 and Tomcat 6.0/7.0

Others: Solr / Lucene, UNIX Shell Scripting, RAD, RSA, Ant Tool, 2008, Toad, UML and Rational Rose

PROFESSIONAL EXPERIENCE

Confidential

Sr Hadoop Developer

Responsibilities:

  • Developing parser and loader map reduce application to retrieve data from HDFS and store to HBase and Hive.
  • Dumped the data using Sqoop into HDFS for analyzing.
  • Written Map Reduce java programs to analyze the log data for large-scale data sets.
  • Involved in using HBase Java API on Java application.
  • Automated all the jobs for extracting the data from different Data Sources like MySQL to pushing the result set data to Hadoop Distributed File System.
  • Customize parser loader application of Data migration to HBase.
  • Developed Pig Latin scripts to extract the data from the output files to load into HDFS.
  • Developed custom UDFS and implemented Pig scripts. implemented Map Reduce jobs using Java API and PIG Latin as well HIVEQL
  • Participated in the setup and deployment of Hadoop cluster
  • Hands on design and development of an application using Hive (UDF).
  • Responsible for writing Hive Queries for analyzing data in Hive warehouse using Hive Query Language (HQL).
  • Provide support data analysts in running Pig and Hive queries.
  • Involved in HiveQL.
  • Involved in Pig Latin.
  • Importing and exporting Data from Mysql/Oracle to HiveQL Using SQOOP.
  • Importing and exporting Data from Mysql/Oracle to HDFS.
  • Configured HA cluster for both Manual failover and Automatic failover.
  • Designed and built many applications to deal with vast amounts of data flowing through multiple Hadoop clusters, using Pig Latin and Java-based map-reduce.
  • Specifying the cluster size, allocating Resource pool, Distribution of Hadoop by writing the specification texts in JSON File format.
  • Creates a Solr schema from the Indexer settings
  • Implemented SOLR index cron jobs.
  • Experience in writing SOLR queries for various search documents
  • Responsible for defining the data flow within Hadoop eco system and direct the team in implement them.
  • Exported the result set from Hive to MySQL using Shell scripts.
  • Developed HIVE queries for the analysts.

Environment: Big Data Apache Hadoop, Hive, Hue Tool, Zookeeper, Map Reduce, Sqoop, crunch API, Pig 0.10,HCatalog, Linux (Red Hat 5.1), Git, Java, JSP, JSF, Eclipse, Maven, Python, Solr / Lucene, J2EE, PHP, SQL, HTML, XML, XSLT, XQuery, DHTML, Oracle, MS SQL Server, MYSQL, Ajax/JavaScript, JSON & web services API

Confidential

Hadoop Developer

Responsibilities:

  • Importing and exporting data into HDFS and Hive using Sqoop
  • Responsible to manage data coming from different sources
  • Involved in loading data from UNIX file system to HDFS
  • Installed and configured Hive and also written Hive UDFs
  • Involved in creating Hive tables, loading with data and writing hive queries
  • Implemented nine nodes CDH3 Hadoop cluster on Red hat LINUX.
  • Implemented best income logic using Pig scripts.
  • Managed and Reviewed Hadoop log files
  • Extended Hive and Pig core functionality by writing custom UDFs.
  • Define HBase table schema and develop map reduce jobs to migrate bulk data in Oracle DB to HBase
  • Creates a Solr schema from the Indexer settings
  • Search is being done by Apache Solr and is integrated with portal front-end.
  • Implemented SOLR index cron jobs.
  • Analyzed data using Pig Latin, HiveQL, HBase and custom MapReduce programs in Java
  • Wrote SOLR queries for various search documents
  • Develop JUnit test cases to increase code coverage and validate the data in HBase tables with the expected value and column family group.

Environment: Big Data Apache Hadoop, Hive, Zookeeper, Map Reduce, Sqoop, Pig, Linux, Java, J2EE,JSP,JSF, Eclipse, Maven, J2EE, SQL, HTML, XML, XSLT, Oracle, MYSQL, Ajax/JavaScript, Solr / Lucene, JSON & web services API

Confidential

Sr. Java developer

Responsibilities:

  • Identified and analyzed the user requirements and design, development, testing and deployment.
  • Responsible for creating artifacts like class diagrams, sequence diagrams, use case diagrams for all the use cases.
  • Involved in Lifecycle development on business tier of large scale complex SOA based application
  • Used Confidential RAD in developing UCMS components.
  • Used Hibernate mappings to persist.
  • Used Site minder authentication with LDAP to communicate with third party managers.
  • Developed Team Tasks pages for the team supervisor that shows the list of invalid reports associated with their tasks and let the supervisor assign the tasks to the knowledge workers.
  • Configured active directories to provide authentication for portal applications.
  • Used JET tool to generate hbm, java classes.
  • Involved in designing the user interfaces using JSP, JavaScript.
  • Used Mediator design pattern to apply business logic associated with the business rules and Spring Dependency Injection (DI) to load components and configured them in spring configuration files.
  • Developed Custom Validations using Apache Validation Framework.
  • Developed the application using EAD4j (Enterprise Application Development frameworks for Java) Framework that leverages classical Model View Layer (MVC) architecture.
  • Implemented Core Java.
  • Used JavaScript for form submits and reloads.
  • Involved in applying accessibility and implementing section 508.
  • Used XML Parser for Building the XML Documents.
  • Used Web Services using SOAP.
  • Developed Triggers and Stored Procedures using PL/SQL.
  • Performed unit testing using JUnit.
  • Used Clear Case for version control.
  • Worked closely with deployment teams during testing and production deployments of the application.

Environment: RAD 7.0, Spring DI, Hibernate 3.0, Web sphere Process Server,WebServices, WebSphere Application Server 6.0, Java 1.5, JSP 2.0, JavaScript, XML, XSL,Oracle 10g, Clear Case versioning, Clear Quest, JET Tool, EAD4J,EJB(Message Driven Beans), Confidential MQ Series.

Confidential

Sr. Java Developer

Responsibilities:

  • Developed UI Portlets for Employee Direct Billing and OLS application.
  • Added users to global groups based on roles using Portal API and Implemented Users Profile Information
  • Developed Commission structure creation UI Portlets and deployed into ALUI Portal
  • Upgraded ASP Gadgets to .NET Portlets and Provided Portal administration support
  • Responsible as a Lead developer in the development next generation J2EE application that manages interactions of processes and Essbase server.
  • Complete ownership of developing message handling framework along with a simple UI to manipulate the messages using JSF.
  • Independently built the database layer using Hibernate and Developed core functionality of the product.
  • Built a unique test harness for java interface using Junit Application: Analytic Provider Services JAVA, XML, Servlets, Tomcat, SAP, OBIEE, Web Services, Web Logic, JDBC
  • Led the team with the architecture, design, development of various modules in the application, Analytic Provider Services along with handling critical customer issues.
  • Developed portal branding for all the communities
  • Used Oblix core id for Portal SSO
  • Developed Header and Footer portlets based on Global Groups and deployed Online service Community
  • Created Experience definitions for Online service Community and OLS Community
  • Created Global groups on AD/AM, Authentication source, Profile Source and Sync Jobs on Portal
  • Created Experience Rules using Experience Rules Manager and added Groups and Communities
  • Implemented security for portlets, Community Pages and Communities

Environment: Oracle Webcenter User Interaction 10GR3, Publisher, Collaboration, Studio, Analytic server, Filenet, Web methods, Eclipse, Maven,, web Services, ASP,ASP.NET,IDK 6.0,Gadgets,JS6 168, Spring DI, Hibernate 3.0,WebServices, Java 1.5, JSP 2.0, JavaScript, XML, XSL, Oracle 10g, Clear Case versioning, IDK 6.0, .NET Framework 2.0, IIS.60,SITEMINDER SSO,WAS 6.1

Confidential

Java Developer

Responsibilities:

  • Completed up gradation of Plumtree portal 5.0.5 to Oracle Webcenter User Interaction 10grR3
  • Created SQL script for quick resolution to the date issue as a utility useful for upgrade to Oracle Webcenter User interaction
  • Configured Search index and automation server, Tomcat and Weblogic application server, performance tuning and load balancing servers
  • Developed Admin utilities and Tested performance testing using Load Runner
  • Upgraded GDK Portlets to IDK Portlets and Customized Peoplesoft framework
  • Implemented SAP with JCO JAVA connector
  • ALBPM is used to design, orchestration and implement the business processes which are used in the Product delivery to the customers, All the Process are designed and developed using the Aqualogic Studio tool and deployed in the Aqualogic User Interaction Portal
  • Designed and Implementation of ALUI portal integration with ALBPM
  • Developed custom news templates using adaptive tags and style sheets for different branding
  • Migrated all the custom portlets written in JSP, JSF, Java, PHP and ASP. Migration involved deployment of the custom code, bug fixing and APIs changes for the portlets to be compatible with the new environment.
  • Developed up gradation Utility tools Advanced UI Customization: PEIs, Custom Activity Spaces, Pluggable Navigation, Custom crawlers and Custom Tags
  • Developed and Configured WSRP portlets and RSS portlets, custom publisher templates and Friendly urls and Collaboration Projects
  • Configured User Activities, User Status Portlets, Studio Portlets, Active Directory and Profile Source
  • Delivering services and support to all Confidential portal customers, which includes end users and community owners,
  • Upgrading custom branding 5.0.5 to 10gR3 using Adaptive Tags, CSS.
  • Developed custom branding using Adaptive Tags and layout using Adaptive layout tags
  • Created run search index and troubleshoot Jobs and performed routine Portal maintenance, Users and Groups in the Portal Set up Activity Rights for users
  • Configured Web Services, Authentication with ACTIVE DIRECTORY, and User Profile Web Service
  • Understand all of the content management objects in the Portal
  • Created Crawler to allow access to external content through the Portal
  • Maintain Portal content and its search index and documentum crawlers
  • Implemented Portal best practices

Environment: Content Service for Windows Files 10g R3, BEA-AquaLogic Interaction 6.5,BEA-AquaLogic Interaction Development kit(6.0, 5.4, 5.3), BEA-AquaLogic Interaction Collaboration 4.2 MP1, BEA-AquaLogic Interaction Publisher 6.4, and 2003, AJAX, Java Script, CSS, DHTML, HTML, Eclipse SDK 3.1.1, RAD,RSA, Tomcat 6.1, Windows Server 2003 SP2, MS SQLServer 2000, Apache-ant-1.6.1

Confidential

Sr. Java Developer

Responsibilities:

  • Upgraded custom Navigation 5.0.5 to 6.1 MP1 using Customization installer
  • Developed adaptive portlets using IDK in .NET Framework
  • Portal orphan object cleanup utility developed using IDK Remote API
  • Developed Content server HTML News Portlet
  • Developed Links and References Portlet using IDK API
  • Created Users and Groups in the Portal Set up Activity Rights for users.
  • Configured Web Services. AD Authentication Web Service and User Profile Web Service and Crawler to allow access to external content through the Portal
  • Understand all of the content management objects in the Portal
  • Created Crawler to allow access to external content through the Portal
  • Developed Portal Jobs Failed Notification script using Portal API
  • ALUI Portal Setup user permissions to portal development services

Environment: Eclipse SDK 3.1.1Java, JSP, Windows Server 2003 SP2, MS SQL Server 2000, 2005, Apache-ant-1.6.1

Confidential

Sr. Portal Developer

Responsibilities:

  • Installation of plumtree Corporate Portal 5.0.4, Collaboration Server 4.2,SQL Server 2000 version,Weblogic Application Server 8.1
  • Developed portlets using Portal Server API and EDK API
  • Created folder filters and using them in crawlers
  • Developed external operations to automate manual processes and to complete missing functionality from the portal, portlets using Publisher API
  • Developed Collaboration portlets using collaboration API and deployed into portal server and configured studio server portlets
  • Created Remote Server, Webservices and portlets
  • Involved in creation of admin objects

Environment: Plumtree Enterprise 5.0.2, 5.0.4, Collaboration server 4.2, Content Server, ‘Weblogic portal 8.x,Java, JSP, JDBC, Struts Framework, JWSDP,JMS-TIBCO EMS4.1.0, Web Services 1.1, Java Script, JUnit, Oracle 9i, SQL Server, Weblogic 8.1,Tomcat 4.x, SUN Solaris, Windows 2003, IE 6.x,java, Eclipse SDK 3.1,Toad.

Confidential

Plumtree Portal Developer and Administrator

Responsibilities:

  • Content Server Administration
  • Collaboration Server Administration
  • Job Server administration
  • Portal administration
  • Search Server administration
  • Resolved the problem tickets and created the task tickets
  • Portal User Account Issues
  • Portlet / Community problems
  • Created Community templates / Page Templates
  • Community creation
  • Customized portlets development and Publisher templates development
  • Created Template based Plumtree Content Server Use Case Portlets setup user permissions to portal development services setup user access to community management setup users to access right community
  • Java portlet installations

Environment: Plumtree Enterprise 5.0.2, 5.0.4, Collaboration server 4.2, Content Server, C#, ASP.NET, Java, EDK, JSP, J2EE, Oracle 9i, IIS 5.0, 6.0 (.NET 1.1 SP1),SQL Server, Weblogic Application server 8.1,Tomcat 4.x,Windows 2003, sun Solaris, IE 6.x, java, Eclipse SDK 3.1,Toad.

Confidential

Portal Developer

Responsibilities:

  • Specification Study, Technical design for RFC
  • Developed BDC program for Create/Change Sales Views, Foreign Trade for Warranty material and RFC for Claims list.
  • Developed iviews using Java PDK, Sap Portal server, and Eclipse SDK.
  • Created User names, Roles, and assign the Iviews into roles and configured roles, work sets, pages, and iviews
  • Performed configuration, development and administration of Guided procedures and SSO between Portal and backend systems.
  • Customized, Designed iviews and pages.
  • Connected Portal to LDAP, which is used as user repository.
  • Created KM file repositories and KM iviews.
  • Performed portal branding and customization.
  • Involved in the knowledge transfer to in-house staff

Environment: Java PDK, SAP Enterprise Portal, Eclipse SDK, SAP R/3 (Version 4.6C & 4.7), ABAP/4, SAP, JCO 2.0

Confidential

Java Developer

Responsibilities:

  • Involved in System Study
  • Done requirement Analysis,
  • Prototype Development, Database Design, Client Communication,
  • Coding and Unit Testing.
  • The ability to enter cost and sales data and generate a business case for each repair, to enter individual repair data
  • The ability to track the status of repairs, to print predefined reports related to repair data, to add or change user roles and to change or deleted data by authorized users

Environment: Java, Eclipse, ColdFusion JSP, Oracle

We'd love your feedback!