We provide IT Staff Augmentation Services!

Sr. Hadoop Engineer Resume

SUMMARY:

  • Having 10+ years of IT experience in developing, delivering of software using wide variety of technologies in all phases of the development life cycle. Expertise in Java and Hadoop technologies as consultant, proven ability in project based teamwork and good communication skills.
  • Very Strong Object - oriented concepts with complete software development life cycle experience - Requirements gathering, Conceptual Design, Analysis and Detail design, Development, Mentoring, System and User Acceptance Testing.
  • Strong knowledge of Java with experience ranging from introduction of version 1.3, adoption of version 1.6 and commitment to use SWING for component architecture of product interface.
  • Hands-on development and implementation experience in Big Data Management Platform (BMP) using Hadoop, MapReduce, Hive and other Hadoop related eco-systems as a Data Storage and Retrieval systems.
  • Good experience installing, configuring, testing Hadoop eco system components.
  • Highly knowledgeable in Writer Comparable, Writer interfaces, Mapper and Reducer abstract classes, Hadoop Data Objects such as IntWritable, ByteWritable, Text objects.
  • Well-experienced Mapper, Reducer, Combiner, Partitioner, Shuffling and Sort process along with Custom Partitioning for efficient Bucketing
  • Experience in supporting data analysis projects using Elastic Map Reduce on the Amazon Web Services (AWS) cloud. Exporting and importing data into S3.
  • Hands on experience in developing numerous Multi-tier Java, J2EE (JSP, Jakarta Struts Framework, Servlets, Spring, RMI) components including Business Components (EJB), Presentation Tier components (JSP, Struts Tag Libraries, Custom Tag Libraries, HTML, DHTML, Tiles, Jakarta Struts and Struts Validator Framework and Servlets), Resource Tier components (JDBC) and Persistent Object Components using Hibernate and DAO.
  • Extensive experience as a software engineer for clients in the Pharmaceutical, LIMS, Banking, Financial, Web and Product Domain.
  • Expertise in development of application using Java Swings including Look & Feel, Drag & Drop, Layout Management and writing Swing Custom components.
  • Hands on experience in Agile and Scrum methodologies.
  • Extensively development experience in different IDE’s like Eclipse, NetBeans, Forte and STS.
  • Experience in developing Apache Axis WebServices.
  • Highly proficient in XML technology and working with numerous DOM and SAX parsers and XSLT for transforming the XML.
  • Extensively used J2EE design and Java patterns like Model View Controller (MVC in Struts and Spring), Business Delegate, Session facade, Service Locator, Data Value Objects, Data Access Objects, Singleton, Factory patterns.
  • Experience in writing JUnit in test driven development.
  • Experience in developing and deploying applications using Ant Scripts in any BEA Weblogic, JBoss and Apache Tomcat servers.
  • Expertise in relational databases like Oracle, My SQL.
  • Excellent analytical, problem solving and communication skills.
  • An innovative team player proven to work under tight deadlines, Adaptable to new software technologies, quick learner and also can work efficiently as an individual.
  • Experience in different domains like LIMS, e-Commerce, Sales and Finance.
  • Extensive experience in working with the Customers to gather required information to analyze, debug and provide data fix or code fix for technical problems, build service patch for each version release and unit testing, integration testing, User Acceptance testing and system testing and providing Technical Solution documents for the Users.

TECHNICAL SKILLS:

Eco Systems: Hadoop, MapReduce, HBase, Hive, Pig, HDFS, Zookeeper, Sqoop, Cassandra, Apache Crunch, Oozie and Flume

Languages: Java, C, C++, SQL, PL/SQL

J2EE Technologies: Servlets, JSP, JSTL, JDBC, Spring2.5, Struts1.1/1.2.2, LOG4J, JUnit, EJB 3.0

Middleware: Hibernate 3.0

API: Java Swings, Look & Feel, Layout Management, Drag & Drop, Event Handling, Reflections, Multi Threading and Concurrency

Oracle 8i/9i/10g, MySQL, MS: Access

Web Technologies: JQuery, Applets, JavaScript, CSS, HTML, XHTML, AJAX, XML, XSLT

Web Services / Messaging: JMS, SOAP 1.1, UDDI, WSDL, Web Services, Apache Axis.

Web/Application Servers: BEA WebLogic 7.0/8.1, IBM WebSphere 6.0, Tomcat 4x/5x, JBOSS 4.2.3

IDE Tools: Eclipse 3.3, Eclipse RCP, NetBeans 6, STS 2.0, Editplus

Design Methodologies: UML, Rational Rose

Version Control Tools: CVS, SVN

Operating Systems: Windows XP/2000/NT, Linux, UNIX

Tools: Ant, Maven, TOAD, AgroUML, WinSCP, Putty, Lucene

PROFESSIONAL EXPERIENCE:

Confidential

Sr. Hadoop Engineer

Responsibilities:

  • Developed utilities using MapReduce extensively to read data and process data from multiple sources using custom input formats and custom record readers.
  • Developed MapReduce to convert EBCIDIC to ASCII format.
  • Developed MapReduce to generate unique key across the loan records.
  • Developed MapReduce to convert Avro format Files to Fixed length ASCII files.
  • Developed multiple Reduce jobs for data normalization.
  • Used Pig Latin to apply transformations on System of Record.
  • Developed Pig scripts and UDF’s extensively for Value Added Processing (VAPS).
  • Design and developed Custom Avro Storage to use in Pig Latin to Load and Store data.
  • Actively involved in design analysis, coding and strategy development.
  • Developed Sqoop commands to pull data from Teradata and push to HDFS.
  • Developed Hive Scripts for implementing dynamic partitions and Buckets for retail history data.
  • Streamlined Hadoop jobs and workflow operations using Oozie workflow and scheduled through AutoSys on a monthly basic.
  • Designed and developed read lock capability in HDFS.
  • Developed hive scripts for implementing control table logic in HDFS.
  • Planned and implemented application migration to New Hadoop Hardware.
  • Identifying upstream and down stream dependencies.
  • Deployment plan across the different applications (products)
  • Identifying Hadoop Configuration changes.
  • Identifying connectivity requirements.
  • Integrated test plan across the applications.
  • Data validation between current and new cluster.

Environment: Java 1.6, Hadoop, Map Reduce, Pig Latin, Hive, Sqoop, Oozie, Eclipse, JUnit, Log4j, Windows and Linux, Scrum.

Confidential

Sr. Software Engineer

Responsibilities:

  • Developed Map Reduce to process VOD and ODOL Events.
  • Developed Metadata Generator, which reads the Episodes, Series, Movie and VOD entity feeds and produces a single metadata file using Map Reduce.
  • Created HBase tables to load large sets of structured, semi-structured and unstructured data coming from VOD and ODOL.
  • Developed MapReduce to write User Profiles and Personalized Recommendation data into HBase.
  • Involved in architecture design and application development.
  • Performance tuning for infrastructure and Hadoop settings for optimal performance of jobs and their throughput
  • Involved in Hadoop Data pipelines setup from scratch including design and implementation.
  • Used SOLR to index metadata to generate recommendations based on content for each asset (Movie / Series).
  • Created SOLR queries to generate MoLT.
  • Automated Azkaban Jobs, which provides a web-based console to schedule and monitor Hadoop pipelines, as well as run any other processing tasks, required.
  • Involved in product life cycle developed using Scrum methodology.
  • Build and Deployment
  • Design and developed ant scripts to build the application.
  • Automated application deployment using shell scripts to deploy in Development, SIT, UAT and Production.
  • Managing the version control for the deliverables by streamlining and re-basing the development streams of the SVN.
  • Hadoop Installation
  • Mechanized Hadoop stack deployments from scratch across multiple nodes.
  • Setup/Install Hadoop on 12 Physical nodes.
  • Mentoring Team
  • Involved in mentoring team in technical discussions and Technical reviews.
  • Involved in code reviews and verifying bug analysis reports.

Environment: Java 1.6, Hadoop, Map Reduce, HBase, Couch Base, Azkaban, SOLR, JAXB, Eclipse, JUnit, Log4j, Windows and Linux, Scrum.

Confidential, MD

Sr. J2EE Developer

Responsibilities:

  • Evaluated of High Level Designs and use cases given.
  • Developing Web Application, Administration and Service Management modules on Spring and EJB. Spring is used for dependency injection.
  • Designed and developed the communication between Spring beans and EJB (Stateless Session beans).
  • Designed and developed the front-end with Spring MVC framework, Tag libraries and Custom Tag Libraries and development of Presentation Tier using JSP pages integrating AJAX, Custom Tag’s, JSP TagLibs, HTML, JavaScript and JQuery.
  • Used Java-J2EE patterns like Model View Controller (MVC), Business Delegate, Session façade, Service Locator, Data Transfer Objects, Data Access Objects, Singleton and factory patterns.
  • Exposed EJB’s as web services and deployed web services in JBoss Application server in development and testing environment.
  • Used Hibernate to develop persistent classes following ORM principles.
  • Developed Hibernate configuration files for establishing data base connection and Hibernate mapping files based on POJO classes.
  • Involved in the design and development of Business Tier using Service Beans (Stateless EJB’s), DAO’s (Data Access Objects), Data Access Layer using Hibernate.
  • Deployed spring configuration files such as application context, application resources and application files.
  • Design and developed Maven scripts to build and deploy the application in JBoss 4.2.3.
  • Managing the version control for the deliverables by streamlining and re-basing the development streams of the MS Visual Source Safe.
  • Involved in product life cycle developed using Scrum methodology.
  • Configured JBoss in Linux and deploying application.
  • Involved in unit testing of web services for generated WSDL using WSDL Browser.
  • Involved in mentoring team in technical discussions and Technical review of Design Documents.
  • Involved in code reviews and verifying bug analysis reports.
  • Involved in Approval of SDD’s and Module completion reports submitted by team.

Environment: Java 1.5, J2EE, OOA, OOD, Spring, Hibernate, EJB 3.0, JQuery, Custom Tags, JSP, HTML, XML, XSLT, DHTML, AJAX, CSS, JavaScript, Web Sphere 6.0, JAXB, Eclipse, JUnit, Log4j, Oracle, Windows and Linux, STS 2.0 (IDE), Scrum.

Confidential, NC

Sr. J2EE Developer

Responsibilities:

  • Evaluated of High Level Designs and use cases given to us by the client.
  • Developing Proposal Management Web Application on Spring and EJB and Spring is used for dependency injection.
  • Designed and developed the front-end with Swings and Spring MVC framework, Tag libraries and Custom Tag Libraries and development of Presentation Tier using JSP pages integrating AJAX, Custom Tag’s, JSP TagLibs, HTML, JavaScript and JQuery.
  • Swings and EJB used to implement management screens with MVC architecture and Session Facade, coding involves writing Custom components, Action Classes, Data classes, hibernate mappings and EJB.
  • Developed management forms with Plastic Look & Feel, Table Layout, Drag and drop functionality of Tree nodes.
  • Used Java-J2EE patterns like Model View Controller (MVC), Business Delegate, Session façade, Service Locator, Data Transfer Objects, Data Access Objects, Singleton and factory patterns.
  • Used Hibernate to develop persistent classes following ORM principles.
  • Developed Hibernate configuration files for establishing data base connection and Hibernate mapping files based on POJO classes.
  • Involved in the design and development of Business Tier using Service Beans (Stateless EJB’s), DAO’s (Data Access Objects), Data Access Layer using Hibernate.
  • Deployed spring configuration files such as application context, application resources and application files.
  • Design and developed Maven scripts to build and deploy the application in JBoss 4.2.3.
  • Managing the version control for the deliverables by streamlining and re-basing the development streams of the MS Visual Source Safe.

Environment: Java 1.5, J2EE, OOA, OOD, Spring, Swings, Hibernate, EJB 3.0, Custom Tags, JSP, HTML, XML, AJAX, CSS, JavaScript, JBoss 4.2.3 GA, JAXB, Eclipse 3.4, Log4j, Oracle, Windows and Linux.

Confidential

Developer

Responsibilities:

  • Designed the application using Session Façade Design Patterns, Swing Components, Hibernate, Data Access Object
  • Designed and developed several EJB’s
  • Designed and Implemented management screens with MVC architecture using Swings, coding involves writing Custom components, Action Classes, Data classes, hibernate mappings and EJB
  • Developed Proxy classes to access business logic components
  • Involved in the development Bean factory to lookup for remote bean which helps proxy class for to access business components.
  • Installed and configured JBoss 4.2.3 in Development and Testing environment
  • Designed, developed and deployed necessary stored procedures
  • Involved in working with J2EE Design patterns (Singleton, Service Locator and Session Facade) and Model View Controller Architecture (Swings).
  • Involved in resolving System Testing, UAT and Production Issues for the Management Modules.

Environment: Java, J2EE, Swings , Hibernate 3.0, Eclipse 3.3, JBoss 4.2.3, Oracle 9i, Windows 2000 .

Confidential

Developer

Responsibilities:

  • Developed Management forms on RCP.
  • Experienced usage of Singleton Proxy design pattern.
  • Coding and code reviews.
  • Building Installers and involved in Code Integration.
  • Assisted in the testing phase of project (development testing, unit testing, System testing and integration).
  • Involved in writing hibernate mappings and Data classes.
  • Participated in the Client call to get more clarity on the requirements and changes.

Environment: Java 1.4, Swings , Hibernate 3.0, Eclipse 3.2 RCP, Oracle, Windows 2000.

Confidential, MD

Developer

Responsibilities:

  • Developed dynamic content of presentation layer using JSP.
  • Experienced in web application development using Edit Plus .
  • Deployed the application on Tomcat.
  • Assisted in the testing phase of project (development testing, unit testing, System testing and integration).
  • Involved in Writing Controller Classes, Value Objects and Dao Classes Using MVC Framework.
  • Participated in the Client call to get more clarity on the requirements and changes.

Environment: Java 1.4, Servlet 2.4, JSP, Eclipse Lomboz, Oracle, Tomcat 4.1 and Windows 2000 .

Hire Now