Hadoop Developer Resume
SUMMARY:
- Having around 10 years of experience in Software Development industry, I have worked on end - to-end Java/J2EE and Big Data projects with widening my scope from the core development to techno-functional role also.
- Strong knowledge in Hadoop Ecosystem including MapReduce, Hive, Pig, Hbase, Hue, Sqoop, Flume, Kafka, Spark, Scala and Oozi.
- Experience in processing data using Map Reduce, Hive/Pig scripts and has experience in writing UDF's based on the requirements.
- Good working knowledge on scheduling jobs using Oozie.
- Used Hue GUI for File browsing, Job browsing for MapReduce, HBase browsing, Query editing Hive, Pig, and Sqoop.
- Expertise in Java applications using Core Java, J2ee, Spring, JSF, Hibernate and Strong working experience in SQL concepts and Oracle.
- Big Data Hadoop Trained and Certified, Simplilearn
- R language Trained, Simplilearn
- Gained experience in developing applications based on MapReduce, Pig, Hive, Spring, JSF technology and framework.
- Won different awards in Confidential for receiving a good customer feedback, showing high flexibility and commitment towards work.
- Have gained good exposure in different domains worked, I have been involved from the requirement analysis, doing the scoping and development of the Project.
SKILL:
Big Data Technologies: Map-Reduce, PIG, Hive, HBase, Spark, Kafka, HDFSYarn, OOzie, Flume, Sqoop, MRUnit, Cloudera Hue Interface, R language
Programming Language: Java, J2EE, Scala, JSF, JSTL, A4j, Web-Services
Scripting Language: Java Script, JSON, JQUERY
Frameworks: Struts, Spring, Hibernate, Jboss Portal, Ant, Maven
Server: Jboss, Jboss-Portal, Web Sphere5.0, Apache
Tomcat: 5.0,Web logic.
IDE Tools: WASD, Net Beans 5.0, Eclipse, Toad, Win CVS.
RDBMS: Oracle, MySQL.
Operating Systems: Win-95, 98, 2K, Xp, Windows NT.
Application Software: MS Office 97, 2K
Web Tools: HTML, Xml, CSS, Ajax, XML DOM, XSLT,XSD
Testing: Junit,Selenium. Versioning Management
System: CVS
PROFESSIONAL EXPERIENCE:
Confidential
Hadoop Developer
Technologies Used: Hadoop, HDFS, Map-Reduce, Hive, Pig, Hbase, Spark, Scala R-Language, JDK 1.6, Oracle, Sqoop, Hue, MrUnit, Log4j, Eclipse IDE, Apache Poi.
Responsibilities:
- Involved in loading data from RDBMS into HDFS using Sqoop.
- Collecting and aggregating large amounts of log data using Apache Flume and staging data in HDFS for further analysis.
- Developed multiple Map Reduce jobs in java for data cleansing and preprocessing.
- Involved in writing pig scripts and hive QL.
- Real time streaming the data using Spark with Kafka.
- Configured Spark streaming to receive real time data from the Kafka and store the stream data to HDFS using Scala
- Documented the systems processes and procedures for future references.
- Involved in creating Hive tables, loading with data and writing Hive queries for data processing and analysis.
- Responsible for moving the data from source (Oracle) to HDFS.
- Gained experience in managing and reviewing Hadoop log files.
- Involved in scheduling Oozie workflow engine to run multiple jobs.
- Responsible for developing data pipeline using flume, Sqoop and Pig to extract the data from weblogs and store in HDFS.
- Involved in code promotion using SVN.
- Used Oozie Scheduler system to automate the pipeline workflow and orchestrate the map reduces jobs that extract the data on a timely manner.
- Worked with Hue GUI in scheduling jobs with ease and File browsing, Job browsing, Metastore management.
- Involved in story - driven agile development methodology and actively participated in daily scrum meetings.
- Actively participated in software development lifecycle (scope, design, implement, deploy, test), including design and code reviews, test development, test automation.
- Extensively used Agile Practices for Iteration Planning, Time Estimation, Development and Delivery.
Confidential
Sr. System Analyst
Technologies Used: JDK 1.6, JSF, Servlets, Spring, HTML, CSS, Java Script, Jboss Server, Oracle(Database), MyEclipse, Junit, Log4j.
Responsibilities:
- Analyzing software specifications and identification of issues with Retail application functionalities for design, development and testing.
- Performing RTB (Run the Business) activities, such as fixing all the Production Defects and development related to new Funds release, IT related issues and bugs that may come up during the production phase. This also includes helping the application users in understanding the application and setting up the environment for them to make the application up and running.
- Providing production support with, timely fixing production problems encountered, performing UI, Mid-Tier level fixes, & troubleshooting issues for business users and business analysts.
Confidential
Team Lead
Technologies Used: JDK 1.5, JSF, HDFS, Map Reduce, Flume, Pig, Hive, Sqoop, Servlets, A4J, JSTL, Spring, SOAP, Web Services, HTML, CSSJava Script, Jboss Server, Oracle(Database), MyEclipse, Junit, Log4j.
Responsibilities:
- Responsible for the development activities at offshore of the Project, doing the designing of the technical flow and review the progress of the team.
- Developed data pipeline using Map Reduce, Flume, Sqoop and Pig to ingest Locomotive data into HDFS for analysis.
- Worked with BigData for the data analysis and created UDFs in PIG and used Sqoop for pushing it to LDM database repository
- Involved in developing and writing Pig scripts and to store unstructured data into HDFS.
- Involved in creating tables in Hive and writing scripts and queries to load data into Hive tables from HDFS..
- Responsible for all the activities from requirement analysis, Quality control and coordination between functional and development team.
- Customer interaction related to project and auditing the bugs and fixes.
- Milestone Tracking, Defect Management, Resource Utilization and Tracking Team Progress
Confidential
Team Lead
Technology Used: XML, XSLT, JUnit, spring, Oracle 9i, JBoss Portal Server, Tomcat, Web-Services.
Responsibilities:
- Responsible for the development activities of the modules assigned, with the team aligned and as per the requirement specifications.
- Responsible for all the activities from requirement analysis, Quality control.
- Customer interaction related to project and auditing the bugs and fixes.
- Milestone Tracking, Defect Management, Resource Utilization and Tracking Team Progress
Confidential
Developer
Responsibilities:
- Responsible for the development activities of the modules assigned, with the team aligned and as per the requirement specifications.
- Responsible for the integration with pay pal, implementation of https and many other application level handling.
- Responsible for all the activities starting from the requirement analysis, designing.
- Responsible for the estimations, done on the component based model.
- Worked on UI Specification sheets and BRD documents.
- Customer interaction related to project.
Confidential
Developer
Technologies Used: JDK 1.5, JSP, Servlets, Struts, Hibernate, HTML, CSS, Java Script, Tomcat 5.5, Web Sphere, Oracle(Database), MyEclipse.
Responsibilities:
- Responsible for the development activities of the modules assigned.
- Involving in system/integration testing
- Ensure that final deliverables confirms to requirements
- Preparing Technical specifications
Confidential
Developer
Technologies Used: JDK 1.4, JSP, Servlets, Struts, Ajax, Hibernate, HTML, CSS, Java Script, Tomcat 5.5, Web Logic, Oracle(Database), MyEclipse, SiteBulder, Interwoven, XML, Siebel, SAP.
Responsibilities:
- Responsible for the development activities of the modules assigned.
- Preparing technical specifications
- Unit testing of the developed modules
- Participating in release management
- Participating in Integration testing
Confidential
Developer
Technologies Used: JDK 1.4, JSP, Servlets, HTML, CSS, Java Script Tomcat 5.5, Web Logic, Oracle(Database), Net Beans5.0. Interwoven, Ajax, XML, Lucene Search Engine, open-deploy.
Responsibilities:
- Responsible for the development activities of the modules assigned.
- Participating in release management
- Involved in DD preparation and Coding Phases.
- Unit testing of the developed modules