Big Data Consultant Resume
Parsippany, NJ
SUMMARY
- Over 7 years of IT experience in various Big Data analysis technologies, such as Hadoop, HBase, Pig, Hive etc., and also in software design and development using Java technologies, such as Java, Spring, Eclipse, Tomcat etc.
- Working Experience in variety of development methodologies like Scrum, Agile along with the traditions waterfall, Iterative models.
- Experience working in financial domains like Banking.
- 2 years of experience with Hadoop Ecosystem, including HDFS, Map Reduce, PIG, HIVE and Hbase.
- Experience in working with different frameworks like Cloudera and Horton works.
- Experience in working with Hadoop in stand - alone, pseudo and distributed modes.
- Experience in importing and exporting data from different RDBMS like MySQL, Oracle and SQL Server into HDFS and Hive using Sqoop.
- Experience in developing custom Map-Reduce programs using Apache Hadoop to perform Data Transformation and analysis as per requirement.
- Strong competency in HIVE Schema design, Data imports and Analysis.
- Experience in Design & Development, tuning and maintenance of NoSQL databases.
- Developed applications using open source technologies like Spring MVC, Java Script etc.
- Expertise in writing Spring MVC controllers and corresponding spring injections.
- Expertise in writing web service client applications using Spring Web Services.
- Experience in working with Database SQL Queries.
- Excellent troubleshooting/debugging skills towards the solution.
- Able to work independently as well as with teams within an aggressive and demanding project schedule and environment.
TECHNICAL SKILLS
Operating Systems: Windows,Unix,Linux.
Databases: Oracle8i/9i/10g, My SQL
IDE: Eclipse
Languages: Java, JSP
Web Tools and languages: HTML,XML,CSS,DHTML,JavaScript
Hadoop Technologies: Map-Reduce,Pig,Hive,Hbase,flume,Sqoop,Oozie.
Webservers/Application Servers: Apache Tomcat,IBM WebLogic
PROFESSIONAL EXPERIENCE
Confidential, Parsippany, NJ
Big Data Consultant
Responsibilities:
- Using sqoop to load data from DB2 into HBASE environment.
- Insert Overwriting the HIVE data with HBASE data daily to get fresh data every day.
- Creating various views for HBASE tables and also utilizing the performance of Hive on top of HBASE.
- Using XML to get data and get some new information about the claim using XPATH UDF.
- Using Pig to transform large datasets into required format.
- Actively involved in the decision process of the data flow and utilization.
- Hortonworks 2.0 being used with Hive 0.12 /HBASE 0.94
- Extensively used Map-Reduce to process the available terabytes of data.
- Using HCatalog to create on the fly tables and daily refreshing new data.
- Used PVCS for verision control and maintaining the code.
- Using various Queue Names to give priority to the job being processed.
- The processed data is then provided for various applications consumption.
- Deployed and tested the application on UNIX based environments.
Environment: Hadoop, HBase, Hive, Map-Reduce, DB2, java, XML,, Pig, PVCS, UNIX, HCatalog.
Confidential, UT
Hadoop Consultant
Responsibilities:
- Involved in Writing Map-Reduce Jobs using core Java
- Involved in using Amazon Elastic Map-Reduce(Cloud Computing) for processing the data.
- Responsible in using JSON to get the data and store it on HDFS
- Used Amazon RDS as Database for processing relations
- Used PERL Scripts to perform client Side data validation and manipulation.
- Participated in deployment of Hadoop Clusters into individual nodes
- Extensively used Map-Reduce to process the available terabytes of data.
- Worked on loading the data from MySQL to HBase where necessary using Sqoop
- Using Hbase to store majority of data which needs to be divided based on region.
- Using Hive to query the exported CSV data containing billions of data records.
- Using Oozie to schedule various jobs on Hadoop Cluster.
- Java multi-threaded environment and quartz scheduler.
- Written JUnit and integration tests for the class developed.
- Developed projects using Maven to build and deploy.
- Deployed and tested the application on UNIX based environments.
- Gathered the business requirements from the Business Partners and Subject Matter Experts.
- Utilized Agile Scrum Methodology to help manage and organize the team.
- Weekly meetings with technical collaborators and active participation in code review sessions with senior and junior developers.
Environment: Hadoop, HBase, Hive, Map-Reduce, Eclipse, JUnit, MySQL, java, JSON, maven.
Confidential, Wilmington, DE
Java Developer
Responsibilities:
- Designing and development of spring controllers and corresponding DAO’s.
- Responsible to write the services to invoke the web services
- Developing the presentation layer using Velocity framework.
- Involved in peer design/code reviews to ensure the design/code was compliance with project standards
- Proper version maintenance using GIT.
- Working with Business in the pre-grooming sessions to finalize the requirements.
- Implementing the new business logic in Transite and SASSY(uses XSLT)based on the MSP functionality.
- Functionalities include, Transfer Money, Account History, and Summary etc.
- Follow the Agile developmentprocess throughout the development. i.e. participating in By-weekly sprint planning, daily stand up meetings, sprint reviews, retrospective etc.
- Developing unit/integration tests at all layers (i.e. controller, service and Dao layer) using EasyMock and JUnit.
Environment: Java, Spring 2.5.6, Spring Web services, Oracle, JavaScript, XML, XSLT, velocity, templates, sonar, AHP, Git, JUNIT, EasyMock, SVN, Eclipse, Tomcat, Windows XP.
Confidential
Java Developer
Responsibilities:
- Preparing the design specs for the use cases.
- Designing the Service model and Object models using Rational Rose.
- Developing the presentation layer using JSPs framework.
- Responsible for writing JDBC programming to persist the data in Oracle 9i database.
- Involved in peer design/code reviews to ensure the design/code was compliance with project standards
- Proper version maintenance using Clear Case.
- Troubleshoot and resolve the defects with a quick analysis.
- Providing support for deployment team by resolving the deployment issues w.r.t application.
Environment: Java, J2EE, JSP, Java Script, CSS, HTML, SQL, XML, Oracle 9i, SQL Developer, ANT, JUNIT, Clear Case, Windows XP, UNIX.
Confidential
Software Developer
Responsibilities:
- Responsible for requirement analysis, gap analysis and interacting with the end users for requirement clarifications.
- Customizing the existing features based on the requirements.
- Design and Development of new requirements (JSP, Servlets, EJB, Java Script, HTML).
- Development of Internet Banking interface with B@NCS, Retail banking product.
- Development of Internet Banking application with Eximbills, Corporate banking product.
- Deployment of Internet Banking application in Weblogic 7.0
- Used the VSS version manager for merging the existing code.
Environment: Java, J2EE, JSP, XQUERY, Servlets, JDBC, SQL, HTML, JavaScript, XML, Oracle 9i, TOAD, VSS, Visual Age for Java, Windows XP, Weblogic Server 7.0.
