Hadoop Developer / Independent Contractor Resume
Durham, NC
SUMMARY
- 6 Years of extensive experience including two and a half years of BigData and BigData analytics
- Strong Knowledge of Hadoop and Hive and Hive's analytical functions.
- Hands on experience in installing, configuring and using ecosystem components like HadoopMapReduce, HDFS, Hbase, Zoo Keeper, Oozie, Hive, Sqoop,Pig, Flume
- Hands - on experience with "Productionalizing" Hadoop applications
- Hands on Experience in working with ecosystems like Hive, Pig, Sqoop, Map Reduce.
- Efficient in building hive, pig and map Reduce scripts.
- Used Control-M for workload automation
- Implemented Proofs of Concept on Hadoop stack and different big data analytic tools, migration from different databases (i.e Teradata, Oracle, MYSQL ) to Hadoop.
- Successfully loaded files to Hive and HDFS from HBase
- Loaded the dataset into Hive for ETL Operation.
- Good knowledge on Hadoop Cluster architecture and monitoring the cluster.
- Experience in using DBvisualizer, Zoo keeper and cloudera Manager.
- In-depth understanding of Machine learning Algorithms.
- Experience in implementation of Open-Source frameworks like Struts, Spring, Hibernate, Web Services etc.
- Experience in deploying applications in heterogeneous Application Servers TOMCAT, WebLogic and Oracle Application Server.
- Strong Communication skills of written, oral, interpersonal and presentation
- First point of contact for any R&D activities and critical problems.
- Implemented Unit Testing using JUNIT testing during the projects.
- Ability to perform at a high level, meet deadlines, adaptable to ever changing priorities.
- Excellent communication skills, interpersonal skills, problem solving skills a very good team player along with a can do attitude and ability to effectively communicate with all levels of the organization such as technical, management and customers.
TECHNICAL SKILLS
Big Data: Hadoop, MapReduce, HDFS, HBase, Zookeeper, Hive, Pig, SqoopOozie, Flume, ElasticSearch, Weka
Java Technologies: Java 5,Java 6, JAXP, AJAX, I18N, JFC Swing, Log4j, Java Help API
J2EE Technologies: JSP 2.1 Servlets 2.3, JDBC 2.0,JNDI, XML, JAXP, Java Beans
Methodologies: Agile, UML, Design Patterns
Framework: Struts, Hibernate
Database: Oracle 10g, DB2,MySQL
Application Server: Apache Tomcat 5.x 6.0, Jboss 4.0
Web Tools: HTML, Java Script, XML, DTD, Schemas, XSL, XSLT, XPath, DOM, XQuery
Tools: SQL developer, DB visualize
IDE / Testing Tools: NetBeans, Eclipse
Operating System: Windows. Linux
Scripts: Bash, Python, ANT
Testing API: JUNIT
Workload automation: Control-M
PROFESSIONAL EXPERIENCE
Confidential, Durham, NC
Hadoop Developer / Independent Contractor
Responsibilities:
- Analysis on the existing transformations that happens before loading into database.
- Implemented SessionFlagging logic using Hive Queries and Hive UDF
- Used Sqoop to send the feeds to the partnering teams for analysis.
- Prepared the final table in the WDCC project, which will be used by datascientists for analysis
- Participated in discussion with Clients and other Big Data Consultants on the design implementation
- Helped peers and offshore team during the analysis and development
- Prepared documentation on the logic involved in transformation like fixing the urls,SessionFlagging process in proper format
- Delivered modules on time.
- Prepared Java, Hive UDF Coding Standards for the team to follow .
- Took the responsibility of Integration testing.
- Created job flow for the modules to run through Ctrl-M
- Prepared opdocs for the module
- Took the responsibility of creating and set up of jobs in Ctrl-M
- Successfully ran the WDCC cycle in production.
Environment: Windows XP, Unix
Confidential, Kansas city, KS
Hadoop Developer
Responsibilities:
- Importing and exporting data into HDFS and Hive using Sqoop
- Experienced in defining job flows
- Experienced in managing and reviewing Hadoop log files
- Experienced in running Hadoop streaming jobs to process terabytes of xml format data
- Load and transform large sets of structured, semi structured and unstructured data
- Responsible to manage data coming from different sources
- Supported Map Reduce Programs those are running on the cluster
- Involved in loading data from UNIX file system to HDFS.
- Installed and configured Hive and also written Hive UDFs.
- Involved in creating Hive tables, loading with data and writing hive queries which will run internally in map reduce way.
- Loaded the data into HBase for faster access of large customer base without taking performance hit.
- Gained very good business knowledge on health insurance, claim processing, fraud suspect identification, appeals process etc.
Confidential, RALIEGH, NC
Java/J2EE Developer
Responsibilities:
- Responsible for understanding the scope of the project and requirement gathering.
- Developed the web tier using JSP, Struts MVC to show account details and summary.
- Created and maintained the configuration of the Spring Application Framework (IoC).
- Implemented various design patterns - Singleton, Business Delegate, Value Object and Spring DAO.
- Used Spring JDBC to write some DAO classes to interact with the database to access account information.
- Mapped business objects to database using Hibernate.
- Involved in writing Spring Configuration XML files that contains declarations and other dependent objects declaration.
- Used Tomcat web server for development purpose.
- Involved in creation of Test Cases for JUnit Testing.
- Used Oracle as Database and used Toad for queries execution and also Involved in writing SQL scripts, PL/SQL code for procedures and functions.
- Used CVS, Perforce as configuration management tool for code versioning and release.
- Developed application using Eclipse and used build and deploy tool as Maven.
- Used Log4J to print the logging, debugging, warning, info on the server console.
Environment: Java1.5, J2EE Servlet, JSP, XML, Spring 3.0, Struts 1.1, Hibernate 3.0, Design Patterns, Log4j, CVS, Maven, Eclipse, Apache Tomcat 6, and Oracle 11g.
Confidential
Java/J2EE Consultant
Responsibilities:
- Involved in various phases of Software Development Life Cycle.
- Created UML Diagrams (Class and Sequence) during Design Phase using Visio.
- Used Eclipse 6.0 as IDE for application development.
- Validated all forms using Struts validation framework and implemented Tiles framework in the presentation layer.
- Configured Struts framework to implement MVC design patterns
- Designed and developed GUI using JSP, HTML, DHTML and CSS.
- Worked with JMS for messaging interface.
- Deployed the entire project on WebLogic application server.
- Used AJAX for interactive user operations and client side validations.
- Used XML for ORM mapping relations with the java classes and the database.
- Used XSL transforms on certain XML data.
- Developed ANT script for compiling and deployment.
- Performed unit testing using JUnit.
- Extensively used log4j for logging the log files.
- Used Subversion as the version control system
Environment: Java/J2EE, Oracle 10g, SQL, PL/SQL, JSP, EJB, Struts, WebLogic 8.0, HTML, AJAX, Java Script, JDBC, XML, JMS, XSLT, UML, JUnit, log4j, MyEclipse 6.0
Confidential
Java J2EE Developer
Responsibilities:
- Coded the business methods according to the IBM Rational Rose UML model.
- Extensively used Core Java, Servlets, JSP and XML.
- Used Struts 1.2 in presentation tier.
- Generated the Hibernate XML and Java Mappings for the schemas
- Used DB2 Database to store the system data
- Used Rational Application Developer (RAD) as Integrated Development Environment (IDE).
- Used unit testing for all the components using JUnit .
- Used Apache log 4j Logging framework for logging of trace and Auditing.
- Used Asynchronous JavaScript and XML (AJAX) for better and faster interactive Front-End.
- Used IBM Web-Sphere as the Application Server.
- Used IBM Rational Clearcase as the version controller.
Environment: s: Java 1.6, Servlets, JSP, Struts1.2, IBM Rational Application Developer (RAD) 6, Websphere 6.0, iText, AJAX, Rational Clearcase, Rational Rose, Oracle 9i, log4j.
Confidential
Java Developer - Intern
Responsibilities:
- Involved in development of Care Plans module, which provides a comprehensive library of problems, goals and approaches. You have the option of tailoring (adding, deleting, or editing problems, goals and approaches) these libraries and the disciplines you will use for your care plans.
- Involved in development of General Ledger module, which streamlines analysis, reporting and recording of accounting information. General Ledger automatically integrates with a powerful spreadsheet solution for budgeting, comparative analysis and tracking facility information for flexible reporting.
- Developed UI using HTML, JavaScript, and JSP, and developed Business Logic and Interfacing components using Business Objects, XML, and JDBC.
- Designed user-interface and checking validations using JavaScript.
- Managed connectivity using JDBC for querying/inserting & data management including triggers and stored procedures.
- Developed various EJBs for handling business logic and data manipulations from database.
- Involved in design of JSP’s and Servlets for navigation among the modules.
- Designed cascading style sheets and XML part of Order entry Module & Product Search Module and did client side validations with java script.
Environment: J2EE, Java/JDK, JDBC, JSP, Servlets, JavaScript, EJB, JNDI, JavaBeans, XML, XSLT, Oracle 9i, Eclipse, HTML/ DHTML, SVN.