Big Data Analyst Resume
SUMMARY
- Over 6 years of experience in software development.
- Experience in developing Map Reduce Programs using Apache Hadoop for analyzing the big data as per the requirement.
- Experienced on major Hadoop ecosystem projects such as HIVE, PIG.
- Good working experience - using Sqoop to import data into HDFS from RDBMS and vice-versa.
- Good knowledge in using job scheduling and monitoring tools like Oozie.
- Experience in developing solutions to analyze large data sets efficiently.
- Extending Hive and Pig core functionality by writing custom UDFs.
- Experience in analyzing data using HiveQL, Pig Latin, and custom Map Reduce programs in Java.
- Strong problem solving skills, good communication, interpersonal skills and a good team player.
- Have the motivation to take independent responsibility as well as ability to contribute and be a productive team member.
TECHNICAL SKILLS
Hadoop/Big Data Technologies: HDFS, Map Reduce, Hive, Pig, Sqoop, Oozie
Programming Languages: Java JDK, HTML, SQL, PL/SQL
Frameworks: Hibernate, Spring, Struts
Operating Systems: Windows, LINUX
Application Servers: IBM Web sphere, Tomcat, Web Logic
Web technologies: JSP, Servlets, JNDI, JDBC, Java Beans, JavaScript
Databases: MySQL, Hive
Java IDE: Eclipse
PROFESSIONAL EXPERIENCE
Big Data Analyst
Confidential
Responsibilities:
- I used Hive, Oozie and shell scripting for day-to-day tasks
- Business Requirement analysis and follow-up with Confidential Marketing teams
- Working with Data ingestion teams for data input.
- Feasibility analysis and coming up with first-cut estimates
- Agile/Sprint Development that covers coding and unit testing
- Productizing the code and releasing it.
- Complete feature testing and sprint demos
Confidential
Environment: AWS, Hadoop, MapReduce, HDFS, Hive, Pig, Java, SQL, Cloudera Manager, Sqoop, Flume, Oozie, Java (jdk 1.6), Eclipse
Responsibilities:
- Developed Simple to complex Map/reduce Jobs using Java
- Optimized Map/Reduce Jobs to use HDFS efficiently by using various compression mechanisms and file formats
- Handled importing of data from various data sources, performed transformations using Hive, MapReduce loaded data into HDFS and Extracted the data from MySQL into HDFS using Sqoop
- Analyzed the data by performing Hive queries to study customer behavior
- Used UDF’s to implement business logic in Hadoop
- Implemented business logic by writing UDFs in Java
- Continuous monitoring and managing the Hadoop cluster using Cloudera Manager
- Using Oozie workflow engine to run multiple Hive and Pig jobs
- Exported the analyzed data to the relational databases using Sqoop for visualization and to generate reports for the BI team
Java/J2EE Developer
Confidential
Responsibilities:
- Responsible for gathering and analyzing requirements and converting them into technical specifications.
- Developed presentation layer using JSP, Java, HTML and JavaScript.
- Used Spring Core Annotations for Dependency Injection.
- Designed and developed Hibernate configuration and session-per-request design pattern for making database. Connectivity and accessing the session for database transactions respectively. Used HQL and SQL for fetching and storing data in databases.
- Participated in the design and development of database schema and Entity-Relationship diagrams of the backend Oracle database tables for the application.
- Implemented web services with Apache Axis.
- Designed and Developed Stored Procedures, Triggers in Oracle to cater the needs for the entire application. Developed complex SQL queries for extracting data from the database.
- Designed and built SOAP web service interfaces implemented in Java.
- Used Apache Ant for the build process.
Environment: Java, JDK 1.5, Servlets, Hibernate, Ajax, Oracle 10g, Eclipse, Apache Ant, Web Services (SOAP), Apache Axis, Apache Ant, Web Logic Server, JavaScript, HTML, CSS, XML
Java/J2EE Developer
Confidential
Responsibilities:
- Developed Features and Enhancements of the ITKO Lisa tool
- Bug fixing during maintenance and sustenance
- Unit testing
- Web Testing using ITKO Lisa
- Demo and POCs with UI of Lisa
Confidential
Responsibilities:
- Involved in the development of JSPs and Servlets for different User Interfaces.
- Used Struts action forms and developed Action Classes, which act as the navigation controller in Struts framework.
- Implemented the template-based categorization of presentation content using Struts-Tiles. MVC implementation using Struts framework.
- Involved in Unit Testing of Various Modules based on the Test Cases.
- Involved in Bug fixing of various modules that were raised by the Testing teams in the application during the Integration testing phase.
- Involved and participated in Code reviews.
Environment: Java, J2EE, XML, XML Schemas, JSP, HTML, CSS, PL/SQL, Junit, Log4j, IBM Web sphere Application Server.
