Big Data Engineer Resume
SUMMARY:
- About 10 years of experience in the field of Information Technology, principally in design and development of applications using Big Data technologies, Java, J2EE and Database.
- Experienced in working with layered architectures and enterprise applications.
- Designed and developed applications in Securities, Insurance, Telecom, Business Intelligence and Banking Domains.
- Thorough understanding of software development processes like waterfall and agile methodologies.
- Experienced in designing applications using various design patterns.
TECHNICAL SKILLS:
Programming Languages/Frameworks: Java, J2EE, Struts 2.x, Spring, Hibernate, Ibatis, REST Web Services using Spring Boot, Web Services using Hessian protocol, Maven, Ant, JMS, Python(Basics), Scala(Basics), Junit, Elastic Search
Big Data frameworks: Apache Hadoop, MapReduce, Hive, Sqoop, Hbase, Apache Spark (Core, SQL, Streaming), ML algorithms using python, MRunit, Flume, Mapr - Fs
Database: NoSQL - Hbase, RDBMS - MySQL, Oracle
Application or Web Server: Tomcat
IDE: Eclipse, Spring Source, SQL Developer
Version Control: CVS, SVN, GIT
Rules Engine: Drools
Virtualization/Cloud: VMWare, Oracle Virtual box, Docker, AWS(EC2)
PROFESSIONAL EXPERIENCE:
Confidential
Big Data Engineer
Platform & Skills: Hadoop 2.2.0, Hive 0.13
Responsibilities:
- Provide professional services to clients for Kyvos.
- Convert Sql queries used to generate reports to cube data in Kyvos.
- Configure reports based on cube data.
Confidential
Lead Big Data Engineer
Platform & Skills: Hadoop 2.2.0, Hive 0.13, Hbase 0.98, Apache Spark, Java, Scala, Mapr-Fs
Responsibilities:
- Analyze the given problem statement and participating in design discussions.
- Leading and mentoring a team of four junior engineers.
- Used Spark API over Hadoop YARN to perform analytics on data in Hive.
- Worked on multiple end to end flows using Spark, Hadoop, Hive, and other technologies.
Confidential
Lead Big Data Engineer
Platform & Skills: Java, Hadoop 2.2.0, Hive 0.13, Hbase 0.98, Map Reduce, Drools 6.3.0, Kie Workbench 6.3.0, Elastic Search, Mapr-Fs
Responsibilities:
- Analyze the given problem statement and participate in design discussions like usage of HCatalog, Hbase column design etc.
- Perform research and create POCs for usage of technologies like MapReduce vs Spark for delivering an optimal solution considering the performance aspects.
- Creation of end to end project flow along with MRUnits.
Confidential
Lead Big Data Engineer
Platform & Skills: Java, Spring Boot 1.2.2.RELEASE, Hadoop 2.6.0, Hive 1.2.1, Impala 2.2.0, Sqoop 1.4.5, Activiti 5.19.0., Amazon EC2
Responsibilities:
- Analyze the given problem statement and participate in design discussions.
- Research and explore technologies and algorithms that help in arriving at an optimal solution.
- Used Hive to write SQL queries. Implemented Partition and Query Optimization.
- Workflow contains Sqoop ETL process, Hive scripts.
- Mentoring new team members to explain the relevant technologies.
Confidential
Senior Member Technical Staff
Platform & Skills: Core Java, J2EE, JSP, Servlets, XML, Web services, JDBC, Oracle 10g, Window, Maven
Responsibilities:
- Designing and developing architectural solutions.
- Providing production support on critical issues.
- Ensuring the deliveries are done within the time lines.
- Mentoring the new team members to explain the relevant technologies.
Confidential
Senior Software Engineer
Platform & Skills: CCXML, Java/J2EE (JMS/ActiveMQ, Struts 2, Spring), Web Services (using Hessian protocol), Ibatis, Oracle 11g, Maven build, Tomcat, Protocols like SMPP, MM7, SMTP
Responsibilities:
- Module Leader of Notification Server and VMS Server.
- Products overtake from Nanjing, China.
- Coding: Development and Unit testing of Java/J2EE, PL/SQL code. Development of code to work in a distributed environment to deposit mails and to interact with third party SMSC, MMSC and Email servers.
- Design: Creating low level design documents.
- Mentoring.
Confidential
Software Engineer
Platform & Skills: Java/J2EE (Struts 2, Spring), Hibernate, Oracle 11g, Maven build, WebSphere.
Responsibilities:
- Project inception at client site (Sydney, Australia).
- Coding and unit testing.
Confidential
Software Engineer
Platform & Skills: Java/J2EE (Struts 2, Spring), Hibernate, Oracle 11g, Maven build, WebSphere, Windows, Linux.
Responsibilities:
- Module lead for ‘Premium Coverage’ module.
- Coding and unit testing: Functionality to calculate premiums based on customer’s modified policy data.
- Mentoring.
Confidential
Software Engineer
Platform & Skills: Java/J2EE (Struts1), JDBC, Oracle 9i, Maven build, Tomcat, Windows.
Responsibilities:
- Coding and unit testing: Functionality to add/edit customers and funds details.
