We provide IT Staff Augmentation Services!

Senior Bigdata Engineer Resume

Chicago, IL

SUMMARY:

  • Over 13 years of strong experience in Software Analysis, Design, Development, Implementation and Testing of Object Oriented Applications and Web based Enterprise Applications using Java/J2EE on Windows and UNIX platforms for Retail and Travel Domains.
  • Out of 13 years, last 5 years I have been working on Big data projects
  • Expert in Core Java, J2EE enterprise technologies - including Servlets, JSP, JDBC, Struts , Spring , Hibernate , JAXP (DOM and SAX), XPath, JDOM and web client technologies - including JSF , AJAX, HTML, CSS, and JavaScript .
  • Have experience in developing Map reduce program to store and analyze big data
  • Have experience in Spark - Big data analytics tool and Cassandra.
  • Have very good experience on Machine Learning algorithms like Random forest, Logistic regression, Kmeans
  • Extensive experience in writing Java Web Services using SOA , Restful, JAX-RPC, JAX-WS, SOAP, WSDL, UDDI .
  • Experience in developing fast and optimized SQL queries, stored procedures, functions, triggers using DB2, Oracle, Informix and comfortable using other open source databases like MySQL .
  • Extensive knowledge in general object-oriented design principals and concepts including design patterns like Model-View-Controller, Singleton, Front Controller, Business Delegate, Data Access Object and Transfer Object.
  • Extensive experience in full application development and software product lifecycle including Requirement gathering, Analysis, Design, Implementation, Testing (Unit/Integration), Release and Technical documentation.
  • Experience in using logging libraries like Apache Commons Logging and Log4j.
  • Have experience in build and deployment ativities.
  • Experience in using Rapid Application Development (RAD) environments like Eclipse and Net beans IDE and version control systems like Subversion , ClearCase , VSS and CVS.
  • Experience in training, motivating and mentoring onsite and offshore junior developers.
  • Strong organizational and management skills with excellent verbal and written communication and interpersonal skills.

TECHNICAL SKILLS:

Language/Technologies: Java 1.5, J2EE Suite, JSP, Servlets, EJB 3.0, JAXB, JDBC, JMS, Hadoop, Map Reduce, Apache Spark, Cassandra, Python, SCALA, Databricks Spark, Groovy, Apache Kafka, Gradle, Lombardi BPM, AWS, Apache HBASE

Web Technologies: JSF, AJAX, XSLT, X/HTML, JavaScript, CSS

Framework: Adobe Flex, Struts, Spring, Hibernate/JPA.

Database Technologies: SQL, PL/SQL, Store Procedure, Apache Cassandra, PostgreSQL, MySQL

RDBMS:: DB2

Application Servers: Tomcat 6, WebSphere Application Server 6.0

Operating Systems: Windows NT/2000, HP UNIXIDE/Modelling Tools: MS Visio, Rational Rose, Rational Application Developer (RAD), WSAD, Eclipse, Edit Plus, JProbe, Find Bugs

Version Control: Sub version, Clear case, Maven, VSS, GIThub

Unit Testing Tools: Junit,Mockito,PowerMock

Database Tools: IBM DB2 Client SQL Developer, TOAD, DB Visualizer.

Analysis/Design: J2EE Design Patterns, MVC Pattern, UML.

SOA: Web Services, JAX-RPC, JAX-WS, SOAP, WSDL, XSD, UDDI, XML, REST API

Methodologies: Waterfall, Agile, Extreme programming

Performance Testing Tools:: JMeter

PROFESSIONAL EXPERIENCE:

Confidential, Chicago, IL

Senior Bigdata engineer

Responsibilities:

  • Gathering the requirements from the business users and performing the requirement analysis.
  • Designing the applications module based on the finalized requirements from the business user and covert the design into the high level design document.
  • Experience in leading a Team technically and assigning the tasks to the team and updating the development and the testing status to the manager day by day basis.
  • Coordinating, Planning & Executing the System Development Life Cycle.
  • Involved in designing the data model in Hive and HBase
  • Created scripts to ingest data to Hbase from Oracle and Mysql
  • Design and develop Hadoop Map reduce programs
  • Created the Hadoop MR units for all the Map reduce programs
  • Created Shell scripts and HQL queries for data preparation from different source
  • Created SQOOP jobs to import data from Oracle
  • Design and create the feature list and the data frames required for the Machine learning algorithm from the dataset for the predictive analytics
  • Live streaming data from Kafka topic were read which was used as one of the key input for the machine learning algorithm
  • Implement the machine learning algorithm like Random forest, Logistic regression and Clustering Kmeans algorithm using Scala and Python libraries in Databricks Notebook
  • Maintained the version control of the source code using SVN Repository.
  • Performed the unit testing, integration testing and system testing of the applications.
  • Coordinate with the QA team for the QA testing of the applications and defect fixes.

Environment: Shell Script, Hadoop MR jobs, Hive SQL, SQOOP, Databricks Spark, ML and MLIB libraries, SCALA, GIThub

Confidential, Atlanta, GA

Senior Bigdata Engineer

Responsibilities:

  • Gathering the requirements from the business users and performing the requirement analysis.
  • Designing the applications module based on the finalized requirements from the business user and covert the design into the high level design document.
  • Experience in leading a Team technically and assigning the tasks to the team and updating the development and the testing status to the manager day by day basis.
  • Coordinating, Planning & Executing the System Development Life Cycle.
  • Involved in designing the data model in Hive
  • Created scripts to ingest data to Hbase from Oracle and Mysql
  • Design and develop Hadoop Map reduce programs
  • Created the Hadoop MR units for all the Map reduce programs
  • Created Shell script and HQL queries for data preparation from different source
  • Created SQOOP jobs to import data from EDW and DB2 which is required for the algorithm
  • Design and create the feature list and the data frames required for the Machine learning algorithm from the dataset for the predictive analytics
  • Implement the machine learning algorithm like Random forest, Logistic regression and Clustering Kmeans algorithm using Scala and Python libraries in Databricks Notebook
  • Maintained the version control of the source code using SVN Repository.
  • Performed the unit testing, integration testing and system testing of the applications.
  • Created the build jobs in Jenkins and deployed in the Tomcat server
  • Coordinate with the QA team for the QA testing of the applications and defect fixes.

Environment: Java Batch, Hadoop MR jobs, Hadoop MR units, Hive SQL, SQOOP, Databricks Spark, ML and MLIB libraries, SCALA, Python,GIThub

Confidential, Atlanta, GA

Senior Bigdata Engineer

Responsibilities:

  • Gathering the requirements from the business users and performing the requirement analysis.
  • Designing the applications module based on the finalized requirements from the business user and covert the design into the high level design document.
  • Experience in leading a Team technically and assigning the tasks to the team and updating the development and the testing status to the manager day by day basis.
  • Coordinating, Planning & Executing the System Development Life Cycle.
  • Designed and developed all the user interface screens using HTML,Jquery and RESTful web services on AWS
  • All web services created were micro web services
  • Involved in designing the data model in Hive
  • Design and develop Hadoop Map reduce programs to implement the pricing and clearance pricing algorithm
  • Created the Hadoop MR units for all the Map reduce programs
  • Created scripts to ingest data to Hbase from Oracle and Mysql
  • Created Shell scripts and HQL queries for data preparation from different source
  • Created SQOOP jobs to import data from EDW and DB2 which is required for the algorithm
  • Maintained the version control of the source code using SVN Repository.
  • Performed the unit testing, integration testing and system testing of the applications.
  • Coordinate with the QA team for the QA testing of the applications and defect fixes.

Environment: Java, Hadoop MR jobs, Hadoop MR units, Hive SQL, J2EE, SQOOP, RESTful web services, Log4j, Eclipse 3.7, SVN, Junit, Find Bugs, Tomcat, HP UNIX, Jenkins, Opsware

Confidential, Atlanta, GA

Technical Lead

Responsibilities:

  • Gathering the requirements from the business users and performing the requirement analysis.
  • Designing the applications module based on the finalized requirements from the business user and covert the design into the high level design document.
  • Experience in leading a Team technically and assigning the tasks to the team and updating the development and the testing status to the manager day by day basis.
  • Coordinating, Planning & Executing the System Development Life Cycle.
  • Designed and developed all the Order creation management screens using Flex and REST web services on AWS
  • Involved in designing and implementing Data Access object to connect the database
  • Deployed the applications on Tomcat server in the AD and QA regions.
  • Maintained the version control of the source code using CVS Repository.
  • Performed the unit testing, integration testing and system testing of the applications.
  • Coordinate with the QA team for the QA testing of the applications and defect fixes.
  • Application support and maintenance
  • Developed Unix Shell scripts

Environment: Java, J2EE, RESTful web services, Log4j, Eclipse 3.6, CVS, Junit, Find Bugs, Tomcat, Jenkins, Opsware

Confidential, Atlanta, GA

Senior Java Developer

Responsibilities:

  • Implemented MVC2 architecture to develop web application using Struts, Hibernate framework
  • Planned and involved in the Unit and QA testing’s.
  • Prepared the WS design and DDD(Detailed Design Document) Document.
  • Used Struts validation framework, customized default error messages by creating message resource bundle
  • Conducted the performance testing using the JProbe tool to identify the memory leaks, unused and useless java objects.
  • Daily and Weekly status/progress to the IT manager.
  • Used Struts validation framework, customized default error messages by creating message resource bundle
  • Developed the project using Agile methodologies and Test Driven Development
  • Designed XML configuration files for Action Mapping as well as Tiles Definition.
  • Designed and developed Struts Configuration files as well as Controller classes for the implementation of the business logic in the Struts Framework .
  • Designed and Developed Java persistence classes objects for storing the data in the database using Hibernate OR mappings.
  • Utilized Hibernate for Object3/Relational Mapping purposes for transparent persistence onto the database using the Stateless and session beans(EJB 3.0)
  • Developed SOA architecture based WebServices using SOAP and WSDL
  • Wrote and used SOAP for sending and getting data from the external interface
  • Developed Openmake script to build and deploy the application
  • Consistently produced the highest quality code through disciplined and rigorous unit testing using JUnit
  • Extensively used Eclipse IDE while writing code & used Sub Version for version control
  • Used Log4j for logging and debugging
  • Deployed application in Tomcat Server

Environment: Java 1.5, SOA, Web Services, JSP, JavaScript, XML,DB2, Eclipse IDE, SOAP, WSDL, UNIX, Sub Version, Junit, Log4j, Openmake, JProbe, Tomcat Server, Jenkins, Opsware

Confidential, Atlanta, GA

Senior Java Developer

Responsibilities:

  • Gathering the requirements from the business and performing the requirement analysis.
  • Designing the applications based on the finalized requirements including the design of data communication between the Java applications and mainframes transactions.
  • Designed and developed all the Web pages using Struts Tags, JSP, HTML and validating the client data using java script.
  • Internationalized the application for Canada and Spanish population through resource bundle.
  • Developed ActionForm classes as well as Dispatch Action classes to process the each logical request and forwarded through appropriate Action Mapping.
  • Designed XML configuration files for Action Mapping as well as Tiles Definition.
  • Designed and developed controller classes to implement all the business logic and Involved indesigning
  • Developed SOA architecture based WebService calls to make communication with external systems.
  • Deployed the applications on Tomcat Server 6.0 application server in the AD and QA regions.
  • Maintained the version control of the source code using IBM Clear Case
  • Performed the unit testing, integration testing and system testing of the applications.
  • Coordinate with the QA team for the QA testing of the applications and defect fixes.
  • Software configuration management using Clear case and Clear Quest.
  • Deployed the packages in the AD and QA regions using Opsware SAS client.

Environment: Java, J2EE, JSP 2.0, Web Services(Apache Axis), XML, Log4j, XML, Eclipse 3.5, Opsware, Junit, Find Bugs, JProbe, Oracle, Tomcat Server 6.0, Jenkins, Opsware

Confidential, Atlanta, Georgia

Technical Lead

Responsibilities:

  • Involved in design and implementation of the application using Java, Struts, Servlets, JSP.
  • Responsible for deploying different modules of the project in Jboss application server.
  • Implementation of View and Controller components with Struts Frame Work, Model components with EJBs.
  • Used struts validation framework for performing presentation tier validations.
  • Written ant build.xml files for ear and war files generation.
  • Designed several web pages using front end technologies like JSP, JSTL, Tiles.
  • Used Configuration Management tool Subversion for version management.
  • Extensively worked on Oracle, Stored Procedures (PL/SQL) and Toad.
  • Designed and created web services
  • Played a key role in the team by developing two modules out of four independently.

Environment: Java, Struts 1.2, J2ee (JDBC, Servlets, JSP), Edit plus, Eclipse3.0 IDE, Jboss, ANT, Subversion, HTML, JavaScript, Jenkins, Opsware

Confidential

Java Developer

Responsibilities:

  • Developed the project using Agile methodologies and Test Driven Development
  • Implemented MVC architecture to develop web application using JSF framework
  • Implemented Business Logic using SLSB(stateless Session Beans)
  • Added Ajax functionality to Java Server Pages
  • Developed POJO classes using Hibernate
  • Utilized Hibernate for Object3/Relational Mapping purposes for transparent persistence onto the database
  • Wrote and used SOAP for sending and getting data from the external interface
  • Involved in writing the ANT scripts to build and deploy the application
  • Consistently produced the highest quality code through disciplined and rigorous unit testing using JUnit
  • Extensively used WSAD 5.0 while writing code & used CVS for version control
  • Used Log4j for logging and debugging

Environment: Java 1.4, JSF, Hibernate, JSP, JavaScript, AJAX, XML, WSAD 5.0, Oracle 9g, Stored Procedures, JSF, Web Logic 7.0, SOAP, WSDL, UNIX, CVS, Rational Rose, Log4j, Ant

Confidential

Java Developer

Responsibilities:

  • Developed the transaction forms using JSPs and Servlets.
  • Designing and developing user interfaces using JSPs.
  • Designing and implementing product features based on Client specific PS Framework, which is similar to Struts.
  • Developed Action Classes using Client specific PS Framework.
  • Created SQL Queries as well as Stored Procedures for data manipulation using JDBC.
  • Developed Enterprise Java Beans (EJBs) to ease the implementation and deployment of application.
  • Deployed the Application on Websphere Application Server.
  • Involved in Building and Code deployment in the Unix Development and Test Servers.
  • Integration testing and bug reporting.

Environment: Rational Application Developer, WAS 6.0, Java 1.4, JavaScript, JSP, Servlets, EJB, Web Services, XML, JMS, MQ, Struts, IBM DB2,Star Team, Rational Rose, JUnit with Easy Mock.

Confidential

Java Developer

Responsibilities:

  • Developed the transaction forms using JSPs and Servlets.
  • Designing and developing user interfaces using JSPs.
  • Designing and implementing product features based on Client specific PS Framework, which is similar to Struts.
  • Developed Action Classes using Client specific PS Framework.
  • Created SQL Queries as well as Stored Procedures for data manipulation using JDBC.
  • Developed Enterprise Java Beans (EJBs) to ease the implementation and deployment of application.
  • Deployed the Application on Websphere Application Server.
  • Involved in Building and Code deployment in the Unix Development and Test Servers.
  • Integration testing and bug reporting.

Environment: Rational Application Developer, WAS 6.0, Java 1.4, JavaScript, JSP, Servlets, EJB, Web Services, XML, JMS, MQ, Struts, IBM DB2,Star Team, Rational Rose, JUnit with Easy Mock.

Hire Now