We provide IT Staff Augmentation Services!

Senior Data Infrastructure Engineer Resume

Fostercity, CA

SUMMARY:

  • Well rounded IT professional with more than 7 years of experience workingwith Cloud Infrastructure and Applications Development experience in Java, Hadoop, RDBMS and NoSQL technologies.
  • Big Data Applications experience includes Data Extraction, Transformation, Loading and Data Analysis, Map Reduce, HDFS, Hive, Pig, Sqoop, Flume, Hbase, Oozie, Yarn, Impala, Spark, python, Kafka, Ambari in various Hadoop Distributions including Cloudera&Hortonworks.
  • In - depth understanding of Hadoop design principals, cluster connectivity, security and the factors that affect distributed system performance.
  • Managed large scale Hadoop cluster environments, handling all Hadoop environment builds, including design, capacity planning, cluster setup, performance tuning and ongoing
  • Expertise in architecting and deploying of fault tolerant, cost effective, highly available and secure servers in AWS.
  • Development experience includes using Java, Spring MVC, Struts MVC, REST Web Services, Hibernate, SOAP, ESB, JDBC, XML, HTML, CSS, ANT, Client-Side scripting, Maven with specialization in Industrial, Educational, e-commerce, Financial, and health care domains.
  • Strong experience in Scripting and Generated innovative automation solutions to recurring tasks or problems. Implemented scripting solutions to accomplish automation tasks(Backups, Patches, Scaling)
  • Experience in designing and developing Enterprise Applications using Spring framework, JSP, SERVLETS, EJB, STRUTS, JSF and Hibernate with emphasis on Unix/Linux development environment.
  • Strong experience in developing Hadoop c luster on Public and Private Cloud Environment like Amazon AWS, OpenStack.
  • Experience WebLogic Administration 12c and 11g and OBIEE Administration 12c and 11g
  • Experience in Data visualizations tools Tableau and Spotfire and Reporting tool (OBIEE)
  • Experience with MongoDB scaling across data centers and/or in-depth understanding of MongoDB HA strategies, including replica sets and sharding.
  • Extensively worked in Agile environment including Agile Management and Software Development, Scrum, RAD and "Agile" RUP.
  • Experience in working with application servers including Apache Tomcat, WebLogic 11g and 12c..
  • Experience in build tools to aggregate projects using Apache, Ant, Maven, Groovy tools, and Gradle.
  • Energitic, Enthusiastic, always wanting learn and apply latest technologies in solving current business problems.

TECHNICAL SKILLS:

Technologies/Frameworks: Python,Core Java, JDK Update 5/6, JSP, JDBC, Spring, Struts, Hibernate, Java Rest Web v Services, SOAP, JUnit, SOA, CSS, AJAX, JNDI, AWT, Swing, ANT Scripting Language, XML, XSLT, JavaScript, Unix Shell, WSDL, Design PatternsApp/Web Servers Apache Tomcat 4.x/5.x/6.0, WebLogic 12 and 11g

Databases: Mongo DB,Oracle 10g/9i/8i,Mysql

Web Technologies: HTML, JavaScript, JSP, DHTML, Ajax, CSS

Testing Tools: JUnit, Log4j, Mockito framework, Easy Mock

Methodology: Agile Methodology, Scrum

Operating System: UNIX, Linux (Centos,Redhat,Ubuntu) MacOS

Version Control: Tortoise SVN, GIT and Perforce

XML Technologies: XML, SAX, DOM, JAXP, JAXB, SOAP

WORK EXPERIENCE:

Confidential, FosterCity, CA

Senior Data Infrastructure Engineer

Responsibilities:

  • A deep understanding of Hadoop design principals, Cluster connectivity, security and the factors that affect distributed system performance.
  • Architecture of our Hadoop infrastructure to meet changing requirements for scaling, reliability, performance, manageability
  • Managed large scale Hadoop cluster environments, handling all Hadoop environment builds, including design, capacity planning, cluster setup, performance tuning and ongoing monitoring
  • Installed and configured Hadoop MapReduce, HDFS, Developed multiple MapReduce jobs in python for data cleaning and processing.
  • Experience with MongoDB scaling across data centers and/or in-depth understanding of MongoDB HA strategies, including replica sets and sharding
  • Installations of MongoDB Cluster, load balancing, failover and caching technologies
  • Implemented Disasterrecovery solution for different applications Hadoop, OBIEE and WebLogic and Databases(oracle, Mongo DB) and Automated disaster recovery efforts, including introducing random "chaos" into the system to test and improve overall resiliency to failures
  • Implemented and did POC on ETL integration with Hadoop(HDFS,HIVE) using Informatica Power center for Hadoop /HIVE (BIG data Management )
  • Generated innovative automation approaches and solutions to recurring tasks or problems. Implementedscripting solutions to accomplish automation tasks(Backups, Patches, Scaling )
  • Implemented monitoring solutions with Elastic search and Logstash. Used Ansible for configure tomcat servers and maintain.
  • Capacity planning and implementation of new/upgraded hardware and software releases as well as for storage infrastructure.
  • Evaluated and recommend systems software and hardware for the enterprise system including capacity modeling.
  • Contribute to the evolving architecture of our storage service to meet changing requirements for scaling, reliability, performance, manageability, and price.
  • Importing and exporting data into HDFS and Hive using Sqoop
  • Work with core production support personnel in IT and Engineering to automate deployment and operation of the infrastructure. Manage, deploy and configure infrastructure with Puppet or other automation toolsets.
  • Research and recommend innovative, and where possible, automated approaches for system administration tasks; identify approaches that leverage our resources, provide economies of scale, and simplify remote/global support issues

Confidential, Sanjose, CA

SrData Engineer

Responsibilities:

  • Architect, design and build big data infrastructure platform, primarily based on Hadoop based technologies, ensuring that the infrastructure is highly-available and secure.
  • Managed large scale Hadoop cluster environments, handling all Hadoop environment builds, including design, capacity planning, cluster setup, performance tuning and ongoing monitoring
  • Installed and configured Hadoop MapReduce, HDFS, Developed multiple MapReduce jobs in python for data cleaning and processing.
  • Managed Elastic Cloud Computing (EC2) instances utilizing auto scaling, Elastic Load Balancing, and Glacier for our QA and UAT environments as well as infrastructure servers for GIT and CHEF
  • Streamline automated test infrastructure which can be used by Dev. and SQA to test 24 7 products and report Key Performance Index from product quality perspective.
  • Developed reusable components for automating common business processes and interaction types. Document automated test infrastructure, and train SQA and development teams for applications of test automation.
  • Continuously improve automated test framework, API, libraries, and product quality reporting system.
  • Follow Agile/SCRUM methodology to deliver quality automated test framework.

Confidential, San Ramon, CA

Senior Java Developer

Responsibilities:

  • Implemented new functionality to Jetstream application called Contacts & Directory, this functionality is similar to Facebook Application like searching the users (i.e. Doctor or Clinician) adding them to contact list and forwarding the case with another Clinician.
  • Application is developed using Spring MVC framework
  • Involved in the Software Development Life cycle, Coding, Testing, and Implementation on Linux Platform.
  • Developed the service layer Restful Web services and Spring MVC to support the front end AJAX calls in JavaScript and transfer of data across different applications
  • Used Spring Date JPA for DAO mapping with data base
  • User interface i.e. Dynamic web pages are developed using JSP, HTML, JavaScript, XML and CSS.
  • Used Maven for build tool and deployed the application using GE predix environment
  • Ensured that coding standards are maintained throughout the development process by all developers.
  • Created Junit test cases using Mockito and Easy Mock frameworks.
  • Application is hosted in perforce and SVN
  • Deployed the application in AWS

Environment: JDK 1.6, Spring STS (IDE), Maven, Spring MVC, Rest Webservices, Spring JPA, NoSQL, SVN, JIRA, Scrum Agile development, Windows, CSS, HTML, GE Predix core, Perforce, Azure

Confidential, Washington, DC

Senior Java Developer

Responsibilities:

  • Worked on the design of the entire end-to-end architecture for the Confidential Web Application. Designed the UI, the services layer and the database object model design based on Java Spring 3.0 MVC architecture and Spring batch
  • Extensively used JDBC API, Spring JPA framework for Object relational Mapping for data persistence.
  • Worked as a full stack developer for the end-to-end web application and handled the Server deployment, data modeling, Business Logic, MVC and User Interface.
  • User interface i.e. Dynamic web pages are developed using JSP, HTML, JavaScript, XML and CSS, Dojo Tool kit.
  • Developed the DAO layer using Spring JPA specification to setup object relational mapping to support the database operations for the service layer operations.
  • Ensured that coding standards are maintained throughout the development process by all developers.
  • Created complex SQL statements, PL/SQL and Stored procedures as part of database interaction.
  • Deployment of application on the Web logic Application server and Apache Tomcat webserver
  • Developed SOAP Web Services using Apache CXF API by writing WSDL templates as per consumer requirement.
  • Designed and developed Enterprise Service Bus (ESB) Architecture for integration of different data systems and sources for the Labor data application.
  • Responsible for checking the request and response from ESB.
  • Involved in production support for fixing bugs in the production environment.
  • Created many shell scripts which run on Unix environment as part of production support.
  • Built the project using Maven script and using JAX-B specification for the XML handling. .
  • Knowledge in hosting the application using Apache subversion Repository and also Serena PVCS Version Manger
  • Installed and deployed the application on the Apache Application Server, with JetBrains’ IntelliJ IDEA as the IDE for development.

Environment: JDK 1.6, JBoss Developer Studio, Maven, JavaScript, DOJO, JSP, Ajax, Spring MVC, Spring JPA, Hibernate, MYSQL, SVN, JIRA, Weblogic, Agile development, Windows, CSS, HTML, Putty, Apache Tomcat

Confidential, Denver, CO

Java Developer

Responsibilities:

  • Worked on the design of the entire end-to-end architecture for the Firmware project. Designed the UI, the services layer and the database object model design based on Java Spring 3.0 MVC architecture.
  • Involved in the Software Development Life cycle, Coding, Testing, and Implementation on Unix and Linux Platform.
  • Developed system to render payment processing and online catalog and shopping cart portlet development.
  • Developed the service layer Restful Web services using RestEasy to support the front end AJAX calls in JavaScript and transfer of data across different applications.
  • Implemented Ajax/Json routing and handling infrastructure based on Content-Type and Accept headers.
  • Performed UNIX Shell Scripting for data files management.
  • Applied AngularJS JavaScript Framework architecture to develop a highly modular and unit-testable front-end architecture for the front-end development.
  • Developed JSON templates as data input format to feed the DOJO JavaScript program to render data on UI.
  • Developed the DAO layer using Java JPA specification to setup object relational mapping to support the database operations for the service layer operations.
  • Installed and deployed the application on the Apache Tomcat Application Server, and build the project using Maven script.

Environment: JDK 1.6, Dojo 1.8, JBoss Developer Studio, Maven, Javascript, JSP, Ajax, Spring MVC, RestEasy, Hibernate, Oracle 10g, SVN, Weblogic, Agile development, Windows, CSS, HTML, Putty

Confidential

Java Developer

Responsibilities:

  • Using core JAVA developed a web-based Quiz and testing software.
  • Developed an original object model design using database objects.
  • Developed user interfaces using JSPs, XHTML, CSS, JavaScript and AJAX.
  • Generated Class Diagrams, Sequence Diagrams with Microsoft Visio and RAD.
  • Designed patterns implemented such as Singleton, Front Controller, Factory pattern, Data Access Object.
  • Involved in writing of Web services using SOAP, WSDL, deployment, and configuration and testing.
  • Wrote SQL, PL/SQL and stored procedures as part of database interaction.
  • Extensively used Hibernate for Object relational Mapping for data persistence.
  • Unit testing, bug fixing in multiple environments (DEV/INT/CERT/PROD) and reproduce bugs for fixing and code review of individual modules in the application.
  • Parsed XML using SAX Parser and send that data to consumers as part of Batch Application.
  • Developed unit test cases using JUnit framework.
  • Accessed and manipulated the Oracle10g database by writing SQL Queries

Environment: JDK 1.5, JSP, JDBC, SAS, VBA, HTML, XML, Microsoft Excel, MS Access, Windows XP, Unix, ANT, PL /SQL, Struts MVC, Hibernate, Oracle 10g, UML, Eclipse 3.3.2, JUnit, CVS, JIRA, CSS, SQL, AJAX

Hire Now