Senior Java-hadoop Developer Resume
2.00/5 (Submit Your Rating)
Kansas, CitY
SUMMARY:
- Nine years of experience in building Java - J2EE enterprise applications.
- Experience in ETL and data analysis using Cloudera CDH4 Hadoop ecosystem.
- Experience in real time data analysis using Twitter Storm and Esper.
- Experience in developing distributed applications on Amazon cloud platform and automating deployment process using CloudFormation and Chef Scripts in Linux environment.
- Experience in developing geographic information system (GIS) web and desktop application using Oracle spatial, ESRI ArcGIS and OGC-based open source platform.
- Over five years of experience in Agile driven development.
PROFESSIONAL EXPERIENCE:
Confidential, Kansas City
Senior Java-Hadoop Developer
Responsibilities:
- Developed modeling application using technologies like Spring MVC, Jsch ssh library, Spring JMS, IBM-MQ, Hibernate, Spring rest service (Rest template/Apache HttpClient), Spring batch process, Spring map reduce, Groovy, Apache MQ, Jsonlib/Jackson Json, Jaxb, Dozer, GIT, Hudson, Maven, Sonar and IBM Web Sphere Application Server.
- Apply modeling and analytics on claim data (historical and real-time) using Cloudera CDH 4.4.1 HDFS, Hbase, Map Reduce, Apache Crunch, Avro, Hive, Pig, Oozie, Zookeeper, Sqoop, Twitter storm, Flume, Apache Solr.
- Worked on Sqoop script and ETL java data crawler process to import domain data from oracle database to Hbase.
- Worked on Quartz scheduler to manage status and to send notifications
- Worked on test cases using Hadoop cluster, Active MQ and H2 database in memory
- Responsible for automating application build and deployment process using maven, fisheye, svn/git, Hudson and Jython script to automate deployment to IBM WebSphere.
- Responsible for implementing data loading and batch processing using Cloudera Hadoop Ecosystem.
- Responsible for upgrading application to use Storm
Confidential, Chicago
Development and Application support
Responsibilities:
- OA Suite is a highly customizable web-base measurement system built on GWT, GXT, Spring, Hibernate, BIRT
- Reporting, MySQL, JMS, Html5, Javascript, Sancha touch for mobile, ExtJs, Jersey & Spring Rest WebService and other open source Java technologies. SMR follows the SaaS model and is deployed on virtual servers running on the EC2 Amazon cloud (S3, EBS, RDS, Auto Scaling, and Load Balancing). SMR is developed using an advanced versioning and build automation system based on Maven, SVN/YouTrack, Teamcity, Tomcat 7.1 and Apache Http server.
- Senior developer for the OA platform, maintaining contacts with clients to design new functionalities and support the application throughout different instances.
- Deep knowledge of the interaction of GWT/GXT with a full J2EE stack.
- Extensive experience in resolving cross-browser GWT/GXT issues in Java source and compiled Javascript.
- Contributed to the migration of SMR from GWT 1.7 to GWT 2.5, GXT 2.1 to GXT 2.3 and BIRT 2.2 to BIRT 4.3.
- Optimized the performance of complex GWT/GXT pages to work with older browsers like IE6.
- Working with other team members to automate Amazon cloud using Amazon cloud formation and Chef using Ruby and Bash scripting.
Confidential, Chicago
Senior Java Consultant
Responsibilities:
- Worked on python, bash and pig scripts to transform and cleanup probe GPS data received from traffic team and inserted processed files organized and grouped by date and quad-key tiles into HDFS Hadoop cluster.
- Worked with other team members to schedule workflow jobs using Apache Oozie.
- Developed multiple MapReduce jobs to analyze GPS data using clustering algorithm and map matching process
- Experience with data mining and machine learning tool Weka
- Supported analyst and other teams for querying data using Hive
- Responsible for monitoring health of cluster along with other developers
- Reported errors in vendor data by visualizing it on Tableau software
- Extracted probe data from Hbase to Hdfs using MapReduce
- Upgrading system to support realtime insertion and querying probe data by migrating to Hbase for data storage on HDFS.
- Used apache Sqoop tool to migrate data from oracle to Hadoop.
Confidential, Chicago
Senior Java Consultant
Responsibilities:
- Involved in complete development cycle: from design to implementation.
- Worked as lead developer responsible for deciding open source framework and tools required for application.
- Helped team to implement Agile process and mentored other developers.
- Developed application web interface using Smart GWT, GWT, JSP, Open layers Javascript library.
- Implemented Java wrapper library around open layers javascript using JSNI and client side components were built using Command and Mediator pattern for interacting with Bing and DigitalGlobe WMS Map.
- Implemented unit test cases using JUnit, Mockito and integration testing using JBehave and Spring unit test case and browser side testing using Selenium.
- Experienced in using Maven, AnthilPro, Sonar, Fisheye, Jenkins for build and ClearCase, Svn for source repository.
- Worked on WFS, WMS services on WGS84 and mercator projection using JTS, Open Jump, Geo Tools, ESRI Arc Desktop and Web tools, Google earth, Open layers and GeoWebCaching.
- Implemented Soap and Rest web services using Apache Axis2 and Spring web service support.
- Used Jackson JSON processor, Jaxb XML message converter and built security using Spring Oauth LDAP library.
- Worked on ApacheDS and Open LDAP to allow external teams to access application and managed group-role-user creation using Apache directory studio and used LDAP client API and Spring LDAP support.
- Extensively used spring to develop various components of application used spring MVC, IOC, AOP, LDAP support, Security-Session management, Web service support, ORM-Hibernate, JDBC, JMS support, transaction management, thread management and Quartz job schedular.
- Used Hibernate as ORM layer and its spatial support, C3PO connection pooling, EhCache support.
- Used Beanlib, Dozer to send/share hibernate objects to client.
- Application was built using Oracle 10g and later migrated to MySql using Pentaho ETL tool.
- Experienced in using Oracle Enterprise manager and JMX console.
- Worked on Couch and Mongo NoSQL Database to upload and query GML data.
- Used Oracle Stellent Content Management to store application specific files using web service.
- Worked with other developer to schedule web service jobs using Control-M
- Developed workflow management using Esper Server components, ActiveMQ JMS API, Cometd, Dojo, JQuery, HTML5 to track user activity and created dashboard to display Esper events.
- Used JMS to perform batch validation
- Implemented framework to import map data using GeoTools-shapefile, Batik parser-SVG data and used Xalon, Xpath, JAXP, X-stream to transform-query-serialize objects.
- Implemented GML extraction using Jaxb, XSD schema, Dozer
- Worked on wrapper library around Python Open CSV library to scan raster image and generate vector data.
- Worked on indoor map routing link creation algorithms using Voronoi points, Delunary triangulation, AStar shortest path finder, JGraph library for natural guidance and multimode routing for Garmin.
- Worked along with developer to host application on Amazon cloud platform using Elastic bean stalk, EC2 instances, EBS drive, S3, MySQL RDS, Auto scaling, Elastic load balancer and monitored application using Management Console.
- Worked on python/bash/amazon command line scripts to automate deployment process and used Amazon Java library and Amazon Eclipse plugIn and later migrated to Amazon Cloud Formation and Chef to automate deployment.
- Experience in configuring, monitoring and deploying application on Apache Tomcat, Jboss, Apache Http server.
- POC’s and Innovative ideas -
- Building spatial application using Non-spatial database like MySQL on Amazon RDS using RTree indexing
- Indoor routing on raster and vector data using AStar algorithm
- Pedestrian traffic - Pedestrian motion prototype for IIT campus to show current and future crowd factor trend Confidential given place like restaurant, library with in campus by applying clustering algorithms on probe data received from mobile vendors, Facebook and twitter (App was built for mobile, desktop, ipad using Html5,Jquery,Javascript,twitter bootstrap api, machine learning clustering algorithm, GeoJson, Jsonlib, Jslint, YUI compressor, Css, deployed on AWS, analytics to track user visits on page)
- Real time probe data processing using open source Dempsy framework (similar to twitter storm) and push probe data to connected map clients using Web socket.
- Worked on idea to use Hadoop framework to match core map data with probe points and links around indoor mall to connect routing links from indoor mall to road links using Map-Reduce programming, HDFS file, Hbase, Pig, Hive Zookeeper.
Confidential Chicago
Senior Java consultant
Responsibilities:
- Worked on developing Transit Editor tool to display public transit network of the city (tool can be used to create transit network for any city across globe) using the ESRI ArcGIS technology stack and desktop tools (ArcMap, ArcEditor, ArcInfo, Arc Catalog) using C# .net and Java.
- Contributed to systems architecture analysis, design, and responsible for developing most of the components
- Provide technical input to risk analysis and for preparation of business cases
- Report progress status to project manager/technologies director
- Third-tier customer support resolving complex customer issues
- Involved in system and user acceptance testing
- Responsible for prototyping application to enhance transit editor application using ArcEditor, Java Swing and Java Web ADF API.
- Responsible for analyzing SRS and involved in application design and HLD (High level Design Document)/FRD (Functional Requirement Documentation) documentation along with Lead.
- Responsible for continues interaction with Internal and External customers to analyze requirement and preparation of HLD and sequence diagram to support and implement new requirement to improve application functionality and customer experience.
- Responsible for implementing POC project on using JSP based web applications leveraging the EGIS Arc Server platform to convert Transit Editor Desktop application into web app which reduces cost involved in installing and licensing transit editor desktop application on individual customer machine.
- Involved in database design and data modeling for Transit Editor Pipe line project for Oracle 10g database.
- Responsible for developing customized snapping Bezier curve line smoothing algorithm.
Confidential, Chicago
Senior Java GIS consultant
Responsibilities:
- Developed web interface of the application using Html, JSP, AJAX, JavaScript, Css, Dojo and Oracle Java Script map viewer spatial API’s to display Base map to render user defined and JDBC Themes on Map
- Implement server side components using Spring MVC controllers and hibernate
- Implemented dependent application using Struts framework
- Involved in configuration and development of dashboards using Oracle Business Intelligence (OBI)
- Involved in configuration and deployment of EAR file on to Oracle 10.3.1.0 Application Server (OC4J J2EE Server)
- Involved in developing interactive dynamic query pad to query different things displayed on map.
- Involved in creating PL-SQL functions and procedures, query tuning, High-level database scheme design and review
- Involved in Peer review of the code & logged many bugs in HP Quality Center & Jira Bug tracker application.
- Involved in configuring NAVTEQ database scheme to create Geographical Information System (GIS) Base Map.
- Developed POC to use Google maps, Microsoft Virtual earth, and Yahoo maps as replacement to Oracle map Javascript involved in Unit testing & Functional testing.
Confidential
Senior Development Engineer
Responsibilities:
- Involved in requirement review, design document preparation, UML model diagrams and UI Mockup creation
- Responsible for developing user interface using Sap web dynpro java support using Sap Net weaver developer studio
- Responsible for coding business logic using ABAP objects
- Responsible for creating database tables and relations for resource management SCM module in DB2
- Responsible for exposing core location and shift management functionalities through web service