Big Data Engineer Resume
Santa Clara, CA
SUMMARY
- Over 20 years of hands on experience in Scala/Java/ J2EE development.
- Over 12 years of experience in Senior Role as Software Architecture, Design, Development, Implementation, Testing, Support, Team Leadership and Project Management.
- Expert in Amazon EMR, Spark, Kinesis, S3, Boto3, BeanStalk, ECS, Cloudwatch, Lambda, ELB, VPC, ElasticCache, DynamoDB, Redshit, RDS, Aethna, Zeppelin & Airflow.
- Strong OO Design & Analysis, Design Patterns, Frameworks, Spring 3.x, Core - Java 7/8, JEE 5 & 6, JSE 7, XML and UML.
- Expert level in Server side development using J2EE, EJB, J2SE, Spring, Servlets, J2SE, Python, C++ on Windows, Unix and Linux Platform.
- Expert in Spring MVC/AOP, Spring Rest/WebServices, Spring Batch, Spring Integration, Spring Data, Spring ORM/Hibernate, JDBC, Spring Remoting, Spring JMS, MQ, Apache Camel & ServiceMix.
- Strong experience in designing and modeling the system with OOAD using UML with Rational Rose and Design Patterns, Like Patterns such Façade, Front Controller, Data Transfer Object, Data Access Object, Service Locator, Business Delegate, Singleton, Abstract Factory Method, Factory method, Adaptor, Decorator
- Expert in Analysis, Design and Development of Web and Web enabled applications using Java, JSP, JSTL, MVC, Struts, Spring, Perl, Python, Tiles, XSLT, XML, JSON, Ajax, Ext-JS, AngularJS, Backbone, BootStrap, YUI, JQuery, JavaScript, CSS, C#, ASP.NET and VB.NET.
- Experienced in Caching technologies like Coherence, Memcached, Redis, JCache, and GemFire & Gigaspace.
- Well versed in UML Design, State, Sequence and Class diagram using tools like NetBeans, MS Visio and IBM Rational Application Developer, Rational Rose and JDeveloper 10g.
- Well Experienced in Data Warehouse, ETL, Search, Virtualization and Portal development.
- Proficient in IDE’s like PyCharm, Eclipse, JDeveloper, IBM WebSphere, IBM RAD, JBoss IDE, IntelliJ and Visual Studio.
- Proficient with application servers like OC4J 10g (Oracle Application Server), GlassFish, Weblogic, IBM WebSphere, JBOSS AS 5.0, Jetty, Tomcat and Apache.
- Extensively involved in coding using Swing, Frameworks, Core Java, Concurrency, Multithreading, NIO 2, Akka and JEE Design patterns.
- Developed Message Driven Beans (MDB) as adapters to support incoming JMS messages in MQ Series / Active MQ / Tibco / Spring MQ.
- Involved as in preparation of Functional Specifications, Data Flow Diagrams and Data Modeling for development of Web Portal for Content management systems.
- Experience in Database design, modeling, maintenance and administration using Oracle 10g, Postgres, MySql, DB2, HSQLDB, Derby and MS SQL Server 2005.
- Extensive experience in CMS tools using Verity/Autonomy Portal, Actuate, JBoss and Oracle Portal.
- Handson Experience through hackathons in Web 2.0 JavaScript like Dojo, JQuery, YUI, Ext-JS, Sencha, Node.js, Backbone.js, Dart & AngularJS.
- Handson Experience through hackathons in Scala, Clojure, Python, Perl, R, Ruby, Groovy & Grails.
- Handson Experience on Cloud Platforms in OpenStack, OpenShift, CloudFoundry, Azure, AWS & Heroku.
- Excellent interpersonal, communication, mentoring skills, and analytical abilities
- Exposure to Cloud, Finance, Banking, Telecom, Wireless, Semi-Conductor, Utility, Pharmaceutical, Oil & Gas, Manufacturing, Software and Media Services
- Attended Hands-on Courses, Seminars with projects on AWS, EME, Big Data, Hadoop, Spark, PySpark, HBase, Hive, MapReduce, Lucene, Solr, NoSQL, CouchDB, CouchBase, MongoDB, and Casandra & Splunk.
TECHNICAL SKILLS:
Languages: Scala, Java, Python, Ruby, C#, VC++, C++, C, Shell Script, Swing
Java Technologies: JSSE 5,6, 7, 8, JEE 6, EJB, Entity/Session Beans, Swing, AWT, JNDI, JMS, JDBC, JMX, JavaMail, JUnit, XML, DTD, XSD, XSLT, JAXWS, JAXRS, JAXB, JAXP, SAXP, Log4j, Commons, WSDL, UDDI, SOAP, SOA, WebServices, JMS, Hibernate 3, Axis 2.
Web Technologies: Servlets, JSP 2.0, JSF 2.0, JSTL, HTML, DHTML, DOM, CSS, ActionScript, JavaScript, AJAX, ExtJS, YUI, JQuery, GWT, XML, XSL, XSLT, Spring MVC, WebFlow.
Framework: Struts 2, MVC, Hibernate 3, IBatis, TopLink, JPA, Spring 3, and WebWork.
Application Server: OC4J, WebLogic, WebSphere, GlassFish, JBOSS, Apache Tomcat, IIS7
Operating Systems: UNIX, Solaris, Linux, AIX, Windows 2000/NT/XP/Vista
Databases: NoSQL, Hbase, Cassandra, MongoDB, Oracle, Postgres, DB2, Derby, MySql, HSQLDB, PL/SQL, SQL Server, SAP Hana, FileNet, MS Great Plains.
Middleware: RMI, JMS, EJB, ActiveMQ, MQ Series, ETL, Corba, COM, DCOM
Big Data: Hadoop, Spark, HBase, Pig, Hive, MapReduce.
Tools: UML, Microsoft Visio, MagicDraw, Clear Case, Rational Rose, CVS, MKS, SVN, JUnit, TestNG, Eclipse, Netbeans, IntelliJ, WSAD, Apache Ant, Maven, Cruise Control, Cygwin, JMeter, Coccon, XML Spy, JProfiler
PROFESSIONAL EXPERIENCE
Confidential, Santa Clara, CA
Big Data Engineer
Responsibilities:
- Wrote Scala/Spark/AWS EMR cloud application to process & transform billions of Rest & mobile events generated on Realtor.com every hour.
- Created CloudWatch, AWS Data pipelines, Kinesis Realtime, Lambda, Firehose, API Gateway, BeanStalk, ECS & Spark Streaming projects on AWS Cloud environment.
- Used Python, Ruby, Pig, Hive, Sqoop to implement various tools & utilities for data import & export.
- Used Redshit, DynamoDB, Aurora, MariaDB & Sql Server in various projects.
- Implemented reporting in PySpark, Zeppelin & querying through Airpal & AWS Aethna.
- Used Airflow & AWS Data piple-line for job scheduling, orchestration & monitoring
- Evaluated R, Kafka, Redis, ElasticCache, Google Big Query & various other AWS technologies for multiple POCs.
Confidential
Hadoop/Hbase/Spark/Java/Spring (Solutions Architect / Developer - Contractor)
Responsibilities:
- Wrote script for Location Analytic project deployment on a Linux cluster/farm & AWS Cloud deployment using Python.
- Designed & Developed tool like Ambari & Chef for MPact Software, Hadoop, Hbase & Spark Deployment, Configuration, Monitoring, HA, Load & Data Balancing, Scalability on AWS, ESXI, XEN & distributed cluster using Java 8, Spring, Scala, Python & Ruby.
- Wrote software for BLE Beacon OTA configuration and monitoring in Java, Spring & Ruby
- Wrote Functional Ruby Scripts for application integration with HBase.
- Develop, Enhance & Maintain CrossSell Marketing Advertisments module for Banking Products
- Work along with offshore team in enhancing the products.
- Develop & Use multiple SOA Services for product integration with other platforms.
- Enhance portlet & portal application frontend using GWT.
- Enhance & Create Quickbase reports for Data Analytics.
- Perform Data Mining, log analysis, analytics & monitoring using Splunk.
Technologies involved: SpringFramework, spring, Spring MVC, Spring GWT, JaxRS, Java7, REST, SOA, GWT, Maven, Jenkins, JIRA, Oracle, MacOSX, UNIX, SOAPUI, Postman, IntelliJ Idea & Eclipse, XML, JSON, Causata, Quickbase, Perforce, P4 & Splunk.
Confidential, Santa Clara, CA
Lead Scala/Java/JEE Consultant (Contractor)
Responsibilities:
- Lead, Architected & Developed SOA based Video OrderingApplication
- Developed over 120 SOA REST Services, 300 Unit test. Implemented 25,000 lines of Scala code.
- Used Play for WebService design, SBT for builds and ScalaTest & Spec for Unit test. RegEx validation.
- Designed, Modeled & Deployed MySql database Schema & Mongo database. Implemented Caching and Single Signon. All implementation was an AWS Cloud Services.
- Used Mule, Camel & Spring Integration for messaging & Service Integration.
- Developed Frontend of Webapps using BackboneJS, Query, and ExtJS.
Technologies involved: Scala, Play, Lift, Slick, JPA, ScalaTest, Specs, SBT, Maven, Eclipse, Spring Integration, Mule, Camel, MySql, MongoDB, TOAD, IntelliJ Idea, Akka, Actors, JQuery, CoffeScript, LESS, AngularJS, BackboneJS, JSON, BSON, AWS EC2, AWS RDS, GIT & Github.
Confidential, Santa Clara, CA
Java/JEE/.NET Consultant (Contractor)
Responsibilities:
- Solely responsible for Enhancement, Architecture, Develop, Design, Analyze, Specs, Monitor, Debug, Alerts, Secure & Support Java Server Products for Laser Data Collection.
- Unit test, Package, Build, Continuous Integrate & Support Java based Windows Embedded Products for Laser Data Analysis.
- Integrate & Develop Java Server Products with Web Services for Integration with other tools.
- Develop, Maintain Java, Visual .NET & C# tools for products installation and upgrade
- Develop Design & Maintain Java & C #Visual .NET Web Application for Hardware configuration, monitoring, test & analysis.
- Design & Architect new applications using Use cases & UML. Analyses collection logs for client laser issues. Maintain Monitor, Scale, and Write & Review Alerts for multiple apps.
- Develop New Messaging based Replication Server Products. - Confidential New Products.
- Design Specs, Architecture, Code, Unit test & implement Security features for Database Replication Server and related products.
- Design, Architect, and Develop Cloud Engineering Infrastructure Automation, IaaS & PaaS Software and Cloud Client & Server SOA Services.
- Enhanced caching application for real-time infrastructure discovery & inventory.
- Wrote multiple unit test cases, multi threaded, concurrent using spring and XML for application testing.
- Developed DHCP, DNS, SSH, ISO Image Management, solutions around Virtualization.
Technologies involved: My work was mainly focused in development using tools and technologies such as Spring 3.5/3.0, Spring MVC, SOA, RestFul, Rest and SOAP Web Services, SOAP UI, AOP, JSTL, XML, XSLT, VMWare, VirtualBox, JMS, Active MQ, Camel ESB, J2SE, Java, JDK, JAXB, JNDI, JMX, JAAS, JAX-WS, JSP 2.1, Servlets 3.0, Jakarta Commons, ExtJS, AJAX, FireBug, Hibernate, DAL, XML, Javascript, JSON, Agile, TDD, JUnit, Maven, Rational ClearCase, Log4J, SLF4J, JConsole, Eclipse 3.5, MySQL, Oracle 11, TOAD, ERD, Red Hat 10, Fedora, DHCP, SSH, Unix, UML, Scrum Methodology, Rally, Tomcat, WebSphere and many other tools and technologies.
Confidential, San Francisco, CA
Senior Java Developer / Consultant (Contractor)
Responsibilities:
- Design, Architect, Develop Internet based Mortgage, IRA, Loans, Credit Card applications for application submission, workflow and status check.
- Mobile Application development for account balance check.
- Wrote multiple we tools using spring and XML for application testing.
Technologies involved: My work was mainly focused in development using tools and technologies such as Spring 3.0, Spring MVC, AOP, JSTL, XML, XSLT, JMS, IBM MQ, Active MQ, Web Services, J2SE, Java, JDK, JAXB, SAX, JNDI, JMX, JAAS, REST, JAX-WS, OSGI, Spring DM Server, AOP, JSP 2.1, Servlets, Jakarta Commons, ExtJS, AJAX, Hibernate, JPA, XML, Javascript, JSON, DHTML, CSS, Agile, TDD, JUnit, Maven, rational ClearCase, Log4J, SLF4J, JConsole, Eclipse 3.5, Fortify, Oracle 11, PL/SQL, TOAD, ERD, Unix, Cygwin, UML and Tomcat, Weblogic Server and many other tools and technologies.
Confidential, San Francisco, CA
Senior Java Developer / SOA Architect (Contractor)
Responsibilities:
- Design, Architect, Develop, & Manage Internal SOA application and Service Catalog application.
- Used ErWin Data Architect to create data model of the Catalog Application and also create DDL, and Data Schema.
- Used TigerStripe to generate Class Model POC of Catalog application & generated hibernate java model with the architecture.
- Enhanced and Maintained a REST SOA application using Adobe Flex as frontend.
- Developed Server side and client side web applications using WebServices, Weblogic EJB, Spring 2.5, OSGI Bundles, and Struts 2, Hibernate, and Ajax frameworks.
- Developed frontends using ExtJS, Dojo, JQuery, JSF 2.0, JSP and JSTL.
- Service Catalog: Design, Develop and Lead a POC of Service Catalog application.
- Used ExtJS and Dojo to develop POC UI of Service Catalog.
Technologies involved: My work was mainly focused in development using tools and technologies such as Erwin Data Architect, J2EE, J2SE, Java, JDK, JAXB, SAX, JNDI, JMX, JAAS, REST, JAX-WS, Axis, Spring 2.5, OSGI, Spring DM Server, Equinox, Knoplerfish, Felix, AOP, JSP 2.0, JSTL, Struts 2, Servlets, Jakarta Commons, ExtJS, YUI, AJAX, Hibernate, JPA, WebServices Gateway, XML, Javascript, JSON, DHTML, CSS, Agile, TDD, JUnit, Maven, SVN, Optimizeit, Log4J, SLF4J, Eclipse 3.x, TigerStripe, OC4J 10G, Oracle 10g, PL/SQL, TOAD, ERD, Unix, Cygwin, UML and Tomcat, Weblogic Server and many other tools and technologies.
Confidential, San Francisco, CA
Lead Java Developer (Contractor)
Responsibilities:
- Design, Architect, Develop, & Manage Security application to track frauds.
- Mentor architecture and design decisions. Review code with Fortify and other security tools. Coordinate with different groups on application and data integration using ESB and file transmission techniques.
- Managed offshore development design, code, specs and deliverables.
- Offer 24x7 support services for application stability, and create use case, design, UML, functional and specification documentation. Responsible for application DR, Security, Scalability, Enhancements, Support and 24x7 uptime monitoring & tuning.
- Used Weblogic JMS for messaging services.
- Used EJB’s to manage declarative transactions and JDBC/JNDI for batch inserts and batch updates.
- Developed Server side and client side web applications using WebServices, Weblogic EJB, MDB, Spring 2.5, Struts 2, Hibernate, and YUI Ajax frameworks.
- Developed and Installed RSA server and webServices to determine user risk levels and risk analysis.Projects Developed:
- CFM: This is a Fraud Management system which tracks and reports user activity on Well Fargo Banking Portal. It determines fraudulent logins, Monetary Wires, Trojan, Bots and Virus detection. Cross Site and Sql injection scripting and various involving hacking techniques used by hackers.
Technologies involved: My work was mainly focused in development using tools and technologies such as Fortify, RSA, J2EE, J2SE, Java, JDK, JMS, MOM, JAXB, SAX, JNDI, JMX, LDAP, JAAS, MDB, REST, JAX-WS, Axis, WebLogic MQ, Spring 2.5, AOP, Spring Batch, WebFlow, Swing, JSP 2.0, JSTL, Struts 2, Servlets, Jakarta Commons, Python, ExtJS, YUI, DWR, AJAX, Hibernate, JPA, XML, Javascript, JSON, DHTML, CSS, Agile, TDD, JUnit, Cruise Control, ANT, ClearCase, SVN, Optimizeit, Log4J, Eclipse 3.x, NetBeans, OC4J 10G, Oracle 10g, PL/SQL, TOAD, ERD, Unix, Cygwin, UML and WebLogic 10.x Application Server and many other tools and technologies.
