Big Data Hadoop Developer Resume
SUMMARY
- 17+yearsof experience in the fulllife cycle(SDLC)of the software development process includinganalysis, design, development and implementationof Client/Server.
- Distributed Applications using Object Oriented Methodologies and RDBMS. Completemulti - tieredapplication development lifecycle experience usingJava/J2EE Technologies
- Experience in severalJ2EE TechnologieslikeJSP, Servlets, Web Services, JPA
- Experience in writingSQL Queries, Stored Procedure and viewsusing Oracle
- Experience in implementing DAO layers using JPA (Eclipse Link) standards and Hibernate API
- Experience in creating Process/Data Flow Diagrams,Use Case Diagrams, Class Diagrams and State
- Experience withDatabasessuch as Oracle 10g/11g, Sybase, DB2 and Postgres
- Proficiency inSystem Life Cycleincluding developing and testing the applications.
- Experience inMVC (Model View Controller)architecture, usingStruts and Spring Frameworkwith
- Experience inJava/J2EEtechnologies likeJSP, Hibernate, Spring, Struts, Java Servlets,
- JNDI, JMS, XML, REST, JAX-RPC web service usingIDEs likeEclipse.
- Experience in producing and consuming REST based web services.
- Experience usingAgileandScrum Programmingmethodologies.
- Experience with IBM WebSphere Application server, Weblogic Application Server, Tomcat 5.5/6.0.23
- Experience with Apache Hadoop, Presto, Hive, Sqoop, Impala and HBase
TECHNICAL SKILLS:
Languages: Java, SQL
Java/J2EE Technologies: Servlets, JSP, JDBC, SWT, GWT, Angular, MVC, ANT, MAVEN, Log4j, XML, JAX-RPC, JNDI, JUNIT, REST Web services, Splunk, AWS Cloud
Web Technologies: HTML, JavaScript, XML, Web Services (SOAP, REST, WSDL)
Frameworks: Struts, Spring, Hibernate, JPA (Eclipse Link), Spring Core, Spring ORM, Spring MVC, Birt Report
Web/Application Servers: Web Logic, IBM Web Sphere, Apache Tomcat 5.x/4.x, Spring TC server
Web Service Technologies: SOAP, REST
Build Script: ANT, Maven
IDE: Eclipse 4.1/4.4
Patterns: MVC, Core J2EE design patterns (MVC, business delegate, service locator, session façade, DAO, DTO and Singleton etc.)
Methodologies: UML, OOAD, Agile, Scrum
Database Environments: Oracle 10/11, Postgres, Presto and Sybase, Hive, HBase, Impala
Big Data Technologies: Apache Hadoop, Presto, Hive, Sqoop and HBase
Operating Systems: Windows, UNIX
Version Control: Rational ClearCase, VSS, CVS, Subversion, Git, Stash, and Jira
Build Tool: Jenkins, XL Deploy, Bladelogic
PROFESSIONAL EXPERIENCE
Confidential
Big Data Hadoop Developer
Responsibilities:
- Created Hive external tables and loaded data from Teradata and query data using HQL
- Involved in creating Hive tables, loading with data and writing Hive queries which will run internally in Map Reduce way
- Executed Hive queries on Parquet tables stored in Hive to perform data analysis to meet the business requirements
- Created Partitions in Hive for both Managed and External tables for optimizing performance
- Worked on importing data from various sources and performed transformations using Hive to load data into HDFS.
- Scheduling Ingestion jobs for data extraction, data validation and ingesting intoHadoopcluster.
- Developed tpt scripts to extract raw data, populate staging tables and store the refined data in Partitioned tables in HDFS.
- Loaded Merchant Tagging data into Spark RDD to generate the JSON response and copied into HDFS cluster on weekly basis
- Worked on Apache Nifi as ETL tool for batch processing
- Involved in developing Stored Procedures for fetching data from GreenPlum and created workflow using Apache Nifi
- Experience in writing customized UDF's in java to extend Hive functionality to mask PII information
- Imported data using Sqoop to load data from SQL server to HDFS on a regular basis.
- Data science work investigating data for different products like Deposit, Device and Credit Card etc., in attempts to extract more information from requests
- Load and transform large data sets of structured, semi structured and unstructured data using Hadoop/Big Data concepts.
- Used Apache Impala to read, write and query the Hadoop data in HDFS
- Experience in Cloudera distributed system
Environment: GreenPlum, Stash, Git,, Jira, Hadoop, Hive, Sqoop, NiFi, Spark, Scala, Impala, HBase and Cloudera
Confidential
Senior Java / Big Data Developer.
Responsibilities:
- Involved in developing core java and server side for MRWS, SPIE and applications.
- Involved in developing REST web services for sending requests to Bluesheet system to generate FBS number and Match reports
- Developed RSA reports for NYSE, NASDAQ etc. and other Pattern reports using Apache POI and BIRT technologies.
- Developed JAMS and Autosys jobs for scheduling Automated Bluesheets, Goal Days and other notification and clean up tasks.
- Developed Oracle and Postgres sql for generating Pattern Reports.
- Developed Oracle and Postgres sqls for Alert Type creation process and user management access
- Developed Admin Page to support Production Support activities and reprocessing Failed Match reports and Alerts using Angular
- Developed JPA entities using Eclipse Link to store catalog and threat scenario information for SPIE application.
- Developed Criteria Builder search criteria for searching multiple inputs from UI.
- Involved in TC migration from Weblogic and Maven project conversion
- Involved in Build and Deployment support using Jenkins, Bladelogic and XL Deploy
- Involved in converting Oracle sql’s to hive queries for generating exception reports.
- Involved in AWS Cloud Migration to setup security rules, EC2 and EMR instance creation
- Created Hive tables in Datalake to store the L2 and L3 exception data.
- Involved in writing Java API for interacting with Hive and HBase tables for fetching the exception data.
- Involved in writing Flume and Hive scripts to extract transform and load the data into the Database.
- Involved in developing metadata environment for DM registration process
- Created Hive tables and working on them using Hive QL.
- Written Hive queries for data analysis and exception reports.
- Analyzed the complex AGR and EGR sql’s and implemented in Hive and Impala.
- Used Eclipse IDE for development.
Environment: Java, JPA (Eclipse Link), Birt Report, Spring, Hibernate, JAMS, Angular, Autosys, Oracle, Postgres, Presto, Subversion, Stash, Git, Splunk, Scrum, Jira, AWS, SQS, EMR, EC2, Hadoop, Hive, Sqoop and HBase
Confidential
Sr. Java Developer
Responsibilities:
- Involved in preparing Technical design documentation with workflows and sequential diagrams
- Developed server connector class using socket session and pipe communication using core java.
- Developed Referential and Quotation service components to look up market and instruments and pricing data respectively using java,
- Developed sql‘s to fetch the trade data, best quotes and Open/Close/High and Low values.
- Involved in Developing mapping table for incoming JSDA pricing feed to S&P
- Developed Oracle sql’s to insert the market data received from JSDA via Quant House API
- Developed Exception framework to handle the daily data ingest from JSDA to handle data accuracy, data coverage and delta data check
- Developed Maven script for building the application.
- Used Eclipse IDE for development.
Environment: Core JAVA, SVN, Oracle, Eclipse IDE
Confidential
Sr. Java Developer
Responsibilities:
- Developed NAV & Performance and Account Search screen using JSP and ExtJS.
- Developed Client On-Boarding screens using ExtJS MVC application architecture.
- Developed dynamic ExtJS Grids for NAV data screen.
- Developed Transaction and Account common window to display the historic data.
- Used JSON for data interchanges between JSON controller and the screens.
- Created liferay portals for Client Onboarding, commitment, redemptions and NAV.
- Implemented Custom liferay Theme for all the pages.
- Integrated ExtJS application with Liferay Portal.
- Developed the spring configuration files for Dependency Injection.
- Used FAST Eclipse IDE for development.
Environment: Core JAVA, JSP, ExtJS, JSON, Liferay Portal, SQL Server 2008, Sonar, spring framework, Tomcat, SVN, FAST, Eclipse IDE
Confidential, NA
Sr. Java Developer
Responsibilities:
- Used JSP, Struts2, spring, tiles and Hibernate for development.
- Developed customer and order screens using JSP, Struts2 and tiles.
- Developed hibernate mapping files to configure the customer and order information insert and update to the database.
- Developed the spring configuration files for Dependency Injection.
- Used JQuery for all the client side form validations.
- Developed xml files to configure the database connection.
- Used Eclipse IDE for development.
- Used SQL Server as the backend for the development.
Environment: Core JAVA, JSP, Struts2, tiles, JQuery, Eclipse IDE, log4J, XML, SQL Server 2008, Hibernate, Spring framework, JBoss7.1.
Confidential - JP Morgan Chase, NJ
Sr. Java Developer
Responsibilities:
- Used Core java, spring and collections for development.
- Used Oracle as the backend for the development.
- Wrote xml files to call the stored procedure from java using spring constructor injection.
- Developed wrapper class for Spring stored procedure.
- Developed and configured the xml files to make the database connection.
- Developed Custom exceptions to handle the Syncova calculator exceptions.
- Involved in creating Loader classes to load the instruments data from Margin based different instrument security type to Syncova (House Calculator).
- Created JUnit classes for testing all the Loaders to test the data quality.
- Used Eclipse IDE for development.
- Used TO (Task Orchestration) framework for running the margin related tasks.
- Implemented Applied margin Calculation rule for calculate the High deficit/low excess
Environment: Core JAVA, Eclipse IDE, Thread, Collections, JDBC, Apache DBCP, log4J, XML, Oracle 11, Mule ESB, Syncova Margin Calculation Tool, Spring framework, Maven, JUnit.
Confidential, NY
Sr. Java Developer
Responsibilities:
- Facilitated sessions to gather User Requirements and Business Requirements from Business User to document Functional Requirement Specification, Technical Requirement Specification that provided appropriate scope of work.
- Used Core java, collections, thread and JDBC for developing the application.
- Developed Database connection for Confidential application.
- Used JDBC mechanism for connecting to java-database.
- Used java prepared statement and callable statement for java database communication.
- Developed castor mapping xml files for mapping request and response from external system.
- Used thread mechanism to execute the application as standalone.
- Developed Connection mechanism for connecting ALERT host to Omgeo host using SSL.
- Used Eclipse IDE for development.
- Used SYBASE as the backend for the development.
- Involved in building and deploying applications.
- Developed the hibernate mapping files for inserting and updating the GPF database.
- Developed the spring configuration files for Dependency Injection.
- Developed the Configuration files for GPF database connectivity.
- Developed Exception framework for this application.
- Developed Logging framework for this application.
- Used annotation programming for transaction, database rollback and JUnit test.
- Developed the JUnit test cases for testing GPF functionality.
Environment: Core JAVA, Eclipse IDE, Thread, Collections, JDBC, Xcers, Castor, Log4J, Visio, XML, Sybase 12.5.4.
