EMPLOYMENT HISTORY:

Confidential, Pleasanton, CA

Big Data Engineer

Responsibilities:

• Create/Implement robust data ingestion framework(s) that allow for the expedited migration of numerous disparate data sources into HDFS.
• Development of Spark structured streaming to read the data from Kafka in real time and batch modes, apply different mode of Change data captures (CDCs) and then load the data into Hive.
• Developed File watcher using NIO API and Notification services using Kafka.
• Developed different services checksum, copying files to HDFS, encryption and decryption, compression, duplication and zipping.
• Data offset is maintained while reading data from Kafka to maintain data consistency and integrity.
• Developed common message model for the data receiving pipeline.
• Developed independent services for configurations (Kafka, System and Database), producer manifest and data manifest using spring boot rest API.
• Record conversion from multiline records to single line records using map reduce jobs.
• Worked on converting schema to Avro schema using Apache Avro.
• Developed Kafka producer and consumer to send and receive messages.
• Worked/Consumed on schema Registry to register/apply/build schema using Avro format for Hive external tables.

Environment: Big Data, Spark, Kafka, Java, HDFS, ZooKeeper, MapReduce, Yarn, Avro, Hive, Spring boot, Web services, Rest API, Jackson API, MYSQL, Maven, Jetty, Stash/GIT, Azure, Cloudera, Golden Gate.

Confidential, San Francisco, CA

Technical Lead/Big Data Engineer

Responsibilities:

• Developed Scoop logic to pull data from data warehouse (CPD+, EDW, MTV, ODS) in to Hadoop Landing area in the form of Parquet file format and creates external hive tables on top of it.
• Developed Spark jobs to transform and load data to stage and target Database
• Developed Oozie to schedule the spark jobs to load and generate the reports and finally store it in HDFS for internal and external users to access though the applications.
• Worked with end users to evaluate business and technical requirements.
• Developed rest services for the reporting functionalities.
• Designed data model for report scheduler stand alone and reporting application.
• Team Management, co - ordination and responsible for the deliverables to the Client.
• Research of new framework and developing functional features in the application.
• Perform peer review of the application developed by the team using techniques such as unit testing, system testing and code inspections
• Writing cronjobs and shell scripts for the automation
• Release management and deployment on DEV, MOT/UAT and Production servers.

Environment: Java 1.7, Big Data, Scoop, Hive, Impala, Oozie, HDFS, Cloudera, Spark 1.5, J2EE, JSP, Spring 3.1, Hibernate 4.1, JavaScript, Ajax, Web services, Oracle 11G, Tomcat 7, Velocity, BO Webi, BODS Angular JS, Maven.

Confidential

Technical Lead/Developer

Responsibilities:

• Working with end users to evaluate business and technical requirements.
• Responsible for the deliverables to the Client.
• Developed analytical dashboards using Fluid Analytics Engine (FAE)
• Designed underlying Data Model using Netezza database.
• Team Management and co-ordination.
• Perform peer review of the application developed by the team using techniques such as unit testing, system testing and code inspections
• Release management and deployment.

Environment: Java 1.7, J2EE, JSP, Spring 3.1, Hibernate 4.1, JavaScript, Ajax, Web services, Netezza, Tomcat 7

Confidential, San Jose, CA

Technical Lead

Responsibilities:

• Developed spring rest services for the application functionalities.
• Automation of the kettle jobs of ETL process.
• Writing cronjobs and shell scripts for the automation.
• Designed data model for the application.
• Working with end users to evaluate business and technical requirements.
• Responsible for the deliverables to the Client.
• Team Management and co-ordination.
• Research of new framework and developing functional features in the application..
• Adding new functionalities to the application.
• Perform peer review of the application developed by the team using techniques such as unit testing, system testing and code inspections
• Release management and deployment.

Environment: Java 1.7, J2EE, JSP, Spring 3.1, Hibernate 4.1, JavaScript, Ajax, Web services, MySQL 5, Tomcat 7, Velocity, Pentaho (ETL).

Confidential, San Francisco, CA

Senior Software Engineer

Responsibilities:

• Integration of two applications (.net and Java) (OMS—DMS Integration)
• Knowledge tree tool support.
• Migration of production servers to the higher end configuration servers.
• Https Implementation.
• Coordinating offshore and onsite team.
• Research of new framework to be incorporated
• Developing functional features.
• Issue resolution.

Environment: Java, J2EE, JSP, JavaScript, PHP, Ajax, Struts, MySQL, Tomcat 6.0.18, Apache 2.2.11, Knowledge Tree 3.6.1, MS SQLServer 2005.

Confidential, Phoenix, Arizona

Senior Software Engineer

Responsibilities:

• Working with end users to evaluate business and technical requirements.
• Responsible for the deliverables to the Client.
• Team Management and co-ordination.
• Perform peer review of the application developed by the team using techniques such as unit testing, system testing and code inspections.
• Various Research on the new frameworks or the functional features to be incorporated in the applications.

Environment: Java 1.6, Tomcat 7, WebServices, Hibernate, spring, Oracle 10g, MsSql Server 2008, HighCharts API, IPAD

Confidential, San Francisco, CA

Senior Software Engineer

Responsibilities:

• Involved in development of business logic.
• Coordinating with on-site and offshore team
• Research of new framework to be incorporated
• Developing functional features
• Generating reports

Environment: Java 1.6, J2EE, JSP, Struts, Ajax, EXTJS, HTML, JavaScript, MySQL, Tomcat 6.0.18, SugarCRM 5.5.0, Fusion Charts, Web services.

Confidential, San Jose, CA

Senior Software Engineer

Responsibilities:

• Writing business logic for the modelling administration, dashboard and reporting screens.
• Team Management and co-ordination.
• Getting requirements from Client.
• Involved in developing the Xcelsius Graphs through the Web Services.
• Responsible for the deliverables to the Client.
• Involved in Code reviews and unit testing.

Environment: Java 1.5, J2EE, Servlets, JSP, Struts, WebServices, Axis 2.0, Crontab, Xcelcius, Corda Server, Tomcat 4.1 & Oracle9i