SUMMARY:

• Having 13+years of experience in all phases of Software Development Life Cycle with 3+ years of experience on Big Data Analytics with hands on experience in implementing solutions using Hadoop Map reduce, HDFS, HBase, Zookeeper, Hive, Sqoop, Pig, Flume, Cassandra, Kafka and Spark.
• Excellent understanding / knowledge of Hadoop architecture and various components such as HDFS, JobTracker, Task Tracker, Name Node, Data Node and Map Reduce programming paradigm.
• Experienced in working with Spark ecosystem using Spark - SQL and Scala queries on different data file formats like .txt, .csv etc.
• Developed the Pig UDF'S to pre-process the data for analysis.
• Experience working on different file formats like Avro, Parquet, ORC, Sequence and Compression techniques like Gzip, Lzo, and Snappy in Hadoop.
• Strong understanding of NoSQL databases and hands on work experience in writing applications on NoSQL databases like HBase, Cassandra and MongoDB
• Experience in Data load management, importing & exporting data using SQOOP & FLUME.
• Experience in analyzing data using Hive, Pig and custom MR programs in Java.
• Experience in scheduling and monitoring jobs using Oozie and Zookeeper.
• Implemented POC to migrate Map Reduce jobs into Spark RDD transformations using SCALA.
• Have good experience in creating real time data streaming solutions using Kafka and Flume.
• Worked in various domains
• Financial - Data Science, Payment systems and various messaging formats (ISO 20022, PACS, PAIN, SWIFT MT, XML)
• Telecom - 4G and VoIP Protocols
• Public Sector - Applications for Government organizations
• Insurance - Public-facing web applications
• Good experience in Cloudera, Hortonworks & Apache Hadoop distributions.
• Knowledge on AWS (Amazon EC2) Hadoop distribution (Hortonworks and Cloudera)
• Developed high-throughput streaming apps reading from Kafka queues and writing enriched data back
• Experience working with different databases, such as Oracle, SQL Server, MySQL and writing stored procedures, functions, joins, and triggers for different Data Models.
• Wrote and worked on complex performance improvements on PL/SQL queries, stored procedures, triggers, indexes with databases like MySQL and Oracle.
• Strong Experience in writing SQL queries.
• Hands-on experience in scripting skills in Python, Linux and UNIX Shell.
• Good working experience using Sqoop to import data into HDFS from RDBMS and vice-versa.
• Experience in application development using Java, J2EE, EJB, Hibernate, JDBC, Struts, JSP and Servlets.
• Experience of using build tools Ant and Maven.
• Working with relative ease with different working strategies like Agile, Waterfall and Scrum methodologies.
• Expertise in implementing Service Oriented Architectures (SOA) with XML based Web Services (SOAP/REST).
• Translated ideas into working software in Hackathons: Confidential

TECHNICAL SKILLS:

Languages: C, Java, SQL, Scala, Python

Hadoop Ecosystem: MapReduce, Spark, Hive, Pig, Sqoop, Flume.

Databases: Oracle 10g/11g, SQL Server, MYSQL

No SQL: HBase, Cassandra, MongoDB

Application / Web Servers: Apache Tomcat, JBoss, Web Logic, Web Sphere

Web Services: SOAP, REST

Operating systems: Windows, Unix/Linux

Microsoft Products: MS office, MS Visio, MS Project

Frameworks: Spring, Hibernate, Struts

PROFESSIONAL EXPERIENCE:

Confidential, FL, USA

ETL platform

Responsibilities:

• Design, develop and support production-grade Databridge components to extract and ingest data from and to Hadoop and SAS platforms.
• Built a production-grade data ingestion and extraction system based on Spark, Scala and Java.
• Deal with broad variety of data sources: Hadoop, Google Analytics, SAS, Web Services, CSV and RDBMS
• Developed PoC to store Kafka streaming data into Hadoop
• Analyze long running extraction and ingestion jobs
• Design and implement query translation features into the platform using Presto and Groovy
• Add SQL features to query parser using Presto
• Involved in converting Hive/SQL queries into Spark transformations using Spark RDDs, Python and Scala.
• Developed POC using Scala and Spark SQL along with Kafka and other tools as per requirement then deployed on the Yarn cluster.
• Developed Spark code using Scala and Spark-SQL for faster processing of data
• Developed Spark scripts by using Scala shell commands as per the requirement
• Used Spark API over Cloudera Hadoop YARN to perform analytics on data in Hive.
• Documented the requirements including the available code which should be implemented using Spark, Hive, HDFS and SOLR.
• Used Akka remoting for interfacing between applications
• Extract Real time feed using Kafka and Spark Streaming and convert it to RDD and process data in the form of Data Frame and save the data as Parquet format in HDFS.
• Responsible for creating Hive tables and working on them using Hive QL.
• Implementing various Hive UDF’s as per business requirements.
• Used Data Bricks API in Scala program to generate CSV output from spark jobs.

Environment: Hadoop, HDFS, HBase, Sqoop, Hive, Map Reduce, Spark-SQL, Scala, Kafka,Sbt, Java, Ubuntu/Cent OS, MySQL, Linux, GitHub, Maven, Jenkins.

Confidential, PA, USA

Responsibilities:

• Developed Docker images and Worked on Docker containers
• Develop PoC using fast network packet processing framework - DPDK
• Implement encryption using cryptodev DPDK library

Environment: Docker, Kubernetes, Intel DPDK, C++.

Confidential,

Responsibilities:

• Developed PoC by creating Data Lake by extracting customer's data from various data sources into HDFS
• Implemented full blow Data Lake solution to move historical data into Hadoop ecosystem.
• Used Sqoop to load data from Oracle Database into Hive.
• Developed MapReduce programs to cleanse the data in HDFS obtained from multiple data sources.
• Implemented various Pig UDF’s for during the implementation of Data Lake.
• Developed Pig Latin scripts for data processing.
• Liaise with various stakeholders, technically own and implement all SDLC phases of several enhancements (VAT, Swift Release 2015, 2016, country-specific regulatory changes etc,.) for back-office application ISIS.
• Developed PoC with Spark to process huge PAIN files
• Used WEB HDFS REST API to make the HTTP GET, PUT, POST and DELETE requests from the webserver to perform analytics on the data lake.
• Coordinate with business, packaging, deployment and vendor teams on all aspects of the system for smooth functioning.
• Lead and guide a team of developers
• Proactively support L3 production issues. Own and take them to closure.
• Discuss with architects to review design and take inputs on new developments.
• Used Hive to analyze the data in HDFS to identify issues and behavioral patterns.
• Cluster coordination services through Zookeeper.
• Assisted with the addition of Hadoop processing to the IT infrastructure.

Environment: Hadoop, Pig, Sqoop, Oozie, MapReduce, HDFS, Hive,Java, Eclipse, Flume, Oracle 10g, UNIX Shell Scripting, GitHub, Maven.

Confidential,

Responsibilities:

• Feature development of Xtreme Configurator UI using Spring framework.
• Design, develop, test, document and deploy reporting module using JReport IDEs and APIs.
• Involved in development of Web services using JAX-WS and JAX-RS.
• Design Restful client module to consume web services exposed by backend
• Prepare unit test cases for code changes, enhancements and bug fixes
• Maintain and fix existing unit test cases for enhancements and bug fixes
• Take initiative to unit test Javascript code to ease UI validation testing with QUnit
• Implemented Single Sign-on (SSO) with JReport
• Mentor new team members and Support customer trials

Environment: Core Java 5, JSP, Struts, HTML, CSS, XML, JavaScript, Oracle 10g, PL/SQL, Database Objects like Stored Procedures, Packages. Rational Application Developer7, Windows 7, WebSphere Application Server 7, Oracle SQL Developer, Maven, TOAD, Putty.

Confidential,

Responsibilities:

• Involve in lead team of QA engineers to ensure the migrated application function as in the legacy system.
• Involve in investigating bugs identified during UT, SIT and UAT
• Track, debug, fix, resolve and deploy UAT issues
• Automation of vendor's release verification against inventory
• Attend weekly update meetings and coordinate with users during UAT and prioritizing issues
• Knowledge transfer about migrated application, Java and UNIX technologies to legacy system support team and other teams
• Setup system environment for Production, UAT and SIT

Environment: Java, J2EE, Oracle Weblogic Server, Oracle 11, SVN, Servlets, JSP and Solaris.

Confidential

Quality of Service Analyzer

Responsibilities:

• Involved in writing programs for XA transaction management on multiple databases of the application.
• Developed java programs, JSP pages and servlets using Cantata Struts framework.
• Redesign, code, test and integration of Enricher and Aggregator to support LTE protocols
• Involved in creating database tables, writing complex TSQL queries and stored procedures in the SQL server.
• Worked with AJAX framework to get the asynchronous response for the user request and used JavaScript for the validation.
• Design, code, test and integration of Signaling & Media co-relater for GTPv2 Protocol
• Optimize memory usage with help of profiling tools like JProfile
• Improve processing speeds of Enricher & Aggregator modules
• Used EJBs in the application and developed Session beans to implement business logic at the middle tier level.
• Actively involved in writing SQL using SQL Query Builder.
• Involved in coordinating the on-shore/Off-shore development and mentoring the new team members.
• Extensively Used Ant tool to build and configure J2EE applications and used Log4J for logging in the application
• Used JAXB to read and manipulate the xml properties.
• Used JNI for calling the libraries and other implemented functions in C language.
• Involved in fixing defects and unit testing with test cases using JUnit.

Environment: Java, EJB, Servlets, XSLT, CVS, J2EE, AJAX, Struts, Hibernate, ANT, Tomcat, JMS, UML, Log4J, Oracle 10g, Eclipse, Solaris, JUnit and Windows 7/XP, Maven.

Confidential,

Responsibilities:

• Played an active role in the team by interacting with business and program specialists and converted business requirements into system requirements.
• Implemented Services using Core Java.
• Developed web services for interaction with government agencies for ERI
• Involved in development of classes using java.
• Maintain, debug and fix Lipper fund price extraction module developed in Visual Basic
• Involved in testing of CAN protocols.
• Developed the flow of algorithm in UML.
• Developed verification and validation scripts in java.
• Developed Test cases for Unit Test cases and as well as System and User test scenarios.

Environment: Java, JSP, Servlets, JDBC, JavaScript, MySQL, JUnit, Eclipse IDE, Windows 7/XP/Vista, UNIX, LINUX.

Confidential,

Responsibilities:

• Low level design and Development of socket interface, DAO layer and System controller of Seamless Mobility Application Server (SMAS)
• Took initiative to simplify configuration of multiple components of SMAS
• Implemented RedHat Package Management (RPM) for SMAS
• Incorporated Log4cxx in SMAS replacing non-standard logging framework
• Code review, End-to-End test, debugging and fixing production issues
• Developed and integrated Communication Framework in SIP (RFC 3261) Stack. It enables different layers of stack to be distributed across multiple machines, thereby handling more load.
• Test CFW on Linux, Windows and Solaris platforms.
• Technologies: C, C++, Solaris, Linux, Win32, POSIX IPC (Socket and Message Queues), IBM Rational Purify, Klocwork, Visual C++, Clearcase

Confidential,.

Responsibilities:

• Functional Testing of PoC Application Server
• Functional Testing of Shared XML Document Management Server
• End-to- End Testing
• Automated test case execution with Tcl and Shell Scripting
• Bug fix ASN.1 compiler and SIP Traffic Generator
• Technologies: C, SIP, In-house manual test tools, Shell script and Python