SUMMARY:

• 10 years of IT Experience as Developer, Designer & quality reviewer with cross platform integration experience using Hadoop, Java and J2EE
• Qualified and certified Hadoop and Java Developer with good experience in Analytics, Design and Development and Maintaining applications for various Business enterprises.
• Experience using Cloudera and Horton Works platform and their eco systems. Hands on experience in installing, configuring and using ecosystem components like Hadoop MapReduce, HDFS, Pi, Hive, Sqoop and Flume .
• Extensive experience in data ingestion, big data storage planning, complex transformations, data integration, analysis for Pharmaceutical, Healthcare and Retail sectors.
• Experienced in Integrating Hadoop with Apache Storm and Kafka . Expertise in uploading Click stream data from Kafka to Hdfs, Hbase and Hive by integrating with Storm.
• Have experience in Apache Spark, Spark Streaming, Spark SQL and No SQL databases like Cassandra and Hbase
• Have experience in Hadoop distributions like Amazon, Cloudera and Hortonworks and Cloud ecosystems components of Amazon like Redshift, Dynamo DB, EMR
• Hands - on experience in advanced Big-Data technologies like Spark Ecosystem (Spark SQL, MLlib, SparkR and Spark Streaming, Yarn),
• Very good understanding of Hadoop ecosystems like Sqoop2, Spark and YARN.
• Experienced in providing technical solutions to the business on applications that are developed on Hadoop and its eco systems.
• Thrives on challenge and works well under pressure, with technical expertise to learn new environments quickly, locate inefficiencies in code, and provide quick solutions.
• Expertise in developing web applications using JAVA, Spring MVC, vignette portal . Good experience to provide technical oversight for large complex projects and achieve desired customer satisfaction from inception to deployment.
• Experience in Data Analysis, Data Validation, Data Verification, Data Cleansing, Data Completeness and identifying data mismatch.
• Experience in working with MR, PIG scripts &HIVE query language.
• Experience in importing and exporting data using Sqoop from HDFS to Relational Database Systems and vice-versa.
• Extensive experience developing and deploying applications using Web Logic, Apache Tomcat and JBOSS.
• Experienced with Upgrades, Migration, Backup, Disaster Recovery, Performance Monitoring and Fine-tuning of systems running various Linux platforms.
• Installed, monitored, and supported web and application servers in Linux environments.
• Extended Hive and Pig core functionality by writing custom UDF’s.
• Experienced analyzing data using Hive QL, Pig Latin, and custom MapReduce programs in Java.
• Extensive experience with SQL, PL/SQL, PostgreSQL and database concepts.
• Knowledge of NoSQL and Mango DB such as HBase and Casandra.
• Knowledge of job workflow scheduling and monitoring tools like Oozie and Zookeeper
• Have advanced analytical, problem solving, negotiation and organizational skills with demonstrated ability to multi-task, organize, prioritize and meet deadline. Ability to multitask and work multiple projects concurrently. Ability to work independently and as part of a team.
• Have experienced using Waterfall project execution methodologies in all phases of an application development starting from Planning all the way to the delivery of the Product
• Experience in implementing Spark using Scala and SparkSQL for faster analyzing and processing of data.
• Proficient in working with Various IDE tools including Eclipse Galileo and IntelliJ IDE.
• Hands-on experience in Scala, Kafka and Strom.
• Experience in implementing Spark using Scala and SparkSQL for faster analyzing and processing of data.
• Java & J2EE Technologies: Core Java

TECHNICAL SKILLS:

Big Data Platforms: Apache Spark, Spark SQL, Spark Streaming, Amazon EMR, Red Shift, Cloudera, Big Data, Hadoop, Yarn, Map Reduce, PIG, HIVE, HBASE, Storm, Kafka, Impala,, Mongo DB and Cassandra

Languages: JAVA, J2EE, JSP, Servlets, Spring MVC, Spring MVC Portlet, Struts

Databases: Oracle10g/9i/8i/8.0/7.0,MS SQL Server 6.5/7.0/2000/2003.

Tools and Products: Eclipse, Vignette Content Management systems, Documentum, ATG e Commerce and Team Connect.

Web: HTML, DHTML, JavaScript, JSP, XSL and XML.

Build Tools: Maven and Ant

Version Controls: Clear Case, StarTeam, Serena and SVN

Operating Systems: UNIX, Linux, Microsoft Windows 95/98/00/NT/XP, MS-DOS.

PROFESSIONAL EXPERIENCE:

Confidential, Oak Brook, IL

Sr, Hadoop Developer

Responsibilities:

• Was hired for the Hadoop developer role and the primary responsibilities include Design, implement and maintain applications that receives a transaction-based and Product mix data generated from McDonald’s restaurants across all US locations.
• Job duties involved the design, development of various modules in Hadoop Big Data Platform and processing data using Map Reduce, Hive, Pig, Scoop and Oozie.
• Design, developed and tested Map Reduce programs on Mobile Offers Redemptions and Send it to the downstream applications like HAVI. Scheduled this map reduce job through Oozie workflow.
• Ingested huge amount of XML files into Hadoop by Utilizing DOM Parsers with in Map Reduce. Extracted Daily Sales, Hourly Sales and Product Mix of the items sold in Confidential Restaurant’s and loaded them into Global Data Warehouse.
• Write and test the Map/Reduce code to do aggregations on identified and validated data. Processed Mobile Offers data for McDonald’s stores in USA across various location and ingested the data into Hadoop HIVE tables.
• Scheduled Multiple Map Reduce jobs in Oozie. Involved in extracting the promotions data for Confidential stores within USA by writing the map reduce jobs and automating it with UNIX shell script.
• Involved in Setting up and Managing training sessions. Currently Responsible for mentoring Peers and leading technical teams.
• Involved in coordinating and part of the client meetings for clarity of the requirements to ingest the data for Confidential APMEA markets.
• Fix the code review comments; Build the Jenkins and support for the code deployment into the production. Fix the postproduction defects to perform the Map/Reduce code to work as expected.
• Responsible for migrating the code base from Hortonworks Platform to Amazon EMR and evaluated Amazon eco systems components like Redshift, Dynamo DB.
• Involved in migrating the map reduce jobs into Spark Jobs and Used Spark SQL and Dataframes API to load structured and semi structured data into Spark Clusters
• Involved in requirement and design phase to implement Streaming Lambda Architecture to use real time streaming using Spark and Kafka .
• Used Spark DataFrame API to process Structured and Semi Structured files and load them back into S3 Bucket.
• Migrated Map reduce jobs to Spark Jobs to achieve better performance.

Confidential, New Brunswick, NJ

Hadoop Developer

Responsibilities:

• Designed and developed multiple Map Reduce jobs in Java for complex analysis. Importing and exporting the data using Sqoop from HDFS to Relational Database systems and vice-versa. Developed UDF functions for Hive and wrote complex queries in Hive for data analysis.
• Job duties involved the design, development of various modules in Hadoop Big Data Platform and processing data using Map Reduce, Hive, Pig, Scoop, Oozie, and Apache Spark and Kafka.
• Designed utility jobs to move data into Amazon Redshift from Hortonworks in-house platform.
• Integrated Apache Storm with Kafka to perform web analytics. Uploaded click stream data from Kafka to Hdfs, Hbase and Hive by integrating with Storm .
• Configured Flume to transport web server logs into HDFS. Also used Kite logging module to upload webserver logs into HDFS.
• Developed UDF functions for Hive and wrote complex queries in Hive for data analysis
• Performed Installation of Hadoop in fully and Pseudo Distributed Mode for POC in early stages of the project.
• Processed large data sets utilizing Hadoop cluster. The data that are stored on HDFS were preprocessed/validated using PIG then the processed data is stored into Hive warehouse which enabled business analysts to get the required data from Hive.
• Used Oozie to automate the data loading into Hadoop Distributed File System. Designed & implemented Java Map/Reduce programs to support distributed data processing.
• Developed Hive queries to join click stream data with the relational data for determining the interaction of search guests on the website
• Developed a well-structured and efficient adHoc environment for functional users.

Confidential, New Brunswick, NJ

Java/J2EE Developer

Responsibilities:

• Work involved Providing Support to the production environment for various applications and actively work on incidents and issues raised by users. This also involved in on call support during off hours
• Followed J2EE Specifications in the project. Developed various modules in the Team Connect product by implementing the dependency injection of Spring MVC framework.
• Responsible for troubleshooting the performance of Java/J2EE application and provided resolution by implementing indexing and fine tuning the java components inside the application.
• Extensively involved in migrating the existing project build on Team Connect to newer version of the product with co-ordination of Mitratech Vendor.
• Responsible for enhancing the feature in the application by providing feasibility to the users to use IPAD/IPhone to digitally sign the documents.
• Acted as a liaison between the business, client and the offshore IT team. Coordinated the development, maintenance and testing activities.
• Involved in preparing high level estimations, project and task level scheduling, tracking and reporting. Responsible for handing change requests, provide resolution on time to meet the project deadlines.

Confidential

Software Developer

Responsibilities:

• Was involved in the complete life cycle of the project from gathering business requirements to creating an architecture and build applications on Java/J2EE with Spring MVC Framework
• Created new Project and project sources and worked on developing new security model in the application. Worked extensively in developing various modules in the project which interact with siperian library.
• Involved in creating the stored procedures, indexes in oracle database to improve the performance of the application. Managed build and release of the code in various environments.
• Extensively developed various entities in the project with dependency injection of Spring MVC Framework.
• Lead Offshore Team, Conduct POCs and performance evaluation. Provide presentations on the functional and technical design to stakeholders.

Confidential, Delaware

Technical Lead

Responsibilities:

• Job duties involve development of JSR and Spring MVC portelts on Vignette Portal Server. Perform major enhancements in existing portlets using SPRING MVC architecture.
• Involved in upgrading application built on documentum foundation classes to Java/J2EE web application.
• Responsibilities include extensive interaction with end users and Vignette product vendors to migrate the application built on the product to newer version of the product.
• Participate in requirement gathering, design documentation and coding. Perform estimates for the enhancements in the project using the Complexity Point methodology.
• Involved in development of Interface tool that parses and imports XML data into the database. This batch job process xml files and updates corresponding data in the database.
• Extensively involved in fixing the defects, writing unit test cases and doing system testing for the changes and enhancements in the project.
• Lead Offshore Team, Conduct POCs and performance evaluation. Provide presentations on the functional and technical design to stakeholders.

Confidential

Programmer Analyst

Responsibilities:

• Job duties involve development of JSR and Spring MVC portelts on Vignette Portal Server. Perform major enhancements in existing portlets using SPRING MVC architecture.
• Responsible for developing applications in JAVA, J2EE, JSP, JDBC, Spring MVC Portlet and Documentum.
• Ensure the adherence of various processes and SLAs, to make the application available to customers 24/7.
• Acted as a liaison between the business, client and the offshore IT team. Coordinated the development, maintenance and testing activities.
• Review system requirements with the Business and Team Members. Assisted in creating design documents, test plans, and test cases. Create system test plan, test cases, provide support for UAT and system testing.
• Perform database corrections, handled policy errors, provided solutions to remedy tickets, fixed the code flaws in the system, test the resolutions and manage the implementation of the system.

Confidential

Application Specialist

• Job duties involved the design, development and administration of web application projects using Web Programming techniques and technologies including Java, J2EE, Struts, Hibernate and HTML.
• Was responsible in Developing DAO, Service, Delegate and Action Layers for User Interface module using JSP and Servlets and Struts framework.
• Implemented service improvement in the project by developing automated service which creates user account when the data is imported from external Interface into the web application.
• Worked on creating Unit test cases for applications built on Java/J2EE technologies. Coordinate code releases with release management team.
• Played a vital role as Support Analyst ensuring that the normal service operations are restored as quickly as possible following an Incident. To analyze the root cause for a problem raised, and provide quick solution as soon as possible.
• Developed web tire using Servlets, JSP, Struts, Tiles, Java Script, HTML and XML.
• Responsible for Design & Implementation of Online Survey module
• Used Front Controller design pattern for Domain blocking module. Also extensively used Singleton, DAO design patterns for enhancements to other modules.
• Implemented Client Side and Server Side validations using Java Script and Struts Validation Framework on Login and Registration forms.
• Involved in creation of Use Cases and Test Cases. And also involved in execution of Unit Test cases and Integration test cases.
• Development of PL/SQL Stored Procedures to be used by the Java DAO layer
• Development of UI Mock Prototype using HTML and Java Script for Domain Blocking module.
• Involved in framing and documenting the Coding standards and best practices for the team, which improved the code quality and performance of the application.