PROFESSIONAL SUMMARY:

• Around 7+ years of professional IT experience in Software Development in Java with 4+ years of hands - on experience in development of Big Data Technologies, data analysis.
• Over 3+ years of experience as Hadoop Developer with good knowledge in MapReduce, YARN, HBASE, PIG, HIVE, SQOOP.
• Played a crucial role for developing QUANTUM tool which built on spark. Added multiple components in QUANTUM.
• Experience with distributed systems, large-scale non-relational data stores, NoSQL map-reduce systems, data modeling, database performance tuning, and multi-terabyte data warehouses.
• Excellent understanding and knowledge of NOSQL databases like HBase.
• Excellent understanding of Hadoop architecture, Hadoop Distributed File System and API's.
• Good Exposure on Apache Hadoop Map Reduce programming architecture and API's.
• Experienced in running Map reduce and Spark jobs over YARN.
• Experienced in writing custom map reduce I/O formats and key-value formats.
• Experienced in writing Map Reduce jobs over HBase, custom Filters, Co-processors.
• Hands on experience in Import/Export of data using Hadoop Data Management tool SQOOP.
• Used Hive and Pig for performing data analysis.
• Familiar with MongoDB concepts and its architecture.
• Good experience in using Elastic Map Reduce on Amazon Web Services (AWS) cloud for supporting data analysis projects along with exporting, importing data into S3.
• Basic Knowledge in Knowledge on Scala, Kafka, impala and Apache Zookeeper and Spark.
• Good experience in all the phases of Software Development Life Cycle (Analysis of requirements, Design, Development, Verification and Validation, Deployment)
• Hands on experience in application development using Java, RDBMS, and Linux shell scripting.
• Experience working with JAVA J2EE, JDBC, ODBC, JSP, Java Beans, EJB, Servlets.
• Experience in using IDEs like Eclipse, experience in DBMS like Oracle and MYSQL.
• Evaluate and propose new tools and technologies to meet the needs of the organization.
• Good knowledge in Unified Modeling Language (UML), Object Oriented Analysis and Design and Agile Methodologies.
• An excellent team player and self-starter with effective communication skills.

TECHNICAL SKILLS

Operating Systems: Linux (Ubuntu, CentOS), Windows

Hadoop ECO System: HDFS, MapReduce, YARN, Hive, Pig, Sqoop, Oozie, ZooKeeper

NOSQL Databases: HBase

Programming Languages: C, C++, Java, J2EE (SERVLETS, JSP, JDBC, JAVA BEANS, EJB), AWS

Web Technologies: HTML, CSS, XML, JavaScript, Kafka, Scala, Spark

Scripting Languages: Bash and Korn

Databases: ORACLE 10g, MySQL, Postgresql

IDE: Eclipse, Intellij

Web Services: REST, SOAP

Tools: Git, Maven, Ant, Bugzilla, QuickTestPro (QTP) 9.2, Selenium

PROFESSIONAL EXPERIENCE:

Confidential, Rolling Meadows, IL

Big Data Engineer

Roles and Responsibilities:

• Quantum is tool which build on Spark and driven by Json inputs. It is modern etl tool where we can define any flow in form of json.
• Developed few workflows end to end on transactions, statements.
• Ingesting Account, Customer, Transaction, Statement data from vendors to PostgraSql tables and Delivering data to partners by segregating data with Bin no’s provided on daily basis.
• Moving received current and historical data into Data Lake.
• Involved in failover process East to west locations.
• Maintained all the workflow for a particular partner.
• Developed few workflows like auth transcations and statement
• Developed few components like write fie, read file, filter.

Environment/Technologies: HDFS, MapReduce, Hive, YARN, Shell Scripting, Scala, Kafka, Spark, GitHub, AWS, Postgresql, RedShift, Snowflakes.

Confidential, Hoboken, NJ

Hadoop Developer

Roles and Responsibilities:

• Analyzed the performance to identify bottlenecks.
• Performed HDFS cluster support and maintenance tasks like Adding and Removing Nodes without any effect to running jobs and data.
• Used Spark API over Hadoop YARN to perform analytics on data in Hive.
• Integrated Kafka with Spark and used System tools to migrate the data. Used Replicated tool for high availability of nodes. ·
• Gather requirement from the client.
• Client engagement and architect solutions to business problems.
• Setting up the process to load mainframe data in Hadoop.
• Coordinating with the team to create generic utilities for Data ingestion.
• Performed Data Migration from Greenplum Database to Hadoop.
• Upgraded from Pivotal Hadoop to Hortonworks Cluster.
• Created/modified UDF and UDAFs for Hive and PIG whenever necessary.
• Managed and reviewed Hadoop log files to identify issues when job fails.
• Followed parametrized approach for the schema details, file locations and delimiter details to make the coding efficient and reusable.
• Involved in writing shell scripts in scheduling and automation of tasks to handle regular daily tasks.
• Automated the process to copy files in Hadoop system for testing purpose at regular intervals.
• Processed large amounts of structured and unstructured data using MapReduce programs.
• Developed Spark code and Spark-SQL/Streaming for faster testing and processing of data.
• Customized the dashboards and done access management and identity in AWS.
• Developed Spark scripts by using Scala shell commands as per the requirement and analyzed the data using Amazon EMR.
• Worked on tuning Bloom filters and configured compaction strategy based on the use case.
• Worked on Linux shell scripts for business process and loading data from different interfaces to HDFS.
• Evaluated business requirements and prepared detailed specifications that follow project guidelines required to develop the application.
• Exported the analyzed data to the relational databases using Sqoop for visualization and to generate reports for the BI team.
• Installed, configured Pig and also written Pig Latin scripts.
• Created partitioned and bucketed tables in Hive.
• Involved in creating Hive internal and external tables, loading with data and writing hive queries which involves multiple join scenarios.
• Developed Pig Latin scripts to extract the data from the web server output files to load into HDFS.

Environment/Technologies: CDH 5, HDFS, MapReduce, Hive, YARN, PIG, Shell Scripting, Scala, Kafka, Spark, Sqoop, Git, AWS, Greenplum

Confidential, Columbia, SC

Hadoop Developer

Roles and Responsibilities:

• Experienced in writing Custom Partitioners, Comparators and Combiner classes for MapReduce jobs.
• Experienced in writing MapReduce jobs over HBase, custom Filters, Co-processors.
• Installed and configured Hive and Oozie on the Hadoop Cluster.
• Installed Oozie workflow engine to run multiple Hive and Pig Jobs.
• Installed and benchmarked Hadoop / HBase clusters for internal use.
• Working on experimental Spark API for better optimization of existing algorithms such as Spark context, SparkSQL, Spark Streaming, Spark DataFrames.
• Involved on configuration, development of Spark environment (Databricks) with AWS cloud such as EC2, EMR, Redshift, Route 53, Cloud watch.
• Experience on machine learning for training the data models using supervision algorithms of classifications.
• Good understanding on SparkMLlib to develop a linear regression model for logistic information.
• Worked on Exporting and analyzing data to the RDBMS using for visualization and to generate reports for the BI team.
• Developed MapReduce programs for the analysis of trade data that are stored in the HDFS.
• Developed Map Reduce Programs for Data analysis and Cleaning with Hive and Pig.
• Developed PIG Latin scripts for the analysis of semi- structured data.
• Involved in data loading and writing Hive UDFs with the help of Hive tables and Hive.
• Used Sqoop to import data into HDFS and Hive from other data systems.
• Using Cloudera Manager, continuously monitored and managed the Hadoop Cluster.
• Developed Hive queries to process the data for visualization.

Environment/Technologies: CDH - 4.1.2, HDFS, HBase, MapReduce, Hive, PIG, Oozie, Maven, Git, Eclipse, Spark SQL, Spark Streaming, Spark Data Frame, Spark MLlib, HDFS, Hive, Sqoop, Kafka, Shell Scripting, Cassandra, AWS.

Confidential, Sanjose, CA

Java/J2ee Developer

Roles and Responsibilities:

• Responsible for the design and development of the framework. The system is designed using J2EE technologies based on MVC architecture.
• Developed Session Beans using J2EE Design Patterns.
• Implemented J2EE Design patterns like Data Access Objects, Business Objects, and Java Design Patterns like Singleton.
• Extensively used MQ series.
• Developed the entire application implementing MVC Architecture integrating Struts with Hibernate and spring framework
• Extensive use of Struts framework.
• Experience using SoapUI for web services testing
• Used JSP and Servlets, EJBs on server side.
• Implemented Home Interface, Remote Interface, and Bean Implementation class.
• Implemented business logic at server side using Session Bean.
• Wrote PL/SQL queries to access data from Oracle database.
• Set up Web sphere Application server and used Ant tool to build the application and deploy the application in Web sphere.
• Developed the application using WSAD.
• Prepared test plans and writing test cases.
• Worked on Hibernate.

Environment/Technologies: Java 1.4, Struts,Soap,Spring, JSP, Servlets API, HTML, JDBC, Web Sphere 5.1,MQ Series, MS SQL server, XSLT, XML, EJB, Edit Plus, EJB, JUnit, CSS,JMS, Hibernate, Eclipse, Unix

Confidential, Indianapolis

Java Developer

Roles and Responsibilities:

• Evaluates the requirements and proposes solutions in developing product with consideration to cost, impact, compatibility and timelines with other systems.
• Assisting architects in preparing the Project and Critical Design Review documents.
• Involved in creating UML design specs - Use cases, Class Diagrams, Sequence Diagrams.
• Executing in agile methodology with iteration time frame as 2 weeks.
• Used Wicket and PS (Presentation Services) frameworks which uses HTML5, JSP, CSS Java Script and JQuery.
• Developed Servlet, Mediator, Handler, Helper classes in various integration points.
• Developed Web services using SOAP and Restful architecture.
• Developed data access layer DAO using Hibernate.
• Implemented Java batch applications using Web services
• Developed JMS to publish messages to queues written MDBs to listen to messages.
• Implemented various Java design patterns like Singleton, Façade, Service locator etc.
• Involved in Web Sphere Application Server Configuration Management and deployment.
• Worked on setting up the projects, baselines and builds on version control RTC.
• Used Sonar tool for static code analysis reports.
• Worked on JUnit testing and Selenium web browser automation tools.
• Actively participated in peer code reviews using smart bear.
• Monitor performance, identify memory leaks and fix timely manner

Environment/Technologies: J2EE, JDK, Wicket, JMS, AJAX, HTML5, JSP, Java Script, Oracle, SQL, WebSphere application server, RSA, Web Services, RTC(Version Controlling), Hibernate, CSS, JUnit, Selenium.

Confidential, PaloAlto, CA

Java Developer

Roles and Responsibilities:

• Involved in the analysis, design, and development and testing phases of Software Development Life Cycle.
• Developed N-tier client-server business application software using Model View Controller (MVC) Architecture.
• Extensive use of core Java Collections, Generics, Exception Handling, and Design Patterns for functionality Involved in writing different Design Patterns like Filter, Action, Business Delegate, Service Locater, Data Transfer Objects (DTOs) and Data Access Objects (DAOs).
• Used Hibernate in persistence layer and developed POJO's, Data Access Object to handle database operations.
• Worked on System security with the use of SSL (Secure socket layer), encryption and used role-based security.
• JSON being light in nature was used as the chief source of communication between the server and application
• Expertise in developing reusable and interoperable Web service modules based on SOA architecture using SOAP and RESTful and Preparation of Java and JSP coding standard checklist.
• Involved in the development of Servlet, Struts Action classes, Business Objects, Web Services.
• Involved in writing JUnit Test Cases and Ant Build Script.
• Involved in writing JSP using Bean, Logic, HTML, and Iterate Tags.
• WSDL has been used to expose the Web Services.
• SOAP has been used as a protocol to Communicate in the form of XML messages.
• Developed client request validations and processing using JavaScript and HTML.
• Used Hibernate Transaction Management, Hibernate Batch Transactions, and Hibernate cache concepts.
• Developed Struts Action Forms, Action classes and performed action mapping using Struts.
• Used MAVEN as a build tool in adding dependences with PAGE OBJECT MODEL design pattern.

Environment/Technologies: J2EE, JDK, Wicket, JMS, AJAX, HTML5, JSP, Java Script, Oracle, DB2, SQL, WebSphere application server, RSA, Web Services, JMS, SVN, Hibernate, CSS, JUnit, Maven, Star Team