SUMMARY

• 8+ years of professional IT experience in design, development, testing, implementation and maintenance. Progressive experience in all phases of teh iterative Software Development Life Cycle (SDLC).
• 4 years of experience wif Big Data management and Hadooprelated components HDFS, MapReduce, Pig, Hive, YARN, Sqoop, Flume, Crunch, Spark, Strom, Scala, kafka based on Big Data platforms.
• Experienced in working wif Hadoop/BigData storage and analytical frameworks over Amazon AWS Cloud using tools like SSH, Putty and MindTerm.
• Experience in Hadoop administration activities such as installation and configuration of clusters using Apache and Cloudera
• Involved in teh Extraction, Transformation and Loading of data(ETL Process) from multiple sources to target
• Experienced in using NFS (network file systems) for Name node metadata backup.
• Responsible for developing data pipeline using Windows azureflume, Sqoop and pig to extract teh data from weblogs and store in HDFS.
• Experience in Working wif BI teams in generating teh reports and designing ETL workflows on Tableau.
• Experience in importing and exporting terra bytes of data using Sqoop from HDFS to Relational Database Systems and vice - versa.
• Developed Reports using Conditional Formatting, CascadingPrompts, optional prompts and Report Bursting.
• Experience in streaming real-time data using Flume into HDFS.
• Troubleshooting, debugging & fixing Talendspecific issues, while maintaining teh health and performance of teh ETL environment.
• Designed asynchronous messaging using Java Message Service (JMS).
• Implemented Single Sign On wif windows Kerberos autantication (Java, JNI, SPPI, VC++).
• Creating XML using JAXBin from java objects.
• Performed streaming of data into Apache igniteby setting up cache for efficient data analysis.
• Developed and maintained ETL (Extract, Transformation and Loading) mappings to extract teh data from multiple source systems like Oracle, SQL server and Flat files and loaded into Teradata.
• Experience in analyzing data using HiveQL, Pig Latin, HBase and custom Map Reduce programs in Java.
• Experience in developing customized UDF’s in java to extend Hive and Pig Latin functionality.
• Expertise in job workflow scheduling and monitoring tools like Oozie and Zookeeper.
• Worked on NoSQL database like HBase, MongoDB and Cassandra.
• Experience in performing data validation using HIVE dynamic partitioning and bucketing.
• Experience on YARN environment wif Strom, Spark, Kafka and Avero.
• Hands on experience in Scala, Kafka and Strom.
• Created HBase tables to load large sets of structured, semi-structured and unstructured data coming from UNIX, NoSQL and a variety of portfolios.
• Implemented algorithms for analyzing using spark.
• Kerberos/LDAP skills Falcon, Atlas, Ranger, Knox, Ambari - Deep noledge w/practical exp.
• Experience on Apache KnoxGateway security for Hadoop Clusters.
• Strong understanding of data warehousing concepts like Fact Tables, Dimension Tables, Star and Snow Flake Schema, Metadata and data marts.
• Designed high level ETL Architecture for overall data transfer from teh Source Server to teh Enterprise Services Warehouse using SSIS2012.
• Involved in creating single page applications using Angular JScomponents, directives and implemented custom directive as part of implementing reusable components.
• Experience in implementation of SPA frameworks like Angular JSand testing frameworks Jasmine and karma test runner.
• Strong experience in JavaScript, Backbone JS, jQuery and templating.
• Experience in extracting source data from Sequential files, XML files, Excel files, transforming and loading it into teh target data warehouse.
• Implemented Spark using Scala and SparkSQL for faster testing and processing of data.
• Good noledge on Netezza for gathering logs information and managing hardware issues.
• Extensive experience working in Oracle, DB2, SQL Server, PL/SQL and My SQL database.
• Hands on experience in application development using Java, RDBMS, and Unix shell scripting.
• Excellent Java development skills using J2EE, J2SE, Servlets, JUnit, MRUnit, JSP, JDBC.
• Hands on Experience in Web Services using XML, HTML, Jquery and Ajax.

TECHNICAL SKILLS

Bigdata Ecosystem: Hadoop, MapReduce, HDFS, Hive, Pig, HBase, Zookeeper, Sqoop, Oozie, Accumulo, Avro, Cascading, TezSpring-XD, AWS, Kaafka, Microsoft Azure Phoenix, Apache Cruch, Spark, Storm, Shark, Apache Ignite, Impala and Ganglia

Java/J2EETechnologies: Java 6.0, J2EE, Servlets, JSP, JDBC, XML, AJAX, SOAP, WSDL, JMS, JAXB

SDLC Methodologies: Agile, UML, Design Patterns (Core Java and J2EE)

Enterprise Frameworks: Ajax, MVC, Struts 2/1, Hibernate 3, Spring 3/2.5/2

Programming Languages: Java, XML, Unix Shell scripting, Python, Scala, SQL and PLSQL

Web Technologies: HTML, DHTML, XML, XSLT, JavaScript, CSS

Web Services: WebLogic, WebSphere, ApacheTomcat, JBoss

Databases: Oracle DB2, MS - SQL Server, MySQL, MS - Access

Operating Systems: Windows 9x/NT/XP, UNIX, Linux

PROFESSIONAL EXPERIENCE

Confidential - SFO, CA

Sr. Hadoop Developer

Responsibilities:

• Participated in Gathering requirements, analyze requirements and design technical documents for business requirements.
• Involved different phases in big data projects like data acquiring, data processing and data serving using dash boards.
• Import/export data from Oracle data base to/from HDFS using Sqoop and JDBC.
• Gathered data from different sources like Internet, sensors, user behavior, and moved to HDFS using Optimized join base in MapReduce programs.
• Implemented Custom Input formats that handles input files received from java applications to process in MapReduce.
• Designed and developed Java applications using Hadoop MapReduce jobs to process large data sets to support distributed data processing by leveraging frameworks: Cascading, Pig and Hive.
• Extensively worked on Monitoring system capacities, system growth, and usingTeradataSQL implanted data compression techniques to improve application performance.
• Implemented joins and data aggregation using Apache Crunch.
• Design and Implementation of Real time applications using Apache Storm, Trident Storm, Kafka, Apache-Ignite's Memory grid and Accumulo.
• Writing MapReduce pipeline programs for testing using Apache Crunch.
• Developed HadoopMapReduce jobs for unit testing using MRUnit.
• Divided each data set in to corresponding categories by fallowing MapReduce Binning design pattern.
• Implemented Filter Mappers to eliminate un-necessary records.
• Apache Hadoopinstallation & configuration of multiple nodes on AWSEC2 system
• Experience in using Pig as an ETL tool for event joins, filters, transformations and pre- aggregations.
• Created partitions, bucketing across state in Hive to handle structured data.
• Migrating servers, databases, and applications from on-premise to AWS, Azure and Google Cloud Platform
• Implemented Dash boards that handle HiveQL queries internally like Aggregation functions, basic hive operations, and different kind of join operations.
• Involved in loading data from Teradata to HDFS.
• Hands on experience in installation, configuration, supporting and managing HadoopClusters using Horton works, Clouderaand MapR
• Implemented business logic based on state in Hive using Generic UDF's. Used HBase-Hive integration.
• Involved in creating data-models for customer data using Cassandra Query Language.
• Managing and scheduling batch Jobs on a HadoopCluster using Oozie.
• Created production jobs using Oozie work flows that integrated different actions like MapReduce, Sqoop, and Hive.
• Experience in managing and reviewing HadoopLog files.
• Experienced wif monitoring Cluster using Cloudera manager.
• Involved in managing Hadoopdistributions using Hortonworks.
• Worked on building BI reports in Tableau wif Spark using Shark and SparkSQL.
• Implemented Spark using Scala and SparkSQL for faster testing and processing of data.
• Implemented data ingestion and handling clusters in real time processing using kafka.
• Experience wif Core Distributed computing and Data Mining Library using Apache Spark.
• Experienced in configuring maven builds that integrated dependencies check styles, test coverage's.
• Responsible for analyzing multi-platform applications using python.
• Developed MapReduce jobs in Python for data cleaning and data processing.
• Designing Test Plans, Test Cases and performed System Testing.
• Involved in daily SCRUM meetings to discuss teh development/progress of Sprints and was active in making scrum meetings more productive.
• Worked wif BI teams in generating teh reports and designing ETL workflows on Tableau
• Experience in integrating Hadoop for categorization and statistical analysis to generate reports.

Environment: Big Data, Hadoop, MapReduce, Pig, Hive, Sqoop, Oozie, Apache Crunch, Scala, Spark, Strom, kafka, Ambari, Cassandra, Linux, Python, Cascading, Oracle10g, Cloudera manager, Maven, MRUnit, Junit

Confidential - Northbrook, IL

Hadoop Developer

Responsibilities:

• Responsible for building scalable distributed data solutions using Hadoop.
• Responsible for Cluster maintenance, managing cluster nodes.
• Involved in teh Extraction, Transformation and Loading of data(ETL Process) from multiple sources to target using Informatica Power Center software (Repository Manager, Designer, Server Manager)
• As teh primary developer of teh application, developed teh application in HIVE and Ruby MapReduce.
• Installed various Hadoopclusters wif different Distributions like Hortonworks and Cloudera.
• Involved in managing& review of data backups and log files.
• Add/remove services and roles, add/remove nodes, configure high availability using Cloudera Manager
• Experienced wif batch processing of data sources using Apache Spark.
• Analyzed data using Hadoop components Hive and Pig.
• Established database connection from Pentahoto store in MySQL.
• Used Oozie for job scheduling in Hadoop cluster creating teh new subscriptions in Azure and giving teh necessary privileges as needed
• Migrating servers, databases, and applications from on-premise to Azureand Google Cloud Platform.
• Developed various complex Mapper and Reduce transformations for PentahoMapReduce Jobs
• Involved in running Hadoop streaming jobs to process terabytes of data.
• Experienced in loading and transforming large sets of structured, semi-structured and unstructured data Hadoop concepts.
• Created Hivetables to store data and written Hivequeries.
• Scheduled Oozie workflow engine to run multiple Hive and Pig jobs, which independently run wif time and data availability.
• Worked wif BI teams in generating teh reports and designing ETL workflows on Tableau.

Environment: Hive, Pig, Sqoop, Oozie, Map Reduce, Cassandra, MongoDB, UNIX, Shell Scripting.

Confidential, St. Louis, MO

Hadoop Developer

Responsibilities:

• Installed and configured Hadoop MapReduce, HDFS, Developed multiple MapReduce jobs in java for data cleaning and preprocessing.
• Worked on analyzing Hadoopcluster and different big data analytic tools including Pig, Hbase database and Sqoop.
• Responsible for building scalable distributed data solutions using Hadoop.
• Created Hbase tables to store variable data formats of PII data coming from different portfolios.
• Implemented best income logic using Pig scripts and UDFs.
• Implemented test scripts to support test driven development and continuous integration.
• Worked on tuning teh performance Pig queries.
• Worked wif application teams to install operating system, Hadoopupdates, patches, version upgrades as required.
• Data Migration experience from Clouderato Hortonworks and vice versa
• Responsible to manage data coming from different sources.
• Involved in loading data from UNIX file system to HDFS.
• Load and transform large sets of structured, semi structured and unstructured data.
• Experienced in managing and reviewing Hadooplog files.
• Experienced in running Hadoopstreaming jobs to process terabytes of xml format data. Tested MapReduce programs using MR unit.
• Load and transform large sets of structured, semi structured and unstructured data that includes Avro, sequence files and xml files.
• Involved in loading data from UNIX file system to HDFS.
• Involved in creating Hive tables, loading wif data and writing hive queries which will run internally in map reduce way.

Environment: Hadoop, Big Data, HDFS, MapReduce, Sqoop, Oozie, Pig, Hive, Flume, LINUX, Java, Eclipse, Cassandra.

Confidential

Java Developer

Responsibilities:

• Involved in teh designing of teh project using UML.
• Followed J2EE Specifications in teh project.
• Designed teh user interface pages in JSP.
• Used XML and XSL for mapping teh fields in database.
• Used JavaScript for client side validations.
• Created stored procedures and triggers that are required for project.
• Created functions and views in Oracle.
• Enhanced teh performance of teh whole application using teh stored procedures and prepared statements.
• Responsible for updating database tables and designing SQL queries using PL/SQL.
• Created bean classes for communicating wif database.
• Involved in documentation of teh module and project.
• Prepared test cases and test scenarios as per business requirements.
• Involved in bug fixing.
• Prepared coded applications for unit testing using JUnit.

Environment: Java, JSP, Servlets, J2EE, EJB 3, Java Beans, Oracle, HTML, DHTML, XML, XSL, JavaScript, BEA WebLogic.

Confidential

Java/J2EE Developer

Responsibilities:

• Involved in requirements analysis and prepared Requirements Specifications document.
• Designed implementation logic for core functionalities.
• Developed service layer logic for core modules using JSPs and Servlets and involved in integration wif presentation layer.
• Involved in implementation of presentation layer logic using HTML, CSS, JavaScript and XHTML.
• Design of MySQL database to store customer's general and billing details.
• Used JDBC connections to store and retrieve data from teh database.
• Development of complex SQL queries and stored procedures to process and store teh data.
• Used ANT, a build tool to configure application.
• Developed test cases using JUnit.
• Involved in unit testing and bug fixing.
• Prepared design documents for code developed and defect tracker maintenance.

Environment: Java, J2EE (JSPs & Servlets), JUnit, HTML, CSS, JavaScript, Apache Tomcat, MySQL.