SUMMARY

• Having 10+ years of professional experience this includes Analysis, Design, Development, Integration, Deployment and Maintenance of quality softwareapplicationsusing Java/J2EE Technologies and Hadoop technologies.
• Experienced in installing, configuring, testing Hadoop ecosystem components on Linux /UNIX including Hadoop Administration (like Hive, pig, Sqoop etc.)
• Expertise in Java, Hadoop MapReduce, Pig, Hive, Oozie, Sqoop, Flume, Zookeeper, Impala and NoSQL Database.
• Excellent experience on Hadoop ecosystem, In - depth understanding of Map Reduce and the Hadoop Infrastructure.
• Excellent experience in Amazon, Cloudera and Hortonworks Hadoop distribution and maintaining and optimized AWS infrastructure (EMREC2, S3, EBS)
• Expertise in developing Spark code using Scala and Spark-SQL/Streaming for faster testing and processing of data.
• Excellent knowledge on Hadoop Architecture and ecosystems such as HDFS, JobTracker, TaskTracker, NameNode, Data Node, YARN and MapReduce programming paradigm.
• Experienced working with Hadoop Big Data technologies (hdfs and Mapreduce programs), Hadoop ecosystems
• (Hbase, Hive, pig) and NoSQL database MongoDB
• Experienced on usage of NoSQL database column-oriented HBase.
• Extensive experience in working with semi/unstructureddata by implementing complex map reduce programs using design patterns.
• Experienced on major components in Hadoop Ecosystem including Hive, Sqoop, Flume &knowledge of MapReduce/HDFSFramework.
• Experienced in working with MapReduce Design patterns to solve complex MapReduce programs.
• Excellent Knowledge in Talend Big data integration for business demands to work towards Hadoop and NoSQL
• Hands-on programming experience in various technologies like JAVA, J2EE, HTML, XML
• Excellent Working Knowledge on Sqoop and Flume for Data Processing
• Expertise in loading the data from the different data sources like (Teradata and DB2) into HDFS using Sqoop and load into partitioned Hive tables
• Experienced on Hadoop cluster maintenance including data and metadata backups, file system checks, commissioning and decommissioning nodes and upgrades.
• Extensive experience writing custom Map Reduce programs for data processing and UDFs for both Hive and Pig in Java.
• Strong experience in analysing large amounts of data sets writing Pigscripts and Hivequeries.
• Extensive experienced in working with structured data using HiveQL, join operations, writing custom UDF's and experienced in optimizing HiveQueries.
• Experienced in importing and exporting data using Sqoop from HDFS to Relational Database.
• Expertise in job workflow scheduling and monitoringtools like Oozie.
• Experience in ApacheFlume for collecting, aggregating and moving huge chunks of data from various sources such as webserver, telnet sources etc.
• Extensively designed and executed SQL queries to ensure data integrity and consistency at the backend.
• Strong experience in architecting batch style large scale distributedcomputingapplications using tools like Flume, Mapreduce, hive etc.
• Experience using various Hadoop Distributions (Cloudera, Hortonworks, MapR etc) to fully implement and leverage new Hadoop features
• Worked on custom PigLoaders and Storageclasses to work with a variety of data formats such as JSON, CompressedCSV.
• Experience in working with different scriptingtechnologies like Python, UNIXshellscripts.
• Strong experience in working with UNIX/LINUX environments, writingshellscripts.
• Excellent knowledge and working experience in Agile&Waterfall methodologies.
• Expertise in Web pages development using JSP, HTML, JavaScript, jQuery and Ajax.
• Experience in writing database objects like StoredProcedures, Functions, Triggers, PL/SQL packages and Cursors for Oracle, SQLServer, and MySQL&Sybase databases.
• Great team player and quick learner with effectivecommunication, motivation, and organizational skills combined with attention to details and business improvements.

TECHNICAL SKILLS

Hadoop/Big Data: HDFS, Hive, Pig, HBase, Zookeeper, Sqoop, Oozie, Flume, Scala, Akka, Kafka, Storm, Mongo DB

NoSQL Databases: HBase

Relation Databases: Oracle 10g and 11g,Sql Server

Languages: Mainframe Programming, PL/SQL, SQL, Pig Latin, HiveQL, Java, J2EE, PL/SQL, Pig Latin, HQL, R, Python, XPath, Spark

Tools: and IDE: SQL Developer, Eclipse, Altova XML Spyware, Microsoft Office suite desktop applications (e.g., MS Visio, Word, Excel, PowerPoint)

Operating Systems: Z/OS, Windows 7/XP/2000/98, Linux

Java/J2EE Technologies: JDBC, Java Script, JSP, Servlets, JQuery

PROFESSIONAL EXPERIENCE

Confidential, Irving TX

JAVA/Hadoop Developer

Responsibilities:

• Migrated from Java to Hadoop Technology.
• Involved in running Hadoop jobs for processing millions of records of text data
• Data validation between existing system and new cluster.
• Written the Apache PIG scripts and Python to process the HDFS data. Developed Map Reduce program for parsing and loading into HDFS information.
• Involved in creating Hive tables, designing patterns, and loading and analyzing data using hive queries
• Worked using Apache Hadoop ecosystem components like HDFS, Hive, Sqoop, Pig, and Map Reduce, Worked with Spark and Python.
• Developed spark scripts for transformations, sort, group, event joins, filter.
• Assisted in exporting analyzed data to relational databases using Sqoop.
• Analyzed business requirements and cross-verified them with functionality and features of NOSQL databases like HBase.
• Created HBase tables to store variable data formats of data coming from different applications
• Load and transform large sets of structured, semi structured and unstructured data.
• Identifying Hadoop Configuration changes. Integrated test plan across the applications
• Peer Code Reviews and assisting the team in full project life cycle implementation (requirement gathering to production)
• Worked with Test team test cases reviews call and suggesting different kind of test scenarios.
• Research and troubleshoot technical problems and provided business logic consultation to the development team.
• Provided data flow after merging various workflows.
• Delivering complex PL/SQL queries to Testing team to test data flow across different system
• Providing Production Support to the Applications. Create, maintain and develop documentation.
• Working on Datastage to fetch various reports.
• Providing SQL script to support and test team to capture data issues in production database.

Environment: Java, Hadoop, Apache Pig, Hive, Sqoop, Mapreduce, Python, Spark, Hbase, SQL PLUS, LinuxBig Data, Spark, Zeppelin, AWS, Cloudera, EMR, JDBC, Redshift, NOSQL, Spark, YARN, HIVE, Pig, Scala, Python, Hadoop.

Confidential, Portland

Hadoop Developer / PL SQL Developer

Responsibilities:

• Discussions with Business & BSAs to get requirements with respect to end user.
• Requirement analysis & understanding to arrive at project implementation deadlines, testing & user sign-off processes to be followed.
• Design & Implement Data Warehouse creating facts and dimension tables and loading them using Informatica Power Center Tools fetching data from the OLTP system to the Analytics Data Warehouse. Coordinating with business user to gather the new requirements and working with existing issues, worked on reading multiple data formats on HDFS using Scala. Loading data into parquet files by applying transformation using Impala. Executing parameterized Pig, Hive, impala, and UNIX batches in Production.
• Discussions & involvement of Data modelling team, application DBAs to arrive at an optimal solution for changes involving DB2 tables
• Plan for the change implementation, notification to various support teams, attend DB2 & pre-prod gate reviews and follow all Confidential internal compliance processes
• Co-ordination with offshore team to set expectations so as to meet deadlines.
• Perform coding, unit testing, code reviews and discussions with offshore on a regular basis
• Plan & execute change implementations on stipulated implementation windows, verify & validate changes post implementation and provide warranty support
• Coordinating with the upstream and downstream applications during technical outages.

Environment: Java, J2EE, Java SE 6, UML, JSP 2.1, Hadoop 1x, Impala, Hive, Pig, HBASE, JSTL 1.2, Servlets 2.5, Spring MVC, Hibernate, JSON, Restful Web services, Big Data, jQuery

Confidential, Portland

Mainframe Lead Developer

Responsibilities:

• Involvement in different phases of SDLC i.e. analysis, design, testing and creation of respective documents during an enhancement project.
• Identified changes in 15 IMS DC screen programs which include changes in PSB, MFS, field addition in IMS segment changes, Include changes.
• Providing round the clock support for production support related activities.
• Creation of High level and Low level design documents as per the business requirements.
• Coding many Cobol and DB2 programs as per the low level design documents.
• Creation of test cases as part of enhancement rollouts.
• Involved in Unit level and Integration level testing.
• Involvement in rollout activities i.e. deployment of the packages.
• Creating effective Procedures for generating the ability to reuse the existing code effectively.
• Testing the entire Daily job flow in the test environment in the event of critical production issues.

Environment: COBOL, JCL, DB2, CICS, VSAM, Turnover, File-Aid, effective SORT cards.

Confidential, Portland

Mainframe Lead Developer

Responsibilities:

• Involvement in different phases of SDLC i.e. analysis, design, testing and creation of respective documents during an enhancement project.
• Providing round the clock support for production support related activities.
• Creation of High level and Low level design documents as per the business requirements.
• Coding many Cobol and DB2 programs as per the low level design documents.
• Creation of test cases as part of enhancement rollouts.
• Involved in Unit level and Integration level testing.
• Involvement in rollout activities i.e. deployment of the packages.
• Creating effective Procedures for generating the ability to reuse the existing code effectively.
• Implemented the DB2 checkpoint routines wherever required to enhance the processing capability of millions of customer’s account information stored in the databases.
• Testing the entire Daily job flow in the test environment in the event of critical production issues.

Environment: COBOL, JCL, DB2, IMS DB/DC, VSAM, Turnover, File-Aid, TSO

Confidential

Team Member & Tech Lead

Responsibilities:

• Participating in user requirement sessions to gather business requirements.
• Involved in Development, Integration and Testing of application modules.
• Developed DB2 Query optimization techniques for faster processing and retrieval of data.
• Worked on Enhancement and Development of program of sales modules.
• Implemented consistent summarization of data using a file based approach with the aid of powerful sort cards.
• Bug-Fixing, Handling Support Request and Service Request, Job Monitoring, Analysis and its implementation.
• Reduced the Technology infrastructure costs by moving the archaic data from disks to tapes using IEBGEBER utility.
• Handled the upstream file’s data cautiously through effective GDG creations using IDCAMS utility.
• Optimized the DB2 table designs by dropping the partitions in the least frequently accessed tables using file-based approach.

Confidential

Software Developer

Responsibilities:

• Worked on both WebLogic Portal 9.2 for portal development and WebLogic 8.1 for Data services programming.
• Developed the presentation layer using JSP, HTML, CSS and client validations using JavaScript.
• Used GWT to send Ajax request to the server and updating data in UI dynamically.
• Developed Hibernate 3.0 in Data Access Layer to access and update information in database.
• Used JDBC, SQL, and PL/SQL programming for storing, retrieving, manipulating the data.
• Involved in designing and development of the ecommerce site using JSP, Servlets, EJBs, JavaScript and JDBC.
• Used Eclipse 6.0 as IDE for application development configured Struts framework to implement MVC design patterns.
• Validated all forms using Struts validation framework and implemented Tiles framework in the presentation layer.
• Designed and developed GUI using JSP, HTML, and CSS. Worked with JMS for messaging interface.
• Used XML for ORM mapping relations with the java classes and the database.
• Used Subversion as the version control system. Extensively used Log4j for logging the log files