SUMMARY:

• Certified Hadoop Developer with 8 Years of experience with emphasis on Big Data Technologies and Development and Design of Java based enterprise applications.
• Experience in development of Big Data projects using Hadoop, Mapreduce, Pig, Hive and other open source tools/technologies.
• Experienced in installation, configuration, supporting and managing Hadoop clusters.
• Implemented standards and processes for Hadoop based application design and implementation.
• Responsible for writing MapReduce programs using Java. Logical Implementation and interaction with HBase.
• Developed MapReduce jobs to automate transfer of data from HBase.
• Performed data analysis using Hive and Pig.
• Loaded streaming log data from various webservers into HDFS using Flume.
• Successfully loaded files to Hive and HDFS from Teradata database using SQOOP.
• Assist with teh addition of Hadoop processing to teh IT infrastructure. Worked in Multiple Environment in installation and configuration.
• Document and explain implemented processes and configurations in upgrades. Support development, testing, and operations teams during new system deployments.
• Good Knowledge on Hadoop Cluster architecture and monitoring teh cluster.
• Experience in all stages of SDLC (Agile, Waterfall), writing Technical Design document, Development, Testing and Implementation of Enterprise level Data mart and Data warehouses.

TECHNICAL SKILLS:

Languages: Java - J2EE, Pig Latin, HiveQL, COBOL, JCL, CICS

Databases: Hive, Teradata, DB2

Big Data tools: Hadoop, Pig, Hive, Sqoop, HBase, Cassandra, Oozie

Operating Systems: Linux/Unix, WINDOWS XP /7, z/OS

Framework and:

Architecture: Hadoop-Map reduce, Hibernate, Java EE, MVC, Struts

Methodologies/Tools: Visual Studio 2008/2010, Agile, Eclipse, SVN, Autosys, CA7, Endevor

Technologies: Hadoop, Java/J2EE, Mainframe

PROFESSIONAL EXPERIENCE

Confidential, Concord CA

Hadoop Developer

Responsibilities:

• Involved in identifying teh source data from different systems and map teh data into teh warehouse.
• Involved in modifying teh existing mainframe - Teradata ETL process to Hadoop-Teradata ETL process.
• Responsible for loading customer's data/ Confidential warehouse data into HBase using Java API.
• Created HBase tables to store variable data formats of input data coming from different portfolios.
• Involved in adding huge volumes of data in rows and columns to store data in HBase.
• End-to-end performance tuning of Hadoop clusters and Hadoop Map/Reduce routines against very large data sets.
• Successfully loaded files to Hive and HDFS from Teradata Database.
• Involved in review of functional and non-functional requirements.
• Installed and configured Hadoop Mapreduce, HDFS, Developed multiple MapReduce jobs in java for data preprocessing and loading into HDFS.
• Importing and exporting data into HDFS and Hive from Teradata using Sqoop.
• Involved in preparing adhoc report as per end users requirement by running Hive queries or Pig Latin scripts.
• Define job flows in Autosys.
• Managing and review Hadoop log files.
• Load and transform large sets of structured data.
• Responsible to manage data coming from different sources.
• Supported Map Reduce Programs those are running on teh cluster.
• Involved in loading data from UNIX file system to HDFS.
• Involved in creating Hive tables, loading with data and writing hive queries, which will run internally in map, reduce way. Involved in designing a production process for extracting teh final data and forwarding it to end users on an as-needed basis (me.e. daily, weekly, monthly, quarterly, and yearly).
• Setup and benchmarked Hadoop/HBase clusters for internal use

Environment: Java 7, Eclipse, Teradata, SVN, Hadoop, Hive, Pig, HBase, Unix, Map Reduce, HDFS, Sqoop, Hadoop Map Reduce, Windows 7, UNIX Shell Scripting, Cassandra.

Confidential

Senior Java Developer

Responsibilities:

• Created web based applications to manage information systems of teh company using J2EE and DB2.
• Created interactive UI using Struts MVC, Hibernate framework, JSP, JQuery, JavaScript, HTML and CSS.
• Wrote backend code to interact with database using Hibernate framework.
• Involved in end to end testing of code and verifying results with business owners.
• Documented teh complete process flow to describe program development, logic, testing, and implementation, application integration, coding
• Worked with internal architects and assisted in teh development of current and target state enterprise data architectures
• Performed data analysis and data profiling using complex SQL on various sources systems.
• Created SQL scripts to find data quality issues and to identify keys, data anomalies, and data validation issues
• Involved in defining teh source to target data mappings, business rules, and data definitions. Responsible for defining teh key identifiers for each mapping/interface. Technical Analysis of requirements: Active participation in requirements discussions.
• Implementation: Programming and Unit Testing for screens. Unit testing using Junit.
• TEMPEffectively handled support activities for teh application in time and delivered teh client.
• Suggesting value adds for teh application and appropriate support tasks to teh Customer so dat overhead can be reduced.
• TEMPEffective communication with customer for any clarifications or requirements or technical discussions on teh user stories. Delivery on time: All assigned squish tickets (Tasks) are resolved within allocated time frame and no reopening of teh issue. Co-ordination with team members for delivery of modules in time.

Environment: Java-J2EE, Struts, MVC, Hibernate, JQuery, HTML, CSS, Java script, DB2

Confidential

Mainframe Application Developer

Responsibilities:

• Worked in mainframe technology and having good expert hands on COBOL, JCL, DB2, Easytreive, CICS etc. Enhancement in existing functionality of teh Systems.
• Preparing HLD/LLD. Coding in COBOL, JCL and DB2. Coding includes changes in copybook with new layout, COBOLDB2 module changes.
• Preparing teh Test Data to execute Unit and CIT scripts. Testing teh system at Unit level and component integration level.
• Simulating teh test conditions with teh help of tools like FILE-Manager and FMDB2.
• Coordinating with Onsite team regarding clarifications and in requirement gathering
• Report Generation. Production job Monitoring