PROFESSIONAL SUMMARY:

• Hadoop application Developer 8+ years of professional experience working with Java and Big Data technologies - Hadoop Ecosystem Map-Reduce Framework, NoSQL DB - HBase, HIVE, Pig and Sqoop.
• Used Sqoop to connect to Teradata, Oracle, and DB2 and Mainframe datasets to get data into HDFS.
• Experience in using Flume to get Web Server and Application Server log data into HDFS.
• Extensive experience in writing Java MapReduce programs.
• Understand the advantages and disadvantages of the various compression algorithms and its use cases with big data.
• Excellent understanding of the Yarn architecture and the MRV2 framework.
• Excellent understanding of the MapReduce Design patterns and their applications and the Java MapReduce v2 API.
• Developed custom UDFs in Pig and custom UDFs and UDAFs for Hive.
• Excellent SQL skills, and good understanding of the ETL Process and the Data warehousing architecture.
• Knowledge of NoSQL Database programming and management of HBASE, MongoDB and Cassandra.
• Knowledge of Apache Phoenix SQL interface over HBASE.
• Good understanding of the HDFS, YARN and the Hadoop commands.
• Limited working proficiency of Data Visualization tools Tableau, gnuplot etc.
• Job chaining Azkaban and Oozie, Job Chaining, Shell-script chaining etc.
• Scheduling of the Prod ready jobs using Crontab, Jenkins etc.
• Hadoop Administration knowledge.
• Good Working knowledge of Amazon Web Services Elastic Compute Cloud (EC2), Elastic Block Store (EBS), Elastic Map Reduce (EMR) Identity and Access Management (IAM).
• Very good Linux shell scripting, sed, awk, grep, regex skills and command-line skills.
• Knowledgeable on JVM Tuning GC Permgen GC algorithms.
• In depth understanding of data structures and algorithms.
• Experienced in application design using Unified Modeling Language (UML), Sequence diagrams, Case diagrams, Entity Relationship Diagrams (ERD).
• Experience in Building, Deploying and Integrating with Ant, Maven and Jenkins.
• Java EE development experience with Spring, Hibernate, Apache Tomcat and IBM WebSphere.
• Very good working knowledge on Real Time big data Technologies Spark, Storm, Kafka.
• Proven track-record of performing the responsibilities/duties of Programmer Analyst, Team member, Developer, Requirement Analyst, Team Leader, Technical Lead.
• Extensive work experience with different SDLC approaches such as Waterfall and Agile development methodologies.
• Good communication and presentation skills.
• Ability to identify and resolve problems both independently and quickly.
• Self-motivated, Self-starter, Quick learner, Flexible and focused.
• Excellent problem solving skills and debugging techniques.
• Strong ability in communicating with Development Teams and ability to work on multiple projects and prioritize workload.
• Rich work exposure in all the major roles in software development.
• Ability to work in all phases of system design and delivery
• Excellent communication skills, interpersonal skills & problem solving skills with ability to interact with individuals at all levels
• A great team player & ability to effectively communicate with all levels of the organization such as technical, management and customers.
• Moderate knowledge of Python and Hadoop streaming API.

TECHNICAL SKILLS:

Hadoop/Big Data Technologies: HDFS, MapReduce, Hive, Pig, Sqoop, Flume, HBase, Spark, Cassandra, MongoDB, Oozie, Storm, Kafka, Zookeeper, YARN

Programming Languages: Java JDK1.4/1.5/1.6 (JDK 5/JDK 6), C/C++, HTML, SQL, PL/SQL

Frameworks: Hibernate 2.x/3.x, Spring 2.x/3.x, Struts1.x/2.x and JPA

Web Services: WSDL, SOAP, Apache CXF/XFire, Apache, REST

Client Technologies: JQUERY, Java Script, AJAX, CSS, HTML, XHTML

Operating Systems: UNIX, Windows, LINUX

Application Servers: IBM Web sphere, Tomcat, Web Logic, WebSphere

Web technologies: JSP, Servlets, Socket Programming, JNDI,JDBC, Java Beans, JavaScript, WebServices (JAX-WS)

Databases: NoSQL, Oracle 8i/9i/10g, Microsoft SQL Server 2008/2012, DB2 & MySQL 4.x/5.x

Java IDE: Eclipse 3.x, IBM Web Sphere Application Developer, IBM RAD 7.0

Tools: TOAD, SQL Developer, SOAP UI, ANT, Maven, Visio, Rational Rose

PROFESSIONAL EXPERIENCE:

Confidential, Greater St. Louis Area

Senior Hadoop Developer

Responsibilities:

• Involved in all phases of the SDLC including analysis, design, development, testing, and deployment of Hadoop cluster.
• Used Agile development processes and practices.
• Interacting with the business teams to understand the business problems and designing big data platform solutions.
• Implemented the Big data Architect designs using Java, Hive and Pig.
• Used HCatalog as meta-store to manage the metadata for Pig and Hive.
• Hadoop security and access controls (Kerberos, Sentry).
• Used Ganglia Cluster monitoring and CDH Manager.
• Used HBASE and MongoDB Shell commands, HiveQL and CQL commands.
• Used Java JVM Performance Heap analysis using the command line tools and options.
• Extensively worked on Oozie and UNIX scripts for batch processing and scheduling workflows dynamically.
• Implemented data ingestion from multiple sources like IBM Mainframes, Teradata, Oracle and using Sqoop.
• Developed Sqoop scripts to import and export data from relational sources and handled incremental and updated changes into HDFS layer.
• Developed transformations and aggregated the data for large data sets using MR, Pig and Hive scripts.
• Worked on partitioning and used bucketing in HIVE tables and running the scripts in parallel to improve the performance.
• Developed test cases in Junit and MRunit for unit testing of MR Jobs.
• Explored different BI reporting tools to compare which one best suits the requirements.
• Implemented a process to automatically update the Hive tables by reading a change file provided by business users.
• Experienced working with different file formats - Avro, Parquet and JSON.
• Good application knowledge of the various serialization frameworks available for Hadoop Avro, SequenceFile, Parquet, Thrift, JSON etc.
• Experience in using Gzip, LZO, Snappy and Bzip2 compressions.
• Experience in reading and writing files into HDFS using Java file system API.
• Developed Pig and Hive UDF's based on requirements.
• Improved performance using advanced joins in Apache Pig and Apache Hive.
• Tuning MapReduce job parameters and configuration parameters to improve performance.

Environment: Cloudera Hadoop, HDFS, Hive, Pig, MapReduce, Oozie, Flume, Sqoop, Informatica Big Data, Talend, HBase, Cassandra, MongoDB, Platfora, Tableau, Teradata, UNIX, Shell Scripting.

Confidential, Nashville, TN

J2EE Developer

Responsibilities:

• Participated in discussions with the Business Analyst to convert Business Requirements to Use Cases.
• Provide leadership and mentor new team members and junior developers on the client, the project, and the technology being used as needed to ensure successful delivery.
• Converted business Use Cases to Technical Design Documents.
• Designed and developed various functionalities for Inventory Management.
• Used JMS as a J2EE specification for messaging and to define Queues or topics in container and then send messages on these queues.
• Used JMS API to access WebSphere MQ message provider to produce and consume messages asynchronously.
• Worked on Publish/Subscribe (pub/sub) messaging domains to distribute messages from multiple publishers to multiple subscribers.
• Performed efficient 24/7 customer support to resolve production issues.
• Member of the SWAT team responsible for expedited development to complete a complex project in a very short time. Noted for exceptional performance on the Cards inventory management SWAT Team.
• Performed efficient onsite coordination with the offshore technical team to support development and testing.
• Used Spring Web Flow for Customer Portal that requires several requests into the server to complete and invoke in different contexts.
• Used Spring MVC for Cardholder application.
• Used JavaScript, DOJO, AJAX, and DWR to make the UI more presentable and efficient.
• Used various JSTL tags and custom tags in JSP.
• Programmed extensively in multithreading environments.
• Worked with Java Collections to handle data.
• Used various browser plugins to debug front end issues.
• Enhanced system performance by creating Cache.
• Created a prepaid statement PDF for the customer in different languages using iText library.
• Wrote security code to implement PCI Compliance
• Developed applications using Spring and Hibernate framework.
• Implemented different modules of Spring Framework such as IOC, AOP, DAO, O/R mapping
• Designed and developed persistence layer with Hibernate3.0
• Used Hibernate as ORM tool for accessing the database.
• Involved in developing Hibernate mapping files and POJOs for Hibernate persistence layer
• Used Spring Web Services to connect to the CAMS Mainframe system to transfer business information back and forth.
• Used LDAP and EJB for the user authentication log-on.
• Created Unit Test Cases using EasyMock.
• Used Fish Eye Crucible for the code review process.
• Used Subversion for version control and Quality Center for bug tracking.
• Performed build master task efficiently to ensure the code quality.
• Performed code drops for various development, testing, and production environments.
• Used Cruise Control for the project build and deployment.
• Utilized excellent debugging skills to find and correct the existing defects.
• Used various commands in UNIX to further enhance debugging.
• Created Unit, Acceptance, and Integration Test documents and Code Review documents.
• Implemented Web Services security.

Environment: Java 5, RAD, RSM, Spring Web Flow, Spring MVC, Hibernate, UNIX, AJAX, DOJO, DWR, RAD 7.5, SVN, Tortoise Oracle 11i, XML, Struts 1.2, JSP 2.4, Tag Libraries, TOAD, Enterprise Java Beans, Design Patterns, UML, J2EE1.4, J2SE1.4, Java Beans, JDBC, XML, LDAP, CVS, SQL * Plus, PL/SQL.

Confidential

Java Developer

Responsibilities:

• Analysis, Design, Project Planning and effort estimate and Development of FTM application based on -MVC using Struts Framework and server-side J2EE technologies.
• Part of the core agile team in developing the application in Agile Development Methodology.
• Involved in mentoring team in technical discussions and Technical review of Design Documents.
• Hands on Code development by using Core java, servlet and Hibernate framework's API.
• Used Hibernate to develop persistent classes following ORM principles.
• Developed Hibernate configuration files for establishing data base connection and Hibernate mapping files based on POJO classes.
• Developed JUNIT test cases and System test cases for all the developed modules and classes, use Jmeter for performance test.
• Used SVN for source control.
• Used Maven for product lifecycle management.
• Involved in code reviews and verifying bug analysis reports
• Created the PL/SQL stored procedure, function, triggers for the Oracle 11g database.
• Used Eclipse Juno as the IDE and Tomcat 6.0/ 7.0 as the application server.