SUMMARY

• Over 7 years of hands on experience in Finance and Search Engine industries
• Over 2 years of comprehensive experience as a Hadoop Developer and Admin in a DevOps capacity
• Passionate towards working in Big Data and Analytics environment
• Experience in working with MapReduce programs using Apache Hadoop, Solr and Nutch
• Good understanding of Data Mining and Machine Learning techniques using Apache Mahout
• Experience with SQL and understanding of database concepts
• Experience with NoSQL - Cassandra, HBase
• Knowledge of Hadoop architecture and various components such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node and Map Reduce concepts
• Hands on cloud based deployments to match data in local datacenter to cloud
• Experience in developing solutions to analyze large data sets efficiently
• Ability to learn new system components and architecture in shorter duration
• Handles responsibilities including identifying functional and technical gaps, requirements gathering, designing solutions, development, documentation, and production support
• Excellent interpersonal and communication skills, strong business acumen, creative problem solving skills, technical competency, team-player spirit, and leadership skills

TECHNICAL SKILLS

Java & J2EE: Core Java, Servlets, JSP, JDBC, Java Beans, REST API, HTTP, XML, JSON, GSON

OS & Software: Windows 7/8, Mac OSX, UNIX, RHEL, MS Office, Adobe CS, VMWare

Hadoop: HDFS, MapReduce, ZooKeeper, Solr, Nutch, Hive, Spark, Chef/ Knife, AWS

IDE Tools: Eclipse, XCode, Maven, GIT, SVN

Programming: C, C++, C#, Java, SML, Python, SOAP, Ruby, SAS, Shell

Databases: Oracle 11g, MySQL, MS-SQL Server

Testing: Ant, Maven, Selenium, JUnit

Other: Jenkins, GIT, Confluence, JIRA, Fish-Eye, Peer-Coding

PROFESSIONAL EXPERIENCE

Confidential, Oakland, CA

Sr. Software Engineer

Responsibilities:

• Designed and tested scalable, highly available content services and tools that operate at web search scale.
• Performed continual improvement for three independent projects.
• Strengthened development methodologies and processes and maintained code.
• Advocated best programming practices and standards in an Agile environment
• Supported and consulted with the internal engineering and business customer base.
• Large data sets of terabytes analysis using solr queries and shell scripts
• Involved in running Hadoop jobs for processing millions of records of text data
• Developed Map-Reduce jobs in java for web crawling, content cleaning and pre-processing
• Involved in weekly rotation for production support, bug fixes, and enhancements
• Responsible for managing data from multiple sources as delta dump, custom crawler, indexer and RDBMS
• Lead development of a query-context retaining system by working with other functional teams and stakeholders
• Coordinated development with cross functional teams and offshore teams
• Provided production support during deployments of various components and software
• Used JIRA, GIT and Chef / Knife to manage builds, packages and source code
• Programmed Chef cookbooks, recipes and Knife packages using Ruby for the builds and packages management
• Provided in-depth technical and business knowledge to ensure efficient design, programming, implementation and on-going support for the application
• Decreased turn-around time to solve live production issues by working with cross-functional teams
• Handled node management of 48 node SOLR and 200 node Hadoop cluster in a 200 TB content capacity
• Interacted with the Business Requirements and the design team and preparing the Low Level Software Design and high level design documents

Environment: Java5, JDK1.7, Spring MVC, XML, GSON, JSON, REST, Hadoop, HDFS, Map Reduce, LINUX, Solr, Nutch, Tomcat, Ruby, Cassandra

Confidential, Rolling Meadows, IL

Software Developer

Responsibilities:

• Worked with the Data Science team to gather requirements for various data mining projects
• Deployed apps written for cloud and moved indexed content from HDFS to AWS buckets.
• Optimized buckets every sprint to hold current data.
• Worked with application teams to install operating system, Hadoop updates, patches, version upgrades as required
• Designed and Developed multiple Map-Reduce programs to analyze data and model unusual activity based on different variables for the Data Science team
• Involved in loading data from LINUX file system to HDFS
• Responsible for managing data from multiple sources
• Developed scripts and processes to push data from local data center to AWS S3 using Shell and Ruby
• Maintained Data Quality over large datasets for different applications
• Managed 6 multi-node clusters serving production traffic and involved in weekly production support
• Configured and recommended changes to Hadoop installation and management
• Performed batch analytics using built-in HDFS Map Reduce
• Performed cleanups on development environments using Python scripts.
• Involved in identifying possible ways to improve the efficiency of the system
• Studied Requirements, Software Development Specification, Development and Unit Testing
• Conducted technical/business evaluations of requirements and recommend appropriate solutions for clients
• Administered a 12 node Cloudera CHD5 cluster
• Created and maintained technical documentation for launching in an Agile environment

Environment: Hadoop, JDK 1.7, App Security, Hive, HDFS, AWS, MapReduce, LINUX, Python, Cassandra

Confidential, Peoria, IL

Java Developer w/ Hadoop

Responsibilities:

• Involved in setting up Hadoop clusters.
• Responsible for coding Map Reduce program, testing, debugging, peer code review, troubleshooting and maintain status report.
• Developed Map Reduce programs in Java for going through borrower history to determine impact on borrowers for a production issue and provide statistics to business.
• Developed Java API for HBase and Cassandra.
• Programmed Map Reduce in Python on datasets of size over 40TB to identify, aggregate, and process data models for analysis
• Executedautomation scriptsthat clean up log files based on timeline from each HDFS node and the clusters to assist the PRODUCTION team.
• Used MongoDB to provide backend storage for apps built on NodeJS
• Used WinSCP, FTP and SFTP to obtain data from external systems.
• Worked on various data formats including tab delimited, comma-separated, XML, JSON and semi-structured data.
• Involved in upgrading Hadoop 1 to Hadoop 2.
• Followed agile software development practice paired programming, test driven development and scrum status meetings.
• Used Eclipse Integrated Development Environment (IDE) in entire project development.

Environment: Hadoop 1 & 2, Map Reduce, Java 7, Python, PIG, Hive, Unix, HBase, Cassandra, MongoDB, MySQL

Confidential, Dallas, TX

Java Developer

Responsibilities:

• Worked independently to maintain core IT infrastructure and document software installations, upgrades, and migrations
• Created MS Active Directory Services to meet network policy requirements for applications Coordinated security assessments with business needs and manage VMWare server deployment
• Used Scala briefly to create programs that setup and run faster compared to Java.
• Provided technical and business leadership to the consultant team overseas and identified key project risks and mitigated effectively
• Used struts validation framework for form level validation
• Wrote test cases in JUnit for unit testing of classes
• Involved in templates and screens in HTML and JavaScript
• Provided technical support for production environments resolving the issues, analyzing the defects, providing and implementing the solution defects
• Built and deployed Java applications into multiple Unix based environments

Environment: JDK 1.5, J2EE 1.4, JSP, Servlets 2.5, JavaScript, JUnit 3.8, MS Active Directory, Unix Systems, Cent OS

Confidential, Alpharetta GA

Java developer

Responsibilities:

• Built an end to end vertical slice for a JEE based billing application using popular frameworks like Spring, Hibernate, JSF, Facelets, XHTML, Maven2, and Ajax by applying OO design concepts, JEE & GoF design patterns, and best practices
• Designed the logical and physical data model, generated DDL scripts, and wrote DML scripts for Oracle 9i database
• Gathered business requirements and wrote functional specifications and detailed design documents
• Identified and fixed transactional issues due to incorrect exception handling and concurrency issues due to unsynchronized block of code
• Assisted in designing, building, and maintaining database to analyze life cycle of checking and debit transactions
• Used Web Sphere to develop JAX-RPC web services
• Developed Unit Test Cases, and used JUNIT for unit testing of the application
• Involved in the design team for designing the Java Process Flow architecture
• Closely worked with QA, Business Units and Architects to solve various defects in quick and fast to meet deadlines

Environment: Java 1.2/1.3, Swing, Applet, Servlet, JSP, JUnit

Confidential

Jr. JAVA Developer

Responsibilities:

• Extensively used Core Java, Servlets, JSP and XML
• Used Struts 1.2 in presentation tier
• Generated the Hibernate XML and Java Mappings for the schemas
• Used DB2 Database to store the system data
• Actively involved in the system testing
• Involved in fixing bugs and unit testing with test cases using JUnit
• Wrote complex SQL queries and stored procedures
• Used Asynchronous JavaScript for better and faster interactive Front-End
• Used IBM Web-Sphere as the Application Server

Environment: Java 1.2/1.3, Swing, Applet, Servlet, JSP, XML, HTML, Java Script, Oracle