Hadoop Developer/lead Resume
Florida Hadoop Developer Lead, FloridA
SUMMARY:
- A dynamic professional with over 8 years of experience in Hadoop & BigData related technologies with good exposure in Map Reduce, HDFS, Hive, Sqoop, Pig, Cornerstone, Magellan
- MapR certified Hadoop Developer & Splunk certified Power User.
- Excellent understanding/ knowledge of Hadoop architecture and various components such as
- HDFS, Job Tracker, Task Tracker, Name Node, Data Node, Resource Manager and Node Manager and Map Reduce programming paradigm
- Excellent understanding/ knowledge about troubleshooting capability in every tier of the application for enterprise and standalone applications.
- Hands on experience in developing and deploying using Hadoop Ecosystem components like Hadoop Map Reduce, HDFS, Hive, Sqoop, Pig in MapR Hadoop Ecosystem.
- Experience on Apache Hadoop Map Reduce programming, PIG Scripting, Hive warehousing and Distribute Application HDFS.
- Experience in importing and exporting data using Sqoop from HDFS to Relational Database Systems and vice - versa.
- Experience in all phases of software design life-cycle management and implementation.
- Outstanding leadership abilities able to coordinate all phases of project-based efforts while managing, motivating and leadership project teams.
- Hands-on experience in learning and excelling at new technologies as needed. Adept at developing innovative applications, and technical specifications.
- Strong experience in Development and Production support projects.
- Good Experience on Version control systems like Tortoise SVN and GIT
- Used Jenkins for application validation and building the system.
TECHNICAL SKILLS:
Big Data: Apache Hadoop, HDFS, Map Reduce, Hive, Pig, Sqoop, Spark (Beginner).
Languages: Scala(Beginner), Java 1.6, PL/SQL.
RDBMS: Oracle 9i, 10G.
Scripting Languages: UNIX Shell script, HTML
XML Technologies: XML
Deployment Tools: SVN, GIT
Building Tools: Maven
Development Tools: Eclipse
Operating systems: Windows XP/7/8, Linux, MAC
Methodology: Waterfall, Agile
PROFESSIONAL EXPERIENCE:
Confidential, Florida
Hadoop Developer/Lead
Responsibility
- Data Ingestion into Cornerstone (Big data Repository) from Credit Bureau’s through Ingestion activities.
- Appling deduping and adding rules on top of deduped data.
- Creation of external, managed & Partitioned Tables in Hive to store data.
- Running the workflow through Event Engine.
- Creating CSV and fixed width files and sending back to Mainframes for downstream applications.
- Coordinating and leading the team providing technical suggestion.
- Business process understanding and requirement gathering.
- Develop Utilities, reusable components for applications using Hadoop technology stack.
- Involve in different performance tuning approach to improve application response time.
- Involved in running Hadoop jobs for processing millions of records of text data.
Technical Details: Hive, Hadoop, Unix, Cornerstone, Sqoop, Pig, Magellan, Shell Script, Event Engine.
Confidential
Hadoop Developer
Responsibility
- Sqoop Extracts to pull data from Teradata into HDFS.
- Automation of workflow from pulling data to HDFS to generation of reports using Spring Batch framework.
- Writing of Hive scripts based on business logic as per requirement.
- Creation of external, managed & Partitioned Tables.
- Using crontab to schedule jobs.
- Writing Utilities, UDFs for the big data platform, code review, define standards, best practices
- Involved in identifying possible ways to improve the efficiency of the system
- Business process understanding and requirement gathering.
Technical Details: Hadoop, Hive, Unix, Sqoop, Spring Batch Framework, Maven, Shell Script, Cornerstone.
Confidential
Hadoop Prod Support Analyst
Responsibility
- Co-coordinating with offshore and direct interaction with Clients
- Loading data into hive.
- Changing views as per the incoming batches.
- Enhancements as per the requirements.
- Requirement gathering, design, development, testing and Weekly status reporting,
- Monitoring the production system and measuring its efficiency and creating reports.
- Production strategy, planning, execution.
- Resolution of Defect reported by application users
- Application Support and Maintenance of the application.
- Interaction with business users for requirement clarification an
- Production Support Activities.
- Monitoring of jobs as well as the health of cluster.
- Working on Change Requests as well as Service Requests.
- Handling P0/P1/P2/P3 tickets.
Technical Details: Hadoop, Hive, Unix, HDFS, BBEdit, Autosys & core JAVA
Confidential
Hadoop Developer
Responsibility
- Requirement gathering and estimation.
- Coding using JAVA (Map Reduce)
- Coding for different Input formats.
- Co-coordinating with offshore and direct interaction with Clients
- Unit, Functional and Integration Testing of the Application.
- Interaction with business users for requirement clarification and resolution of problems reported
- Design, Implementation and Deployment for enhancements
- Coordination with global teams and vendor.
- Deploying the code.
Technical Details: Hadoop, Hive, Unix & core JAVA.
Systems Engineer
Confidential
Responsibility
- Creation of workflows and lifecycles.
- Upgradation of CUSTOMIZED USPL DRM from WebTop 6.5SP2 to 6.6.
- Unit, Functional and Integration Testing of the Application.
- Completed framework establishment, development, deployment and support hand over for this enhancement.
- Communicated to the clients and business on the daily basis.
- Gathered the business requirements from the Business Partners and Subject Matter Experts.
Technical Details: Core Java, Documentum & Tools