Hadoop Developer/ Lead Resume
Nyc, NY
PROFESSIONAL SUMMARY:
- Experienced programming professional with exceptional skill in high - performance code writing, enterprise application architecture, database theory, analytics and big data ecosystem seeks position as Hadoop Developer/Architect which enables use of exceptional knowledge in Hadoop, MapReduce, Splunk, Hive, Pig and Oozie to improve analytics systems and collaborate on program development.
- A dynamic professional with over 7 years of experience in IT and over 4 Years of experience in Hadoop & BigData related technologies with good exposure in MapReduce, HDFS, Hive, Sqoop, Pig, Cornerstone, Magellan
- MapR certified Hadoop Developer & Splunk certified Power User.
- Excellent understanding/ knowledge of Hadoop architecture and various components such as HDFS, JobTracker, Task Tracker, NameNode, Data Node, Resource Manager and Node Manager and MapReduce programming paradigm
- Excellent understanding/ knowledge about troubleshooting capability in every tier of the application for enterprise and standalone applications.
- Hands on experience in developing and deploying using Hadoop Ecosystem components like Hadoop MapReduce, HDFS, Hive, Sqoop, Pig in MapR Hadoop Ecosystem.
- Experience on Apache Hadoop MapReduce programming, PIG Scripting, Hive warehousing and Distribute Application HDFS.
- Experience in importing and exporting data using Sqoop from HDFS to Relational Database Systems and vice-versa.
- Experience in all phases of software design life-cycle management and implementation.
- Outstanding leadership abilities able to coordinate all phases of project-based efforts while managing, motivating and leadership project teams.
- Hands-on experience in learning and excelling at new technologies as needed. Adept at developing innovative applications, and technical specifications.
- Strong experience in Development and Production support projects.
- Good Experience on Version control systems like Tortoise SVN and GIT
- Used Jenkins for application validation and building the system.
TECHNICAL SKILLS:
Big Data: Apache Hadoop, HDFS, MapReduce, Hive, Pig, Sqoop, Spark
Languages: Scala(Beginner),Java 1.6, PL/SQL, HQL
RDBMS: Oracle 9i, 10G
Scripting Languages: UNIX Shell script, HTML
XML Technologies: XML
Deployment Tools: SVN, GIT
Building Tools: Maven
Development Tools: Eclipse
Operating systems: Windows XP/7/8, Linux,MAC
Methodology: Waterfall, Agile
PROFESSIONAL EXPERIENCE:
Confidential, NYC, NY/ Fort Lauderdale, FL
Hadoop Developer/ Lead
Responsibilities:
- Data Ingestion into Cornerstone (Big data Repository) from Credit Bureau’s through Ingestion activities.
- Appling deduping and adding rules on top of deduped data.
- Creation of external, managed & Partitioned Tables in Hive (HQL) to store data.
- Running the workflow through Event Engine.
- Creating CSV and fixed width files and sending back to Mainframes for downstream applications.
- Coordinating and leading the team providing technical suggestion.
- Business process understanding and requirement gathering.
- Develop Utilities, reusable components for applications using Hadoop technology stack.
- Involve in different performance tuning approach to improve application response time.
- Involved in running Hadoop jobs for processing millions of records of text data.
Environment: Hive (HQL), Hadoop, UNIX, Cornerstone, Sqoop, Pig, Magellan, and ShellScript Event Engine.
Confidential, Fort Lauderdale, FL
Sr. Hadoop Developer
Responsibilities:
- Sqoop Extracts to pull data from Teradata into HDFS.
- Automation of workflow from pulling data to HDFS to generation of reports using Spring Batch framework.
- Writing of Hive scripts based on business logic as per requirement.
- Creation of external, managed & Partitioned Tables.
- Using crontab to schedule jobs.
- Writing Utilities, UDFs for the big data platform, code review, define standards, best practices
- Involved in identifying possible ways to improve the efficiency of the system
- Business process understanding and requirement gathering.
Environment: Hadoop, Hive (HQL), UNIX, Sqoop, SpringBatch Framework, Maven, ShellScript, Cornerstone
Confidential
Sr. Hadoop Developer
Responsibilities:
- Co-coordinating with offshore and direct interaction with Clients
- Loading data into hive.
- Changing views as per the incoming batches.
- Enhancements as per the requirements.
- Requirement gathering, design, development, testing and Weekly status reporting,
- Monitoring the production system and measuring its efficiency and creating reports.
- Production strategy, planning, execution.
- Resolution of Defect reported by application users
- Application Support and Maintenance of the application.
- Interaction with business users for requirement clarification an
- Production Support Activities.
- Monitoring of jobs as well as the health of cluster.
- Working on Change Requests as well as Service Requests.
- Handling P0/P1/P2/P3 tickets.
Environment: Hadoop, Hive, UNIX, HDFS, BBEdit, Autosys & coreJAVA
Confidential
Hadoop Developer
Responsibilities:
- Requirement gathering and estimation.
- Coding using JAVA (Map Reduce)
- Coding for different Input formats.
- Co-coordinating with offshore and direct interaction with Clients
- Unit, Functional and Integration Testing of the Application.
- Interaction with business users for requirement clarification and resolution of problems reported
- Design, Implementation and Deployment for enhancements
- Coordination with global teams and vendor.
- Deploying the code.
Environment: Hadoop, Hive, UNIX & core JAVA
Confidential
Java Developer
Responsibilities:
- Creation of workflows and lifecycles.
- Upgradation of CUSTOMIZED USPL DRM from webtop 6.5SP2 to 6.6.
- Unit, Functional and Integration Testing of the Application.
- Completed framework establishment, development, deployment and support hand over for this enhancement.
- Communicated to the clients and business on the daily basis.
- Gathered the business requirements from the Business Partners and Subject Matter Experts.
Environment: Core JAVA, Documentum & Tools
