Hadoop Consultant Resume
Chicago, IL
SUMMARY
- 13 plus years of work experience in application and product development using full SDLC primarily using Hadoop, Core Java, Mainframe, ETL and Data warehousing Technologies.
- Well - equipped to provide software solutions, deliver quality applications and give technical advice.
- Strong technical and communication skills with 3 plus years of experience on Big Data Hadoop Ecosystem, and 5 years of working as a Tech Lead, managing and leading team at onshore and offshore.
- 13 plus years of progressive experience in Designing applications and development using full SDLC primarily on Distribution computing (Big Data Hadoop Ecosystem) and Data warehousing technologies.
- Experience in Mortgage Banking, Securities, Insurance, Logistics, Telecom and Retail Domain.
- Involved in various stages of application customizations like deployment, troubleshooting, monitoring, load testing, supporting both production and test environments.
- Strong knowledge on Big Data Hadoop ecosystem (Hive, HBase, Pig, Oozie, Sqoop).
- Experience in developing batch processing framework to ingest Terabytes of data into HDFS using Hive (HQL) scripts and HBase.
- Involved in System Analysis, Requirements Analysis, Designing and Implementing Data Lake, Migration and up-gradation.
- Excellent knowledge in RDBMS and Hadoop concepts and constructs along with Database Objects creation.
- Collected/translated business requirements into distributed architecture & robust scalable designs.
- Proficient in understanding business processes / requirements and translating them into technical requirements.
- Extensively worked in Database Design, Data Modeling, Development, Metadata, Tuning Hive queries and testing.
- Expertise in Estimation, high-level design and detailed design.
- Follow solution oriented approaches to deliver right solutions at right time.
- Committed to professionalism, highly organized, work under strict deadline schedules, have excellent written and verbal communication skills.
- Expertise in development and implementation of small and large-scale projects.
- Extensive experience in the areas of System study, Conceptual Design, Detail design, Requirement gathering, Analysis, Development, Implementation, Unit Testing & maintenance of Applications.
- Experience in Application Maintenance, Troubleshooting, Bug-fixing
- Experience in all phases of Software Development Life Cycle with a strong emphasis on analysis, design, development and testing of applications
- Highly motivated with the ability to work effectively in teams as well as independently.
- Excellent communication, self-motivated, organized individual with strong interpersonal and leadership skills.
- Adept at quickly understanding business domains and requirements and providing effective and efficient solutions.
- Well-disciplined hands-on coder in writing high quality reusable concise code dealing with complex problems.
TECHNICAL SKILLS
- Hadoop
- HDFS
- Hive
- PiG
- HBase
- Oozie
- Shell Script
- Spark SQL
- Core Java
- Hadoop APIs
- Mainframe
- COBOL
- JCL
- VSAM
- DB2.
- MongoDB
- C#
- Ajax
- XML
- Oracle
- MySQL
- MS SQL Server
- MS Access
- Teradata
- ASP.NET 3.5
- 4.0
- ADO.NET
- C
- C++
- Java Script.
PROFESSIONAL EXPERIENCE
Hadoop Consultant
Confidential, Chicago, IL
Responsibilities:
- Designed and Developed ETL Process to Generate Dynamic SQL for Exposure Data processing to handle Split, Substitute and Combine data defined in Metadata.
- Design and Develop ETL process for POS update process.
- Redesigned ETL Load Process for Rentrak ADs and Tunes data.
- Interacting with Business Users to understand Requirements.
- Performance Tuning Hive Queries.
- Written Hive UDF using Core Java.
Environment: MapR 5, Hive, Sqoop, Oracle, Shell Script, Python, Core Java, Agile.
Hadoop Consultant
Confidential, Overland Park, KS
Responsibilities:
- Responsible for understanding existing ETL Process and Design solution with Hadoop Ecosystem.
- Understand the requirements and Prepare HLD documents based on requirements
- Supported latest upgrades for existing Hadoop cluster.
- Participated in gathering and analysis of business and technical requirements.
- Participated in Design and Implementation of Data Lake in Hadoop.
- Converting Functional requirement into Technical Requirement.
- Implemented code migration and participated in code reviews.
- Design and Developing Common Hive Script for Automation and Handling Late Arrival Data.
- Design and Developing Hive UDF to Generate Unique Dimension Key from Natural keys with HBase.
- Designed and Developed Hive UDTF to get ORC file counts.
- Involved in Performance Tuning.
- Written Hive UDF using Core Java.
Environment: Hortonworks HDP 2.3, Hive, HBase, Sqoop, Spark SQL, Teradata, Shell Script, Oozie, Core Java.
Tech Lead
Confidential, Kansas City, MO
Responsibilities:
- Allocating and Assigning work to the team.
- Responsible to analyze and understand end to end system flow.
- System Analysis - problem research/resolution, performance improvement.
- Design and Provide Solution to enhance performance and stability in the system.
- Creating POC on Hadoop Standalone Cluster to process sales data from Oracle.
Environment: Cobol, Jcl, DB2, VSAM, Unix, Oracle, Teradata.
Tech Lead
Confidential, Gaithersburg, MD
Responsibilities:
- Allocating and Assigning work to the team.
- Responsible for gathering requirements and design solution.
- Identifying Bottlenecks and Areas for Performance improvement.
- Reviewing all the work products delivered to client.
- Coordinating with offshore in developing and resolving issues.
- Estimating and Implementing Enhancements.
- Identifying recurring incidents.
- Providing resolution for implementation.
Environment: COBOL, JCL,DB2, VSAM, CICS, File Aid, Spufi, Xpeditor.
Tech Lead
Confidential, Hoffman Estates, IL
Responsibilities:
- Responsible for managing and leading multiple Applications.
- Estimation and work allocation to the team members monitor and track it till closure.
- System Analysis - problem research/resolution, performance improvement.
- Writing Specs, coding programs and also involved in testing
- Coordinating with offshore in resolving bugs and production fixes.
- Estimating and Implementing Small Enhancements.
Environment: COBOL, JCL,DB2, VSAM, MQ Series, CICS, Endevor, File Aid, Spufi, Xpeditor.
Technology Analyst
Confidential
Responsibilities:
- Responsible for Analysis of Business and Technical requirements.
- Arrange to pullover production data to test or development regions for testing purposes.
- Preparing Requirements documents, Impact Analysis, Detail Design.
- Prepare and test the code in unit and system testing regions. Debugging the programs.
- Preparing Unit and System test plans
- Testing and Reviewing all the work products sent to clients
Environment: COBOL, JCL, IDMS.
Senior Software Engineer
Confidential
Responsibilities:
- Coding & Unit Testing of Work assigned.
- Responsible for developing automated report generation for Batch Cycle.
- Testing all the work products sent to clients.
- System Analysis - problem research/resolution, performance improvement.
- Identifying and fixing program bugs.
- Implementing parallel processing of jobs where feasible.
Environment: COBOL, JCL, VSAM, DB2
Senior Software Engineer
Confidential
Responsibilities:
- Responsible for Resolving the Tickets
- Coding & Unit Testing of Work Packets assigned.
- Testing all the work products sent to clients.
- Identifying and fixing program bugs.
Environment: COBOL, JCL, VSAM, DB2
Software Engineer
Confidential
Responsibilities:
- As an Onsite Coordinator was responsible for Analysis of Business requirements.
- Work division allocation to offshore team.
- Presenting business and technical designs to the Client.
- Identifying and fixing program bugs.
- System Analysis - problem research/resolution, performance improvement.
- Estimation and work allocation to the team members monitor and track it till closure.
- Arrange to pullover production data to test or development regions for testing purposes.
- Liaising with Business Analyst and Architect in finalizing the Design
- Preparing Requirements documents, Impact Analysis, Detail Design.
- Prepare and test the code in unit and system testing regions. Debugging the programs.
Environment: COBOL, JCL, VSAM, Pattern
Software Engineer
Confidential
Responsibilities:
- Verifying and validating all the work products sent to clients.
- Identifying and fixing program bugs.
- System Analysis - problem research/resolution, performance improvement.
- Pull production data to test or development regions for testing purposes.
- Mentoring less experienced resources.
- Followed stringent Quality procedures for promotion of code to Production environment.
- Preparing Impact Analysis document.
- Prepare and test the code in unit and system testing regions. Debugging the programs.
Environment: COBOL, JCL, VSAM, Pattern