Hadoop Admin Resume
Bloomington, IL
SUMMARY:
- Having 9+ years of experience in Design, Develop and delivering software applications using Hadoop, Apache Spark, Apache Scala and Java applications.
- Working in big data domain for more than 6 years with expertise in Hadoop, Spark, Scala, Cassandra, Couchbase, Solr, Kafka and Storm.
- Worked on Apache Spark with huge data processing applications.
- Development experience with Apache Scala and Python. Knowledge of how to assess the performance of data solutions, and how to diagnose performance problems.
- Hands on experience in designing and developing scalable and distributed applications in big data technologies such as Hive, PIG, Sqoop.
- Have created workflows to schedule jobs in Oozie and exposure to big data monitoring tools like Ganglia.
- Created REST web services and used Apache Drill to query datasets in Data Lake such as S3 and HDFS.
- Experienced in working with Cloudera and Hortonworks distribution.
- Worked with Hadoop Admin team closely to resolve infrastructure related issues and took part in Hadoop upgrade.
- Customer facing skills to represent hadoop technology towards implementation for different complex solutions.
- Excellent working experience in agile development methodology and scrum process.
- Ability to get up to speed on variety of technical subject matters.
- Lead the team from onsite and get the deliverables from offshore on time.
- Have the motivation to take independent responsibility as well as ability to contribute and be a productive team member.
KEY DOMAIN AND TECHNICAL KNOWLEDGE:
Domain: Insurance, Retail and Manufacturing.
Technical: Hadoop, Spark, Scala, Hive, Pig, Sqoop, Oozie, Storm, Kafka, Solr
NoSQL: Cassandra, Couchbase
Programming: Java, Scala, Python and Shell scripting
Web service: REST web service.
Version control: svn, GIT.
Build tools: ant and maven
IDE: Eclipse, Dev Center.
Cont. Integration: Jenkins, Teamcity
PROFESSIONAL EXPERIENCE:
Confidential, Bloomington, IL
Hadoop AdminTechnology Stack: Apache Spark, Scala, Oozie, Hadoop, Hive, PIG, CDH.
Responsibilities:
- Design, develop and test the modules based on sprint story assignments.
- Follow the Agile methodology strictly and attend daily scrum meetings.
- Create Spark application code with Scala and deploy the application in Cluster.
- Develop and test Hive and PIG scripts for various data loads as applicable.
- Conduct technical meeting and get the developed code reviewed for the given module.
- Suggest and help in code review for the others in the team.
- Proactively share the updated versions in technologies and replacing the existing version and discuss the same with Clients.
- Work with Business team to understand any outstanding issue and resolve them.
Confidential, Irving, TX
Hadoop AdminTechnology Stack: Java, Cassandra, Hive, PIG, Kafka, Storm, Solr, Couchbase, CDH.
Responsibilities:
- Design, develop and test the modules based on sprint story assignments.
- Participate in Sprint planning and get the requirements from clients about various performance tuning activities and upcoming sprint stories.
- Follow the Agile methodology strictly and attend daily scrum meetings.
- Develop and test Hive and PIG scripts for various data loads as applicable.
- Conduct technical meeting and get the developed code reviewed for the given module.
- Suggest and help in code review for the others in the team.
- Proactively share the updated versions in technologies and replacing the existing version and discuss the same with Clients.
- Coordinate with the testing team to test and close the story in JIRA.
- Monitor Hadoop/Cassandra cluster for issues and continue to do performance tuning on various issues.
- Work with Business team to understand any outstanding issue and resolve them.
Confidential
Hadoop AdminTechnology Stack: Hadoop, Java, Hive, PIG, Oozie, Cassandra, Couchbase.
Responsibilities:
- Worked in a module to move the static content email to dynamic email which is customized for each customer.
- Design and develop the application per assigned stories.
- Participate in Scrum call and get the requirements and discuss blockers.
- Document the technology/business elements in Confluence.
- Work on existing email content bug fixes.
- Involved in all cycles of software process which includes design, development, testing.
- Also worked in Hadoop Admin activities like Cluster disaster recovery, Data node addition and software installation to Hadoop nodes.
Confidential
Hadoop AdminTechnology Stack: AWS, Java, Oozie, JQuery.
Responsibilities:
- Design and develop various user interface pages.
- Create user interface pages for create/update cluster details.
- Demonstrate the outcome on weekly basis.
- Create java programs to connect to AWS and provision clusters.
- Involved in all cycles of software process which includes design, development, testing.
- Present the final demo to the clients and document the reuse components as Knowledge document.
Confidential
Hadoop AdminTechnology Stack: Hadoop, Java, Hive, PIG, Oozie, Sqoop.
Responsibilities:
- Design, develop and test the modules based on sprint story assignments.
- Able to create scripts for processing huge raw operational and technical data.
- Created various processing techniques for processing batch data as well as realtime data.
- Create a model which incorporates data stores capable of storing and processing pre - computed data in different formats.
- Export the pre-computed data in various hybrid data stores for access through applications.
- Created REST services for data access by application to the underlying data stores.
- During this process created a reusable data-ingestion framework to move data from a particular source environment to a target environment.
- Conduct technical meeting and get the developed code reviewed for the given module.
- Suggest and help in code review for the others in the team.
- Proactively share the updated versions in technologies and replacing the existing version.
- Coordinate with the testing team to test and close the story in JIRA.
Confidential
Hadoop AdminTechnology Stack: Hadoop, Java, PIG, Oozie, Sqoop, AWS
Responsibilities:
- Coding the requirements and do unit test for given modules.
- Analyze about bootstrapping in Amazon EMR cluster and other software versions.
- Follow the Agile methodology strictly and attend daily scrum meetings.
- Create UI pages in JQuery and create Rest web services.
- Suggest and help in code review for the others in the team.
- Proactively share the updated versions in technologies and replacing the existing version.
- Coordinate with the testing team to test and close the story in JIRA.
- Document the technical and functional parts of modules and save in confluence.
- Demonstrate each module to the clients and enhance the code based on comments.
Confidential
Hadoop AdminTechnology Stack: Java, JSP, Servlet, SOAP web services, Oracle.
Responsibilities:
- End to end requirement mapping.
- Coding and Unit testing.
- Providing enhancements to the existing Applications.
- Implementing Struts MVC design with Java, Servlet, and JSP with Oracle10g.
- Participate in mandatory and cross functions across team .
- Responsible for implementing Database design and Data Model.
- Coordinate with the testing team to test and close the story in JIRA.