We provide IT Staff Augmentation Services!

Sr. Hadoop Admin / Architect Resume

5.00/5 (Submit Your Rating)

PROFESSIONAL SUMMARY:

  • IT Professional Consultant with around Seventeen years of experience in information technology using distributed object - oriented platform , UNIX (Client Server), Object Oriented platform/technologies and Mainframes. Experience spans in the areas of Installations, version up-gradations, deployment, planning, design, development, implementation, maintenance phase projects.
  • Have been exposed to software development life cycle methods and possess good analytical, technical & problem solving skills. Experience has been gained in industries/business systems associated with Telecommunications, Retail (Supply Chain, Pricing, Item Database, and Invoicing), Banking, Auto Insurance, Claims Processing and Child Protective Services.
  • Knowledge, skills, and hard work have been key factors in the successful implementation of many development & maintenance projects. Possess good Management, Team Lead, & Client Interaction skills along with oral & written communication skills.
  • As an Architect/Hadoop administrator, played a pivotal role is setting up large scale Hadoop clusters with ~ 60-800 nodes, establishing operations, automation of Production environment developing in-house tools for auto renewal of keytabs, Hadoop service validations.
  • Assisted in designing and developing the enterprise solution for on-boarding data using Hadoop as a platform
  • Wrote automated scripts to process and format the data using hive API.
  • Worked on Spark Administration, Spark Performance tuning, Spark guidance to cross functional teams
  • As a Sr. Programmer Analyst have led technical meeting with Business Users, Infrastructure teams, Support teams, Development teams to provide solutions that meet the requirement
  • Key role as a liaison between various departments to co-ordinate project development, resolve issues, setup user meetings (internal & external clients), organize team for development and implementation, track deliverables, milestones, requirements, resources etc.,
  • Worked on Hortonworks HDP distribution versions - Hadoop ecosystem/HDFS/Yan/MapReduce Framework, NoSql, HBase and Hive.
  • As a Lead was involved with business user interaction, definition of scope, sizing, planning, organizing, project timeline management of the enhancement requests
  • Managed team members as technical development members and evaluated performance on a regular basis and provided feedback to the management over any shortfalls.
  • Worked as an interface between offshore team, business users, on-site management to execute the various tasks associated with the development, maintenance, execution & implementation of the various application solutions.
  • Provided valuable suggestions, streamlined current processes to the application development /maintenance, support management, task prioritization, and timeline based execution, quality enforcement.
  • Structured Analysis, Design, Coding, Construction, Testing, Requirements/Functional/Tech/Test Plan Documentation, System Testing, Integration Testing, Change Management Process, Version Control Process, SDLC methodology, Root Cause Analysis, Production Support, Data Modeling, Transformation, Construction, Business Requirements Gathering, GUI/Screen Design, Scoping, Technical Design Documentation, Functional Documentation, Implementation & Deployment, Data Analysis & Operations, Customer Interface

TECHNICAL EXPERIENCE:

BigData Technologies: HDFS, MapReduce (MRv1/MRv2), Hive, Pig, Zookeeper, Sqoop, Oozie, Flume, Kafka, HBase, Spark, Kafka, Ranger, Knox, Tez, SmartSense

Hadoop Distributions: HDP (1.3.x, 2.2.x, 2.3.x, 2.4x, 2.5x, 2.6x)

Scripting & Programming Languages: Shell Scripting, HQL, Python, Core-JAVA, JavaScript, HTML, XML, CICS, COBOL, JCL, SQL, PL/SQL

Database: MySQL, PostgreSQL, DB2, IMS-DB, ORACLE, VSAM, MS SQL, MS-Access, IDMS

Software/Tools: TSO/ISPF, CA-7, CA-11, PANVALET, ELIPS, FILE-AID, SPUFI, QMF, ABEND-AID, CEDF, EAZYTRIEVE, SDF,DCLGEN, FTP, MS-VISIO, SDSF, DUMPMASTER, PLATINUM, XPEDITER, Visio, SYNCSORT, GN Architecture Tools, INSYNC-DB2, INTERTEST, TELON, EASYTRIEVE, Web Aware (CICS)

Operating Systems: Red Hat Linux 6, Centos 5, MVS (OS/390), MVS (z/OS), UNIX, WINDOWS

Monitoring Tools: Ambari Metrics, Nagios, Ganglia

Quality Functions: SEI-CMM-5 process standards

PROFESSIONAL EXPERIENCE:

Confidential

Sr. Hadoop Admin / Architect

Responsibilities:

  • Extensively involved in Cluster Capacity planning, Hardware planning, and Tuning/optimizing cluster for performance.
  • Worked on upgrades/patches for HDP versions 1.3.x, 2.1.x, 2.3.x, 2.4.x,2.5.x, 2.6.x
  • Demonstrated understanding of concepts, best practices and functions to implement a Big Data solution in a corporate environment.
  • Help design of scalable Big Data clusters and solutions.
  • Designed and Configured the Clusters with Hadoop eco system services required i.e., Hive- Metastore, Hive server2, Kerberos, HDFS, Spark, Oozie, Storm, Falcon, Kafka, HBase, Zookeeper, Knox, Slider, SmartSence.
  • Troubleshooting the cluster by reviewing Hadoop service log files to find RCA.
  • Implemented High-Availability for Name node, Yarn's Resource Manager and Hive services
  • Implemented Rack Awareness for data locality optimization.
  • Have ability to do stress tests and benchmark the large distributed clusters
  • Involved in collecting and aggregating large amounts of streaming data and every node logs into HDFS using Flume.
  • Monitoring and controlling local file system disk space usage, log files, cleaning log files with scheduled scripts.
  • Possess good familiarity with open source configuration management and deployment tools such as Puppet.
  • Implemented Capacity Scheduler to share the resources of the cluster for all Yarn managed applications run by users.
  • Experience in using Sqoop to migrate data to and fro from HDFS and RDBMS (MySQL, Oracle & Teradata) and deployed Hive and HBase integration to perform OLAP operations on HBase data.
  • Supporting Hadoop developers and assisting in optimization of HQL, Pig, Impala and Spark.
  • Experience in troubleshooting errors in HBase Shell/API, Pig, Hive and MapReduce, Tez
  • Experienced in creating shell scripts and python scripts that gets the jobs info running every hour and puts into hive tables to generate the cluster usage reports.
  • Experience in setting up perimeter level for Kerberos with LDAP integration and storage/SQL based authorizations for Hive.
  • Worked on user onboarding to setup new Hadoop users. This includes setting up Linux users, Ambari views/UI users & adding to appropriate groups in LDAP to get data access.
  • Worked with Ranger/Kafka/Storm for the proof of concept for carrying out log processing on distributed system.
  • Involved in defining job flows using Oozie for scheduling jobs.
  • Enabled speedy reviews and first mover advantages by using Oozie to automate data loading into the Hadoop Distributed File System and PIG to pre-process the data.
  • Automated backing up data on regular basis to a DR cluster using distcp scripts.
  • Worked with network and Linux system engineers/admin to troubleshoot/define optimum network configurations/issues, server hardware and operating system.
  • Evaluate and propose new tools and technologies to meet the needs of the organization
  • Have worked with Hortonworks Tech support personnel to troubleshoot/fix the production issues, opening respective severity cases to them.

Confidential, Jefferson City, MO

Programmer Analyst

Responsibilities:

  • Involved and participated in business requirement meetings to gather the actual requirement from the end users i.e., eligibility Specialists when the legacy GAP determination system getting integrated into the current Confidential system.
  • Also analyzed the impacted modules and modified some of the high level design documents that are submitted to the end-users for their approval accordingly.
  • Modified the Technical specification documents for all the existing impacted modules of the Confidential systems.
  • Modified the Placement Information Screen of the Case Management System to accommodate the relationship between the child and the vendor individuals when child is under Legal Guardianship Placement
  • Also made changes to the court information screen to integrate the legacy system's additional information section of GAP, when child's legal status for Legal Guardianship is set.
  • Did the analysis to the existing eligibility batch subroutine to in corporate the GAP IV-E determinations based on the information entered online by case manager and the eligibility specialist and the pre-defined criteria for all eligible kids. These automated determinations needs to be done by monthly batch determination.
  • Need to modify the worker alert screen and the rules table to show up the converted over alerts i.e., "IV-E Guardianship Determination is Required" alerts from the existing IV-E GAP system
  • Analyzed the existing business functionality of the GAP IV-E Eligibility Batch subroutine
  • Did the analysis to convert the existing GAP IV-E system data into the Confidential database, adding new database fields to the existing DB2 tables and creating new tables
  • Involved in the technical walk through meetings of this PAQ
  • Developing and modifying programs using COBOL, JCL, SQL, HTML, CICS, DB2, JAVASCRIPT
  • Extensively using SPUFI to prepare the test cases and provide the same for testing team
  • Preparing test script documents and the test data for unit and integration testing to cover the functionality, features and reliability
  • Demonstrating technical experience in the implementation of CICS WEBAWARE (CICS) methodology combining the following technologies:

Technologies: Z/OS, TSO, COBOL, JCL, ELIPS, INSYNC, Platinum, QMF, IBM UTILITIES, TSO/ISPF, VSAM, DB2, WEBAWARE (CICS), HTML, JavaScript and INTERTEST (Batch & Online), Dump Master (Batch & Online), XML and Ruby On Rails, AJAX, Prototype and JQuery Frameworks

Programmer Analyst

Confidential

Responsibilities:

  • Did the analysis and made changes to the existing eligibility batch subroutine to in corporate the new applicable/non-applicable criteria in doing the IV-E / FFP Adoption Subsidy determinations/Re-determinations for the eligible kids
  • Analyzed the existing business functionality of the IV-E / FFP Eligibility Batch subroutine
  • Made changes to batch Eligibility subroutine to remove the Income and Resource considerations In FFP determinations/re-determinations
  • Wrote the Technical Specification documents in quick turnaround time meeting the tight deadlines
  • Wrote a new one time batch eligibility subroutine that needs the process only the DCNS that are qualified to be re-determine
  • Involved in the technical walk through meetings of this PAQ
  • Developed and modified programs using COBOL, JCL, SQL, HTML, CICS, DB2, JAVASCRIPT
  • Extensively used SPUFI to prepare the test cases and provide the same for testing team
  • Prepared test script documents and the test data for unit and integration testing to cover the functionality, features and reliability
  • Added an new QA review worker alert that is sent to the respective Eligibility Specialist, when an adoption subsidy determination is completed to any Child
  • Had involved the business requirements meetings that are held with the Helpdesk support group and end users i.e., eligibility Specialists
  • Involved in regression testing of both online and batch eligibility determination life cycle i.e., creation of automated IV-E / FFP Adoption Subsidy determinations, sending informational alerts to eligibility specialists, invalidating the existing/past determinations for the same calc-period in case of Re-determinations, proper navigation through the online screens and creating the history instances.
  • Worked on the JIRA tickets that are raised on the production problems occurred in the support period after the implementation of changes.
  • Demonstrated technical experience in the implementation of CICS WEBAWARE (CICS) methodology combining the following technologies:

Technologies: Z/OS, TSO, COBOL, JCL, ELIPS, INSYNC, Platinum, QMF, IBM UTILITIES, TSO/ISPF, VSAM, DB2, WEBAWARE (CICS), HTML, JavaScript and INTERTEST (Batch & Online), Dump Master (Batch & Online), XML and Ruby On Rails, AJAX, Prototype and JQuery Frameworks

Sr. Programmer Analyst

Confidential

Responsibilities:

  • Involved in making changes to the existing online Court information screen programs and all the impacted batch and online subroutine programs.
  • Wrote the Technical Specification documents in quick turnaround time meeting the tight deadlines
  • Involved in the technical walk through meetings of this PAQ
  • Prepared test script documents and the test data for unit and integration testing to cover the functionality, features and reliability
  • Current knowledge of the Department of Social Services Children's Division business practices, policies and procedures
  • Had communicated with DDS Helpdesk support group, UAT team and business users and helped them in provided the list of DCNS/ CASES for their testing/region
  • Demonstrated technical experience in the implementation of CICS Web Aware (CICS) methodology combining the following technologies: COBOL, DB2, SQL, HTML, JavaScript, JCL and TSO/ISPF

Technologies: Z/OS, COBOL, JCL, ELIPS, INSYNC, Platinum, QMF, IBM UTILITIES, TSO/ISPF, VSAM, DB2, Web Aware (CiCs), HTML, JAVA, JavaScript and INTERTEST (Batch & Online), Dump Master (Batch & Online), XML

Sr. Programmer Analyst

Confidential

Responsibilities:

  • Involved in enhancing the Web Aware and Subroutine programs for both online and batch for the applications, Case Management and Eligibility
  • Involved in modifying the technical specifications documents based on the High Level Design Documents (HLD)
  • Extensively used SPUFI to validate queries for better results before implementing
  • Prepared test script documents and the test data for unit and integration testing to cover the functionality, features and reliability
  • Expertise in the design, code, test and implementation of the remaining deliverables for the Missouri Confidential system
  • Prepared the estimates for the client for various change requests, analyzing the Business Requirements and the current functionality of the system
  • Current knowledge of the Department of Social Services Children's Division business practices, policies and procedures
  • Demonstrated technical experience with Missouri Office of Administration Information Technology Services Division programming standards
  • Demonstrated technical experience in the implementation of CICS Web Aware (CICS) methodology combining the following technologies: COBOL, DB2, SQL, HTML, JavaScript, JCL and TSO/ISPF

Technologies: Z/OS, COBOL, JCL, ELIPS, INSYNC, Platinum, QMF, IBM UTILITIES, TSO/ISPF, DB2, VSAM, Web Aware (CiCs), HTML, JAVA, JavaScript and INTERTEST (Batch & Online), Dump Master (Batch & Online), XML

Sr. Programmer Analyst

Confidential

Responsibilities:

  • Involved in developing and enhancing the Web Aware and Subroutine programs for both online and batch for the applications, Case Management, Eligibility, IA, CA/N hotline, Financials and Resources.
  • Played a role in Production Support team and fixed the production problems assigned, in quick turnaround time depending on the priority of the tickets.
  • Involved in developing the online and batch case record report programs for the new requirements
  • Involved in developing the technical specifications documents based on the High Level Design Documents (HLD)
  • Extensively used SPUFI to validate queries for better results before implementing
  • Prepared test script documents and the test data for unit and integration testing to cover the functionality, features and reliability
  • Involved in the functional enhancements like Fund Code, MHD, Case Record Report &
  • Concurrent plan changes (i.e., CCBs) to the existing system
  • Expertise in the design, code, test and implementation of the remaining deliverables for the Missouri Confidential system
  • Prepared the estimates for the client for various change requests, analyzing the Business
  • Requirements and the current functionality of the system
  • Expertise in executing those tasks necessary to provide production system support for the current Confidential including ongoing project implementations
  • Current knowledge of the Department of Social Services Children's Division business practices, policies and procedures
  • Quickly grasped the domain knowledge to successfully communicate with DDS Helpdesk support group, UAT team and business users
  • Demonstrated technical experience with Missouri Office of Administration Information Technology Services Division programming standards
  • Demonstrated technical experience in the implementation of CICS Web Aware (CICS) methodology combining the following technologies: COBOL, DB2, SQL, HTML, JavaScript, JCL and TSO/ISPF

Technologies: Z/OS, COBOL, JCL, ELIPS, INSYNC, Platinum, QMF, IBM UTILITIES, TSO/ISPF, VSAM, DB2, Web Aware (CiCs), HTML, JAVA, JavaScript and INTERTEST (Batch & Online), Dump Master (Batch & Online), XML

We'd love your feedback!