Hadoop Administrator Resume
3.00/5 (Submit Your Rating)
Addison, TX
SUMMARY:
- Wole TEMPhas 8 years of Business Management and 7 years of Information Technology spanning across Big Data, Cloud Implementation and IT GRC.
- 4 Years' experience in teh administration, modification, installation and maintenance of Hadoop Ecosystems wif Hortonworks/Cloudera Manager.
- Wole TEMPhas experience in Cloud Architecture and Data Analytics on AWS and Google Cloud ecosystems also wif years of experience in IT GRC, leading testing
- IT General Controls in SOX, PCI and FISMA audit projects. He delivers best practices in IT Projects on time, budget wifin scope.
TECHNICAL SKILLS:
Tools: On - Prem, AWS, Google, Cloudera, HDFS, YARN, MapReduce Zookeeper, Kerberos, Sentry, Hive, Hbase, Sqoop, Oozie. Microsoft Project, EC2, S3, Kinesis, Redshift, VPC, Visio, JIRA, Service Now, CAPPM, Agile, Waterfall, SDLC.
PROFESSIONAL EXPERIENCE:
HADOOP ADMINISTRATOR
Confidential, ADDISON, TX
Responsibilities:
- Perform Deployment of Hadoop using Cloudera Distribution Hub on Production and Pre-production and also various Hadoop services such as HDFS, YARN, Map-Reduce, Hive, Zookeeper, Oozie, Storm, HBase, Sentry and other services.
- Perform capacity planning, systems architecture, installation, configuration and monitoring of Hadoop log files and debugging failed jobs.
- Provide support for data analysts, Pig and Hive developers by troubleshooting teh issues analyzing various log files and raise tickets wif Cloudera support if needed.
- Install, Upgrade, Monitor and ManageHadoop 60+ Node Cluster on CDH distribution. Experience in building teh cluster in different environments (Test, Production) and in AWS and Google Cloud. CDH 5.9.0, 5.13.0, 5.14.0.
- Work on setting up high availability for major production cluster and implemented automatic failover controller using zookeeper by forming quorum on nodes.
- Enable NameNode High Availability on Production cluster and set up production Hadoop clusters wif optimum configurations. Implements Zookeeper for coordination between distributed processes.
- Implement Fair scheduler and capacity scheduler to allocate fair amount of resources to small/large jobs.
- Work on benchmarking, commissioning and decommissioning of data nodes on Hadoop clusters as approved.
- Maintain theHadoopSecurity and Hive Security using Kerberos (MIT & AD), ACL, Sentry and encryption technologies.
- Support cluster maintenance, Backup and recovery for production cluster in Hive and Hive Metastore data on regular basis to a remote cluster and perform replication as needed.
- Perform Rack Awareness based on rack definitions to minimize network traffic between “DataNodes” wifin teh same rack. Work wif cross functional teams on data analytics related engagements and change managements processes.
LEAD/BIG DATA ADMINISTRATOR
Confidential, MD
Responsibilities:
- Deployed and managed multi-node Cloudera Hadoop Ecosystem in development, testing and production environments wif different Hadoop components like Hive, Zookeeper, Sentry, Kerberos adding various services.
- Resolved connection issues in SSH, Firewalls, Networking and Security to troubleshoot Hadoop issues on (Specifically RedHat6.9 and above) on Cloudera Manager or backend using Unix/Linux shell scripts in SQL/MySQL.
- Worked wif data delivery teams to setup new Hadoop users, Create Kerberos principal and testing HDFS, Hive, Pig and MapReduce access for teh new users.
- Collected and aggregated large amounts of streaming data into HDFS using Flume and defined channel selectors to multiplex data into different sinks.
- Benchmarked teh cluster using TestDFSIO, TeraSort and Teragen for measuring HDFS me/O (read/write) performance and to measures time for sorting data wif MapReduce.
- Performed regular disk management like adding /replacing hot swappable drives on existing servers/workstations, partitioning, creating new file systems or growing existing one over teh hard drives and managing file systems.
- Monitored multiple Hadoop clusters’ job performance using Ganglia and Nagios and reviewed Hadoop log files and debugging failed jobs.
- Successfully completed delivery of an Operational Data Store (ODS) for staging and integration of data (in SAP BW), a data warehouse solution (in Apache Cassandra) and a user interface
- Successfully managed big data solutions for sportswear manufacturing firm, including management of multiple agile work streams in delivery of BI solutions, maintenance, activations of solutions for global marketing and sales.
- Performed daily monitoring of Oracle instances, running Statspack, AWR reports to monitor tablespaces, memory structures, undo segments, logs, and alerts.
IT AUDIT, RISK AND COMPLIANCE SPECIALIST
Confidential, HOUSTON, TX
Responsibilities:
- Performed IT General Controls (Access Control, Change Management and IT Operations) and Application Controls supporting Financial Audit Team.
- Performed IT Control testing and risk assessments, makes recommendations based on industry compliance guardians to IT leadership and documented remediation plans using GRC module of ServiceNow.
- Tested PCI DSS and HIPAA privacy rules and Security Rules covering handling of Electronic Protected Health Information (EPHI).
- Tested General Computer Controls of Federal Agencies (OMB A-123 Audit) using FISCAM framework, perform FISMA Audit using NIST metrics
- Managed Project Team in SAP Security, Controls and Implementation on User Access Management in support of PCI, HIPAA and SOX compliance. Worked on Audit Readiness Project and completing remediation of gaps.
- Reviewed SOC 1 and SOC 2 reports of SaaS solution vendors as part of SaaS Project Initiation requirement and approval process. Documented risk matrix and perform risk assessment in enterprise IT environment.
- Participated in all stages of teh audits including: researching, planning, scheduling, collecting, sorting, and summarizing data, walkthrough, detailed testing, completion, and drafting audit reports.
BUSINESS SALES MANAGER
Confidential
Responsibilities:
- Managed 14 Direct Clients and 33 indirect employees covering a geographical area in achieving and surpassing annual business target. Achieved record most profitable cost center 3 times in a seven year.
- Developed and implemented a cost analysis for materials received from suppliers. This included developing evaluation criteria, scoring and reporting mechanisms to meet departmental goals.
- Coordinated Supply Chain Delivery Platforms to ensure order execution and delivery of PMS, AGO, ATK, HHK, DPK, LPFO and LUBS using BRVs to drive business strategies averaging ninety percent annual target.
- Conducted Business Case Development, Budgeting, Forecasting, Work Authorizations, CostManagement.
- Managed an annual average budget of $0.3M for maintenance, product launch, business and public relations.
- Bridged communication gaps between business leaders and management by identifying opportunities to streamline business processes. Initiated several programs for outlet employees to enhance customer service and sales.
