We provide IT Staff Augmentation Services!

Hadoop Platform Administrator Resume

4.00/5 (Submit Your Rating)

PhiladelphiA

SUMMARY:

  • Confidential has about 16+ years of experience in the IT Industry
  • Hands on experience in installation, configuration, supporting and managing highly available Hadoop Clusters
  • Rich experience in Teradata, Aster and Oracle Database administration
  • Effective hands - on leader with strong business and technology acumen

KEY SKILLS:

Hadoop Platform: Cloudera Hadoop CDH5, Hortonworks Hadoop 1.3.2, Apache Hadoop 1.2, 2.x

Hadoop Ecosystem: HDFS, Hive, Impala, Spark, Hue, Sqoop, Flume, Oozie, Hbase, Kudu, Kafka

Cluster Management Tools: Cloudera Manager, Ambari, Ganglia, Nagios

Cloud: AWS EC2, S3

Operating Systems: Linux, Sun Solaris, AIX, Windows 2k Advance server

Languages: Shell Scripting, Windows Batch, Oracle PL/SQL

RDBMS: Aster 5.x,6.x, Teradata 12, PostgresSQL 9.2, Oracle 10g,9i,8i, MySql 5.6, Memsql DB, Kinetica GPUDB

RDBMS Tools: Aster ACT, Confidential, ncli, ncluster backup, Confidential, TD Studio, Eclipse, TD SQL Assistant, TD Administrator, Viewpoint, Arcmain, Bteq, Fastload, Multiload, Toad, Oracle Enterprise Manager, SQL Plus

Configuration Management: Cluster shell (Clush), Ansible

Security: CADA, Kerberos

Containerization Tools: Dockers

CLIENT ENGAGEMENTS:

Hadoop Platform Administrator

Confidential, Philadelphia

Responsibilities:

  • Responsible for installation, configuration, patching, upgrades and ongoing administration of Hadoop infrastructure with 500+ nodes
  • Aligning with the systems engineering team to propose and deploy new hardware and software environments required for Hadoop and to expand existing environments
  • Installation & configuration of third party Applications like Cloudera Data science work bench (CDSW), Atscale, Zoomdata, R & Python packages, Knowledge Repo, R studio
  • Screen Hadoop cluster job performances and capacity planning
  • Monitor Hadoop cluster connectivity and security
  • Manage and review Hadoop log files.
  • File system management and monitoring.
  • HDFS support and maintenance.
  • Diligently teaming with the infrastructure, network, database, application and business intelligence teams to guarantee high data quality and availability.
  • Collaborating with application teams to install OS and Hadoop updates, patches, version upgrades when required.
  • Point of Contact for Vendor escalation

Hadoop Platform Administrator

Confidential, San Jose, CA

Responsibilities:

  • Hadoop cluster configuration, Add/Remove nodes, setting parameters in core-site, hdfs-site and mapred-site cfg files, environment setup in hadoop-env.sh, managing Config File changes across cluster
  • Cluster monitoring using Cloudera Manager, Hadoop WEB UI, Ganglia, Nagios
  • Hadoop File system commands, HDFS Balancer, Hadoop Job submission
  • Creating Users and Home directories, assign directory space quota, User password policies, sticky bit, Configure, restore & delete Trash.
  • Monitor & maintain System, Daemon logs
  • Capacity planning for Hadoop Cluster Growth
  • Import/Export Data into HDFS from another RDBMS. Configured Distcp for data transfer between HDFS & Aster File Storage ( Confidential )
  • Creation of Hive External tables and Hive managed tables, Implemented Column level encryption for Hive managed tables, Implemented Snappy compression ORC format for Hive managed tables, loading data from Hive to Aster database using load from hcatalog aster function.
  • User creation in hive and Grant privileges, data validation, creation of staging and target databases, Implemented column level encryption in hive for sensitive data.
  • Extract logs from multiple sources and load to HDFS
  • Coordinating & assisting infrastructure support teams during platform upgrades
  • Drive KT sessions with customer team(s) to improve technology understanding

Aster and Teradata DBA

Confidential

Responsibilities:

  • Using Aster Management Console ( Confidential ) and Ganglia, Teradata Manager, Teradata Administrator check cluster nodes status, Monitor Aster Logs.
  • Create/Alter/Delete Users, Schemas, Tables, Views, Indexes and SQL MR Functions.
  • Monitor and maintain cluster free space, Reclaim DEAD space from table using truncate/ vacuum/ vacuum full.
  • Allocate/Delete/Modify database security Roles, Grant/Revoke rights and privileges, Report database access violations.
  • Maintain Aster Data Workload Management settings, Review and document client workload categorization, sessions and concurrency settings.
  • Prepared and deployed Audit scripts for sessions, statements space history information, invalid/failed logons and false table access. PDCR Performance Reports and Skew Analysis.
  • Analyze explain and query tuning, suggestions on distribution key columns.
  • Administer Backup & Recovery software, including policies & schedule.

Confidential

Lead Oracle DBA, Oracle DBA

Responsibilities:

  • Managing the DBA pool for daily operations.
  • Maintaining growth plan of database.
  • Maintaining Oracle security.
  • Trouble shooting day-to-day database and system problems.
  • Verifying the daily Backup activity.
  • To find the hogging CPU queries.
  • Planning Backup and recovery strategies.
  • Generating Daily and Monthly Database reports for management activities.
  • Installation and Configuring Databases.
  • Design and Implementation of Backup Scripts for hot and cold backups.
  • Schema Management
  • Performance Tuning of Databases

We'd love your feedback!