Hadoop Administrator Resume Charlotte, NC - Hire IT People

TECHNICAL SKILLS

Software: Apache Spark, Hadoop HA/Federation clusters, HDP 2.5/3.1, CDH5, Hive, Pig, Kafka, zookeeper, oozie, ETL, EDW, Talend, Microsoft Power BI, SQL, Hadoop Security, Ranger, Knox, Kerberos, LDAP, Ambari, AWS Cloud, RHEL, Ansible, HBase, MongoDB, Solaris, Java Programming, Shell scripting, Vmware, Linux.

Hardware: HP DL380e Gen9, DL360P Gen9, Oracle(sun)Sparc, HP ProLiant BL460 Gen7/8/9,HP Proliant DL380 Gen7/8/9.IBM x3650 m4/m3, Sun E15/25K, Sun E450/250, Emulex HBA, Qlogic HBA, CNA, SATA, SAS. Cloud (AWS, IBM Pure)

PROFESSIONAL EXPERIENCE

Confidential, Charlotte, NC

Hadoop Administrator

Responsibilities:

Corporate risk helps all Confidential businesses identify and manage risk. We focus on three key risk areas: credit risk, operational risk and market risk. We help our management and Board of Directors identify and monitor risks that may affect multiple lines of business and take appropriate action when business activities exceed the risk tolerance of the company.
Involved inDesign Hadoop Cluster environment from the scratch to support Multi - tenant architecture process. Build Hortonworks distribution Hadoop Cluster environment based on architecture design.
Configured security using LDAP, Kerberos and SSL configuration on Cluster. Enabled High availability for Services: Hadoop hdfs (NN), Hive Services and resource managers (RM).
Enable Multiple 3rd party Plugins (Notebooks, IDE etc) for Data Science Experience (IBM DSX) and Machine Learning team members and monitor Cluster alerts, Node and data disk failures and perform decommission and commission servers
Install and administrate R studio, Anaconda Python, Spectrum, XGBoost and IBM Spectrum for Machine Learning and Power Artificial Intelligence (AI).
Analyzing Hadoop cluster and different Big Data analytic tools including Hive, HDFS, HBase, Spark and Scala.
Importing and exporting data into HDFS and Hive using SQoop from HDFS to Relational Database Systems (RDBMS) and vice-versa.
Execute Agile/Scrum methodology to develop the application by performing everyday standups to discuss status update of the stories and roadblocks. Use Version One as agile project management software for managing the backlogs, stories, goals and incidents.

Confidential, Chicago, IL

Hadoop Administrator

Responsibilities:

Build and Support Hadoop Based EDW platform to support ETL process. Streamline data ingestion from multiple source systems into Datalake. Transform data. Create and support workflow in Talend TAC and Oozie, develop Pig, Hive QL, Spark QL, Spark Streaming scripts. Build Master Data Management (MDM) data sourcing data from datalake. Create data lineage using Talend TMM.
Install and configure and manage hdp2.3.2/hdp2.5.2 hortonworks hadoop on premise cluster in Lower Level and Production, Disaster Recovery environments. Use Ambari, zookeeper, oozie, Falcon to manage the cluster. Stabilize Bigdata/Hadoop cluster with regular patch updates and cluster upgrades. Build Operational process to manage Bigdata/hadoop clusters with agreed Service Level Agreements.
Secure Bigdata/Hadoop cluster with robust security architecture using Kerberos, Active Directory, Ranger, Knox, Centrify. Automate hadoop cluster access controls through Ranger policies for the uptodate security. Provide granula security upto column level. Datagovernance from the TMM data lineage and Ranger based access controls on HDFS and Hive Metadata. End user security through Kerberos CLI tools, beeline and ambari views.
Prepare and execute contingency plan by building Disaster Recovery hadoop cluster and automate replication from Production with regular interval. Oozie, Falcon based replication.
Build interactive web interface to the developers and end users of hadoop with Ambari view to run Pig jobs, hive jobs, View Tez jobs.

We provide IT Staff Augmentation Services!

Hadoop Administrator Resume

Charlotte, NC

We'd love your feedback!

Resume Categories

Client Services

Job Seekers

Visa Sponsorship