We provide IT Staff Augmentation Services!

Hadoop Administrator Resume

0/5 (Submit Your Rating)

Piscataway, NJ

SUMMARY

  • Having 9+ years of overall experience in Big Data and DW technologies like Hadoop(Apache, Cloudera, Hortonworks),Tableau, OBIEE, Informatica.
  • Around 4+ years of experience in Hadoop Administration & Big Data Technologies like Hadoop(Apache, Cloudera, Hortonworks) HDFS, Yarn, Hive, Impala,Hbase, Solr, Spark, Flume, Sqoop, Oozie, Zookeeper, Kerberos
  • Hands on experience in installation, configuration, supporting and managing Hadoop Clusters using Apache, Cloudera, and Hortonworks.
  • Hadoop Cluster capacity planning, performance tuning, cluster Monitoring, Troubleshooting.
  • Backup configuration and Recovery from a NameNode failure.
  • Installation of various Hadoop Ecosystems tools like Hive, Pig, Sqoop, Hbase,Zookeeper, Impala, Spark.
  • Involved in bench marking Hadoop/HBase cluster file systems various batch jobs and workloads
  • Experience monitoring and troubleshooting issues with Linux memory, CPU, OS, storage and network
  • Good experience on Design, configure and manage the backup and disaster recovery for Hadoopdata.
  • Hands on experience in analyzing Log files for Hadoop and eco system services and finding root cause.
  • Experience on Commissioning, Decommissioning, Balancing, and Managing Nodes and tuning server for optimal performance of the cluster.
  • As a admin involved in Cluster maintenance, trouble shooting, Monitoring and followed proper backup& Recovery strategies.
  • Experience in HDFS data storage and support for running map reduce jobs.
  • Experience in importing and exporting the data using Sqoop from HDFS to Relational Database systems/mainframe and viceversa.
  • Experience in setup, configuration and management of security for hadoop clusters using Kerberos and integration with LDAP/AD at an Enterprise level
  • Good understanding on OBIEE architecture especially for standalone applications.
  • Good expertise in building OBIEE repository on complex models with aggregation, multiple sources and security implementation.
  • Having experience in Informatica job Monitoring and DAC Monitoring and Control - M.
  • Gathering all the Functional and Non Functional information, problems in the form of Tickets.
  • Responsible for deployment activities across 8 OBIEE Confidential BI allpications every month.
  • Installed OBIEE11g in clustered linux enironment in OBIEE 11G for Linux.
  • Handling Tableau Admin works, Automation of existing bottleneck issues
  • Preparing and presenting Various decks for management Overview
  • Extensive experience in Tableau Installation, configuration and Security architecture, SSO,SSL configuration
  • Good expertise in building OBIEE repository on complex models with aggregation, multiple sources and security implementation using SSO and SSL

TECHNICAL SKILLS

Big Data: Apache Hadoop, Cloudera, Hortonworks, Pivotal HD

Hadoop Ecosystem: HDFS,YARN\Mr2,Hive,Impala,HBase,Solr,Flume,Spark,Zookeeper, Sqoop,Oozie,Kerberos

Devop Tools: Chef, Puppet, Ansible, Jenkins, Git, SVN

BI Tools: OBIEE,BI Publisher, OBIA 7.9.6, Tableau

ETL Tools: Informatica8.6/9.1,ODI

Cloud Technologies: AWS-EC2,S3

Database: Hadoop, Oracle, EMC Greenplum, Server 2005

Scheduling Tools: Control-M,DAC

Languages: C,C++,Java, Python

Application Servers: Web logic, WebSphere.

Operating system: Linux/Unix, Windows

PROFESSIONAL EXPERIENCE

Confidential, Piscataway, NJ

Hadoop Administrator

Responsibilities:

  • Work with Client’s internal support teams to Build/Troubleshoot/Fix Hadoop platforms
  • Work with the application teams to design and develop an effective Hadoop/Data Science solution.
  • Develop best practices for developing and deploying Hadoop applications and assist the team to manage compliance to the standards.
  • Manage the backup and disaster recovery for Hadoop data.
  • Optimize and tune the Hadoop environments to meet performance requirements.
  • Work with big data developers and developers designing scalable supportable infrastructure.
  • Work with Linux server admin team in administering the server hardware and operating system
  • Assist with management of formal system runbooks.
  • Create and publish various production metrics including system performance and reliability information to systems owners and management.
  • Perform ongoing capacity management forecasts including timing and budget considerations.
  • Coordinate root cause analysis (RCA) efforts to minimize future system issues.
  • Upgrading hadoop cluster hbase/zookeeper from CDH 5.8 to CDH 5.10,5.11
  • Monitoring Hadoop cluster using tools like Nagio's, Ganglia and Cloudera Manager.
  • Automating the script to monitor HDFS and HBase through cronjobs.
  • Migration from traditional data center to AWS using AWS Route 53 with two hosted zones was very successful and widely appreciated by the client.
  • Installation, configuration, supporting and managing Hadoop Clusters using Apache, Cloudera (CDH4,CDH5), and Yarn acrhitecture.
  • Hadoop Cluster capacity planning, performance tuning, cluster Monitoring, Troubleshooting.
  • Used Network Monitoring Daemons like Ganglia and Service monitoring tools like Nagios.
  • Backup configuration and Recovery from a NameNode failure.
  • Decommissioning and commissioning the Node on running hadoop cluster.
  • Installation of various Hadoop Ecosystems tools like Hive, Pig, Sqoop, Hbase,Zookeeper, Impala, SparkManaged and reviewed Hadoop log files.

Confidential

Hadoop Adminstrator

Responsibilities:

  • Involved in start to end process of hadoop cluster setup where in installation, configuration and monitoring the Hadoop Cluster on Hortonworks HDP platform.
  • Monitoring systems and services, architecture design and implementation of hadoop deployment, configuration management, backup, and disaster recovery systems and procedures.
  • Configured various property files like core-site.xml, hdfs-site.xml, mapred-site.xml based upon the job requirement
  • Importing and exporting data into HDFS using Sqoop.
  • Experienced in define being job flows with Oozie.
  • Loading log data directly into HDFS using Flume.
  • Experienced in managing and reviewing Hadoop log files.
  • Installation of various Hadoop Ecosystems and Hadoop Daemons.
  • Installation and configuration of Sqoop and Flume, Hbase
  • Managed and reviewed Hadoop Log files as a part of administration for troubleshooting purposes. Communicate and escalate issues appropriately.
  • As a admin followed standard Back up policies to make sure the high availability of cluster.
  • Involved in Analyzing system failures, identifying root causes, and recommended course of actions. Documented the systems processes and procedures for future references.
  • Worked with systems engineering team to plan and deploy new hadoop environments and expand existing hadoop clusters.
  • Monitored multiple hadoop clusters environments using Ganglia and Nagios. Monitored workload, job performance and capacity planning using Cloudera Manager.
  • Installed and configured Flume, Hive, Pig, Sqoop and Oozie on the hadoop cluster.
  • Involved in Installing and configuring Kerberos for the authentication of users and hadoop daemons.
  • Experience in setup, configuration and management of security for hadoop clusters using Kerberos.

Environment: Hortonworks HDP,Ambari,Hive, Pig, Sqoop, Hbase,Zookeeper,Linux

Confidential

OBIEE\Tableau Adminstrator

Responsibilities:

  • Gathering all the Functional and Non Functional information.
  • Designing and creating data sources for tableau reporting
  • Provisioning users and Groups and creating projects and setting permissions
  • Creating workbooks, reports, dashbaords and publushing them to users.
  • Migrating wokrbooks,datasources,projects and managind user athentication and authorization.
  • Extensive experience in Tableau Installation, configuration and Security architecture, SSO,SSL configuration
  • Creating/Edit Sites (Separate sites can be created per Horizon Analytics business domain)
  • Adding Users/User mainly Site Administrators and Groups that are common to all Sites or Site Administrators.
  • Adding additional Tableau server administrator, if required to manage Horizon Tableau server landscape
  • Creating and maintain subscriptions and alerts
  • Analyzing reason for Data Extract Refresh failures, with Site Admin
  • Perform maintenance activities Backup, Logs Cleanup and Archiving Log files in prescribed intervals - These activities will be used for Business continuity during a Disaster.
  • Performing periodic server restart as a part of maintenance to ensure all unused memory objects are freed up.
  • Performing software sync activities like Planned upgrades, Configuration changes and patch deployments
  • Periodic monitoring of inbuilt admin dashboards, create/provide inputs to create required dashboards to monitor their areas of interest
  • Involved in data validation of the results in Tableau by validating the numbers against the data in the database tables by querying on the database.
  • Dashboards from Tabular Models to help managers to identify critical KPIs and facilitate strategic planning in the organization.
  • Designing and creating data sources for tableau reporting
  • Provisioning users and Groups and creating projects and setting permissions
  • Creating workbooks, reports, dashbaords and publushing them to users.
  • Migrating wokrbooks,datasources,projects and managind user athentication and authorization.
  • Extensive experience in Tableau Installation, configuration and Security architecture, SSO,SSL configuration
  • Good understanding on OBIEE architecture especially for standalone applications.
  • Good expertise in building OBIEE repository on complex models with aggregation, multiple sources and security implementation using SSO and SSL
  • Having extensive work experience in OBIEE production deployment.

Environment: OBIEE11G, Tableau, EMC Greenplum, Toad, SQL plus, Redhat/Suse Linux

Confidential

OBIEE Admin/Developer

Responsibilities:

  • Gathering all the Functional and Non Functional information.
  • Involved in developing the EDW DB on greenplum.
  • Creating tables,views,functions
  • Worked on customizing various no of GP functions to fit to our requirement
  • Also involved in creating informatica mappings
  • On top of the EDW we have design the various BI applications for the reporting purpose using OBIEE
  • Involved in end to end implementation .
  • Gathering all the Functional and Non Functional information, problems in the form of Tickets.
  • Responsible for all the OBIEE11g admin related work in clustered environment across 8 different 8 LOB's
  • Responsible for deployment activities across 8 OBIEE Confidential BI allpications every month.
  • Installing and Production Environment setup for all 9 servers in OBIEE 10G Windows.
  • Installed OBIEE11g in clustered linux enironment in OBIEE 11G for Linux.
  • Handling Tableau Admin works
  • Monitoring the informatica loads
  • Automation of existing bottleneck issues
  • Resolve system/ reporting problems
  • Preparing and presenting Various decks for management Overview
  • Identifying and Streamlining the weak processes within the system
  • Extensive experience in Tableau Installation, configuration and Security architecture, SSO,SSL configuration
  • Good understanding on OBIEE architecture especially for standalone applications.
  • Good expertise in building OBIEE repository on complex models with aggregation, multiple sources and security implementation using SSO and SSL
  • Having extensive work experience in OBIEE production deployment

Environment: OBIEE11g, EMC Green plum, Oracle Linux

Confidential

OBIEE Developer

Responsibilities:

  • Understanding the user requirements and Analyzing, preparing gap analysis.
  • Modeling physical/business/presentation layers In OBIEE on top of data marts.
  • Creation of logical tables / columns and calculated measures.
  • Building dimensional hierarchies and setting up Drill Hierarchies.
  • Development of criteria with respect to the design of reports.
  • Developing complex reports in Answers such as Pivot tables, charts, gauges, Narrative view, and Ticker view and using union functions.
  • Creation of dashboard prompts, sections and placement of reports for optimum utilization of created objects.
  • Usage of presentation, session, repository variables effectively for synchronized Reporting purposes.
  • Defining security filters as per business requirement.
  • Providing Ldap Authentication for the users.
  • Migration of RPD, reports, security.
  • Working on various project documents FD, TD, User Access and KT documents.

Environment: OBIEE, INFORMATICA, ORALCE, DAC

Confidential

OBIEE Developer

Responsibilities:

  • Understanding the user requirements and Analyzing, preparing gap analysis.
  • Modeling physical/business/presentation layers In OBIEE on top of data marts.
  • Creation of logical tables / columns and calculated measures.
  • Building dimensional hierarchies and setting up Drill Hierarchies.
  • Development of criteria with respect to the design of reports.
  • Developing complex reports in Answers such as Pivot tables, charts, gauges, Narrative view, and Ticker view and using union functions.
  • Preparation of unit test cases and executing them.
  • Supporting SAT, UAT.
  • Implementing object & data level security based on the user groups and the roles.
  • Post Deployment support and User training.

Environment: OBIEE, Oracle, INFORMATICA

We'd love your feedback!