We provide IT Staff Augmentation Services!

Hadoop Administrator Resume

2.00/5 (Submit Your Rating)

SUMMARY:

  • 10 years of extensive experience in WebSphere Administration including 2 years of Hadoop Administration.
  • Experienced managing Linux platform servers and in installation, configuration, supporting and managing Hadoop Clusters.
  • Installed and configured Apache Hadoop, Hive and Pig environment on Amazon EC2 and assisted in designing, development and architecture of Hadoop and HBase systems
  • Hands - on experience on major components in Hadoop Ecosystem including Hive, Sqoop, Flume knowledge of Mapper/Reduce/HDFS Framework.
  • Experienced in database server performance tuning and optimization and troubleshooting and performance tuning for Complex SQL queries
  • Having Working Knowledge on Sqoop and Flume for Data Processing
  • Expertise in developing solutions using Hadoop and Hadoop ecosystem
  • Loading the data from the different Data sources like Teradata and DB2 into HDFS using sqoop and load into partitioned Hive tables
  • Formulated procedures for installation of Hadoop patches, updates and version upgrades and automated processes for troubleshooting, resolution and tuning of Hadoop clusters.
  • Experienced in developing Map Reduce programs using Apache Hadoop for working with Big Data, Hadoop architecture and various components such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node and Map Reduce programming paradigm
  • Involved in log file management where the logs greater than 7 days old were removed from log folder and loaded into HDFS and stored for 3 months.
  • Supported Web Sphere Application Server WAS, IBM HTTP/ Apache Web Servers in Linux environment for various projects.
  • Supported geographically diverse customers and teams in a 24/7 environments.
  • Team player with strong analytical, technical negotiation and client relationship management skills
  • Developed Oozie workflows and sub workflows to orchestrate the Sqoop scripts, pig, python scripts, hive queries and the Oozie workflows are scheduled through Autosys.
  • Experience on Hadoop cluster maintenance including data and metadata backups, file system checks, commissioning and decommissioning nodes and upgrades.
  • Conducted detailed analysis of system and application architecture components as per functional requirements
  • Ability to work effectively in cross-functional team environments and experience of providing training to business users.
  • Experience in Java/J2EE IBM WebSphere Application Server Administration, MQ, Message Broker and IIB on Linux and Windows Platforms and good knowledge in WebLogic
  • Experience in installing Network Deployment Package of WAS in different Operating Systems.
  • Working Experience in IBM HTTP Server and Apache Web Server.
  • Installed and configured IBM HTTP Server and generated plug-in files.
  • Performing application deployments using EAR / WAR files, as requested by the application teams on the respective environments.
  • Federated multiple nodes to the Deployment Manager.
  • Configured WebSphere Application Server in conjunction with DB2, Oracle.
  • Experience in setting up of Nodes, data sources, Virtual host and configuration of Web Sphere Application Server.
  • Successful implementations of Work Load Management (WLM) using clustering techniques.
  • Troubleshooting WebSphere installation issues and configuring health policies and tasks
  • Administrative and configuration tasks through scripting (Jython, Python and Power-shell)
  • Good Confidential trouble shooting using Traces, Logs and Log Analyzer.
  • Created and configured MQ Objects like Queue Managers, Local Queues, Alias Queues, Remote queues, Transmission Queues, Dead Letter Queues, Clustered Queues, Channels, Listeners, Clusters, Triggers, Processes and Name lists.
  • Configured repository Queue Managers in a Clustered environment.
  • Converted an existing network of Queue Managers into a Cluster environment.
  • Built DEV Environments from scratch and followed through to TEST and Successful PRODUCTION Deployment.
  • Created MQ Objects in DEVELOPMENT, TEST and PRODUCTION Environments.
  • MQ (7.1 or 7.5) clustering, load balancing, installation, high-availability, multi-instance queue managers and brokers
  • Experience in handling with social media data and integrating the same with internal data Experience in building customer 360 solutions
  • Configuring Message Broker / IBM Integration Bus tracing / debugging with actual hands-on experience on performance tuning and administering database configurations.
  • Designed, developed, unit test and integrated Message Broker flows.
  • Worked on deployment of Message Broker flows across different environments.
  • Created MQ infrastructure designs and worked with MQ team for implementing designs
  • Deployed the java applications on respective environments using the tools or scripts.

TECHNICAL SKILLS:

Operating Systems: Red Hat Linux, UNIX, Windows, Windows Server 2003/2007/2008

Application Servers: WebSphere Application Server Administration 6.1/7.0, IIS 6.0, Jboss

Messaging: WebSphere MQ 6.1/7.0, Message Broker

Build Repositories: RTC, StarTeam, IBM PureAppsDeploy tools: UCD

Hadoop Ecosystem: Hadoop Map Reduce, HDFS, Flume, Sqoop, Hive, Pig, OozieCloudera Manager, Ambari.

Database: Database Oracle, DB2, MS-SQL Server, MySQL, MS-Access

Tools: Virtualization, Ganglia, Nagios, AWS, BSM, CONTROL-M, Site scope

WORK EXPERIENCE:

Hadoop Administrator

Confidential, Atlanta, GA

Environment: HADOOP HDFS, MAPREDUCE, HIVE, PIG, OOZIE, SQOOP, CLOUDERA MANAGER

Responsibilities:

  • Responsible for architecting Hadoop clusters Translation of functional and technical requirements into detailed architecture and design.
  • Installed and configured CDH5.0.0 cluster, using Cloudera manager for easy management of existing Hadoop cluster.
  • Extensively using Cloudera manager for managing multiple clusters with petabytes of data.
  • Provided Hadoop, OS, Hardware optimizations.
  • Setting up the machines with Network Control, Static IP, Disabled Firewalls, Swap memory.
  • Regular Commissioning and Decommissioning of nodes depending upon the amount of data.
  • Worked on setting up high availability for major production cluster and designed automatic failover control using zookeeper and quorum journal nodes
  • Implemented Fair scheduler and capacity scheduler to allocate fair amount of resources to small jobs.
  • Performed operating system installation, Hadoop version updates using automation tools.
  • Configured Oozie for workflow automation and coordination.
  • Implemented rack aware topology on the Hadoop cluster.
  • Importing and exporting structured data from different relational databases into HDFS and Hive using Sqoop
  • Configured ZooKeeper to implement node coordination, in clustering support.
  • Configured Flume for efficiently collecting, aggregating and moving large amounts of log data from many different sources to HDFS.
  • Installed Oozie workflow engine to run multiple Hive and pig jobs.
  • Installed, Configured and maintained HBASE, using Hbasemaster & hbase regional server.
  • Installed and configured a HDP 2.2, using ambari manager.
  • Managed load balancers, firewalls in a production environment
  • Good knowledge about Map-Reduce Framework which include MR daemons, sorting and shuffle phase, task execution.
  • Implemented Speculative execution for performance tuning of jobs running on the cluster.
  • Involved in collecting and aggregating large amounts of streaming data into HDFS using Flume and defined channel selectors to multiplex data into different sinks.
  • Worked on developing scripts for performing benchmarking with Terasort/Teragen.
  • Experience in understanding the security requirements for Hadoop and integrating with Kerberos authentication infrastructure- KDC server setup.
  • Creating realm /domain, managing Principles, generating key tab file for each and every service and managing key tab using key tab tools.
  • Implemented Kerberos Security Authentication protocol for existing cluster.
  • Exported the analyzed data to the relational databases using Sqoop for visualization and to generate reports for the BI team.
  • Good experience in troubleshoot production level issues in the cluster and its functionality.
  • Backed up data on regular basis to a remote cluster using distcp.

WebSphere Administrator

Confidential, El Segundo, CA

Environment: Linux, IBM Http Server 6.0/6.1, WebSphere Application Server 6.1/7.0, SQL, Java, Oracle, WebSphere MQ, Message Broker, Hadoop

Responsibilities:

  • Installed WAS and IHS 8.0, 8.5.5.x on RHEL for both lower and prod events.
  • Hands-on experience in a clustered environment including deployments, troubleshooting performance issues and especially performance test monitoring, installations, and configuration maintenance
  • Expertise in configuring Cells, Nodes, clustering, JDBC Providers, Data Sources, Virtual Hosts, session management
  • Successful implementation of Workload Management (WLM) using cloning/clustering techniques including horizontal and vertical clustering for fail over processes/DR
  • Worked with the firewall team to finding glitches and getting access across firewalls
  • Worked with Network team to configure Load Balancing across different nodes and troubleshoot issues.
  • Experience in Creating Heap dumps and Core dumps and analyze those dumps using Heap Analyzer.
  • Responsible for updating refresh packs, fix packs and interim fix packs to WebSphere using IIM.
  • Worked closely with developers to define and configure application Servers, Virtual Hosts, Web Applications, Web resources, Servlets, JDBC drivers and Servlet Engines-as well as deployment of EJBs across multiple instances of WebSphere.
  • Experience in using IBM Thread Analyzer to detect JVM thread related issues. Used Tivoli Performance Viewer and Log Analyzer for performance and troubleshooting
  • Created users and groups in LDAP Servers and mapped them to the enterprise applications running on WebSphere Application Server.
  • Enable the global security to secure WebSphere applications and configured Single Sign On -Provided support in a demanding 24/7 on-call support for applications running in production on WebSphere Application servers through VPN connection.
  • Involved in supporting load testing during various testing phases for performance tuning the environment
  • Worked with IBM in opening a PMR for inconclusive root causes, and coordinating the proposed changes with the respective teams.
  • Troubleshot Admin Server start-up issues, Java code defects after deployment, and class path issues by checking the JVM logs, plug-in logs and the Web server logs.
  • Created and maintained technical documentation for the IBM WebSphere environment, including network diagrams, installation and configuration procedures, troubleshooting guidelines, and operational procedures.
  • Managing and implementing SSL certificate for WAS 8.0/8.5.x.x

WebSphere Administrator

Confidential

Environment: Linux, IBM, Http, Server6.0/6.1, WebSphere Application, Server6.1, SQL, Java, Oracle, WebSphere MQ

Responsibilities:

  • Worked on several home grown and vendor applications from the infrastructure perspective.
  • Participate and provide input in Infrastructure Design Review.
  • Involved in capacity planning and tech sizing requirements.
  • Provide subject matter expertise to application development teams to how to utilize WAS services.
  • Worked with different technology groups like architecture, network, database, open systems to establish the infrastructure.
  • Install the WAS software and Create the necessary environments required by the system development life cycle.
  • Configure all environments to each application's specific requirements (such as JDBC, JMS, web services, High Availability, Session Management, Security, Service Integration Bus, etc.
  • Create and Modify Websphere Cell domains required to implement the different logical environments in the system development life cycle (dev, test, stage, prod).
  • Create and Configure application instances within each of the domains as required. Configure Security as required (SSL, single sign-on, administrative, application, etc).
  • Proactively performances tune each environment as well as reactively troubleshoot problems that occur.
  • Provide development support to the application development teams Participate in load and performance test Analyze load test results, optimize and tune infrastructure components Create technical recovery and operation support documents.
  • Maintain the environment by setting up automated start up and shutdown scripts, implement automated monitoring and alerting mechanisms.
  • Installed HTTP Server, WebSphere Application Server, Plugins, maintenance packs through BladeLogic jobs.
  • Deploy applications to the Application server as well as define and set up automated application deployment mechanisms.
  • Research and troubleshoot problems related to the Application server software, the applications that run on them as well as the external systems that they interact with. Communicate regularly and effectively with other team members, clients (application developers) and vendors (other technology teams).
  • Creating regular status reports is one form of communication used.
  • Performance tuned WebSphere portal and application server using Tivoli performance viewer and Wily Introscope.

WebSphere Administrator

Confidential

Environment: windows, Linux, IBM Http Server 6.0/6.1, WebSphere Application Server 6.1/7.0, SQL, Java, Oracle.

Responsibilities:

  • Installation, Configuration and Administration of IBM WebSphere Application Server 6.x/7.x on Windows NT/2000/2003, AIX, Linux, HP-UX and Solaris.
  • Responsible for planning and upgrade of Blue Cross Blue Shield version from 4.0 to 4.1, bringing it in compliance with the business users.
  • Responsible for scheduling installations and upgrades (Fix packs and Cumulative fix packs), and maintain them in accordance with established policies and procedures as per the IBM specification.
  • Integrated IBM HTTP Server, Apache web server with WebSphere Application server on AIX, Solaris and Windows platforms and created Web Server Definition in WAS V6.x/7.x admin console.
  • Performed Migration tasks such as reconstructing the environment of WebSphere Application Server 6.x to a nearly Identical WebSphere Application Server 7.0 environment, including, but not limited to, applications and Configuration settings.
  • Migrated WebSphere Application Server 6.1 on Solaris to WebSphere Application server V7.0 on Linux.
  • Proficient with open deploy and control hub to deploy applications.
  • Experienced in configuring Data Sources, Virtual Hosts, JMS, MDBs, Global Security and tuning in IBM WebSphere 6.x/7.x Configured WebSphere Application server for authentication using LDAP.
  • Worked with networking team in setting up Load Balancers such as BIG IP(F5) to communicate with IBM HTTP Server & Apache Webservers.
  • Troubleshooting on issues such as out of memory, memory leaks, hung sessions and session replication, federation of nodes and synchronization of nodes with NDM.
  • Created IBM Problem Management Records (PMR) to report WebSphere Application Server problems.
  • Analyzed log files to solve problems using debugging tools like Log Analyzer, First Failure Data Capture (FFDC) logs and Collector Tool.
  • Proficient with Maximo and ITSM tools to create, assign and close production and non- production tickets.
  • Worked closely with business, product management, and project management to ensure that application and technical architecture meets project objectives and standards.
  • Provided 24/7 support for Production Issues.

We'd love your feedback!