Sr. Hadoop Administrator Resume
Dallas, TX
SUMMARY
- A Senior Systems Engineer with Seven Years of experience in Hadoop Administration, Web Sphere Application Server Administration and Linux Administration in areas of Airline Industry, Financial, Banking, Insurance, Client - Server, Internet Technologies, SOA application Integration.
- Well versed in installing, configuring and tuning Hadoop distributions: Cloudera, Hortonworks on Linux systems.
- Deep knowledge in Hadoop Core Components including Hive, Pig, Scoop, Flume, HBase, Zookeeper, Oozie,YARN etc
- Manage scalable Hadoop cluster environments.
- HDFS support and maintenance, Cluster maintenance, creation/removal of nodes, Cluster Monitoring/ Troubleshooting, Manage and reviewHadoop log files, Backup and restoring, capacity planning
- General operational expertise such as good troubleshooting skills, understanding of systems capacity, bottlenecks, basics of memory, CPU, OS, storage, and networks
- Work with Hadoop developers and operating system admins in designing scalable supportable infrastructure for Hadoop.
- Experience in setup, configuration and management of security for Hadoop clusters using Kerberos and integration with LDAP/AD at an Enterprise level
- As aMiddleware Administrator, I have been specialized in following roles.WebSphere Application Server Administrator
- Strong System Administrative skills in WebSphere Application Server Environment, SiteMinder Environment, Tivoli Access Manager Environment, WebSpherMQ Environment on AIX, Sun Solaris, Window Server.
- Extensively involved in installing, configuring, maintaining, and supporting WebSphereApplicationServer 6.1/7.0/8.5.5
- Strong technical knowledge includes WebSphere Application server implementation, support, workload management and performance tuning. Web server setup, including complex secure sockets layer (SSL) configuration on IBM HTTP Server.
- Configure and support web servers (IIS, I H S, iPlanet, Apache and Sun One, etc.) for Internet and Intranet environments.
- Responsible for creating all necessary documentation to build, administer and support all dev, TEST, QA and production Portal Environments.
- Strong experience in writing shell scripts to automate the administrative tasks and automate the WebSphere Environment with Jacl and Jython Scripts.Systems Administrator
- Responsible for Operating system installation, regular upgrade and administration.
- Perform daily system monitoring, verifying the integrity and availability of all hardware, server resources, systems and key processes, reviewing system and application logs, and verifying completion of scheduled jobs such as backups
- Create, change, and delete user accounts per request
- Apply OS patches and upgrades on a regular basis, and upgrade administrative tools and utilities
- Perform ongoing performance tuning, hardware upgrades, and resource optimization as required. Configure CPU, memory, and disk partitions as required
- Help tune performance and ensure high availability of infrastructure
- Worked on virtualization technologies such as VMWare ESXi, Hypervisor
- Responsible for monitoring the infrastructure with tools like Nagios
TECHNICAL SKILLS
Operating Systems: Solaris 8, 9& 10, AIX5.1/5.2/5.3, RedHat Linux 6.5/7, Suse LinuxWindows 2008/2012 Servers.
Languages: C, C++, Java, plsql, jacl,jyothonApplication/WebServers WebSphere 8.5.5/7.0/6.1 , WebSphere Portal Server 8.0/7.0/6.1, WebSphere MQ 7.0/6.0, iPlanet Server 6.0/4.1, Tivoli Access Manager6, SiteMinder6.0/5.5, IHS8.5/7.0/ 6.1, IIS7.0/6.0
Big Data Technologies: Hadoop distributions (CDH4.7, 5.3 and HDP 2.1), Red hat Linux 6.x,7.x Solaris 11, Shell Scripts, Nagios, Ganglia monitoring, Kerberos, Shell scripting, Python Scripting, Java, Hive, Pig, Scoop, Flume, HBase, Zookeeper, Oozie, YARN, Cloudera Manager
Databases: Oracle11g/10g/9.0.2.5, SqlServer2000/7.0, DB2UDB9.2/8.2
J2EE Technologies: J2EE1.7/1.6/1.5, Java2.0, Servlet2.3/2.2, Java Beans, EJB 2.2/2.0/1.1/1.0 , JSP1.2/1.1/1.0, JDBC2.0/1.0, JNDI, RMI, CORBA, Java Swing /AWTXML, HTML, DHTML, and JavaScript, WebSphere MQ 5.3, JBoss
Special Software: RAD 7.5/7.0/6, WSAD 5/4, Remedy User, SiteScope, Wily 7.1/7.0, CMG, Citrix ICA Client, Hummingbird Exceed, CSS, WinCVS, VSS, IBM Visual Age, Ultra Edit, Forte, Apache Tomcat Rational Rose, Microsoft Visio, XMLSpy, Home Site 4.5/5.0, IntroScope, Resource Analyzer, and Log Analyzer, Candle, Actuate 5/6
PROFESSIONAL EXPERIENCE
Confidential, Dallas, TX
Sr. Hadoop Administrator
Responsibilities:
- Responsible for architecting the Hadoop environment and integrating with other components.
- Deep knowledge in Hadoop Core Components including Hive, Pig, Scoop, Flume, HBase, Zookeeper, Oozie,YARN, Cloudera Manager, etc
- Responsible for day-to-day activities which includes HDFS support and maintenance, Cluster maintenance, creation/removal of nodes, Cluster Monitoring/ Troubleshooting, Manage and reviewHadoop log files, Backup and restoring, capacity planning
- Worked with Hadoop developers and operating system admins in designing scalable supportable infrastructure for Hadoop
- Responsible for Operating system and Hadoop Cluster monitoring using tools like Nagios, Ganglia, Cloudera Manager
- HA Implementation of Namenode replication to avoid single point of failure.
- Involved in troubleshooting issues on the Hadoop ecosystem, understanding of systems capacity, bottlenecks, basics of memory, CPU, OS, storage, and networks
- Involved in setup, configuration and management of security for Hadoop clusters using Kerberos and integration with LDAP/AD at an Enterprise level
- Operating system and Hadoop Cluster monitoring using tools like Nagios, Ganglia, Cloudera Manager
- Responsible for scheduling jobs in Hadoop using FIFO, Fair scheduler and Capacity scheduler
- Possess good Linux and Hadoop System Administration skills, networking, shell scripting and familiarity with open source configuration management and deployment tools such as Puppet or Chef.
Environment: Hadoop distributions (CDH4.7, 5.3 and HDP 2.1), Red hat Linux 6.x,7.xSolaris 11, Shell Scripts, Nagios, Ganglia monitoring, Kerberos, Shell scripting, Python Scripting, Java,Hive, Pig, Scoop, Flume, HBase, Zookeeper, Oozie,YARN, Cloudera Manager, etc.
Confidential, Jersey City, NJ
Hadoop Administrator
Responsibilities:
- Responsible for installing and configuring Hadoop clusters (for large data sets) in Linux systems.
- Experience in using Hive, Pig, Scoop, HBase, Zookeeper, Oozie, etc
- Involved in Hadoop administration tasks such as adding/removing nodes
- Involved in monitoring of the Hadoop clustered environment using Ganglia
- Good knowledge of Hadoop cluster maintenance.
- Operating system and Hadoop Cluster monitoring using tools like Nagios, Ganglia, Cloudera Manager
- Involved in scheduling jobs using fair scheduler.
- Responsible for installation, configuration and management of Linux servers in the VMWare environment.
- Performed operating systems updates/patches as and when required.
- Involved in 24/7 Production support of Hadoop system.
- Configured storage & partitions for the systems using logical volume manager
- Responsible for mounting, unmounting filesystems based on the requirements.
Environment: Hadoop distributions (CDH3), Red hat Linux 6.x,7.x Solaris 11, Shell Scripts, Nagios, Ganglia monitoring, Kerberos, Shell scripting
Confidential, New York City, NY
Middleware Administrator.
Responsibilities:
- Administer the WebSphere Application Server environments Development, Integration, Testing, Staging and production environments, deploy WebSphere applications to all the environments. Assist developers/application owners with problem resolution as necessary.
- Responsible for the installation and configuration of IBM WebSphere Application Server V6.1 on Linux and Windows platforms.
- Clustered the Application Server environment using horizontal clustering across multiple boxes to facilitate high availability, failover support and load balancing in a production environment.
- Integrated IBM WebSphere Application Server with ITCAM to monitor thread pools, rendering speeds, cache sizes, session data, JVM heap sizes, and database connections.
- Installed and configured IBM HTTP Server and Apache Web Server to transfer HTTP requests to the WebSphere Portal Server through the WebSphere Application Server plug-in in a clustered environment.
- Administer the WebSphere development, TEST, Stage and production environments, deploy WebSphere applications to DEV and TEST environments
- Responsible for J2EE Application Deployments, Plug-in Configuration, Data Source Creation, Virtual Host Creation, Session management, clusters, Deployment Manager Configuration, Network Deployment Configuration in WebSphere6.1 and WebSphere7.0 on Linux environment
- Configured and Enabled the Global Security for WAS Administration Console users and Console Groups using Active Directory Server as a LDAP User Registry.
- Very strong experience in complete life cycle of WebSphere Application Server Administration like involving Architecture/Design discussions, installation ND and Base versions and fix packs, Configuration, Deployment, Scripting, Migration, and Troubleshooting on Solaris, Aix, Linux, Windows 2003/2008 Server Environments.
- Extensively involved in advanced configuration concepts like Service integration Bus, Web Services, Destinations, Message Activations, Listener ports, Queue Connection Factories, Queues, Application Servers, Clusters, Shared Libraries, Profiles, JDBC providers, Data Sources, URL Providers, URLs, JVM Custom Services, Environment Variables, etc.
- Provided infrastructure solutions for J2EE applications around IBM WebSphere Application Server, IBM WebSphere Portal Server, Tivoli Access Manager, IBM MQSeries, IBM HTTP Server, and Network Dispatcher on AIX, Windows and Solaris Platforms.
- Strictly followed Organization standard admin procedures and policies like Application request forms, Audit Request Forms, Version Control, Change Management Control, Organizing or involving in bridge calls for remote teams, Weekly Implementation plans, Code promotion rules etc.
- Responsible for Installing RAD7.5 for development teams and managing patch levels, building out environments, configurations assisting developers.
- Provided 24/7 on call support on a rotational basis during the weekend and at nights.
- Lead for WebSphere Portal 6.1.5/6.1.0.3 migrations on AIX environment and
- WebSphere Content Rules Engine setup on Windows 2003 server environment.
- Installing Deployment Manager, Primary portal node, Secondary portal node and fix packs.
- Database Migration from Cloudscape to Oracle for CP and FS instances and to DB2 for Personalization Rules Engine instance.
- Clustered the Portal Server environment using horizontal clustering across multipleboxes to facilitate high availability, failover support and load Balancing in a production environment.
Environment: WebSphere Application Server 6.1, IHS 6.1/7.0, Shell Scripts, WsAdmin scriptingJ2EE 1.3/1.4/1.5/1.6 , WebSphere 7.0/6.1.0.13 , IBM HttpServer6.0/2.0.47, WebSphere Portal Server 7.0/6.1.0.3 , WebSphere MQ7, Site Minder Components, I planet Directory Server, Web Agent, Java 2.0, JSP1.2, EJB 2.0, JDBC 2.0, XML, Windows 2008 Server, AIX7.1/6, Wily7.1/7.0, RD7.5, DB2UDB, Oracle10g/9.0.2.5, Remedy User, BMC Petrol, Clear Case, Shell Scripts, jython and Jacl.
Confidential
JavaDeveloper/Systems Administrator
Responsibilities:
- Performed requirements analysis and design and used of Rational Unified Process for analysis, design and documentation purposes.
- Interacted with the client to understand the requirements thoroughly in a short span of time.
- Developed Use cases, traceability matrices, design specification and test documents including UATs, and implementation manuals.
- Involved in design and development of the architecture of the web applications in JSP.
- Designed and developed Enterprise Stateless and Stateful Session beans to communicate with the Container Managed Entity Bean backend services.
- Designed and deployed many Servlets and JSPs to WebSphere Server.
- Developed various Java classes, SQL queries and procedures to retrieve and manipulate the data from backend Oracle database using JDBC.
- Involved in developing programs for parsing the XML documents using XML Parser.
- Involved in tuning and profiling the application for better data transactions and performance used JProbe for the same.
- Extensively worked with Java Script for front-end validations.
- Responsible for configuring the project into VSS and creating access rights for the other team members.
- Involved in Unit Testing and Integration Testing.
- Installation and configuration of Linux servers for new build environments.
- Configuration of network equipment for newly builds servers.
- Responsible for server hardware support.
- Kernel re-configuration & parameter tuning.
- Monitoring system logs and root's email for important messages such as errors and warnings or hardware failure errors.
- Managing Disk File Systems, Server Performance, Users Creation and Granting file access Permissions.
- Creation of groups, adding User ID to a group as a primary or secondary group removing User ID from a group.
- Installation of required patches and packages.
Environment: WebSphere 5, Servlets 2.2, EJB, JSP, JBoss, JDBC, PL/SQL, XML, HTML, UML, DHTML, RAD5, Windows NT, Solaris 2.x., IIS, IBM VisualAge, Rational Rose, JProbe, Oracle 8.1.7, ClearCase and ClearQuest.