Hadoop Administrator/operations Engineer Resume
Austin, TX
SUMMARY:
- Over nine years of experience in IT administration in banking, technology, finance and retail sectors.
- Experience with Bigdata Platform/Hadoop stack such as Hive, Pig, Flume, Sqoop and Zookeeper.
- Responsible for architecting Hadoop clusters and providing assistance with the addition of Hadoop processing to the IT infrastructure.
- Setup multi - node Hadoop clusters across various environments using Apache Hadoop, Hortwonworks and Cloudera distributions.
- Experience in installation, configuration and management of Hadoop cluster spanning multiple racks
- Implemented the standard based monitoring practices for Hadoop infrastructure.
- Excellent command in backup configuration and recovery from a Namenode failure.
- Installation of various Hadoop ecosystem components and Hadoop deamons.
- Good knowledge with Tableau and Qlikview BI reporting tools framework.
- Installed, configured and administered Oracle SOA Suite 11g.
- Experience in installing, configuring and trouble-shooting SunOne (Iplanet), Apache and IIS Webserver.
- Installed, managed and configured domains, server instances in Weblogic/Tomcat application servers
- Experience with monitoring tools like HP-BAC, HP-OVO, MIDAS, WILY Introscope and GOMEZ.
- Developed shell scripts for monitoring purposes.
- Hands on experience working with physical load balancers like F5 BIG IP.
- Highly motivated, detail oriented and organized with the ability to multi-task projects, maintaining a high degree of proficiency.
SKILL:
Platforms: Solaris 8/9/10, Linux AS3/AS4/ES4/RHEL (5.5, 5.8,5.9,5.11)/OEL 5.6, Ubuntu 10.04/12.04 , CentOS 6.4, Windows (NT/ 95/98/2000/2003 )
Big Data Tools: Apache Hadoop 1.x, HDP 2.2.4, CDH4, Hive, Hbase, Sqoop, Pig, HBase, Flume
Web Servers: SunOne Webserver 4.0/6.x/7.x, Apache 1.3/2.x, IIS 5.0/6.0.
Application Servers: BEA Weblogic 7.x/8.x/9.x/10.3/11/12c, Apache Tomcat 5.x/7.x
Languages: Shell scripting, HTML, XML, SQL
Packages: J2EE, JDK 1.2/1.3/1.4/1.6/1.7 , Jrockit
Databases: Oracle 8/9i/10g/11g, SQL Server, DB2
Tools: HP-OVO, MIDAS, Gomez, Topaz, Rational Clear case, ANT, SUN N1 SPSEntrust Get Access, Siteminder, Clear Quest, Alarmpoint, F5 BIG-IPCA Workload Control Center, Load Runner, BMC Remedy tool
BI Tools: ReportNet 1.0/1.1, Cognos 6.X/7.X Impromptu, Cognos UpfrontCognos Impromptu Web Reports (IWR), PowerPlay, Access ManagerPowerPlay Enterprise Server
EXPERIENCE:
Hadoop Administrator/Operations Engineer
Confidential, Austin, TX
Responsibilities:
- Responsible for architecting, installation and administration of HDP 2.2.4, CDH4 distributions.
- Setup Hadoop (YARN/MapReduce) cluster on various platforms like RHEL 5.6, CentOS 6.4
- Managed 200+ nodes HDP 2.2.4 cluster with 3 PB of data using Ambari 2.0.
- Configured High-Availability (HA) architecture for Namenode/Resource Manager.
- Experience in decommissioning and commissioning node on running cluster.
- Monitoring Hadoop cluster using tools like Ambari, Ganglia and Cloudera Manager.
- Installed, configured and integrated Hadoop Ecosystem components (Hive, Sqoop, Flume, PIG, Solr, Zookeeper, HBase and Tez).
- Planned and managed HDFS storage capacity. Advised teams on best practices and optimal processes using Pig, Hive and Sqoop tools.
- Implemented backup and recovery procedures from a Namenode failure using NFS.
- Installed, configured Kerberos setup.
- Worked on importing and exporting data from RDBMS into HDFS and Hive using sqoop.
- Collected log data from Webservers and integrated into HDFS using Flume.
- Worked on standards and proof of concept in support of CDH4/5 implementation using AWS cloud infrastructure.
- Knowledge on tools like Knox, Ranger and Puppet.
Environment: Hortonworks HDP 2.2.4, CDH 4/5, Hive, Sqoop, Pig, Flume, Zookeeper, Falcon, Oozie, Tez, RHEL 5.6/Ubuntu 12.04/CentOS 6.4, Splunk 6.1.3, SUN N1 SPS, BMC Remedy Tool, BMC-MIDAS, SharePoint 2010, HP-OVO, MIDAS
Sr. Middleware Administrator
Confidential, Austin, TX
Responsibilities:
- Responsible for providing Weblogic support to the in-house customers and its engineers.
- Point of contact for Oracle Enterprise manager 12c: implemented various OEM tasks.
- Deployed agents, discovered the Weblogic hosts/targets/domains and deploying JVMD agents.
- Performed rollback and patch installation using OEM console.
- Created groups, configuring the notifications and incidents.
- Created OS related jobs and Fusion control Jobs using OEM.
- Monitored and managed components using the OEM console.
- Worked closely with DEV, CQ, and STAGE groups in assisting with deploying applications onto the Weblogic application servers/clusters.
- Re-base lining production codes across (DEV, CQ, STAGE) environments.
- Configured Virtual hosts, Pools and iRules for application load balancing.
- Troubleshoot the day to day errors related with the application deployments.
- Documented the procedures and process for all new implementation involved.
Environment: Weblogic 10.3.x.x.x, OEM 12c, F5 BIG-IP 10.2.4, Oracle 10g/11g, RHEL 5.4/5.9, JIRA, Nexus v2, Ingrid
Sr. Systems/Middleware Administrator
Confidential, Mountain View, CA
Responsibilities:
- Involved in the implementation and infrastructure setup of J2EE application based on Weblogic, Oracle and DataGuard.
- Analyzed user systems and application needs, determining and evaluating alternative solutions and approaches to meeting those needs.
- Developed specifications and requirements for the optimal solution and integration of systems
- Installed, configured and administered Oracle SOA suite 11g R1 components (BPEL, BAM, OSB, and B2B) across Dev/UAT/staging/production environments.
- Configured DB adapters and JMS adapters required for the applications.
- Performed operational SOA administration duties (patching, environment cloning and implemented backup/recovery).
- Customization and tuning of Oracle suite 11g for performance.
- Worked on an upgrading the projects, which involved installation, configuration and administration of the Weblogic server 10.3.5 on Oracle OEL systems on various environments like Dev/Test/staging and production.
- Deployed the applications/patches on Weblogic servers in various environments.
- Involved in OS-level performance tuning, file system configurations, partitions and optimal disk I/O structure.
- Installed and configured the MapProxy server to the serve maps data to the Netcracker application.
- Configured email notifications in Oracle SOA Suite 11g
- Wrote shell scripts that would monitor heap size, state of the server and JDBC of all the instances running in a domain.
- Configured and setup the database monitoring using the ORAMON tools.
- Installed and configured profiler for capturing the application calls for monitoring purposes.
- Performed UNIX administrative tasks such as creating logical volumes and NFS mounts.
- Maintained and supported the assigned systems to ensure minimal downtime and loss of productivity.
- Primarily responsible for 24/7 on-call production support.
Environment: Oracle SOA Suite 11g, WebLogic Server 9.2/10.3, OEL 5.6, RHEL 5.5/5.8, Ubuntu 10.04/12.04 , Oracle 10g/11g, NEC 8.0/9.0, Apache WebServer 2.0, Perforce/Git, MySQL 5.1, MapProxy 1.5, Lighttpd and 1.4, Profiler 6.0.5
Sr. Web Support Engineer
Confidential, San Francisco, CA
Responsibilities:
- Primarily responsible for 24/7 on-call level 3 production support.
- Involved in capacity upgrade project which required installation, configuration and administration of Weblogic server 10.3 on Sun Solaris 10 (T5220 and T5240 hardware series).
- Deployed the applications on Weblogic servers and maintained load balancing, failover and high availability.
- Applied patches to the production boxes recommended by BEA.
- Worked on JDK versions upgrades on all environments.
- Involved in migration of SunONE (iPlanet) webserver 6.1sp8 from Solaris 8 (v490) to Solaris 10 (T5220 and T5240 series) platform
- Installed, configured and administered SunONE Webserver 6.1sp12
- Configured Weblogic 10.x plug-ins on SunONE (iPlanet) webservers
- Used F5 BIG-IP LTM for load-balancing Web and application traffic.
- Installed and configured Wily Introscope with Weblogic servers 10.3.
- Developed shell scripts for monitoring the batch jobs and log-transfer files.
- Worked with HP-OVO tool and MIDAS tool to create new templates and alarms for monitoring and troubleshooting purposes.
- Deployed application code onto multiple application servers across different datacenters using Sun N1 provisioning system tools.
- Experience in creating, modifying virtual hosts, host sets, physical hosts on SUN N1 SPS tools.
- Worked with different teams (IE and development) in game planning sessions for the successful execution of the projects.
- Documented all the procedures and issues throughout the scope of the project its lifecycle.
Environment: WebLogic Server 8.x/10.3, SunOne Webserver 6.x, Solaris 8/10, Oracle9i/10g, HP-OVO, MIDAS, WILY Introscope, CA Workload Control Center, TOPAZ, Verisign, F5 BIG-IP 9.4/10.2v, SUN N1 SPS, JDK 1.5/1.6, BMC Remedy Tool, SVN
Systems Integrator
Confidential, Richmond, VA
Responsibilities:
- Coordinated the design of subsystems and integration of total systems, implementation and testing of single sign-on authorizations for the Confidential applications.
- Installed, configured and administered the WebLogic server 8.1 sp6/9.2 in various environments like, DMZ/SIT/QA/PROD on various platforms like Linux AS 4 and Solaris 8/10.
- Installed and Configured Sun ONE (iPlanet 6.0) Web Server with WebLogic Server 8.1/9.2
- Configured and Administered Weblogic Server 8.1/9.2 with Oracle 9i/10g.
- Involved in configuring Apache Web server with Tomcat application server and the WebLogic server.
- Performed deployment of WAR and EAR application files in a clustered production environment, SIT (System Integration Test) environment and QA environment.
- Involved in performance tuning of WebLogic server with respect to heap size, threads and connection pools
- Involved in application migration and the Weblogic server migration during the OS up-gradation from Solaris 8 to Solaris 10.
- Set up test environments for single sign-ons using Entrust GetAccess.
- Installed and configured GetAccess runtimes on Apache and Sun ONE Webservers in various environments like Windows 2003, Linux and Solaris for user authentication.
- Installed and configured Netscape directory server for single sign-on applications.
- Configured SSL certificates on the WebLogic server.
- Installed SSL certificates on the Iplanet Webserver and Apache Webserver.
- Developed scripts for automatic startup and shutdown of the admin server and managed servers.
- Created operational documentation for AC applications for production implementation.
- Created user roles and groups for securing the resources using local operating system authentication.
- Involved in trouble shooting and fixing the day-to-day problems of the applications in production.
- Used HP service desk as a change configuration and management and peregrine tools for ticketing purposes.
- Provided 24/7 on-call support in production environment.
Environment: WebLogic Server 8.1/9.2, Linux AS3/ES4, Solaris 8/9/10, Windows 2003, J2EE, Jrockit8.1, JSP, Servlets, EJB, LDAP, JDBC, XML, Oracle9i, Ant1.5.1, HP Service Desk, Peregrine, HP-Mercury Diagnostics, Entrust GetAccess, Netscape Directory Server 4.0, Apache 2.0, SunOne Webserver 6.0, Tomcat Application Server, F5 BIG-IP.
Cognos Administrator
Confidential, New Brunswick, NJ
Responsibilities:
- Gathered the reporting requirements from the business users.
- Created database objects including Views and Packages in use of backlog and revenue systems to meet the data needs of the reports.
- Created four different packages in framework manager by importing metadata from backlog, revenue, time track and expense systems.
- Scheduled workflows to run accordingly to the user requirements.
- Maintained, tuned and bug fixed the existing impromptu reports and published to upfront by using the IWR server.
- Created multi- page reports based on multiple master queries to show the data on different pages when the master record changed in a report.
- Built multi- dimensional power cubes using Power Play Transformer by using IQD as a data source.
- Created MDC cubes using Power Play connect and published them on the upfront portal.
- Worked on Cognos security administration to restrict the users.
- Maintained the security level by category level and dimension level.
- Created user classes and users in access manager.
- Published various packages to Cognos Connection in order to use in the query studio for creating ad-hoc reports and report studio for developing the advanced reports.
- Created complex reports in report studio using conditional block, tabular set and tabular SQL.
- Developed standard templates, reports, Charts, Drill-Thru reports, Master Detail reports, Bursting Reports and Multilingual reports using report studio and query studio.
- Migrated impromptu catalogs and reports to CRN using migration utility.
- Involved in end to end testing the reports.
- Prepared functional and technical requirements documentation.
- Responsible for end user training and production support.
Environment: ReportNet 1.0/1.1, Cognos 6.X/7.X (Impromptu, Cognos Impromptu Web Reports (IWR), PowerPlay, Access Manager, PowerPlay Enterprise Server, Cognos Upfront), WebLogic Server 8.1 sp3, Solaris 8, Oracle8i