SUMMARY:

• Over 13 years of extensive IT experience in Hadoop Administration, Configuration Management, Change Management. Also over 5 years’ experience as UNIX Administrator on Solaris/Linux Platforms.
• Sun Certified System Administrator for Solaris 8
• Over 3.5 years of experience in designing and implementing Big Data Projects using Hadoop (HDFS,Map - Reduce). Responsible for end to end implementation.
• Experienced on authorization, authentication, auditing, data encryption and security administration using Apache Ranger, Apache Knox on Kerberos Cluster
• As a Hadoop Administrator responsible for the design, installation, configuration, administration of Client’s various Hadoop environments. Involved in evaluating and testing new products, and worked with tech leads and system engineers. Experience in customizing Hadoop to meet various requirements that come from running in the enterprise environments.
• Extensive knowledge of Hadoop Architecture, MapReduce, YARN and also various components like HDFS, Namenode, Datanode, YARN, Resource Manager and Node Manager.
• Managed Hadoop cluster environment, handling all Hadoop environments including design, capacity planning, cluster setup, performance tuning and ongoing monitoring. Evaluate and recommend systems software and hardware for the enterprise system including capacity modeling.
• Set up an automated monitoring and escalation infrastructure for Hadoop cluster using Nagios and Ganglia. Load log data into HDFS using Flume. Scheduling cron jobs for file system check using fsck and also running the balancer for uniform load on the nodes
• Worked with Architecture and Development teams to understand usage patterns and work load requirements of new projects in order to ensure the Analytics Platform can meet demand.
• Worked on setting up Name Node high availability for major production cluster and designed Automatic Failover control using zookeeper and quorum journal nodes.
• Troubleshoot and debug Hadoop ecosystem run-time issues. Provided developer and operations documentation. Provided Hadoop, OS, and hardware level optimizations.
• Cluster capacity planning, performance tuning, cluster Monitoring, Troubleshooting.
• Design Big Data solutions for traditional enterprise businesses.
• Used Network Monitoring Daemons like Ambari alerts and Nagios.
• Backup configuration and Recovery from a Name Node failure.
• Decommissioning and commissioning the Node on running cluster.
• Installation of various Ecosystems and Daemons.
• Extensive experience as Systems Administrator in Unix Administration, WebSphere Administration, DB2 Administration, IBM CLM/JAZZ Team server support and Clearcase\ClearQuest.
• Responsible for end to end Deployment of CLM/Jazz Server 4.0.4\3.0.1.1 environment, which includes installation and Configuration of Websphere Application Server 7.0.0.17, Rational ClearQuest, RequisitePro Web Servers 7.1.2.3 and CM server for CCRC DB2 5.5/9.7 and Tivoli LDAP user registry configuration

PROFESSIONAL EXPERIENCE:

Confidential, NJ

Hadoop Administrator

Responsibilities:

• Currently working as admin in Horton works (HDP 2.2.4.2/2.4 ) distributions for 3 clusters ranges from Dev, PreProd and PROD contains 300+ nodes.
• Responsible for Cluster maintenance, Cluster Monitoring, commissioning and decommissioning Data nodes, Troubleshooting, Manage and review data backups, Manage & review log files.
• Day to day responsibilities includes solving developer issues and providing instant solution to reduce the impact and documenting the same and preventing future issues.
• Installed and configured Apache Ranger and Apache Knox for securing HDFS, HIVE and HBASE.
• Experience on new component installations and upgrading the cluster with proper strategies.
• Experience on new Discovery Tools installation and integration with Hadoop Components.
• Monitoring systems and services, architecture design and implementation of deployment, configuration management, backup, and disaster recovery systems and procedures.
• Hands on experience on cluster up gradation and patch upgrade without any data loss and with proper backup plans.
• Changing the configurations based on the requirements of the users for the better performance of the jobs
• Helping the users in production deployments throughout the process.
• Experienced in production support which involves solving the user incidents varies from sev1 to sev5.
• Managed and reviewed Log files as a part of administration for troubleshooting purposes. Communicate and escalate issues appropriately.
• As an admin followed standard Backup policies to make sure the high availability of cluster.
• Involved in Analyzing system failures, identifying root causes, and recommended course of actions. Documented the systems processes and procedures for future references.
• Worked with systems engineering team to plan and deploy new environments and expand existing clusters.
• Monitored multiple clusters environments using AMBRI Alerts, Metrics and Nagios.
• Analyze the Performance of the Linux System to identify Memory, disk I/O and network problem.

Environment: Horton Works, Hbase, Hive, Oracle 11g, Platfora, Ambari, Ganglia and Nagios.

Hadoop Administrator

Responsibilities:

• Responsible for Cluster maintenance, Cluster Monitoring, Troubleshooting, Manage and & review log files.
• Day to day responsibilities includes solving developer issues and providing instant solution to reduce the impact and documenting the same and preventing future issues.
• Manage multiple clusters using Pivotal HD and HortonWorks
• Talend platform support, including TAC and job server configuration, project and user set up. Debug, remedy, and automate solutions for operational issues in the production environment
• Participate in the research, design, and implementation of new technologies for scaling our large and growing data sets, for performance improvement, and for analyst workload reduction.
• Experienced in implementing Real-Time streaming and analytics using technologies such as Spark Streaming and Kafka.
• HA implementation of Name Node to avoid single point of failure.
• Installed and configured Hadoop ecosystem components like MapReduce, Hive, Pig, Sqoop, HBase, ZooKeeper and Oozie.
• Ensured data integrity using 'fsck' and another Hadoop system admin tools for block corruption.
• Worked on implementing NameNode backup using NFS for High availability.
• Continuous monitoring and managing the Hadoop cluster through Ganglia and Nagios.

Environment: Horton Works, Pivotal HD, Hbase, Hive, Spark, Kafka, Flume, Sqoop, Ganglia and Check mk, Talend, Tableau.

IT Consultant/Team Lead

Responsibilities:

• Requirement gathering, installations, Configuration and integration of different tools
• Cluster configuration, dash boards for monitoring the cluster
• Created 40 node clusters and dumped data from different sources
• Configured high availability for production cluster and designed automatic failover control using zookeeper and quorum journal nodes.
• Configured Ganglia for monitoring the cluster and integrated Nagios for alerting
• Managing and monitoring the health of the Hadoop cluster ( Capacity trending, data replication, load on HDFS, Monitoring nodes for corrupted blocks and Namenode heartbeats)
• Commissioning and decommissioning of data nodes, Rebalancing of Hadoop cluster.
• Monitor Hadoop job performance and fine tuning and Tested the processing, performance using the Benchmarks like TestFDSIO and Sort
• Monitor and review Hadoop log files
• Design, implement hadoop security using ACLs and Kerberos Authentication
• Data Node forecasting and planning based on Data Ingest
• Using Sqoop for loading structured data from SQL database to HDFS for analysis purpose.

Environment: HDFS, MapReduce, Apache Hadoop, Cloudera Distributed Hadoop, Hbase, Hive, Flume, Sqoop, RHEL, Ganglia and Nagios and MySQL

SCM Engineer

Responsibilities:

• Analysis, Define, Design and implementing Configuration Management policies and procedures.
• Primary responsibility will be to provide daily Linux/CLM administration support for various project/programs.
• Setting up CLM 4.0.4 Staging environment for upgrading the CLM applications and Upgrading CLM 3.0.1.1 till 4.0.4.
• Implemented end to end Deployment of CLM/Jazz Server 3.0.1.1 environment, including installation and Configuration of WAS 7.0.0.17, DB2 5.5, and Tivoli LDAP user registry configuration
• Implemented end to end Deployment of Rational Quality Manager Ver 2.0.1 and upgrading to Ver 2.0.1.1/3.0.1.1.
• Implemented end to end Deployment of Rational ClearQuest Web, Requisite Pro Web Servers 7.1.2.3 and CM server for CCRC.
• Deployed various application modules into WebSphere Application Server.
• Maintain and Troubleshoot Windows, Linux, CLM Websphere and DB2 in a distributed environment.
• Participated in Change control board meetings, and given various impact analyses as and when necessary.

Environment: Linux, WebSphere Application Server, Windows 2003/2008, CLM, Clearcase, ClearQuest, Rational Requisite Pro, Rational Test Manager, CruiseControl, Visual Studio.net, DB2, Oracle.

SCM Engineer

Responsibilities:

• Planned and created the VOBs for the different groups to meet Project requirements and applied triggers accordingly. Assigned and managed the VOBs with different regions and groups to restrict users accessing all VOBs
• Managed software baselines and configurations, including labeling, branching/merging and promoting versioned files.
• Performed Multisite maintenance activities such as Creating replicas on Hub, Checking error logs, shipping bays and manage masterships of replica elements and type objects on the basis of requirements
• Migration of Flat files to ClearCase based Software Configuration Management system for different groups as well as Moving of MBNA code to ClearCase Repository
• Involved in creating UCM PVOB’s, Migrating existing Base ClearCase VOB's to UCM component VOB's

Environment: Solaris 8, Linux, Ant, Perl, Cruise Control, Clearcase, Clearquest, Perl, VSS, Visual Studio.net, SQL Server.

SCM Engineer

Responsibilities:

• Analyzed and defined various server and workspace environments requirements in Cosine development phase.
• Defined and implemented code migration strategy of Cosine's Flat code to Version Control
• Performed Rational ClearCase administration in a Windows/UNIX distributed software development environment.
• Performed weekly and on-call deployments of Continuous Integration Test, System Test and production applications.
• Participated in Change control board meetings, and given various impact analysys as and when necessary.
• Maintained continuous integration effort with CruiseControl along with scheduled builds.
• Co-ordinate builds and release cycles on the request of business with dev teams, testing teams and project management teams.
• Cross platform Integration of Windows NT ClearCase Clients to access UNIX VOB/View Server through Samba.
• Used ClearCase Unified Change Management (UCM) and base ClearCase. Created projects for software teams and provided support to the IOBI teams for SCM related needs.

Environment: Java, JSP, Servlets, EJB, Windows 2000, Java Script, Oracle, J2EE, ClearCase, ClearQuest, WebLogic.

Systems Administrator

Responsibilities:

• Handling calls related to problems in Client Portal servers. Calls were invariably critical in nature and they were attended and resolved on priority. Exposure to Scripting to monitor and to report on inactive status, alert logs, CPU & memory utilization. Log file analysis on both Web server & app. server.
• Installation and administration of Sun Solaris and Linux servers which includes NFS, DNS, NIS Checking the load on servers, User Administration, Adding patches etc.
• Adding & configuring hardware devices like hard disks, network interfaces, memory.
• Backup/Recovery strategy planning and implementation.
• Configuring SSH with auto login between two remote Networks.
• Installation and administration of Web based Squirrel mail using Qmail (Web based mail server) on Linux OS.
• Installation and administration of Windows NT Server 4.0, Windows NT Workstations, Windows Professional OS, Configuring Network Adapters, TCP/IP protocols manually, DNS, WINS, Joining a Domain.
• Setting up Clearcase in an interoperable environment with UNIX and NT Servers and clients using NFS Maestro

Environment: Sun servers 6800, 450 & 420R, Oracle 8, iPlanet application server & web server UNIX (Sun Solaris), Windows NT, C, C++, Humming Bird Maestro.

Confidential

Systems Administrator

Responsibilities:

• Installation & Configuration of SOLARIS, Windows NT/2000 server Operating systems.
• File system management: Monitoring and maintaining of disk based file system, Checking and clearing log files, Mounting/ unmounting all remote/individual file systems, checking the data consistency using fsck command.
• Configuration and Administration of NIS, Auto mount.
• Solving Operating system problems in Windows NT/98 and Solaris
• Installation and configuration of application software’s according to customer environment.