SUMMARY:

• Around 7 years of IT experience including 4 years of experience with Hadoop Ecosystem in installation and configuration of different Hadoop eco - system components in the existing cluster.
• Experienced in installation, configuration, monitoring and administration of ecosystem components such as HIVE, PIG, SQOOP, FLUME, ZOOKEEPER, SCALA, OOZIE and HBASE.
• Extensive experience in cluster planning, installing, configuring and administrating Hadoop cluster for major Hadoop distributions like Cloudera and Hortonworks.
• Possess knowledge on NoSQL database administration.
• Experience on Cloud Computing such as AWS.EC2 and VPC instances.S3, IAM, Cloudwatch.
• Experienced in understanding the client's Big Data business requirements and transform it into Hadoop centric technologies.
• Hands on experience in Installing, Configuring and managing the Hue and HCatalog.
• Analyzing the clients existing Hadoop infrastructure and understand the performance bottlenecks and provide the performance tuning accordingly.
• Worked with Sqoop Importing and exporting data, from different databases into HDFS, HBase and Hive.
• Defined job flows in Hadoop environment using Oozie and Autosys for data scrubbing and processing.
• Experience in configuring Zookeeper to provide Cluster coordination services.
• Loading log files from multiple sources directly into HDFS.
• Hands on experience in Linux admin activities on RHEL & Cent OS.
• Experience in benchmarking, backing up and recovery of Namenode metadata.
• Experience in commissioning and decommissioning of nodes.
• Adept at configuring NameNode High Availability.
• Worked on setting up Namenode high availability for large production cluster and designed Automatic failover control using Zookeeper and journal nodes.
• Strong knowledge on Hadoop HDFS 1.x and 2.x architectures and Map-Reduce framework.
• Experienced in deploying and managing the multi-node cluster for development, testing and production environments.
• Experienced in understanding the security requirements for Hadoop and integrating with Kerberosauthentication infrastructure- KDC server setup, creating realm.
• Used Cluster Monitoring tools like Ganglia and Nagios.
• Well-versed with multiple operating systems such as Windows, Dos, UNIX, LINUX, Sun Solaris.
• Excellent command on change management and coordinating deployments in distributed environments.
• Hands on experience with RAID using Volume Management Software like Logical Volume Manager, Veritas Volume Manager, Solaris Volume Manager.
• Experienced in Installation of Operating Systems, Packages and Patches, adding peripherals, maintaining user accounts, System Security maintenance, performance tuning, troubleshooting at various levels.
• Hands on experience in configuration management systems like Puppet and Chef.
• Security management like performing security health checks as per policies / procedures, patching the servers based on the advisories for the applications and operating systems.
• Hands-on experience in diagnosing, troubleshooting various networking, hardware & Linux server's services issues and performing preventive maintenance.
• Experienced in writing / modifying shell scripts for process automation of systems, applications, backups.

TECHNICAL SKILLS:

Big Data Ecosystem: Cloudera, Hortonworks, HDFS, HBase, Hadoop MapReduce, Zookeeper, Hive, Spark, IMPALA, Pig, Sqoop, Flume, Oozie, YARN.

Database: Oracle (9i, 10g), MySQL, MS Access, NoSQL

Scripting Languages: Bash, Ksh, JavaScript, CGI, Perl, Python Java Scripting, UNIX shell scripting.

Operating Systems: Sun Solaris 8,9,10, Red Hat Linux 4.0, RHEL-5.4, RHEL 6.4, IBM-AIX, HPUX 11.0, HPUX 11i, UNIX, VMware ESX 2.x, 3.Windows XP, Server 2008/2012, Ubuntu.

Management: Cloudera Manager, Ambari

Monitoring Tool: Cloud Watch, Nagios app dynamics, Ganglia, Splunk, IBM Guardium.

Cloud Computing: Amazon AWS Cloud, EC2 and VPC instances, S3, IAM, Cloudwatch.

SDLC: Agile (Scrum), Waterfall.

PROFESSIONAL EXPERIENCE:

Confidential, Charlotte, NC

Sr. Hadoop Engineer/Administrator

Responsibilities:

• Responsible for Cluster Maintenance, Upgrades, Patching, Fine Tunining, Commissioning and Decommissioning nodes, Monitoring, Troubleshooting, Manage and Review data backups and log files.
• Collaborate with key stakeholders within GIS and Cyber Security to establish logging standards to address various governance and develop specific use cases to address business needs. Also apply technical expertise in Hadoop, Cloudera and big data storage to the task of applying real-time database activity monitoring technology using IBM Guardium.
• Engage with information security and technical leaders to determine best approach for applying existing bank security policies to new data storage technologies.
• Develop automation for security tools management and build data pipelines from Hadoop to ArcSight i.e through Cloudera Navigator, Kafka, Guardium appliances, Splunk and ArcSight.
• Tested all the available commands for Hive, Impala, Hdfs and HBase and analyzed the audits of those commands in Cloudera Navigator. Also collaborated with Cloudera Support to fix issues with specific commands which are having issues in auditing.
• Implemented real-time Hadoop Monitoring use cases like Hadoop Failed logins, Unauthorized Admin commands, Unauthorized Access to Confidential data and Unauthorized Updates to Confidential data in GIS Production.
• Used Impala for Data Analytics as per the business requirement.
• Build DR Cluster to store and safeguard data of GIS Production Cluster.
• Monitored workload, job performance and capacity planning using Cloudera Manager.
• Documented the workflow, use cases, issues as per the requirement.

Environment: Cloudera Manager (5.9.1 & 5.13.2), Sentry, Kerberos, HDFS, HBase, Hive, Impala, Map Reduce, Shell Scripting, spark, solr, Sqoop, Kafka, Flume, Oozie, Zookeeper, Splunk, IBM Guardium, Redhat Linux 7.0.

Confidential, Duluth, GA

Sr.Hadoop Administrator

Responsibilities:

• Involved in start to end process of Hadoop cluster setup where in installation, configuration and monitoring the Hadoop Cluster.
• Responsible for Cluster maintenance & Monitoring, commissioning and decommissioning Data nodes, Troubleshooting, Manage & review data backups, Manage & review Hadoop log files.
• Monitoring systems & services, architecture design & implementation of Hadoop deployment, configuration management, backup and disaster recovery systems and procedures.
• Installation of various Hadoop Ecosystems and Hadoop Daemons.
• Responsible for Installation and configuration of Hive, Pig, HBase and sqoop on the Hadoop cluster.
• Configured various property files like core-site.xml, hdfs-site.xml, mapred-site.xml based upon the job requirement.
• Involved in loading data from UNIX file system to HDFS.
• Provisioning, installing, configuring, monitoring, and maintaining HDFS, Yarn, HBase, Flume, Sqoop, Oozie, Pig, Hive.
• Implemented Hadoop stack and different bigdata analytic tools, migration from different databases to Hadoop.
• Monitored multiple Hadoop clusters environments using Ganglia and Nagios.
• Monitored workload, job performance and capacity planning.
• Upgraded Hadoop to 2.7.2 version.
• Expertise in recommending hardware configuration for Hadoop cluster.Installing, Upgrading and Managing Hadoop Cluster on Cloudera distribution.
• Conducted POC for Hadoop and Spark as part of NextGen platform implementation. Implemented recommendation engine using scala.
• Trouble shooting many cloud related issues such as Data Node down, Network failure and data block missing.
• Monitored and configured a test cluster on amazon web services for further testing process and gradual migration.
• Managing and reviewing Hadoop and HBase log files.
• Experience with Unix or Linux, including shell scripting.
• Loading the data from the different Data sources like (Teradata and DB2) into HDFS using sqoop and load into Hive tables, which are partitioned.
• Developed Hive UDF's to bring all the customers information into a structured format.
• Developed bash scripts to bring the Tlog files from ftp server and then processing it to load into hive tables.
• Built automated set up for cluster monitoring and issue escalation process.
• Administration, installing, upgrading and managing distributions of Hadoop (CDH4, Cloudera manager), Hive, HBase.

Environment: Hadoop 2.7.2, HDFS, Map Reduce, Shell Scripting, spark, solr, Pig, Hive, HBase, Sqoop, Flume, Oozie, Zoo keeper, cluster health, monitoring security, Redhat Linux 7.0, impala, Cloudera Manager5.5.4.

Confidential, Herndon, VA

Sr.Hadoop Administrator

Responsibilities:

• Working as admin in Horton works (HDP 2.2.4.2) distribution for 4 clusters ranges from POC to PROD contains nearly 100 nodes.
• Day to day responsibilities includes solving developer issues, deployments moving code from one environment to other environment, providing access to new users and providing instant solutions to reduce the impact and documenting the same and preventing future issues.
• Experienced with Hadoop ecosystems such as Hive, HBase, Sqoop, Kafka, Oozie etc.
• Experienced on adding/installation of new components and removal of them through Ambari.
• Monitoring systems and services through Ambari dashboard to make the clusters available for the business.
• Experience With installing and configuring Distributed Messaging System like Kafka.
• Experienced in Setting up the project and volume setups for the new projects.
• Experience in configuring the Storm in loading the data from MYSQL to HBASE using jms.
• Architecture design and implementation of deployment, configuration management, backup, and disaster recovery systems and procedures.
• Changing the configurations based on the requirements of the users for the better performance of the jobs.
• Developed Map Reduce programs to cleanse the data in HDFS obtained from heterogeneous data sources to make it suitable for ingestion into Hive schema for analysis.
• Implemented complex Map Reduce programs to perform joins on the Map side using distributed cache
• Setup flume for different sources to bring the log messages from outside to Hadoop HDFS.
• Used IMPALA to pull the data from Hive tables..
• Setting up MySQL master and slave replications and helping business applications to maintain their data in MySQL Servers.
• Monitored multiple clusters environments using AMBRI Alerts, Metrics and Nagios.
• Exported the analyzed data to the relational databases using SQOOP for visualization and to generate reports for the BI team.

Environment: Hadoop Horton works (HDP 2.2.4.2), Cloudera, Spark, HDFS Map Reduce, Pig Hive HBase Flume Sqoop, Windows 2000/2003 Unix Linux Java, Shell Scripting., Kafka, Oozie, Java, Oracle 10g, MySQL, Impala, Nagios, Ambra.

Confidential, Chicago, Illinois

Linux Administrator

Responsibilities:

• Patching of RHEL5 and Solaris 8, 9, 10 servers for EMC Power path upgrade for VMAX migration.
• Configuration of LVM (Logical Volume Manager) to manage volume group, logical and physical partitions and importing new physical volumes.
• Documented the standard procedure for installation and deployment of VMAX Migration and logical volume manager.
• Front-line support for users with variable HPC background and unique needsInstallation, configuration, support and security implementation on following services: DHCP, SSH, SCP.
• Configuration and administration of NFS and Samba in Linux and Solaris.
• Installation in the patches, Hardware and Software serversMaintained and monitored all of company's servers operating system and application patch level, disk space and memory usage, user activities on day-to- day basis.
• Installations of HP Open view, monitoring tool, in more than 300 servers.
• Attended calls related to customer queries and complaints, offered solutions to them.
• Creation of VMs, cloning and migrations of the VMs on VMware vSphere 4.0.
• Worked with DBA team for database performance issues, network related issue on Linux / Unix Servers and with vendors for hardware related issues.
• Expanded file system using Solaris Volume Manager (SVM) in the fly in Solaris boxes.
• Managed and upgraded UNIX server services such as Bind DNS.
• Configuration and administration of Web (Apache), DHCP and FTP Servers in Linux and Solaris servers.
• Decommissioning of the old servers and keeping track or decommissioned and new servers using inventory list.
• Handling problems or requirements as per the ticket (Request Tracker) created.
• Participated in on-call rotation to provide 24X7 technical supports.
• Configuration and troubleshooting - LAN and TCP/IP issues.

Environment: Red Hat Enterprise Linux 4.x, 5.x, Ubuntu, Centos, JEE, Sun Solaris 8, 9, 10, HP Blade, VERITAS Volume Manager, Oracle 11G, Samba, Oracle RAC/ASM, EMC Power path, Sun Fire v440, SUN BLADE X6250, X6270.

Confidential

Linux Administrator

Responsibilities:

• Installing and updating packages using YUM.
• Installing and maintaining the Linux servers.
• Created volume groups logical volumes and partitions on the Linux servers and mounted file systems and created partitions.
• Deep understanding of monitoring and troubleshooting mission critical Linux machines.
• Improve system performance by working with the development team to analyze, identify and resolve issues quickly.
• Ensured data recovery by implementing system and application level backups.
• Performed various configurations which include networking and IPTable, resolving host names and SSH keyless login.
• Managing Disk File Systems, Server Performance, Users Creation and Granting file access Permissions and RAID configurations.
• Automate administration tasks through the use of scripting and Job Scheduling using CRON.
• Monitoring System Metrics and logs for any problems.
• Running cron-tab to back up data.
• Adding, removing, or updating user account information, resetting passwords, etc.
• Using Java Jdbc to load data into MySQL.
• Maintaining the MySQL server and Authentication to required users for databases.
• Support pre-production and production support teams in the analysis of critical services and assists with maintenance operations.

Environment: Redhat 4x, 5x, Solaris 9/10, Linux, VMware, TCP/IP, Linux, Ubuntu, RAID, CRON, MySQL, Windows 2008 server, Netapp, SCSI.