SUMMARY

• Having 6+ Years of professional experience in Software Development with Linux and Hadoop/Big Data technologies.
• About 4 years of experience with Hadoop Ecosystem including HDFS, MapReduce, YARN, Hive, Pig, Flume, Sqoop, impala, ZooKeeper, Hue, Oozie and HBase.
• Experience implementing big data projects using Cloudera
• Installed, Configured and Maintained Apache Hadoop clusters for application development and Hadoop tools like Hive, Pig, HBase, Zookeeper and Sqoop.
• Experience in installing, configuring and optimizing Cloudera Hadoop version CDH3, CDH 4.X and CDH 5.X in a Multi Clustered environment.
• Experience in Implementing High Availability of Name Node and Hadoop Cluster capacity planning to add and remove the nodes.
• Experience in Importing and exporting data from different databases like Mysql, Oracle Into HDFS and Hive using Sqoop.
• Strong Knowledge in Configuring and maintaining YARN Schedulers (Fair, and Capacity).
• Experience in configuring Zookeeper to provide Cluster coordination services
• Experience in providing security for Hadoop Cluster with Kerberos
• Experience in setting up the High - Availability Hadoop Clusters
• Experience in writing UDFs for Hive and Pig.
• Commissioning and Decommissioning Hadoop Cluster nodes Including Balancing HDFS block data.
• Working experience of Amazon Web Services (AWS) like S3
• Worked on all of the AWS stack (Including EC2, S3, RDS, DynamoDB, SQS, IAM, Glacier, Cloud Watch and EMR
• Expertise in support activities including installation, configuration and successful deployment of changes across all environments
• Balanced cluster after adding/removing nodes or major data cleanup
• Configured various property files like core-site.xml, hdfs-site.xml, mapred-site.xml and hadoop-env.xml based upon the job requirement.
• Added security to the cluster using Kerberos.
• Monitoring and support through Ganglia and Nagios
• Experience in Rebalance on HDFS cluster
• Experience with cluster management using Cloudera Manager
• Experience in resolving a Namenode Checkpoint failure.
• Implement both major and minor version upgrades to the existing cluster and also rolling back to the previous version
• Wrote the shell scripts to monitor the health check of Hadoop daemon services and respond accordingly to any warning or failure conditions.
• Configured Namenode high availability and Namenode federation
• Monitored workload, job performance and capacity planning using Cloudera Manager
• Goal oriented, reliable, highly motivated and disciplined
• Highly motivated team player with zeal to learn new technologies.
• Effective interpersonal skills with abilities to meet deadlines & work under pressure.

TECHNICAL SKILLS

Hadoop Ecosystems: HDFS, Map Reduce, YARN, Hive, Pig, Flume, Zookeeper, Scoop, Oozie, Cloudera Manager

Operating Systems: Linux, Windows

Programming Languages: JAVA, C, C++ SQL, PIG LATIN, HTML,UNIX Shell Scripting

Front-End Technology: HTML5, DHTML, JavaScript, CSS.

Monitoring tools: Ganglia, AWS Cloud Watch, Cloudera Manager

Databases: MySQL, Oracle, Sql Server

IDE Tools: Eclipse, Jdeveloper10.1.3, Net Beans, Jbuilder.

Design Methodologies: UML, Rational Rose.

PROFESSIONAL EXPERIENCE

Confidential, Plano, TX

Hadoop Administrator

Environment: MapReduce, HDFS, AWS, YARN, Hive, Flume, Cloudera Manager, Sqoop, MySQL, UNIX Shell Scripting

Responsibilities:

• Installed and configured Hadoop MapReduce, HDFS, YARN, developed multiple MapReduce jobs in java for data cleaning and preprocessing.
• Importing and exporting data into HDFS and Hive using Sqoop.
• Responsible for designing, developing, maintaining and expanding AWS infrastructure from a physical data center environment to AWS.
• Implemented custom monitoring metrics/analysis/alarms through Cloud Watch to monitor major metrics like Network packets, CPU utilization, Load Balancer Latency etc.
• Experience on working with Apache Spark to read and write the data form HDFS, Hive and Amazon S3.
• Experienced in defining job flows
• Experienced in managing and reviewing Hadoop log files
• Experienced in running Hadoop streaming jobs to process terabytes of xml format data
• Load and transform large sets of structured, semi structured and unstructured data
• Responsible to manage data coming from different sources
• Supported Map Reduce Programs those are running on the cluster.
• Configuring and maintaining YARN Schedulers (Fair, and Capacity).
• Jobs management using Fair scheduler.
• Experience in providing security for Hadoop Cluster with Kerberos
• Cluster coordination services through Zoo Keeper.
• Involved in loading data from UNIX file system to HDFS.
• Installed and configured Hive and also written Hive UDFs.
• Involved in creating Hive tables, loading with data and writing hive queries which will run internally in map reduce way
• Automated all the jobs, for pulling data from FTP server to load data into Hive tables, Using Oozie workflows.
• Maintained, audited and built new clusters for testing purposes using cloudera manager
• Experience in setting up Test, QA, and Prod environment.
• Involved in loading data from UNIX file system to HDFS.
• Created root cause analysis (RCA) efforts for the high severity incidents.
• Involved in Analyzing system failures, identifying root causes, and recommended course of actions.

Confidential, Jacksonville, FL

Hadoop Administration

Environment: HDFS, AWS, Kerberos, MySQL, Fair Scheduler, YARN, Pig, Sqoop, HBase, Shell Scripting, Ubuntu, Linux Red Hat

Responsibilities:

• Installed and configured Hadoop MapReduce, HDFS.
• Auto configuring the cluster using cluster automation tools.
• Updating to the latest version of Hadoop.
• Importing and exporting data in and out of HDFS & Hive using Sqoop.
• Experienced in defining job flows.
• Build/Tune/Maintain Hive QL and Pig Scripts for user reporting.
• Responsible for managing and reviewing Hadoop log files.
• Experienced in running Hadoop streaming jobs to process terabytes of xml format data.
• Load and transform large sets of structured, semi structured and unstructured data.
• Supported Map Reduce Programs running on the cluster.
• Enabled resource management using Fair scheduler.
• Experience in providing security for Hadoop Cluster with Kerberos.
• Performed cluster coordination services through Zoo Keeper.
• Involved in loading data from UNIX file system to HDFS.
• Installed and configured Hive to write mapreduce jobs in HIVEQL.
• Involved in creating Hive tables, loading with data and writing hive queries which will run internally in map reduce way

Confidential, Addison, TX

Hadoop Administrator

Environment: Linux, Map Reduce, HDFS, Hive, Pig, Shell Scripting

Responsibilities:

• Installed and configured Hadoop MapReduce, HDFS.
• Auto configuring the cluster using cluster automation tools.
• Updating to the latest version of Hadoop.
• Importing and exporting data in and out of HDFS & Hive using Sqoop.
• Experienced in defining job flows.
• Build/Tune/Maintain Hive QL and Pig Scripts for user reporting.
• Responsible for managing and reviewing Hadoop log files.
• Experienced in running Hadoop streaming jobs to process terabytes of xml format data.
• Load and transform large sets of structured, semi structured and unstructured data.
• Supported Map Reduce Programs running on the cluster.
• Enabled resource management using Fair scheduler.
• Experience in providing security for Hadoop Cluster with Kerberos.
• Performed cluster coordination services through Zoo Keeper.
• Involved in loading data from UNIX file system to HDFS.
• Installed and configured Hive to write mapreduce jobs in HIVEQL.
• Involved in creating Hive tables, loading with data and writing hive queries which will run internally in map reduce way.

Confidential, Chicago, IL

Linux Administrator

Environment: Red Hat Enterprise Linux 4.x, 5.x, Ubuntu, Centos, JEE, Sun Solaris 8, 9, 10, HP Blade, VERITAS Volume Manager, Oracle 11G, Samba, Oracle RAC/ASM, EMC Power path,, Sun Fire v440, SUN BLADE X6250, X6270.

Responsibilities:

• Patching of RHEL5 and Solaris 8, 9, 10 servers for EMC Power path upgrade for VMAX migration.
• Configuration of LVM (Logical Volume Manager) to manage volume group, logical and physical partitions and importing new physical volumes.
• Documented the standard procedure for installation and deployment of VMAX Migration and logical volume manager.
• Front-line support for users with variable HPC background and unique needs
• Installation, configuration, support and security implementation on following services: DHCP, SSH, SCP.
• Configuration and administration of NFS and Samba in Linux and Solaris.
• Installation in the patches, Hardware and Software servers
• Maintained and monitored all of company’s servers operating system and application patch level, disk space and memory usage, user activities on day-to- day basis.
• Installations of HP Open view, monitoring tool, in more than 300 servers.
• Attended calls related to customer queries and complaints, offered solutions to them.
• Creation of VMs, cloning and migrations of the VMs on VMware vSphere 4.0.
• Worked with DBA team for database performance issues, network related issue on Linux / Unix Servers and with vendors for hardware related issues.
• Expanded file system using Solaris Volume Manager (SVM) in the fly in Solaris boxes.
• Managed and upgraded UNIX server services such as Bind DNS.
• Configuration and administration of Web (Apache), DHCP and FTP Servers in Linux and Solaris servers.
• Decommissioning of the old servers and keeping track or decommissioned and new servers using inventory list.
• Handling problems or requirements as per the ticket (Request Tracker) created.
• Participated in on-call rotation to provide 24X7 technical supports.
• Configuration and troubleshooting - LAN and TCP/IP issues.

Confidential

System Administrator

Environment: Sun Solaris 2.6/7, SUN Ultra Enterprise 6000/450, SUN Ultra 10/5/2/1, Windows NT 4.0, RHEL 3.x.

Responsibilities:

• Installation, Configuration, Upgradation and administration of Sun Solaris, RedHat Linux.
• User account management and support.
• Jumpstart & Kick-start OS integration, DDNS, DHCP, SMTP, Samba, NFS, FTP, SSH, LDAP integration.
• Network traffic control, IPsec, Quos, VLAN, Proxy, Radius integration on Cisco Hardware via Red Hat Linux Software.
• Responsible for configuring and managing Squid server in Linux.
• Configuration and Administration of NIS environment.
• Managing file systems and disk management using Solstice Disk suite.
• Involved in Installing and configuring of NFS.
• Worked on Solaris volume manager to create file systems as per user and database requirements.
• Trouble shooting the system and end user issues.
• Responsible for configuring real time backup of web servers.
• Log file was managed for troubleshooting and probable errors.
• Responsible for reviewing all open tickets, resolve and close any existing tickets.
• Document solutions for any issues that have not been discovered previously.