SUMMARY

• Over 5+ years of professional IT experience and over 3 Years of Big Data Ecosystem experience in ingestion, storage, querying, processing and analysis of big data.
• In depth understanding/knowledge of Hadoop Architecture and various components such as HDFS, JobTracker, TaskTracker, NameNode, DataNode and MapReduce concepts
• Experience with configuration of Hadoop Ecosystem components: Hive, HBase, Pig, Sqoop, Zookeeper
• Proficient in using Cloudera Manager, an end to end tool to manage Hadoop operations
• Have hands on experience in monitoring MapReduce jobs on Hadoop Ecosystem including Hive and Pig.
• Optimization of resource, performance tunning and volume management of Hadoop cluster.
• SQL skills & working knowledge with Teradata, IBM DB2
• Worked on different OS like UNIX/Linux, Windows NT, Windows XP, and Windows 2K.
• Strong experience with Hadoop and NoSQL.
• Monitor Hadoop cluster job performance and capacity planning
• Manage nodes on Hadoop cluster
• Hadoop cluster connectivity and security
• Participation in support for 7x24 Big Data Environment
• Hands on experience with Linux system administration
• Networking (TCP/IP, Routers, IP addressing, use of network tools).
• Hands on experience with Oracle database
• Experience with RF Network Optimization
• Strong communication and collaboration skills
• Team player with excellent interpersonal, analytical and communications skills

TECHNICAL SKILLS

Big Data: Hadoop, Hbase, Hive, Pig, MapReduce, scoop, Yarn, Spark AWS, Kafka

Databases: Oracle Database (9i, 10g, 11g, 12c), MySQL, Microsoft SQL Server (2008, 2012)

Applications / Tools: VMware Workstation, Oracle VM VirtualBox, Oracle SQL Developer, Microsoft Visual Studio, Microsoft Office (Word, Excel, Power Point, Outlook).

Operating Systems: UNIX, Linux, CentOS, Ubuntu, Windows NT 4.0, Windows 2010

Network: LAN/WAN, GSM, GPRS,EDGE, UMTS/WCMDA, LTE

PROFESSIONAL EXPERIENCE

Confidential, San Ramon, CA

Hadoop Administrator

Responsibilities:

• Installed/Configured/Maintained Apache Hadoop clusters for application development and Hadoop tools like Hive, Pig, HBase, Zookeeper and Sqoop
• Installed and Configured Sqoop to import and export the data into MapR - FS, HBase and Hive from Relational databases
• Administering large MapR Hadoop environments, build and support cluster set up, performance tuning
• Optimized Hadoop clusters components to achieve high performance..
• Applied appropriate support packages/patches to maintain system integrity.
• Monitored workload job performance and capacity planning using Cloudera Manager.
• Performed capacity analysis, monitored and controlled disk space usage on systems.
• Monitored system activities and fine-tuned system parameters and configurations to optimize performance and ensure security of systems.
• Responsible for architecting Hadoop clusters with CDH5.
• Experience in Installation and configuration of Cloudera distribution Hadoop, NameNode, Secondary NameNode, JobTracker, TaskTrackers and DataNodes.
• Strong Experience in Installation and configuration of Hadoop ecosystem like HBase, Flume, Pig, Sqoop.
• Expertise in Hadoop cluster task like Adding and Removing Nodes without any effect to running jobs and data.
• Improved the Hadoop cluster performance by considering the OS kernel, Disk I/O, Networking, memory, reducer buffer, mapper task, JVM task and HDFS by setting appropriate configuration parameters
• Used Apache Solr to search data in HDFS Hadoop cluster.
• Involved in creating Hive tables, loading data, and writing Hive queries
• Manage and review Hadoop Log files.
• Maintain, support, and upgrade Hadoop clusters.
• Performed backup and disaster recovery
• Monitored jobs, queues, and HDFS capacity.
• Balanced, commissioned & decommissioned cluster nodes
• Hands on experience in analyzing Log files for Hadoop and eco system services and finding root cause
• Resolving tickets submitted by users, P1 issues, troubleshoot the error documenting, resolving the errors.

Environment: Hadoop, MapReduce, Red Hat Linux AS/EL 4.0, CDH5, Cloudera Manager, HBase, flume, pig, HDFS, Hive, spark, impala, flume, kafta, Scoop, pig., Zookeeper and Kerberos

Confidential, Chesapeake, VA

Hadoop Administrator

Responsibilities:

• Managed 350+ Nodes CDH 5.2 cluster with 4 petabytes of data using Cloudera Manager and Linux RedHat 6.5
• Managed and reviewed Hadoop log files
• Developed data pipeline using Flume, Sqoop, Pig and Java, Mapreduce to ingest customer behavioral data and financial histories into HDFS for analysis..
• Upgraded the Hadoop cluster from CDH4.7 to CDH5.2
• Monitored cluster for performance, networking and data integrity issues.
• Responsible for troubleshooting issues in the execution of MapReduce jobs by inspecting and reviewing log files
• Test strategize, test plan and test case creation in providing test coverage across various products, systems, and platforms.
• Resolving tickets submitted, P1 issues, troubleshoot the error, documenting, resolved errors.
• Was responsible for importing the data (mostly log files) from various sources into HDFS using Flume. Dump the data from MYSQL to HDFS using SQOOP.
• Perform backup and disaster recovery plans and Predictive Analytics for resource management
• Identify, assess, and recommend appropriate solutions to advise customer on cluster requirements and any limitations by applying industry best-practices and expertise regarding emerging technologies, risk mitigation, and continuity planning to address back-up and recovery.
• Provide enterprise-level information technology recommendations and solutions in support of customer requirements.
• Apply security (Kerberos / Open LDAP) linking with Active Directory and/or LDAP.
• On boarding users to use Hadoop - configuration, access control, disk quota, permissions etc.
• Address all issues, apply upgrades and security patches.
• Expertise in Commissioning/de-commissioning nodes, backup and restore.
• Apply "rolling" cluster node upgrades in a Production-level environment.
• Work with virtualization team to provision / manage HDP cluster components
• Worked extensively with Sqoop for importing metadata from Oracle
• Worked with business teams and created Hive queries for ad hoc access.
• Worked with analyst and test team for writing Hive Queries

Environment: Hadoop, MapReduce, HDFS, Hive, spark, impala, Hbase flume, kafta, Scoop, Pig,), Cloudera Manager 5, Oozie, Oracle 11g/10g, Zookeeper, Kerberos and RedHat 6.5

Confidential, McLean, VA

Linux Administrator

Responsibilities:

• System Administration working on Red Hat Enterprise Linux, Solaris, Centos, Ubuntu, SUSE Linux, and Unix Administration on Sun, HP Servers, and Windows environments.
• Highly experienced with UNIX Administration, EMC Storage Administration, Enterprise Hardware
• Troubleshooting and Capacity Planning. Involved in complete Administration tasks on UNIX (SUN Solaris, Red Hat Linux) and documentation for the projects executed..
• Experience in Installing, upgrading and configuring SUN Solaris 7, 8, 9 and 10 on Sun Servers using Flash Archives and Interactive Installation.
• Interacting with business users for gathering the requirements for on boarding the applications to Citrix Servers.
• Experience in implementing and administering VM's using VMware ESX 5.x, 4.x and VCenter and along with Oracle virtual box, Windows Active Directory and LDAP.
• Responsible for configuring and managing DNS, DHCP, SMTP, Samba, NFS, NTP, FTP, SSH, LDAP, NIS, Send mail and Squid servers in Linux.
• Comfortable with installing, upgrading and configuring Red Hat Servers 6.x/5.x using Kick start and Solaris Server using Jumpstart and customizing the Ignite, Kick start and Jumpstart scripts to automate the installation of multiple servers. Deployed Docker Engines in Virtualized Platforms for containerization of multiple apps.
• Experience in implementing and administering VM's using VMware ESX 5.x, 4.x and VCenter and along with Oracle virtual box, Windows Active Directory and LDAP.
• Expertise in file system management in creating and managing Logical Volume Manager (LVM), ZFS (designed by Sun microsystems) and Monitor Disk space in Red hat Linux.
• Troubleshoot of server virtualization products like KVM, XEN, VMware, and Virtual Box.
• Proficient in User management, Process management, Log management, Disk management, Text processing tools, Memory management and SWAP Partition/Files management..
• Expert in configuration, Implementation, Administration and Troubleshooting skills with network protocols of DHCP, DNS, TCP/IP, SMTP,NIS, SNMP SERVERS and Squid proxy server.
• Hands on experience on Kick Start-PXE, Secure shell installations for complete hands-free installation of workstations and Virtual hosting in Implementation and Troubleshooting.
• Experienced in configuration of file sharing servers like NFS, FTP, SAMBA, SFTP and mail servers such as Postfix server, Send mail server, Qmail server.
• Installation, Configuration and Maintenance of application servers in Apache server 2.x/1.x, Tomcat … and, IBM Web sphere 7/6/5.1 on Solaris and Linux boxes.
• Installing, configuring and maintaining JBOSS, WebSphere Application Servers, Web Logic server, Oracle, Apache web server, Tomcat.
• Experience working with version control tools like SVN and GIT and experience in bug tracking tools like JIRA, HP Quality Center and IBM clear Quest.
• Experienced in working with management tools of Chef, Puppet and scheduled many automated tasks through AT, Cron & Anacron.
• Scripting done in administrative and management tasks using shell, Bash, Python for automated administrative jobs. Experienced with the tools Tar, Cpio and Dump in Backup & recovery for the file system and knowledge in Open stack services for planning and setup of Disaster Recovery Servers.
• Installation of Database servers and user's management such as Oracle, MYSQL, SQL Server
• Worked on Linux based systems administration skills in a Cloud Computing and Virtualized environment for AWS and experience in implementing new and migration of AWS systems.
• Experience working with AWS provided Solutions like EC2 and ELB which includes Creating EC2 instances, adding EBS volumes for EC2 and familiar with VPC, Route 53, RDS, S3, IAM, SNS, SQS, SWF, SES, Auto scaling, Storage gateway, Elastic Beanstalk, Cloud formation and Cloud Watch.
• Managed the operating-system-level virtualization to create, deploy, and run applications by using containers such as Docker.
• Performed security monitoring tests to identify Intrusions and provided Tier 2 and Tier 3 technical support. Deployed performance enhancing/monitoring tools.
• Knowledge and good understanding on Virtualization and Cloud Computing (Private, Public and Hybrid) such as VMware/EMC (CloudFoundry), AWS (EC2 and S3).

Environment: RHEL 5/6, VM Ware 5.0, Cron, Oracle, Shell Scripting, Red hat cluster servers, VERITAS volume manager, NFS, DNS, Email system, Apache, IBM WebSphere 7.0, LVM, and oracle9,10,11g.