SUMMARY:

• Having 11+years of overall experience in Big Data and DW technologies like Hadoop(Apache, Cloudera, Hortonworks Pivotal HD),Tableau, Splunk,Informatica.
• Hadoop(Apache,Cloudera,Hortonworks, Pivotal HD) Hive, Pig, Hbase, Sqoop, Flume, Oozie, Zookeeper, Kerberos, AWS - EC2,S3, DB2,Business Objects, Informtica
• Around 4+ years of experience in Hadoop Administration & Big Data Technologies
• Hands on experience in installation, configuration, supporting and managing Hadoop Clusters using Apache, Cloudera, and Hortonworks.
• Hadoop Cluster capacity planning, performance tuning, cluster Monitoring, Troubleshooting.
• Design Big Data solutions for traditional enterprise businesses.
• Backup configuration and Recovery from a NameNode failure.
• Decommissioning and commissioning teh Node on running hadoop cluster.
• Installation of various Hadoop Ecosystems tools like Hive, Pig, Sqoop, Hbase,Zookeeper, Impala, Spark.
• Involved in bench marking Hadoop/HBase cluster file systems various batch jobs and workloads
• Experience monitoring and troubleshooting issues with Linux memory, CPU, OS, storage and network
• Good experience in Designing,configuring and managing teh backup and disaster recovery for Hadoopdata.
• Hands on experience in analyzing Log files for Hadoop and eco system services and finding root cause.
• Experience on Commissioning, Decommissioning, Balancing, and Managing Nodes and tuning server for optimal performance of teh cluster.
• As a admin involved in Cluster maintenance, trouble shooting, Monitoring and followed proper backup& Recovery strategies.
• Experience in HDFS data storage and support for running map reduce jobs.
• Experience in importing and exporting teh data using Sqoop from RDBMS to HDFS and viceversa.
• Scheduling all hadoop/hive/sqoop/Hbase jobs using Oozie.
• Experience in installing, administering, and supporting Linux operating systems and hardware in an enterprise environment. (CentOS/RHEL/Ubuntu).
• Experience in writing complex queries in HIVE.
• Experience in Database administration for DB2 in Z/OS environment.
• Experienced in supporting critical production databases and worked on 24*7 production support
• Expertise in Performance tuning & optimization.
• Proficient inconfiguring, implementing, and monitoringdifferent types ofHigh Availability & disaster recovery scenarios like Replication, log shipping,Database mirroring and clustering.
• SQL Server 2008 R2/2008/2005 Database Administration.
• Creation, instance upgrade and version migration. Implement a library of homegrown scripts to automate teh scheduling and notification of periodic maintenance jobs, including REORG, BACKUP, RUNSTATS, LOAD,RECOVERY
• Fixing bind issues dat will occur during teh application testing in various phases.
• Maintainedcreate/alter/drop/grant/revoke/rebind/freeDB2objectusing IBMDB2Admin tool.
• Migration of database objects between databases andDB2subsystems using IBMDB2Admin tool.
• Automated theDB2space reports generation for all teh databases we support.
• Created and managed production emergency fix process on themainframes.
• ExecutingDB2reports/utilities for performance/database organization & database growth analysis.

TECHNICAL SKILLS:

Big Data: Apache Hadoop, Cloudera, Hortonworks

Hadoop Ecosystem: HDFS,YARN,MapReduce,Hive,Pig,HBase,Zookeeper, Kafka,Sqoop,Oozie,Flume,Spark,Kerberos,Ambari

Devops Tools: Chef, Puppet, Ansible, Jenkins, Git, SVN

Big Data Analytics: Hive

BI Tools: Business Objects, SSRS, Tableau

ETL Tools: Informatica8.6/9.1, Talend

Cloud Technologies: AWS-EC2,S3, Google Cloud

No SQL: Mongo DB, Cassandra

Database: DB2, IMS, Oracle11g,10g, SQL Server 2008R2

Scheduling Tools: Control-M,CA7

Languages: C,C++, Cobol, Python, Bash

Application Servers: Web logic, WebSphere.

Operating system: Linux(RedHat,CentOS,Debian,Ubuntu)/Unix, Windows

PROFESSIONAL EXPERIENCE:

Confidential

Hadoop Administrator

Responsibilities:

• Involved in start to end process of hadoop cluster setup where in installation, configuration and monitoring teh Hadoop Cluster.
• Responsible for Cluster maintenance, commissioning and decommissioning Data nodes,Troubleshooting, Manage and review data backups, Manage & review Hadoop log files.
• Monitoring systems and services, architecture design and implementation of hadoop deployment, configuration management, backup, and disaster recovery systems and procedures.
• Importing and exporting data into HDFS using Sqoop.
• Experienced in define teh job flows with Oozie.
• Loading log data directly into HDFS using Flume.
• Experienced in managing and reviewing Hadoop log files.
• Installation and configuration of Sqoop and Flume, Hbase,Hive,Hue,Kafka,Spark, Impala.
• Managed and reviewed Hadoop Log files as a part of administration for troubleshooting purposes. Communicate and escalate issues appropriately.
• As a admin followed standard Back up policies to make sure teh high availability of cluster.
• Involved in Analyzing system failures, identifying root causes, and recommended course of actions. Documented teh systems processes and procedures for future references.
• Worked with systems engineering team to plan and deploy new hadoop environments and expand existing hadoop clusters.
• Monitored multiple hadoop clusters environments using Ganglia and Nagios. Monitored workload, job performance and capacity planning using Cloudera Manager.
• Involved in Installing and configuring Kerberos for teh authentication of users and hadoop daemons.
• Experience in setup, configuration and management of security for hadoop clusters using Kerbero
• Configuring HBASE indexer and Solr engines.
• Reporting Nagios and Ganglia metrics for better cluster utilization.
• Perform ongoing capacity management forecasts including timing and budget considerations.
• Coordinate root cause analysis (RCA) efforts to minimize future system issues.
• Installation, configuration, supporting and managing Hadoop Clusters using Apache, Cloudera (CDH4,CDH5), and Yarn acrhitecture.
• Perform data analysis using Hive and Pig.
• Supporting Sandbox Hadoop cluster users with basic Hadoop options
• User/Disk quota Administration.
• Communicated all issues and participated in weekly strategy meetings.
• Implemented system wide monitoring and alerts.
• Migration from traditional data center to AWS using EC2 and S3.
• Upgrading hadoop cluster hbase/zookeeper from CDH3 to CDH4.

Environment:ApacheHadoop, Cloudera,Hive, Pig, Sqoop, Hbase,Zookeeper, Impala,Linux

Confidential

Hadoop Administrator

Responsibilities:

• Work with Client’s internal support teams to Build/Troubleshoot/Fix Hadoop platforms
• Work with teh application teams to design and develop an TEMPeffective Hadoop/Data Science solution.
• Develop best practices for developing and deploying Hadoop applications and assist teh team to manage compliance to teh standards.
• Manage teh backup and disaster recovery for Hadoop data.
• Optimize and tune teh Hadoop environments to meet performance requirements.
• Install and configure monitoring tools.
• Work with big data developers and developers designing scalable supportable infrastructure.
• Work with Linux server admin team in administering teh server hardware and operating system
• Assist with management of formal system runbooks.
• Create and publish various production metrics including system performance and reliability information to systems owners and management.
• Load log data into HDFS using Flume.
• Monitoring Hadoop cluster using tools like Nagio's, Ganglia and Cloudera Manager.
• Automating teh script to monitor HDFS and HBase through cronjobs.
• Administrative support for parallel computation research on a 24-node Fedora/ Linux cluster.
• Integrate Kickstart, Kerberos with open source technologies.
• Hadoop Cluster capacity planning, performance tuning, cluster Monitoring, Troubleshooting.
• Design Big Data solutions for traditional enterprise businesses.
• Used Network Monitoring Daemons like Ganglia and Service monitoring tools like Nagios.
• Adding/removing new nodes to an existing hadoop cluster.
• Backup configuration and Recovery from a NameNode failure.
• Decommissioning and commissioning teh Node on running hadoop cluster.
• Installation of various Hadoop Ecosystems tools like Hive, Pig, Sqoop, Hbase, Zookeeper, Impala, SparkManaged and reviewed Hadoop log files.
• Tested raw data and executed performance scripts.
• Shared responsibility for administration of Hadoop, Hive and Pig.
• Report development using splunk on top of teh EDW
• Designing and creating data sources for tableau reporting.
• Created Hive queries dat helped market analysts spot emerging trends by comparingfresh data with EDW reference tables and historical metrics.
• File system management and monitoring.
• Performance tuning of Hadoop clusters and Hadoop MapReduce routines.
• Collaborating with application teams to install operating system and Hadoop updates, patches, version upgrades when required.
• Point of Contact for Vendor escalation
• Aligning with teh systems engineering team to propose and deploy new hardware and software environments required for Hadoop and to expand existing environments.
• Monitor Hadoop cluster connectivity and security
• HDFS support and maintenance.
• Diligently teaming with teh infrastructure, network, database, application and business intelligence teams to guarantee high data quality and availability.

Environment: Apache Haddop, DB2, Tableau, Hadoop, HDFS, Hive, Sqoop, Flume, Zookeeper and HBase, Big Data Cloudera CDH Apache Hadoop, Toad, SQL plus, Redhat/Suse Linux

Confidential

DB2 Administrator

Responsibilities:

• Analyzing and Gathering and documenting Requirements as per client by directly interacting with them and Physical database design and implementation.
• Physical table and index design, referential integrity, check constraints based on application requirement. Test environment set-up, and production deployment
• Defining stored procedures and creation of Joins, Views Triggers,etc.Experience in JCL, application programs performance monitoring and tuning
• Check database status, monitor daily, monthly batch cycle, resolve any job abends in production Environment. Authorization and privileges for DB2 objects.
• Created and altered teh database objects tablespace, tables, indexes, views, stored procedures.Created teh physical data modeling diagrams using ER-Studio.
• Granted teh appropriate privileges to teh users on teh database objects.
• Prepared teh housekeeping utility jobs image copy, reorg and runstat for new database objects and released these housekeeping jobs into control-M.
• Re engineered teh database objects into physical data model using ER-Studio.
• Involved in improve teh performance of teh SQL queries.
• Deployed teh database objects from test region to system/production region using BMC change Manager.
• Automation of database maintenance activities in production like finding teh image copy gaps and alerts for space threshold.
• Handled and administered teh large data volumes in production tables.
• Storage management including space allocation, space enhancement based on teh growth, re-distribution of data or re-designs of database objects based on existing growth pattern or anticipated growth.
• Application development support on creation of collection id, package, plan creation, bind/rebind, dclgen.
• Technical support to teh programmers and users.
• Debugging application programs, resolution of database errors, support for application errors and bad application performance.
• Supported performance issues of teh database system.
• Worked closely with teh development teams and data architects.
• Installed and scheduled backups, reorganization, recovery, and check point process.
• Coordinated database changes in production to prevent outage, avoid application impacts, and smoothly executeModifications.
• Provided 24-hour 7-day production system support to ensure each service level agreement is achieved.
• Granting and Revoking Utilities access on Table Spaces.
• Creation, instance upgrade and version migration. Implement a library of homegrown scripts to automate teh scheduling and notification of periodic maintenance jobs, including REORG, BACKUP, RUNSTATS, LOAD,RECOVERY.
• Performance tuning of teh Test and development databases using explain tools.
• Schedule and execute reorg/runstat on teh database tables.
• Identifying and Streamlining teh weak processes within teh system

Confidential

DB2 Database Administrator

Responsibilities:

• Created and managed production emergency fix process on teh mainframes.
• Expertise in Database design, Installation, Upgradations, Configuration, Backup, Recovery, Database Security, and Query optimization
• Experience in Data Modeling (logical modeling and physical modeling) using Erwin
• Executed DB2 reports/utilities for performance/database organization & database growth analysis.
• Generate teh Image copy gaps reports and took teh backup copy of an table spaces and alert teh application DBA teams to fill teh IC gaps
• Involved in re-engineering teh application to identify teh highly CPU consuming jobs and improved teh performance of those applications.
• Facilitated execution of load/unload/DSN1COPY of data for application development teams and to migrate teh data between different regions.
• Altered teh database objects like table spaces, tables, indexes, views, stored procedures.
• Executed teh database utility jobs like Image Copy, Unload, Load, Rebuild IMS database.
• Runstats,Check Data, Rebuild and Recovery Utilities.
• Rotational On-call production DBA support.
• Expertise in Backup and restore of teh databases.
• Expertise in Performance tuning & optimization.
• Responsible for database integrity & database backup and recovery.DB2performance and problem determination,fixing production job abends in a 24 x 7 environment. Authorization and privileges forDB2objects.
• Responsible for teh evaluation and creation of appropriate backup and recovery strategies for new database requirements.
• Bind plans & packages. Creation of Package, reviewing & providing DBA approval for production packagesUsing CHANGEMAN tool.
• Removing teh restriction of pending status against DB2 object. Analyze data & develop and execute appropriate DDL to support projects.
• Responsible for database integrity & database backup and recovery.DB2performance and problem determination, fixing production job abends in a 24 x 7 environment. Authorization and privileges forDB2objects.
• Maintained create/alter/drop/grant/revoke/rebind/free DB2 Objects using IBM DB2 Admin Tool
• Migration of database objects between databases andDB2subsystems using IBMDB2Admin tool.
• Automated theDB2space reports generation for all teh databases we support.
• Provided relations between tables Using Erwin Tool.
• SQL Server 2008 R2/2008/2005 Database Administration.
• Experienced in Performance tuning, Optimization, capacity planning.
• Migrated databases from SQL Server 2000 to SQL Server 2005 and 2008 R2

Confidential

Application Developer and DBA

Responsibilities:

• Created teh new database objects like databases, table spaces, tables, index, views, and stored procedures. Altered teh attributes of existing database objects.
• Application development support on creation of collection id, package, plan creation, bind/rebind, dclgen. Loaded and unloaded teh data using IBM load and unload utility.
• Worked on writing and modifying native stored procedures as per business requirements.
• Performed teh unit testing, system testing on stored procedures.
• Deployed teh database objects from test region to system region/production region.
• Prepared and executed teh DB2 Utility jobs runstat, rebuild index, rebind, and check data utilities.
• Fixed bind issues dat will occur during teh application testing in various phases.
• Converting from plan bind to package bind.
• Converting from simple Table Space to Segmented Table Space.
• Converting from Partitioned by Range to Partition by Growth Table Space.
• Granting and Revoking Utilities access on Table Spaces.
• Experience in writing complex queries using SQL
• Providing 24 hour on call support.
• Analyzing Client requirements and preparation of low level design document.
• Developing new COBOL, DB2, application programs as per teh customer requirements and tested versions are delivered to teh customer.
• Creating batch jobs and procs to extract programs and moving teh code to production.
• Coding programs which writes data to XML file by reading DB2 tables.
• Validating XML files According to schema. Provided technical guidance to teh team.
• Preparation of test plans, test cases, code reviews and delivery documents.