Hadoop Administrator Resume
San Francisco, CA
SUMMARY
- Over 2.5 years of Hands On Experience in Apache Hadoop (Cloudera Version)
- Over 10 years of professional and progressive experience in DB2 UDB, Data warehousing Environment, Data Modeling, SQL, Perl, SAP, Oracle and SQL Server 2005 in a challenging, diverse, and dynamic environment.
- UDB DBA with IBM AIX experience in systems, development, and management in a production environment.
- Hands on Experience in Hadoop Administration using CDH4—Cloudera Distribution.
- Hands on experience in Map Reduce programs using Pig.
- Good Knowledge about Hadoop Hive, Impala.
- Hands on experience in upgrading Postgres SQL 8.4 to 9.2
- Excellent experience with Shell Scripting and other scripting languages.
- Hands on experience on various DB2 areas which include database design, implementation and maintenance of different applications.
- Professional and hands on experience on DB2 UDB Utilities like Export, Import, Load and DB2MOVE and other maintenance utilities like BACKUP, RESTORE, REORGCHK, REORG and RUNSTATS for database tables.
- Has concrete experience on other supportive tools of DB2 which concretes vision on DB2 UDB.
- Excellent Hands on experience on UDB DB2 in LUW (Linux, Unix and Windows)
TECHNICAL SKILLS
Databases\ERP\: IBM DB2 UDB, MySQL, Sybase, \SAP Netweaver 2004s, SAP R/3 4.7, \Oracle 8/9i, MS SQL Server, \SAP R/3 4.6\Informix, MS Access, Balanced \Configuration Unit, SAN\
Miscellaneous Tools\Database Design Tools\: IBM Migration Tool Kit, Replication \ERWin, QDesigner, \Tool Kit, Information Integrator, \Quest Data Factory\BMC Patrol, Embarcadero \DBArtisan, Quest System Catalog \Views, Quest Central for DB2, \Quest Knowledge Xpert for DB2, \DB2 Connect\
Operating Systems\Security Tools\: Linux (Redhat), AIX 5L, Windows\Firewalls, IDS, File Checkers, \(2000,NT XP), Solaris, Unix, MVS\Security Suites, Honeypots\
Hardware\Reporting tools\: Storage Area Network (SAN), \ Cognos, SAP BI 7.0, \IBM RS 6000, DS4500, ESS800\SSRS (Microsoft)\
Programming Languages\Web Servers\: DB2 CLI, Embedded SQL, SQLJ, \IBM WebSphere, Apache Tomcat, \Postgre SQL, Java Scripts, Shell \BEA Weblogic\Scripting, Perl, Microsoft Visual basic, \C, C++, Turbo Pascal, VB.NET, \ASP.NET, PERL\
Web Technology\ ETL tools\: Web Service, SOAP, HTML, DHTML, \Informatica\XML, VBScript, Adobe Photoshop, \Dream Weaver, Flash, FrontPage, \Apache, IIS, PHP, ASP \
Others\: DB2 UDB Utilities like Export, Import, \Load and DB2MOVE and other \maintenance utilities like BACKUP, \RESTORE, REORGCHK, REORG \and RUNSTATS for database tables, \Experience in designing and \implementing Database Security, \Stored Procedures, Triggers, UDF, \Troubleshooting database issues\
PROFESSIONAL EXPERIENCE
Confidential, San Francisco, CA
Hadoop Administrator
Responsibilities:
- Upgraded Hadoop Production,UAT,DEV and DR Clusters memory from 32 GB to 128 GB
- Crucial member in Production Support for One - Hadoop Cluster.
- Upgraded PostgreSQL from Version 8.4 to Version 9.2, throughout the the entire OneHadoop Cluster.
- Upgraded Hadoop Cluster from 5.1 to 5.3 as a part of Upgrade process.
- Did various scripting using Bash and UNIX Shell for automating multiple jobs.
- Hands on experience in administering PostgreSQL for Hadoop Clusters.
- Hands on experience in working with Flume component
- Various Hadoop Troubleshooting experiences in production Cluster.
- Setup High Availability for PostgreSQL Server in all environments.
- Upgraded Cloudera Manager for OneHadoop Environment.
- Setup replication of Hadoop Components (HDFS and Hive)
- Worked with developers for Impala and Hive issues.
- Tuned various Hadoop parameters for bettering Performance of OneHadoop Cluster.
- Managed and reviewed Hadoop Log File for locating errors and warnings.
- Worked on maintaining the cluster (Adding and removing multiple Nodes)
- Worked closely with Infrastructure team to ensure fully availability of Hadoop Services.
- Opened multiple tickets with Cloudera for locating issues and resolving problems, worked closely with Cloudera Employees for the resolution.
Environment: Red Enterprise Linux Server 6.2, Cloudera Manager 5.3, 5.1, CDH 5.3.1 and 5.1.0, Hive 0.10 and 0.13, Postgres SQL 9.2 and 8.4, MapReduce 2.0, HDFS 2.0
Confidential, San Jose, CA
Hadoop Administrator
Responsibilities:
- Installed and Configured Hadoop Cluster
- Involved in loading data from UNIX file system to HDFS.
- Involved in analyzing system failures, identifying root causes for Hadoop Clusters.
- Hands on experience in writing pig Latin scripts and pig commands.
- Worked on importing and exporting data from DB2 Database into HDFS and HIVE using SQOOP and also using Hadoop Commands.
- Strong understanding of Cassandra database.
- Hands-on experience in Working with Hadoop applications (such as administration, configuration management, monitoring, debugging, and performance tuning).
- Worked with jobs using Fair Scheduler.
- Managed, reviewed and Troubleshot Hadoop log files.
- Added and decommissioned Data Nodes in Hadoop Cluster
- Good Understanding of MapR and working knowledge of the same.
- Hands on expericnce in writing Pig Scripts for Map Reduce Programs.
- Hands on Experience in supporting Map Reduce programs that are run on the cluster.
- Good Understanding of Hadoop Eco System Components.
Environment: CHD3, CentOs, MacOs Snow Leopard, Home Brew, Sqoop, Hive, MapR
Confidential, San Jose, CA
Hadoop Administrator
Responsibilities:
- Upgraded db2 from V8.2 to V9.7
- Worked on multiple POC’s before fixing on the DB2 Version and level.
- Audited the DB2 Ecosystems for DB2 Licensing and other cost reduction issues.
- Worked with application developers and business users for DB2 Performance issues.
- Compiled PreUpgrade & Post Upgrade DB2 sessions and compared the performances.
- Worked with DB2 End users and developers to make the transition from db2 8.2 to 9.7 and completed the SDLC.
- Converted db2 Type 1 Indexes to Type 2 Indexes.
- Supported Production Support issues pertaining to the db2 upgrade.
- Wrote CPU utilization scripts to assess the CPU utilization and memory utilization of servers.
- Worked with tools like QMF, Uptime for db2 performance analysis.
- Rewrote DB2 Governor as a custom application.
- Deployed the Custom Developed DB2 Governor across the db2 ecosystems.
- Worked with offshore team for DB2 Custom Governor Deployment and other db2 support issues.
- Opened multiple IBM PMR tickets for db2 upgrade and db2 performance issues and worked with the IBM support team for performance impacts and other issues.
- Understanding and working knowledge with big data technologies like Hadoop, Map reduce, and no SQL Mongo DB.
- Good experience with DB2 LVM’s.
- Created DB2 Disaster Recovery Procedures as and when needed.
Environment: DB2 UDB 8.2, UDB 9.7 Fix Pak 7, AIX 5.3, 6.1, Uptime, QMF, Sql Server 2008.Shell Scripting and Perl.
Confidential, Bloomington, IL
UDB/DB2 DBA
Responsibilities:
- Worked with Application Developers to plan the mirgation of data from AIX to Linux.
- Created UNIX shell scripts for Data Migration.
- Created UNIX shell scripts for Data Validation of Special Characters in the data set.
- Worked with the application developers to reengineer their databases with respect to their application perspective.
- Created new table and table-spaces as per the requirement suggestions of the application owners.
- Modified the Scripts of the Applications to suit the new environment.
- Tuned SQL queries as a part of the Database performance evaluations.
- Created Security Scripts to evaluate User Rights and Privileges in the existing environments.
- Migrated the modified databases and utility scripts from DEV to QA and then to Production Servers.
- Worked with Application Owners and Developes for the functionality testing of the applications.
- Lead an offshore team to support the migration of Databases as and when it was required.
- Created a Migration Document consistent to the Migration Policies followed and got it approved from the application owners with every Migration.
- Worked with the Business Users for functionality testing.
Environment: DB2 UDB 9.1, UDB 9.5, AIX 5.3, RHEL
ConfidentiaL, Littlerock, AR
UDB/DB2 DBA
Responsibilities:
- Working with Ab Initio Developers to successfully Implement Ab Initio Plans.
- Developed UNIX Shell scripts for running Backups across the UDB environment.
- Developed UNIX Shell scripts for running Restores across the UDB environment.
- Created new Table spaces for the databases as and when necessary.
- Created new tables for the Ab Initio developers as a part of their Data ware House Expansions
- Tuned SQL Queries by tuning Database Parameters
- Created new indexes for tables and assigned them to their Individual Tablespaces.
- Worked with Developers and Business users to assign them to new Security Roles evolved as a result of SOX and SOD compliance.
- Worked with the management team to create new roles and access lists based on SOX, SOD compliances and the business needs of Blue Cross Blue Shield.
- Created UDB Security Document consistent to the recommendations for a secure Database Environment as a part of Best Practices.
- Migrated the newly created objects from DEV to QA and then to Production Servers thereby completing a full life cycle of SDLC.
- Worked with offshore teams to co-ordinate Job Scheduling of Dataware Houses.
- Worked with Business Users for restoring and granting access to various Database objects.
Environment: DB2 UDB 9.1, UDB 9.5, AIX 5.3, AQT V 7.1.3, Ab Initio 3.0.2.1
Confidential, Windsor, CT
UDB/DB2 DBA
Responsibilities:
- Wrote Security Codes for the UDB Databases in the ING Environment.
- Developed UNIX Shell scripts for running Security Scans across the UDB environment.
- Generated Scan Reports based on Security Scans on a weekly basis.
- Evaluated the Security loopholes available in the Weekly Security Scans.
- Worked with the UDB DBA’s as well as with the Business Users to gather important inputs for the Security Holes that was exposed on the Security Scans.
- Provided remedy for Security issues that was exposed in the Security Scans.
- Provided recommendations and design decisions to UDB DBA teams for dealing with UDB Security Lapses.
- Created UDB Security Document consistent to the recommendations for a secure Database Environment as a part of Best Practices.
- Migrated the Security Scanners from DEV to QA and then to Production Servers thereby completing a full life cycle of SDLC.
- Worked with UDB DBA’s to create a Database model consistent to SOX, SOD expectations.
- Worked with the System Administrators for OS Security pertaining to DB2 Installations and Log Files.
- Worked with offshore teams to co-ordinate Cron Job Scheduling of Security Scans.
- Worked with ING’s Gloabal Security Teams to provide guidelines of Database Hardening issues.
Environment: DB2 UDB 9.1, UDB 8.x, UDB 9.5, Red Hat Linux 5.4, Sun Solaris 9.4 or SPARC, Bash Shell Scripting, Korn Shell Scripting, Sarbanes Oxley, SoD.
