Sr Hadoop Administrator Resume
CaliforniA
PROFESSIONAL PROFILE:
- 9+ years of experience in Design, Development, Implementation and support Of in Production, Development and Test environments using Hadoop and Oracle Tools in client server environments.
- Hands on experience in installing, configuring and using eco - System components like Hadoop Map Reduce, HDFS, Hbase, Pig, Flume, Hive and Sqoop.
- Hands-on experience with "Productionalizing" Hadoop applications (such as administration, configuration management, debugging, and performance tuning).
- Worked on Multi Clustered environment and setting up Cloudera Hadoop eco-System.
- Implemented in setting up standards and processes for Hadoop based application design and implementation.
- Familiar with data architecture including data ingestion pipeline design, Hadoop information architecture, data modeling and data mining, machine learning and advanced data processing.
- Worked on Apache Sqoop for relational data dumps and knowledgeable on Apache Flume.
- Knowledge on HCatalog for Hadoop based storage management.
- Used Apache Oozie for scheduling and managing the Hadoop Jobs.
- Experience on System Analysis, Conversions, Customizations and Reports.
- Extensive experience in Oracle12c, 11g, 10g, 9i and hands on experience writing SQL Queries, Data Modeling and PL/SQL Stored Procedures, Functions, Packages, Database Triggers, Exception Handlers, Referenced Cursors, Database Objects and Collections.
- Experience in understanding business requirements for Analysis, Database Design & Development of applications.
- Expertise in OLTP, System Life Cycle Methodologies (SLDC) in Database Driven Application Development.
- Expertise in Design, Development and Coding of End User Screens and Reports using Oracle Developer/2000, Forms10g and Report 9i.
- Expertise in Design and Development of interface and conversion programs to integrate Oracle Applications module to import data from various using PL/SQL and SQL*Loader.
- Expertise on oracle data masking and oracle data discovery to finding sensitive information.
- Worked on Oracle advanced 12 technics data redaction and data sub setting using OEM.
- Worked on other NOSQL technologies like Mongo dB
- Involved in Table Partitioning, Optimizer Hints and Query Optimization.
- Adept in Oracle tools like SQL * Loader, Toad, SQL Navigator, SQL Developer and Data Loader.
- Used SQL Trace, Explain Plan for Better SQL queries.
- Experience in Logical, Physical Design, Backup, Restore and creating Database Objects (Tables, Views, Indexes, Stored Procedures and Packages, collections).
- Experience in UNIX Shell Scripting and setting up Batch Flows.
- Good programming experience in Object Oriented programming.
- Experience on C/C++, Java, UNIX Shell Scripting and HTML.
- Experience in providing Production Support.
- Experience in Tuning of complex SQL statements.
TECHNICAL SKILLS:
Hadoop eco system: Hadoop, Hive, sqoop, Hdfs, Map-reduce, Yarn, hcatalog, Pig-latin
Hadoop Distributions: Apache hadoop, cloudera 3, cloudera 4.3.0, (hadoop 2.0.5 version), horton works hadoop.
RDBMS versions: Oracle 9i, 10g, 11g,12c
RDBMS Tools: Toad, Tkprof, SQLTRACE
Operating Systems: Linux, UNIX, Windows 2000, NT, 98/95,Mac OS, Ubuntu
NoSQL Databases: Mongo DB
Scripting: UNIX Shell Scripting, Hadoop fs, shell
Languages: C, C++, Java, SQL, PLSQL
PROFESSIONAL EXPERIENCE:
Confidential, California
Sr Hadoop Administrator
Responsibilities:
- Expertise in recommending hardware configuration for Hadoop cluster
- Installing, Upgrading and Managing Hadoop Cluster on Cloudera distribution.
- Troubleshooting many cloud related issues such as Data Node downNetwork failure and data block missing.
- Managing and reviewing Hadoop and HBase log files.
- Experience with Unix or Linux, including shell scripting.
- Sharp analytical abilities and proven design skills.
- Proven results - oriented person with a focus on delivery.
- Built and configured log data loading into HDFS using Flume.
- Performed Importing and exporting data into HDFS and Hive using Sqoop.
- Managed cluster coordination services through Zoo Keeper.
- Mystifying and Demystifying nodes from the Cluster environment.
- Provisioning, installing, configuring, monitoring, and maintaining HDFS, Yarn, HBase, Flume, Sqoop, Oozie, Pig, Hive.
- Patching and upgrading Cloud era and Horton works clusters.
- Recovering from node failures and troubleshooting common Hadoop cluster issues
- Scripting Hadoop package installation and configuration to support fully-automated deployments
- Supporting Hadoop developers and assisting in optimization of map reduce jobs, Pig Latin scripts, Hive Scripts, and HBase ingest Required
Environment: Hadoop, HIVE 10.0, PIG, Puppet, Zookeeper, HBase, Flume, Ganglia, Sqoop, Java, Linux,Centos
Confidential, California
Sr Database Security Administrator
Responsibilities:
- Architecting and design new ways to find sensitive data in oracle and mongo databases.
- Working on oracle enterprise manager (OEM) to generate oracle data masking definitions.
- Database health checkups and creating performance reports.
- Maintenances of development/test and production environment.
- Implementing change requests and solving trouble tickets escalated by Application/Development users.
- Plan growth and changes (capacity planning).
- Implement and maintain database security (create and maintain users and roles, assign privileges).
- Upgrading development and production environment from 10g to 11g with minimal downtime.
- Working on oracle data masking techniques to mask sensitive information while copying production data into non-production environments.
- Working on Mongo Database installation and control sampling technics.
- Developed shell scripts and java scripts for oracle and mongo data discovery and reporting.
Environment: Oracle 12c/11g/10g,MongoDB, PL/SQL, SQL Developer, Shell scripts, Unix, Linux, Explain Plan, TKPROF, ETL, java, Apex, Java Scripts
Confidential, California
Sr Oracle Technical lead
Responsibilities:
- Use SQL*Loader for migrating the flat file data into targeted tables in Oracle Database.
- Data migrated from sql server to Oracle database using external tables and oracle import/export technics.
- Experience in complete Software Development Life Cycle.
- Creating Indexes, Views to improve the System Performance.
- Optimized SQL statements and PL/SQL blocks by analyzing the execute plans and statistics of SQL statements.
- Created and modified some oracle Database objects to make sure all SQL Statements could be executed in efficient ways.
- Written complex SQL statements using joins, sub queries and correlated sub queries.
- Involved in Data Analysis and reducing Data Discrepancy for the source and Target schemas.
- Analyzing and Mapping Processes, Analyzing Data, Producing Functional Design.
- Worked on online Transaction processing (OLTP).
- Involved in writing stored procedures and shell scripts in Oracle and UNIX environment.
- Worked on UNIX shell scripts in oracle.
Environment: Oracle 10g/11g, SQL, PL/SQL, Shell Scripts, SQL Developer, Toad, SQL *Loader, UNIX, Explain plan, ERP, Forms 10g/9i,SQL.
Confidential, California
Sr Oracle Developer
Responsibilities:
- Examined Source Data, Investigated Oracle Objects and Identified method for Data Migration into the target.
- Analysis, design and development of Database procedures, functions and packages using PL/SQL.
- Developed Procedures to load data from Staging Tables to Target Tables.
- Developed SQL Queries, Packages, Functions, Procedures and Triggers in PL/SQL.
- Work on Reports, Interfaces, Conversions, Extensions, workflow (RICEW) in Oracle ERP.
- Used SQL Trace, Analyze and Explain Plan Utilities to develop better SQL Queries.
- Create Views for hiding actual tables and to eliminate the complexity of large queries.
- Successfully manipulated stored procedures, functions and packages using toad.
- Created and modified SQL*PLUS, PL/SQL for data conversions.
- Performed SQL tuning using Explain Plan, Tkprof, Hints and indexes.
- Involved in tuning of SQL queries by using Quest SQL optimizer and manually by Explain plan.
- Partitioned tables and indexes for better performance of application.
- Analyzing and mapping process, analyzing data, producing functional design.
- Involved in handling the changes in compiling scripts according to the database changes.
- Worked on version control software like clear case to keep track of the different releases for the existing projects in the organization.
- Analyzed Functional Dependencies Between Tables.
- Good knowledge on how to use the version controls.
- Coded, Tested, Debugged critical Batch Programs.
- Analysis of requirement and creation of Database.
- Expertise in writing system design document and functional specification documents.
- Expertise in Tuning PL/SQL using collections.
- Hand on experience deals with large database systems.
- Involved in the maintenance and support of existing applications with the users.
Environment: Oracle 10g/11g, SQL, PL/SQL, Shell Scripts, Performance tuning, SQL Developer, Toad, SQL *Loader, UNIX, Explain plan, ERP, Forms 10g/9i,SQL Server.
Confidential, California
Oracle Developer
Responsibilities:
- Created database objects for the system like tables, views, sequences, functions, synonyms, indexes, triggers, packages and stored procedures
- Developed Front-end forms depending upon the logic such as Master-detail form and complex forms for the application.
- Loaded data into various tables from Flat files, Access database as well as from Excel Spreadsheets using SQL*Loader.
- Developed stored procedures, packages and functions for the application that could be called by Forms & Reports.
- Developed complex reports for the systems using running totals, sub totals, grand totals and daily balance.
- Developed new Data Input forms and Reports using Oracle Forms and Reports builder.
- Used Dynamic SQL (DBMS SQL, DBMS DDL) in Procedure, Functions.
- Written scripts to create Temporary tables in various schemas and Audit Transactions.
- Wrote SQL, PLSQL, SQL*Plus programs required to retrieve data from the Data repository using cursors and exception handling.
- Involved in writing Stored Procedures, Shell Scripts, and Perl Scripts in Oracle and UNIX environment.
- Expertise in OLTP systems capture, validate and store large amounts of Transactions
- Modified several wrappers UNIX C shells to run utilities for Oracle instance.
Environment: Oracle9i/8i,UNIX, PL/SQL,SQL*Loader,Toad, SQL*PLUS, SQL Developer, Forms6i,Reports6i.
