Hadoop Developer Resume
Phoenix, ArizonA
SUMMARY
- Responsible, energetic, and self - motivated professional with advanced skills and experience in analysis, designing, developing and implementing database applications and solutions as a Hadoop Developer / Oracle Developer having strong analytical skills and abilities to adapt quickly, capable of working in challenging environments.
- Over 8 years of experience in the IT industry, with the expertise in all phases of Software Development Life Cycle.
- 2+ years of experience in developing applications that perform large scale Distributed Data Processing using Big Data ecosystem tools Hadoop, Hive, Pig, Sqoop, Hbase, Oozie, Zoo Keeper, Flume, Yarn.
- Experience in getting data from various sources into HDFS and building reports using Tableau
- Over 6+ years of experience in in designing and development of applications using Oracle 11g/10g/9i/8i, SQL, PL/SQL, Oracle Forms 11g/10g/9i/6i, Oracle Reports 11g/10g/9i/6i, Oracle APEX3.1/4.2, OBIEE 11g.
- Passionate about Big Data Analytics and skilled in exploring data, content and Expert in distributed computing, algorithms, and data analytics.
- Hands on experience in using various Hadoop distributions (Apache, Cloudera, Hortonworks).
- Experience in performing ad-hoc queries on structured data using Hive QL and used Partition and Bucketing techniques and joins with HIVE for faster data access.
- Experience in performing ETL operations using Pig Latin scripts.
- Expertise in writing Hadoop Jobs for analyzing data using Hive and Pig.
- Experience in working with MapReduce programs using Apache Hadoop for working with Big Data
- Experience in importing and exporting data using Sqoop from HDFS to Relational Database Systems (RDBMS) and vice-versa.
- Familiar with data architecture including data ingestion pipeline design, Hadoop information architecture, data modeling and data mining, machine learning and advanced data processing. Experience optimizing ETL work flows.
- Experience in analyzing data using Hive QL, Pig Latin.
- Knowledge of job workflow scheduling and monitoring tools like Oozie and Zookeeper.
- Expert in Oracle tools like SQL * PLUS, SQL Developer.
- Highly proficient with Oracle applications development tools within a client/server environment.
- Excellent SQL skills, expertise in writing Complex SQL queries, PL/SQL Stored Procedures, Functions and Packages for business needs.
- Expertise in creating Oracle objects like Tables, Synonyms, Triggers, Indexes, Views, Materialized Views and Table Partitions.
- Proficient in advance features of Oracle for PL/SQL programming like using cursor variables, Ref. cursors, Varrays, nested tables and Dynamic SQL.
- Expertise in Query Performance Tuning by Analyzing tables, hints, DBMS Profiler, TKPROF, SQL Trace, Explain Plan, Bulk Collect feature, FORALL statements, and Troubleshooting Oracle database issues.
- Expertise with Data Migration, Data Mapping or Table mapping, Data loading and exporting by using Import Export, SQL*Loader.
- Good knowledge of Data Modeling, Data Warehousing concepts, OLAP Concepts, Star Schema, Snowflake Schema, and Entity-Relationship Diagrams.
- Strong expertise using Informatica Power Center Client tools - Designer, Repository manager, Workflow manager/monitor and Server tools - Informatica Server, Repository Server manager.
- Extensive work experience in ETL processes consisting of data sourcing, data transformation, mapping and loading of data from multiple source systems into Data Warehouse using Informatica Power Center.
- Excellent Database modeling/designing skills using Erwin, ER Studio, SQL Developer Data modeler.
- Experience in designing and development of Oracle Forms and Reports.
- Worked in various levels of SDLC (System Development Life Cycle) which involves Analysis, Design, Development, Testing, Implementation and support with extensive exposure in database.
- Good knowledge of Java and C, C++ programming languages.
- Proficient using version control tools like SVN and GIT.
- Flexible, enthusiastic and project oriented team player with excellent written, verbal communication and leadership skills to develop creative solutions for challenging client needs.
- Ability to perform well as a Team Member to blend well in any situation and environment.
TECHNICAL SKILLS
Languages: SQL, PL/SQL, HiveQL, SQL,PL/SQL, Pig, Java, C, C++, Python, Unix Shell Scripting, HTML, XML
ETL Tools: SQL*Loader, Informatica Power Center 9.x
Databases & Tools: Oracle v7.x, 8.x,/9i/10g/11g, SQL*Plus, SQL Developer, SQL Navigator, Toad, Tableau, BI Publisher, Oracle Forms and Reports 9i/10g/11g, APEX, Erwin Data Modeler, EXCEED
Hadoop Distributions: Cloudera, Horton works, MapR
Operating Systems: Windows 7/XP/VISTA/2000/98, Unix, Linux
PROFESSIONAL EXPERIENCE
Confidential, Phoenix, Arizona
Hadoop Developer
Responsibilities:
- Responsible for building scalable distributed data solutions using Hadoop.
- Used to Sqoop to transform data between oracle and HDFS.
- Developed workflows and coordinator jobs in Oozie.
- Created partitioned Hive tables and used compression storage for better performance.
- Written multiple Map Reduce programs for data extraction, transformation and aggregation from multiple file formats including XML, JSON, CSV & other compressed file formats.
- Implemented various requirements using Pig scripts.
- Wrote Map Reduce job using Pig Latin.
- Experienced in managing and reviewing Hadoop log files.
- Worked on building BI reports in Tableau.
- Experience in deploying data from various sources into HDFS and building reports using Tableau.
- Provided ad-hoc queries and data metrics to the Business Users using Hive, Pig.
- Involved in running Hadoop Streaming jobs to process Terabytes of data.
- Gathered the business requirements from the Business Partners and Subject Matter Experts.
- Did various performance optimizations like using distributed cache for small datasets, partition and bucketing in hive, doing map side joins etc.
- Involved in HDFS maintenance and loading of structured and unstructured data.
- Involved in loading data from LINUX file system to HDFS.
- Hands on experience with ETL process.
- Worked on Debugging Hive, Pig and Oozie jobs.
- Extensive Working knowledge of partitioned table, UDFs, performance tuning, compression-related properties in Hive.
- Involved in writing optimized Pig Script along with involved in developing and testing Pig Latin Scripts.
- Working knowledge in writing Pig’s Load and Store functions.
- Managing and scheduling Jobs to remove the duplicate log data files in HDFS using Oozie.
Environment: Hadoop, Map Reduce, Hive, HDFS, Hbase, PIG, Sqoop, Oozie, Tableau, ZooKeeper, Cloudera, Oracle, Unix/Linux, J2EE, Oracle/SQL & DB2.
Confidential, Harrisburg, PA
Sr. Oracle Developer with Informatica
Responsibilities:
- Maintained and Updated existing applications on Oracle Forms 11g and Reports 11g on a regular basis.
- Worked on numerous problem logs which where accumulated over the years and fixed them.
- Developed control files for SQL*Loader and PL/SQL programs for loading and validating the data into the Database.
- Developed complex mappings using multiple sources and targets from different databases, flat files.
- Extracted data from various sources like Flat files and Oracle, Transformed and loaded the data in to target database using Informatica Power Center.
- Used various transformations like unconnected lookup, connected lookup, aggregator, rank, joiner and normalizer.
- Developed Procedures and Triggers for Oracle Forms and Reports
- Converted Oracle reports into BI Publisher.
- Converted Discoverer workbooks to OBIEE.
- Involved in unit testing stored procedures/functions and The Oracle Forms/Reports.
- Spoke to the users directly to gather the required information and specifications of how each and every form should be like.
- Involved in writing complex queries to generate reports as per client requests as part of production support.
- Used SQL*Loader to load data into Oracle database.
- Modified and created UNIX shell scripts.
- Worked on different modules at the same time.
- Worked on Application level Performance tuning.
- Solved the issues on various modules that were already in production.
- Extensively Developed database triggers, packages, functions, and stored procedures using PL/SQL.
- Achieved optimum Performance Tuning using EXPLAIN PLAN and TKPROF functional utilities and also by creating Indexes.
- Created functional and technical documents.
- Used Validation Controls and Custom validation control to validate Web forms.
- Created Indexes for faster retrieval of the member information and enhance the database performance.
Environment: Oracle11g, Toad, Exceed 14, Informatica Power Center 9.5, SQL*LOADER, Oracle Forms 11g, Oracle Reports 11g, OBIEE 11g
Confidential, Fort Worth, TX
Oracle Developer with Informatica
Responsibilities:
- Developed control files for SQL*Loader and PL/SQL programs for loading and validating the data into the Database.
- Designed and developed database tables, triggers, cursors, procedures, functions and packages to meet business requirements.
- Generated Reports as per the business requirements.
- Developed forms and reports for internal reporting using Oracle Forms Builder/Reports Builder.
- Used forward engineering in Data modeler to create a Physical Data Model with DDL that best suits the requirements from the Logical Data Model.
- Used Reverse Engineering in Erwin Data modeler and identified the Data Elements (in the source systems), Dimensions, Facts and Measures required for reports.
- Developed Re usable Transformations, and Reusable Mapplets.
- Expert in creating UML diagrams including Use Case Diagrams, Class Diagrams, Sequence Diagrams and Activity Diagrams.
- Created Materialized Views and partitioned tables.
- Involved in Unit testing Oracle forms and reports.
- Responsible for the detail design documentation, development, unit testing and maintenance of internally developed applications.
- Worked with built in Oracle Packages (DBMS SQL, DBMS OUTPUT, DBMS XML and others).
- Created and maintained different constraints on database and developed triggers to maintain database integrity.
- Used Exception Handling extensively for the ease of debugging and displaying the error messages in the application.
- Experienced in tracking Project Status, Publishing Status Reports, Managing Scope, Time and Cost.
- Performed SQL tuning using Explain Plan, Tkprof, Hints and indexes.
- Extensively used Cursors, User-defined Object types, Records, and Tables in PL/SQL Programming.
- Modified and created UNIX shell scripts.
- Used DBMS SCHEDULER for jobs scheduling.
Environment: Oracle11g, Erwin Data Modeler 8, Informatica Power Center 9.1, PL-SQL, Oracle Forms10g, Oracle Reports10g, TOAD.
Confidential, Houston, TX
Oracle Developer
Responsibilities:
- Creating and managing schema objects such as tables, views, synonyms, packages.
- Maintaining Referential Integrity.
- Modified existing codes and developed PL/SQL packages to perform Certain Specialized functions / enhancement on Oracle Application.
- Developed SQL scripts to Insert/Update and Delete data in Oracle database tables.
- Analyzing the existing reports and modifying the reports specific to new requirements.
- Interacting with the business users and application owners on their requirements on Merchant data.
- Modified several existing reports and also developed new Merchant reports using BI publisher.
- Developed and modified forms using oracle Forms 10g.
- Worked on Power Center Designer client tools like Source Analyzer, Warehouse Designer, Mapping Designer and Mapplet Designer.
- Designed Sources to Targets mapping from primarily Flat files to Oracle using Informatica PowerCenter.
- Involved in Unit testing the database applications.
- Creation of Transformations like Lookup, Joiner, Rank and Source Qualifier Transformations in the Informatica Designer.
- Wrote complex SQL queries using Joins, Sub queries and Group functions.
- Executed PL/SQL blocks using cursors, REF cursors, exception handling, Collections -Nested tables and Index of Table and Dynamic SQL.
- Created shell scripts in UNIX for job scheduling and batch processing.
- Created number of database Triggers according to business rules using PL/SQL.
- Preparation of Stored Procedures and User Defined functions.
- Created Indexes to speed up the queries.
- Improved the performance of the system by tuning queries using using Explain Plan, Tkprof, Hints and indexes
- Migration of data from different data sources using SQL* LOADER.
Environment: Oracle forms 10g, Oracle Reports 10g, Informatica Power Center 8.6, BI Publisher, SQL*LOADER, PL/SQL, SQL*PLUS, Unix Shell Scripting, TOAD.
Confidential
Oracle PL/SQL consultant
Responsibilities:
- Developing Oracle PL/SQL stored procedures, Functions, Packages, SQL scripts.
- Worked with users and application developers to identify business needs and provide solutions.
- Involved in creating new forms and reports using oracle Apex.
- Modified and created UNIX shell scripts.
- Created Database Objects, such as Tables, Indexes, Views, and Constraints.
- Enforced database integrity using primary keys and foreign keys.
- Tuned pre-existing PL/ SQL programs for better performance.
- Created many complex SQL queries and used them in Oracle Reports to generate reports.
- Implemented data validations using Database Triggers.
- Used import export utilities such as UTL FILE for data transfer between tables and flat files
- Performed SQL tuning using Explain Plan.
- Provided support in the implementation of the project.
- Worked with built-in Oracle standard Packages like DBMS SQL, DBMS JOBS and DBMS OUTPUT.
- Created and implement report modules into database from client system using Oracle Reports as per the business requirements.
- Used PL/SQL Dynamic procedures during Package creation.
Environment: Oracle 9i, APEX 3.1, SQL, Oracle Forms 9i, Oracle Reports 9i, PL/SQL, SQL*Plus, SQL*Loader, Windows XP.