SUMMARY

• 8+ years of IT experience which includes 4 years of experience with Hadoop, HDFS, MapReduce and Hadoop Ecosystem (MapReduce, PIG, HIVE, Sqoop, Oozie, Flume)
• Good knowledge of Hadoop Architecture and various components such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node and MapReduce concepts.
• Hands on experience in writing MapReduce joins like Map - side joins using Distributed Cache API.
• Experience in analyzing data using Hive QL, Pig Latin and custom MapReduce programs in Java.
• Strong experience working with different Hadoopd istributions like Cloudera, Horton works, Map R and Apache distributions.
• Hands-on experience in scheduling jobs on Oozie.
• Experience in developing customized UDF's in java to extend Hive and Pig Latin functionality.
• Collecting and aggregating large amount of Log Data using Apache Flume and storing data in HDFS for further analysis.
• Experience in importing and exporting data using Sqoop from Relational Database Systems to HDFS and vice-versa
• Highly Knowledgeable in streaming data from different data sources like Log files, JMS, applications sources into HDFS.
• Experience in Installation, Configuration, Testing, Backup, Recovery, Customizing and Maintenance of clusters using ApacheHadoop, ClouderaHadoop.
• Java Programmer with 4 years of Extensive programming experience in developing web-based applications and Client-Server technologies.
• Participated in the data migration activities in between Development and production environments.
• Expertise with using Oracle, MySQL, DB2 databases and writing highly complex SQL queries.
• Experienced in using Integrated Development environments like Eclipse, NetBeans, IntelliJ.
• Worked in complete Software Development Life Cycle (analysis, design, development, testing, implementation and support) using Agile Methodologies.
• Extensive knowledge skills and developed UI web-based applications using jQuery UI, jQuery CSS HTML, XHTML and Java Script.
• Excellent technical, communication, analytical and problem-solving skills and ability to get on well with people including cross-cultural backgrounds and trouble-shooting capabilities.
• Designed and developedHadoopsystem to analyze the SIEM (Security Information and Event Management) data using MapReduce, HBase, Hive, Sqoop and Flume.
• Involved in designing and implementation of HBase.
• Coordinated with business customers to gather business requirements and interact with other technical peers to derive technical requirements.
• Extensively involved in Design phase and delivered Design documents.
• Developed custom writable MapReduce JAVA programs to load web server logs into HBase using flume.
• Log data Stored in HBase DB is processed and analyzed and then imported into Hive warehouse, which enabled end business analysts to write HiveQL queries.
• Built re-usable Hive UDF libraries which enabled various business analysts to use these UDF's in Hive querying.
• Developed various workflows using custom MapReduce, Pig, Hive and scheduled them using Oozie.
• Extensive knowledge in troubleshooting code related issues.
• Developed suit of Unit Test Cases for Mapper, Reducer and Driver classes using MRUnit.
• Used Apache Kafka and Apache Storm to gather log data and fed into HDFS
• Configured flume agent with flume syslog source to receive the data from syslog servers.
• Auto Populate HBase tables with data coming from Kafka sink.
• Designed and coded application components in an agile environment utilizing test driven development approach.
• POC (Proof of Concept):
• Setup an agent app interaction server to capture the keystrokes, screen recordings using the NICE application suite
• Setup flume agent on the server to capture the server logs.

TECHNICAL SKILLS

Operating System: Windows 7/10, Linux, UNIX (Sun Solaris, HP-UX).

DBMS/Databases: Oracle … MS-SQLServer.

Web Technologies: HTML, DHTML, Java Script, XML.

Languages: C, C++,SQL,PL/SQL.

Scripting Languages: UNIX Shell Scripting

Database Tools: SQL*PLUS, TOAD,SQL*Tool,PL/SQLDeveloper

Office Packages: MS-Office (Access, Word, Excel, PowerPoint)

Version Control: CVS, SVN, GITHUB

Agile Tools/Methodologies: Jira, RTC, SCRUM

Database: Configuration Assistant,SQLTrace, ERWIN, MS EXCEL, MS VISIO.

PROFESSIONAL EXPERIENCE

PL/Sql Developer

Confidential, Charlotte, NC

Responsibilities:

• Participated in the Database Analysis, design and Interacted with the business users and participated in requirement collection.
• Analyzing the requirements - designing and developing the maps for extraction, transformation and loading of data into warehouse.
• Development of complex mappings related to dimensional and fact tables.
• Developed and modifiedPL/SQLcode to make new enhancements or resolve problems, as per customer requirements.
• Developed several stored procedures and functions using advanced Oracle concepts such as Bulk Binds, Bulk Collects Ref Cursors to improve performance.
• Developed control files forSQL*Loader andPL/SQLscripts for Data Extraction/Transformation/Loading (ETL) and loading data into interface Tables from different systems and validating the data.
• Extensively worked on the ETL mappings, analysis and documentation of OLAP reports requirements
• Involved in Performance tuning of the programs and ETL processes
• Used DataStage Designer for developing various ETL jobs to extract, cleansing, transforming, integrating and loading data
• Strong understanding of Data Modeling in data warehouse environment such as Star schema and Snow flake schema.
• Created and used Table Partitions to further improve the performance while using tables containing large number of columns and rows.
• Created database objects like Tables, views, procedures, functions, packages, materialized views, Index and sequences usingSQLandPL/SQL.
• Partitioned Tables using Range Partitioning, List Partitioning and created local indexes to increase the performance and to make the database objects more manageable.
• Used Bulk collect and For all in stored procedures to improve the performance and make the application to run faster.
• Involved in system study and preparing the System Requirement Specification.
• Implementation and post-implementation support of the system.
• Used Data modeling tools for mapping the parent child tables before creation of new objects for a specific business requirement
• Supported the application when in production and exercised strong debugging skills in resolving time sensitive issues
• Documented System requirements, Technical specifications, Use cases, activity diagrams, workflow diagrams and release notes.
• Regularly interacted with DBA and QA teams to in corporate all standards.
• DevelopedSQL*loader control files to extract data from different text files received from upstream systems into tables.
• PerformedSQLandPL/SQLtuning to improve the performance with the help ofSQLTrace, Explain Plan, Indexing and Hints.
• Developed administrative tools using UNIX Shell scripting.
• Created multiple Unix shell scripts to import data into Oracle using theSQL*Loader.
• Used Collections like variable arrays, nested tables extensively.
• Documented all the work assigned.

Environment: SQLNavigator, Erwin,SQL*Plus, UNIX, 10.5, WindowsXP,SQL*Loader.

Sr. Oracle PL/SQL Developer

Confidential, NY

Responsibilities:

• Gathered the requirements from Business Users and passed on the requirements to the team.
• Created customPL/SQLprocedures to read data from flat files to dump to Oracle database usingSQL* Loader.
• Run Adhoc queries to get client detailed information about their stay and family
• Design, Develop and Test the jobs in Informatica Power Center for the data flow from Flat Files, CARES legacy system to data marts.
• Maintained stored definitions, transformation rules and targets definitions using Informatica repository Manager.
• Used various transformations like Filter, Expression, Sequence Generator, Update Strategy, Joiner, Stored Procedure, and Union to develop robust mappings in the Informatica Designer.
• DevelopedPL/SQLProcedures and database triggers for the validation of input data and to implement business rules.
• Created database objects like packages, procedures, and functions according to the client requirement.
• Extensively involved in using hints to direct the optimizer to choose an optimum query execution plan.
• Used bulk processing for better performance and easy retrieval of data, being a part of performance tuning of the procedures and packages.
• Extracting the data from simple flat text files into operational database.
• Creation of database objects like tables, views, materialized views, procedures, packages using oracle tools likeSQLLoader.
• Used Golden Gate data selection and filtering for replication and making use of SQLEXEC to interact with database.
• Created database links to retrieve data from multiple servers.
• Extensively used for all and bulk collect to fetch large volumes of data from table.
• Create and run batch files on regular basis.
• Created records, tables, collections for improving performance by reducing context switching.
• Created number of database triggers according to business rules usingPL/SQL.
• Wrote complexSQLqueries including inline queries and sub queries for faster data retrieval from multiple tables.
• Extensively used the advanced features ofPL/SQLlike Records, Tables, Object types and DynamicSQL.
• Handled errors using Exception Handling extensively for the ease of debugging and displaying the error messages in the application.
• Used version control tool VSS, which helps multiple users to access, and make changes to the collection of source code files.

Environment: Oracle 11g,SQL*Plus,SQL*Loader,PL/SQLDeveloper, Informatica Power Center, Golden Gate, Unix, VSS.

Oracle PL/SQL Developer

Confidential, Reston, VA

Responsibilities:

• Involved in Logical & Physical Database Layout Design.
• Performed SQL and PL/SQL tuning and Application tuning using various tools like EXPLAIN PLAN,SQL*TRACE, TKPROF and AUTOTRACE.
• Translated business/functional requirements to create and alter database objects like Tables, Indexes, Constraints, Indexes, Types, Triggers, Grants, Synonyms and Stored Procedures.
• Used Cursors, Ref-cursors, Bulking techniques, Oracle Supplied Packages, Collections, & DynamicSQL.
• Designed and developed the views, materialized views, functions, procedures, packages and triggers
• Was a part of conversion team and have taken part actively in propose an idea to convert data from DB2 database to Oracle.
• Experience with different batch processes (e.g. Mail) that run on a schedule and real-time processes (e.g. web services) to keep the data updated and also to interact with different third-party systems.
• Database security by authenticating users, using logon triggers. Created materialized view on remote database and automated scheduler for refreshing of materialized view.
• Was in charge of performance tuning several programs and was successful in getting the run time down for more than 90 percent.
• Assisted my team lead in proposing a new way of writing the procedures and have written a set of coding standards and provided it to the team which was followed by everyone.
• Created and modified several UNIX Shell Scripts according to the changing needs of the project and client requirements.
• Involved in table redesigning with implementation of Partitions Table and Partition Indexes to make database Faster and easier to maintain.

Environment: Oracle 10g/11g,PL/SQL,SQLLoader,SQL*Plus, Windows NT 4.0/2000/XP and UNIX, TOAD, DB2, Shell Scripts, IBM Rational Clear Case version control.

Oracle PL/SQL Developer

Confidential, Bloomington, IL

Responsibilities:

• Interacting with the clients to understand the requirements and Designing module wise Oracle 11g database structure and its implementation on the client server.
• Coordinated with the front end design team to provide them with the necessary stored procedures and packages and the necessary insight into the data.
• Wrote complexSQLqueries using joins, sub queries and inline views to retrieve data from the database.
• Worked onSQL*Loader to load data from flat files obtained from various facilities every day.
• Involved in developing and scheduling using cron jobs to load the data into the database and export/import mechanism for data migration for bulk upload.
• Involved in writing the database triggers to furnish the audit details.
• Used various LOVS (List of Values) and record groups at various points in runtime.
• Troubleshooted performance issues and bugs within packages using dbms output, explain plan.
• Extensively involved in using hints to direct the optimizer to choose an optimum query execution plan.
• Created indexes on the tables for faster retrieval of the data to enhance database performance.
• Used Bulk Collections for better performance and easy retrieval of data, by reducing context switching betweenSQLandPL/SQLengines.
• Developed Unix Shell Scripts to automate backend jobs, load data into the database.
• CreatedPL/SQLscripts to extract the data from the operational database into simple flat text files using UTL FILE package.
• Partitioned the fact tables and materialized views to enhance the performance.
• Created records, tables, collections (nested tables and arrays) for improving Query performance by reducing context switching.
• Used Pragma Autonomous Transaction to avoid mutating problem in database trigger.
• Provided Tier3 Application support with 24/7 production support.

Environment: Oracle 11g,SQL* Plus, TOAD,SQL*Loader,SQLDeveloper, Shell Scripts, UNIX Shell Scripting, Windows XP.

Pl/SQL Developer

Confidential, Charlotte, NC

Responsibilities:

• Gathered the Requirement from the business user and prepared the program specification and design document for the development of the CEMR Application.
• Involved in analyzing the root cause for the missing data and providing the missing data from the Extracts for Testing.
• Extensively worked in providing updated records of the patients on weekly basis by comparing the with the Previously-Exported patient's records.
• Involved in keeping track of Previously-Exported patients and archived them for future reference purpose.
• Created thePL/SQLpackages, procedures, functions applying the business logic to update the patients' database.
• Created custom triggers to automatically populate different tables and also to restrict the data being inserted to the timesheet tables.
• Created the custom tables to import the Patient's data and insert into the database tables.
• Developed theSQL*Loader scripts to load data into the staging tables from the flat files.
• Extensively used DTS package in Migration of the data from the previous timesheet database inSQLServer database to Oracle 10g.
• Extensively involved in tuning the queries and applying hints for faster and better performance of theSQLqueries.
• Created the test scripts and complex queries to test the application and to quality assurance of the data.
• Involved in preparing test plans, unit testing, System integration testing, implementation and maintenance.

Environment: Oracle9i/10g,SQLServer,PL/SQL,SQL*Plus,SQL*Loader, TOAD 10, FTP, DTS package, MS-Office, Perl Scripts, MS Office, MS Visio.

Oracle PL/SQL Developer

Confidential

Responsibilities:

• Writing complex stored procedures/triggers and functions using PL/SQL and optimized for maximum performance.
• Involved in the database design and re-structuring of the database.
• Used SQL and PL/SQL stored procedures, functions to implement business logics in Oracle.
• Developed complex procedures to handle errors and exceptions at database level usingPL/SQL.
• Optimized the performance usingPL/SQLby restructuring the extraction and summarization routines.
• Developed designed and modified operational and financial reports and programs.
• Worked with appropriate decision makers gathering information and specifications for analyzing and reporting on operations.
• Worked with installing, designing and managing MSSQLServer 2008.
• Creating and managing schema objects such as tables, views, indexes, stored procedures, and triggers & maintaining Referential Integrity.
• Worked on Stored Procedures and Database Triggers. Worked on large number of business analytical function
• Automating data loading, extraction, report generation using UNIX shell scripting.
• Coordinated with the Quality Assurance/Testing team members to perform system, integration and unit testing.
• Worked with Business Analyst and users to clarify requirements and translate the requirement into technical specifications.
• Created dimensions/fact tables in data models using Erwin. Forward engineer objects and Complete compare data models to keep objects in synch with the database.
• Coordinated with the DBA for migrations of new/updated objects.
• Use Repository Manager to import metadata for sources and targets and the mapping designer to map source to the target.
• Documented the whole process flow,PL/SQLPackages, log files, locations and description, log tables and possible error messages, process codes and description.

Environment: Oracle 9i,SQLNavigator,SQLServer 2008/2005, Windows 2000/XP.