SUMMARY

• Over 13 years of experience in diversified fields of the Software Development Life Cycle (SDLC), 3 Years of experience in BigData technologies
• Experience in developing hive transformations as per business requirements.
• Experienced on major Hadoop ecosystem’s such as Sqoop, Hive, Pig, Spark
• Good working experience using Sqoop to import data into HDFS and Azure blob from RDBMS and vice - versa.
• Good knowledge in using job scheduling and monitoring tools - Autosys, CAWA
• Experience in developing solutions to analyze large data sets and testing efficiently
• In depth understanding/knowledge of Hadoop Architecture and various components such as HDFS, Mapreduce concepts
• Extending Hive and Pig core functionality by writing customUDF’s.
• Strong problem solving skills, good communication, interpersonal skills and a good team player
• Have the motivation to take independent responsibility as well as ability to contribute and be a productive team member

TECHNICAL SKILLS

Hadoop/Big Data Technologies: HDFS, MapReduce, Hive, Pig, Sqoop, Flume

Programming Languages: Java JDK1.4/1.5/1.6 (JDK 5/JDK 6)Web Services WSDL, SOAP, Apache Axis, REST

Client Technologies: JQUERY, Java Script, AJAX, CSS, HTML 5, XHTML

Operating Systems: UNIX, Windows, LINUX

Application Servers: IBM Web sphere, Tomcat, Web Logic, Web Sphere

Databases: Oracle, MySQL, ADW, Cosmos DB

PROFESSIONAL EXPERIENCE

Confidential - SFO, CA

Hadoop Developer

Responsibilities:

• Developed Simple to complex Ingestion framework to import the data from multiple sources into BigData onprem clusters and Azure Datalake.
• Optimized the ingestion Jobs to use HDFS efficiently by using various compression mechanisms and file formats.
• Handled importing of data from various data sources using stream analytics and event hub, performed transformations using Hive, ADW SQL server loaded data into cloud based storage.
• Analyzed the data by performing Hive queries to study customer behavior
• Implemented business logic by writing UDFs in python
• Continuous monitoring by using Azure Log analytics framework and designed operation management suite to escalate in case of any failures.
• Worked on Hadoop cluster migration activities from 1.x to 2.x for various customer data models.
• Worked on dataquality framework to provide any data quality issues after successful ingestion process.
• Worked on pyspark scripts to implement the complex business logic.
• Using CAWA workflow management to run multiple BigData and Azure jobs.
• Transformed data will be used for visualization and to generate reports for the BI team using PowerBI reports.

Environment: Hadoop, HDFS, Hive, Pig, Java, SQL, Ambari, Sqoop, Flume, CAWA, Talend, Tableau, PowerBI, Stream analytics, event hub, HDInsight, ADW SQL server, Java (jdk 1.6), Eclipse

Confidential - Irvine, CA

BigData Consultant

Responsibilities:

• Worked on different data formats such as Avro, parquet, Json, Orc, Text and sequence files.
• Involved in Data Pipeline and ETL process and Testing.
• Involved different phases in big data projects like data acquiring, data processing, data monitoring and data serving using dash boards.
• Import/export data from Oracle data base to/from HDFS using Sqoop and JDBC.
• Experience in analysing data using Pig Latin and Hive QL.
• Developing the shell scripts to automate the recurring issues and developed the automated SQL reports based on business team requests.
• Implementing change requests which can fix the application/batch related issues and provide ad-hoc support.
• Analyse, Debug, Production support on investment applications and working on investment life cycle events.

Environment: Hadoop, MapReduce, HDFS, Hive, Pig, Java, SQL, Ambari, Sqoop, Autosys, Tableau, PowerShell, Eclipse

Confidential

Technical Support Specialist.

Responsibilities:

• Provide estimation and schedules for test activities i.e, preparation, execution & reporting
• Involved in requirement discussion and design reviews
• Updates daily test activity status to Project management team
• Reviewing the User Acceptance test activities/results and providing technical guidelines to complete UAT testing.
• Involved in release management with respect to resource coordination, deployment steps, DB changes, system down-time, code deployment, and post production smoke tests.
• Provided training to remote Managed service team for SingleView production operations.
• Preparing the test environment to apply the system releases/core upgrade patches to apply in system test environments
• Preparing and distributing the daily/weekly/monthly reports on production error bucket management.
• Preparing and distributing the monthly/ad-hoc roaming usage reports to revenue management team to settle roaming revenue with International roamers/Roaming partners.
• Responsible for providing technical support for production TAP/roaming queries.
• Re-processing of error events are after issues has resolved in production.
• Monitoring the production rating area after implementing any critical patches/maintenance releases.
• Validating the test & commercial tap files (TAP V3.09 & V3.11) using TAP testing tool kit editors.

Environment: SingleView V8.0, Windows, UNIX, Soap UI, SharePoint, Remedy, C, C++, Java, Perl, EPM, Tuxedo, Oracle.

Confidential

Test Specialist

Responsibilities:

• Provide estimation and schedules for test activities i.e, preparation, execution & reporting
• Involved in requirement discussion and design reviews
• Involved in release management with respect to resource coordination, deployment steps, DB changes, system down-time, code deployment, and post production smoke tests.
• Developed and Executed Test Plans, Test Cases and Test Scripts.
• Validated application services of document management, data flows, and message to message payment applications.
• Performed a wide range of quality tests functional,user interface, regression, connectivity, smoke tests, performance,user acceptance, failover and recovery.

Environment: Java, J2EE, XML, Share Point, Tuxedo, SOAP UI, XML Spy,Oracle Developer, Windows, Unix, EPM, Perl, Excel.

Confidential

Production Support Engineer/Test Consultant Specialist

Responsibilities:

• Developed and Executed Test Plans, Test Cases and Test Scripts.
• Used Domino, RTM & Remedy for test case management, defect tracking and traceability for systems/processes.
• Created automated Test Scripts using in house testing tool, EPM Test Harness.
• Created Performance Testing requirements by scaling down the transaction volume for the environment based on the production expected usage trends
• Created and executed performance tests and analyzed test results.
• Support and conduct Performance Testing for webserver and database upgrades.
• Executed various SQL Queries to perform the backend testing & to verify data integrity.
• Testing webservices using SOAP UI & In house test tools

Environment: SingleView V7.0, Java, J2EE, XML, Share Point, MQ Series, Tuxedo, SOAP UI, XML Spy,Oracle Developer, Windows, Unix, EPM, Perl, Excel.

Confidential

Production Support Engineer/UAT Co-coordinator/Test Consultant Specialist

Responsibilities:

• Regularly attending meetings on monthly basis to review the delivery progress, providing updates and closely coordinating with Technical Delivery Managers & Project Managers.
• Finalizing the testing scope and providing the estimation for the project follows the Staggered Release Plan.
• Involved in SV release management like preparing/reviewing the Installation release notes & customer test status reports.
• Executing regular System Test environment backups whenever the Major/Minor releases are delivered.
• Responsible for performing both Manual and Automated Regression Testing and Issue-Based Testing.
• Automation using Test Harness (INTEC Automation Testing Tool) for Bulk Interface and API Testing.
• Prepared automated Regression suite in EPM & API's in Perl

Environment: SingleView V6.01, Java, J2EE, XML, Share Point, MQ Series, Tuxedo, SOAP UI, XML Spy,Oracle Developer, Windows, Unix, EPM, Perl, Excel.

Confidential

Test Consultant Senior

Responsibilities:

• Created and Executed Test Plans, Test Cases and Test Scripts.
• Created various Test Scripts to cover complete prepaid fucntionality.
• Executed various SQL Queries to perform the backend testing.

Environment: SingleView V6.01, Java, J2EE, XML, Share Point, MQ Series, Tuxedo, SOAP UI, XML Spy,Oracle Developer, Windows, Unix, EPM, Perl, Excel.

Confidential

Test Engineer

Responsibilities:

• Created and Executed Test Plans, Test Cases and Test Scripts.
• Provided release notes to deploy the patches in production.
• Executed various SQL Queries to perform the backend testing.

Environment: C, C++, Informix, Java, Windows, Unix, Shell.