SUMMARY:

• 10+ years of IT experience in Data Warehousing with emphasis on Project Planning & Management, Business Requirement Analysis, Application Design, Development, Testing, implementation and maintenance of Data Warehouse using wide range of Technologies such as Big Data Hadoop, Teradata, Informatica, Unix, Java and Erwin.
• Involvement in all phases of SDLC from project proposal, planning, analysis, development, testing, deployment and support.
• Good Experience in developing and implementing big data solutions and data mining applications on Hadoop using Hive, PIG, Hbase, Oozie workflows and designing and implementing Java Map Reduce programs.
• Have hands on experience in writing MapReduce jobs using Java - Ant/Maven.
• Developed ad-hoc queries and data metrics on large data sets stored in Hadoop file system using PIG/Hive.
• Good experience in writing Hive/Pig Latin scripts and Hive/Pig commands.
• Configured Oozie and implemented workflows. Developed shell scripts to call Oozie workflows.
• Experience in using Teradata Administrator, Teradata Manager, Teradata PMON, Teradata SQL Assistant and writing Teradata load/export scripts like BTEQ, Fast Load, Multi Load, TPUMP, TPT and Fast Export in UNIX/Windows environments.
• Have good exposure in Banking domain, Financial, Fermat Application, Teradata FSLDM and Telecom.
• Experience in Analysis and Design, Performance Tuning, Query Optimization, Stored procedures, functions, views and indexes to implement the business logic in Oracle, Teradata, Vertica, Netezza and Sql Server databases.
• Strong in writing Teradata load/export utilities scripts: fast export/multiload/fastload/bteq scripts.
• Experience in Application Design using Object Oriented Analysis and Design (OOAD) and Object Oriented Methodologies like Agile/SCRUM.
• Worked with various data sources such as Flat files and RDBMS-Oracle, Vertica, SQL server 2005 and Teradata. Extensive work in ETL process consisting of data transformation, data sourcing, mapping, conversion and loading using Informatica.
• Developed ETL Scripts for Data acquisition and Transformation. Developed the various mappings using Informatica transformations like Source Qualifier, Expression, Filter, Router, Lookup, Update Strategy and Normalizer transformations etc using Informatica.
• Good experience and understanding of Enterprise Data warehouse(EDW) architecture and possess End to End knowledge of EDW functioning. Have Good experience in development of code from upstream to Downstream-data marts and data mart functioning.
• Strong experience in Data warehousing concepts. Relational Data Modeling and Dimensional Data Modeling, Star Schema, Snowflake Scheme, Physical and Logical Data Modeling using Erwin 7/7.3/9.5.
• Exceptional ability to quickly master new concepts and capable of working in groups as well as independently. Excellent interpersonal skills and the ability to work as a part of a team.
• Experience with data analysis and able to implement complex and sophisticated SQL Logic. Develops and reviews project plans, identifies issues, resolves issues, and communicates status of assigned projects to users and manager.
• Good experience in writing shell scripting in UNIX.

TECHNICAL SKILLS:

Big Data & Hadoop: Big Data Hadoop, HBase, Map Reduce, Sqoop, Hive and PIG

Databases: Teradata V2R5/V2R6/12,13, Vertica, Netezza, Oracle, Microsoft SQL Server, MS Access

Programming Languages: C, C++, C#, Java-Ant/Maven,SVN, UNIX Shell Scripting, SQL and PL/SQL

Database Utilities: BTEQ, Fast Load, Multi Load, Fast Export, T Pump and TPT

ETL Tools: Informatica 8.6/9.1, Teradata Tools & Utilities

Data Modeling: Erwin

Other Tools: Tivoli Work Scheduler, ODI, Control-M, Dollar-U

Domain Knowledge: Banking, Retail, Finance and Telecom

PROFESSIONAL EXPERIENCE:

Confidential, GA

Sr Bigdata Hadoop Developer

Responsibilities:

• Created flow charts, sequence diagrams, schemas, data model of underlying system, pseudoc code and class diagrams using Microsoft Visio.
• Worked on data migration from existing data sources to Hadoop file system.
• Developed Ingestion framework by writing Unix scripts for pushing daily source files into HDFS.
• Interact with the Business Analysts to get the requirements and formulate them into system use cases.
• Understand customer business use cases and be able to translate them to analytical data applications and models to implement a solution.
• Developed map-reduce programs for different patterns of data from Hadoop cluster.
• Developed java map reduce programs using core concepts like OOPS, Multithreading, Collections and IO and compiled and built the application using MAVEN.
• Implemented dynamic partition through hive queries and used bucketing in hive.
• Implemented new features like RSA key, kinit for kerberos authentication and crontab for scheduling the scripts.
• Configured Oozie and implemented workflows.
• Developed shell scripts to call Oozie workflows.
• Involved in Sqooping data from Teradata/Oracle to Hdfs using Sqoop.
• Implemented unit test cases for all java MR jobs using MRUnit.
• Used SVN as version control system.
• Troubleshoot issues during integration, testing & production readiness phases.
• Wrote technical design document, deployment document, supporting documents and release notes.
• Involved in the entire software development cycle spanning requirements gathering, analysis, design, development, building, testing, and deployment.

Confidential, CA

Bigdata Hadoop Developer

Responsibilities:

• Gathering requirements, builds logical models and provides quality documentation of detailed user requirements for the design and development of this project.
• Configured Hadoop in Linux and deploying application.
• Dumped the data using Sqoop into HDFS for analyzing.
• Developed the scripts as per the requirement including Map Reduce Programs, Pig/Hive Scripts and Sqoop etc.
• Extracts data from Oracle to HDFS using Sqoop. Built Rules for different Product lines in Hadoop/Hive for processing covered and uncovered product lines.
• Developed ad-hoc queries and data metrics on large data sets stored in Hadoop file system using PIG.
• Compiled and built the application using ANT scripts and deployed the application. Used SVN as version control system.
• Worked on structured, semi-structured and unstructured data processing using Hadoop.
• Developed Ingestion framework by writing unix automation shell scripts for pushing daily source files into HDFS.
• Developed Load and Extract ETLs and implemented History Load, Incremental Load scripts in Teradata and writing shell scripts for extract and load ETLs.
• Developed ETL logic as per Confidential standards from Source-Flat File, Flat-File-Stage, Stage-Work, Work-Work Interim tables and Work Interim tables- Target Tables using Bigdata.
• Fixing the issues from Source System to downstream data mart during the development process till the code goes live into production and providing post production support.

Confidential

Sr. Teradata & ETL Developer

Responsibilities:

• Communicating with business users and analysts on business requirements. Gathering and documenting the technical and business Meta data.
• Prepared ETL Scripts for Data acquisition and Transformation. Developed the various mappings using transformation like source qualifier, joiner, filter, router, Expression and lookup transformations etc in Informatica.
• Creating conceptual, logical and physical database models for different metadata tables, views or related database structures using ERWIN.
• Developing database architectural designs, modeling, and implementation of business requirements.
• Coding using BTEQ SQL of TERADATA, Implementing ETL logic using Informatica, Transferring files using SSH-Client.
• Populate or refresh Teradata tables using Fast load, Multi load & fast export utilities/scripts for user Acceptance testing and loading history data into Teradata.
• Experience in creating and writing Unix Shell Scripts (Korn Shell Scripting - KSH).
• Preparing test cases and performing Unit Testing and integration testing.
• Performance tuning the long running queries. Work on complex queries to map the data as per the requirements.
• Reduced Teradata space used by optimizing tables - adding compression where appropriate and ensuring optimum column definitions.
• Production Implementation and Post Production Support.

Confidential

Fermat Developer

Responsibilities:

• Worked on different modules in Fermat application...ALM, GL, VAR and RRT etc.
• Good technical and functional knowledge on different modules in Fermat application...ALM, GL, VAR and RRT etc.
• Configuring the Fermat modules such as Data windows using Datagrid/ListPage model, Calculation process, Reporting using Cube/Graph report.
• Configuring the data based on Parameters, Types, Families, Codifiers, Sectors etc customizing the data display.
• Managing the data either from Fermat GUI or using SQL Queries through Query Builder.
• Generating reports using RRT by performing calculations for Credit Risk, Market Risk, and Operational Risk etc.
• Doing the analysis part if any issues found in Fermat and fixing it.
• Have full fledge of knowledge of OCBC-EDW architecture from source system-extraction of data from source system using Informatica to loading of data into downstream datamart using ODI and Teradata.
• Familiar with FSLDM-process of Confidential and following the coding standards.
• Interacting with client and fixing the Adhoc issues on priority on a daily basis.
• Updating the progress\status on a daily basis to client.

Confidential

Project Lead

Responsibilities:

• Providing 24*7 application/production supports to batch scheduled jobs in production live environment with coordinating the team working in shifts.
• Monitoring the critical applications as Batch scheduling of jobs in Production using Tivoli Work Scheduler.
• Fixing the failure jobs and updating the incidents with respect to the job failures in service center with appropriate resolution.
• Maintaining history of the failed jobs by raising incidents in Service Manager.
• Identifying the root cause of the failure job in JCL and fixing it.
• Sending the reports of all the scheduled applications (schedules) to business users in time.
• Communicating to onsite team members regarding the failure jobs and reducing the Service Manager queue.
• Raising ESP’s, Incidents, Change requests and Problem Records in SM7.
• Performance tuning the long running queries/worst performing queries in Unix and JCL jobs
• Interacting with client and attending conference/handover calls.
• Sending weekly-status report of whole team to client and Managers.

Confidential

Teradata Developer

Responsibilities:

• I was responsible for raising ESP’s and coordinating with the client, users and team.
• I was responsible for writing performance tuning queries and tuning worst performing queries.
• Raising incidents, change request in Service Center.
• Creating Build and unit test plan, unit test cases.
• Involved in implementation plan process, development check list.
• Writing Fastload, Multiload and Bteq scripts in Unix Shell scripts, JCL using JCL members for live jobs which fails in Production.
• Populate or refresh Teradata tables using Fast load, Multi load & Fast export utilities for user Acceptance testing and loading history data into teradata.

Confidential

Developer

Responsibilities:

• Familiar with the Teradata and SQL Server .NET Data Provider core Objects/Classes.
• Wrote Teradata Queries using Teradata SQL Assistant. Worked on Teradata Client Tools: BTEQ, Fast Load and Multi Load.
• Worked on Installation test cases, Data Integrity test cases, Performance test cases, Unit test cases and Conformance test cases for TDNETDP.
• Identification of defects in Test phases.
• Reported the behavioral differences between “.Net Data Provider for Teradata” (TDNETDP) and “.Net Data Provider for SQL Server” (SQLNETDP).
• Reported bugs in the “.Net Data Provider for Teradata” (TDNETDP).
• Database Server Management
• Development of the code
• Target data load through various utilities like Bteq, Fast load, Multi load etc.
• Performing Code Reviews
• Maintaining the Code.
• Doing peer review of test cases
• Sending daily status report to test manager.
• Participating /conducting weekly conf. calls with Onsite Manager.