PROFESSIONAL SUMMARY:

• 10+years of diversified experience in system analysis, application design, development,debugging and deploying BI - Data Warehousing solutions (EDW) and Big Data Analytics on various platforms.
• Includes 3 years of experience in Big Data Hadoop technologies and solutions
• Experience in working with Cloudera distributions of Hadoop ecosystem.
• Expertise in writing Hadoop Jobs for analyzing data using Hive and Pig
• Experience in importing and exporting data using Sqoop from HDFS to Relational Database Systems(RDBMS) and vice-versa
• Extensive experience with SQL, PL/SQL and database concepts
• Proficient in Unix Shell Scripting
• Data Analysis, design and development of ETL methodology for supporting data transformations & processing in a corporate wide ETL Solution using TeradataTD12.0/TD13.0/TD14.0, analyzing business needs of clients, developing effective and efficient solutions and ensuring client deliverable within committed deadlines.
• In-depth knowledge of RDBMS concepts with expert knowledge of constructing Relational Database according to business requirement.
• Experience in creating Ad-hoc reports, data driven reports using SQL queries
• Expert in Data Conversion, Normalization, Multi-Dimensional Modeling and involved in creation of Fact Tables, Dimension Tables, Star Schema and Snowflake dimensional schema.
• Strong hands on experience using Teradata utilities (FastExport, MultiLoad, FastLoad, Tpump, TPT and BTEQ).
• Experienced in mapping business requirements and translating these requirements into End User Applications.
• Proficient in Teradata Query optimization, Performance Tuning.
• Experienced in Logical and Physical data modelling, snowflake and star schema methodologies.
• Good knowledge in scheduling batch jobs using Control-M/UC4/Opswise batch scheduling tool.
• Experienced in mapping business requirements, STM Design, Data analysis & Modeling, ETL design and translating the requirements into functional specifications.
• Provided training and technical application support for all end-users.
• Good understanding of reporting tools like Business Object and Microstrategy.
• Created complex Stored Procedures that automated the application process and efficient.
• Functional knowledge of IBM Datastage and Informatica.
• Good experience in all phases of software life cycle and Agile-Scrum process

TECHNICAL SKILLS:

Teradata Tools: Teradata SQL Assistant, Viewpoint, BTEQ, Fast Load, Multiload, Fast Export

Big Data Platform: Hadoop ecosystem, HDFS, Map Reduce, HUE, Hive, PIG, Sqoop

DB Tools: SQL*Plus, SQL Loader, TOAD 8.0, BTEQ, Fast Load, Multiload, FastExport, SQL Assistant, SQL Sever

Databases: Teradata: 13.0/12.0/14.0 , Oracle-10g/11i,MS-SQLServer 2000/2005/2008

Scheduling Tools: Control: M,uc4,Opswise

Version Control Tools: SVN,ClearCase,GitHub

Programming Languages: C, SQL, PL/SQL and UNIX Shell Scripting

Operating Systems: Linux, Windows, UNIX

PROFESSIONAL EXPERIENCE:

Confidential

System Architect (Consultant)

Responsibilities:

• Data Engineer role to analyze data and build robust, fault-tolerant data pipeline
• Perform requirement gathering, Formulated and implemented Design and acted as a liaison between the business side of enterprise and the providers of services to the enterprise.
• Create Design Specification for BI applications. Navigational attribute specifications, Target Table Structures, Source Target Mapping, Data Flow Diagrams and Modeling, Report Templates
• Data Model design, Data Extraction, Transformations and Loading, Customized Analytics Reports, Job Scheduling and Multidimensional Reports generation.
• Mentor my team in technical areas and ensure team has cohesion. This includes team at both offshore and onsite.
• Developed automated data solution for the periodic transfer of processed data from HDFS to enterprise data analytics platform on Teradata.
• Developed Simple to complex Map/reduce Jobs using Hive,Sqoop and Pig
• Development of TD scripts for loading the data into the base tables in EDW and to load the data from source to staging and staging area to target tables using FastLoad, FastExport, MultiLoad, TPT and BTEQ utilities of Teradata.
• Written complex SQLs using joins, sub queries and correlated sub queries. Expertise in SQL Queries for cross verification of data.
• Writing UNIX Shell Scripts for processing/cleansing incoming text files.
• Use SQL to query the databases and do as much crunching as possible in Teradata, using very complicated SQL Query optimization (explains plans, collect statistics, data distribution across AMPS, primary and secondary indexes, locking, etc.) to achieve better performance.
• Performed validations, Data Quality checks on incoming data.
• Used Enterprise Git-hub/SVN for version control, Control-M for scheduling purposes.
• Worked onperformance tuning and query optimization of the Teradata SQLs.

Environment: Tableau 8.2,Teradata 13.0/12.0, Hadoop 1.1.2, Hive 0.9.0, PIG 0.11.1, Sqoop-1.4, Unix, Teradata SQL Assistant,Fastload, MultiLoad, BTEQ .

Confidential

Senior Application Developer (Consultant)

Responsibilities:

• Performed the requirement analysis, impact analysis and documented the requirements using Rational Requisite Pro.
• Developed Simple to complex Map/reduce Jobs using Hive,Sqoop and Pig
• Data Model design, Data Extraction, Transformations and Loading, Customized Analytics Reports, Job Scheduling and Multidimensional Reports generation
• Development of TD scripts for loading the data into the base tables in EDW and to load the data from source to staging and staging area to target tables using FastLoad, FastExport, MultiLoad, TPT and BTEQ utilities of Teradata.
• Written complex SQLs using joins, sub queries and correlated sub queries. Expertise in SQL Queries for cross verification of data.
• Extract Data from HDFS and load it in Teradata.
• Export data from Teradata and store it in HDFS.
• Writing UNIX Shell Scripts for processing/cleansing incoming text files.
• Work with the Project Management in the creation of project estimates.
• Worked extensively in documenting the Source to Target Mapping documents with data transformation logic.
• Worked closely with production support team in case of delay in ETL process.
• Used JIRA tool to track work/data issue/Ad-hoc Reports status.
• Used Enterprise Git-hub for version control, Opswise for scheduling purposes.
• Excellent experience in performance tuning and query optimization of the Teradata SQLs.
• Work closely with Data Scientist team and work on their requirement by using Hive,Pig,Unixetc

Confidential

Application Developer

Responsibilities:

• Development of scripts for loading the data into the base tables in EDW and to load the data from source to staging and staging area to target tables using FastLoad, MultiLoad, TPT and BTEQ utilities of Teradata.
• Documented the ETL process for end-users.
• Written complex SQLs using joins, sub queries and correlated sub queries. Expertise in SQL Queries for cross verification of data.
• Daily basis interact with business regarding the issues and report status.
• Developed python scripts to identify the missing url in the customer acquisition pages.
• Dealt with initials, delta and Incremental data as well Migration data to load into the Teradata.
• Performed application level activities creating tables, indexes, monitored and tuned Teradata BETQ scripts using Teradata Visual Explain utility.
• Analyzing data and implementing the multi-value compression for optimal usage of space.
• Extensively involved in developing & designing ETL by using SQL, BTEQ, MLoad, Fastload, FastExport.
• Developed UNIXshellscripts to run batch jobs and loads into production.
• Tuning of Teradata SQL statements using Explain analyzing the data distribution among AMPs and index usage, collect statistics, definition of indexes, revision of correlated sub queries, usage of Hash functions, etc…
• Used UC-4 for scheduling purposes.

Environment: Teradata 13.0/14.0, Teradata SQL Assistant, Multiload, FastExport, FastLoad, python, UNIX, Shell scripts.

Confidential

Lead Application Developer

Responsibilities:

• Development of scripts for loading the data into the base tables in EDW and to load the data from source to staging and staging area to target tables using FastLoad, MultiLoad, TPT and BTEQ utilities of Teradata.
• Extract and Load data into Oracle RDBMS using sql-loader to support the real time applications.
• Extract and Load data into MySql RDBMS to support the real time applications.
• Partitions the Oracle Database and use the Swap Partition functionality in Oracle.
• Writing scripts for daily load Alerts and data Reconciliation.
• Written complex SQLs usingjoins, sub queries and correlated sub queries. Expertise in SQL Queries for cross verification of data.
• Involved in Analysis, Design and Development, testing and implementation of business rules.
• Co-ordinate with the offshore team and provide the status in agile meetings.
• Discuss the requirement with business and assign the work to offshore team.
• Ad-hoc report generation based on Business requirement.
• Extensively used JIRA tool to track the issue and handle business ad-hoc reports.
• Developed the Teradata Macros, Stored Procedures to load data into Incremental/Staging tables and then move data from staging into Base tables.
• Performed application level activities creating tables, indexes, monitored and tuned Teradata BETQ scripts using Teradata Visual Explain utility.
• Very good understanding of Database Skew, PPI, Join Methods and Join Strategies, Join Indexes including sparse, aggregate and hash.
• Extensively involved in developing & designing ETL by using TeradataSQL, BTEQ, MLoad, Fastload, FastExport.
• Developed UNIXshellscripts to run batch jobs and loads into production.
• Performed validations, Data Quality checks and Data profiling on incoming data.
• Used Enterprise SVN for version control, Control-M for scheduling purposes.
• Excellent experience in performance tuning and query optimization of the Teradata SQLs.

Environment: Teradata 13.0/12.0, Teradata SQL Assistant, Multiload, FastExport, FastLoad, Teradata Parallel Transporter (TPT), Oracle, UNIX, Shell scripts,IBM Datastage

Confidential

Data Analyst /Business Analyst

Responsibilities:

• Involved in Requirement gathering, business Analysis, Design and Development, testing and implementation of business rules.
• Work with internal business partners to develop and implement additional functionality into RET application.
• Developed mappings to load data from Source systems like Oracle, SAP BI, SQL SERVER to Data Warehouse.
• Validate the source data with target data.
• Extract and Load data into Oracle RDBMS using sql-loader to support the real time applications.
• Dealt with Incremental data as well Migration data to load into Oracle.
• Create documents for UAT and production implementation and operation handover.
• Extensively used Oracle sqlldr and export commands
• Create Ad-Hoc reports based on business requirement.
• Automate the ad-hoc reports based on the frequency.
• Written complex SQLs using joins, sub queries and correlated sub queries. Expertise in SQL Queries for cross verification of data.
• Developed UNIX shell scripts to run batch jobs and loads into production.
• Used Informatica/Datastage (ETL) to load the data to Data warehouse Systems.
• Testing of Stored Procedures and Functions, Unit and Integration Testing of Informatica Sessions, Batches and Target Data.
• Involved in designing the data flow diagram.Documented the mappings used in ETL processes
• Participated in Logical and Physical Data modeling. Identified the Entity types, their attributes and the relationship between the Entities in the organization’s business process.
• Performed Unit testing, Integration testing and generated various Test Cases.
• Performed Data analysis and Data validations.
• Convert and migrate generated SQL scripts and ad-hoc queries from Business Objects Universe, Oracleto batch mode Reporting queries to Teradata RDBMS by using Teradata utilities.

Environment: Oracle,Sqlldr,, Business Object, SQL,, Informatica Power Center 8.5, TOAD, Unix Shell script,IBM Datastage