SUMMARY

• Having 8+ Years of experience with Talend Real - time Big Data Platform 7.3.1, Talend Enterprise Data Integration 6.2/6.5/7.1, Snowflake and Pervasive Data Integrator 9.2 as an ETL Developer in the implementation of the projects.
• Hands on Experience to use scheduling tools like Talend Administration Center (TAC) & Talend Management console (TMC), Control-M, Autosys, Amazonredshift and Code migration.
• Developing Talend Jobs based on the Mapping Specification Provided.
• Implemented change data capture and slowly changing dimensions using Talend specialized components.
• Extensively worked on Talend Designer Components - HDFS files, Flat files, Excel, XML, Positional flat files and tMap, tJoin, tHashInput and tHashoutput etc...
• Worked on Talend Bigdata Components - tHDFSConnection, tHDFSInput, tHDFSCopy and tHDFSOutput etc...
• Extensively worked on Talend S3 Components - tS3Connection, tS3List, tS3Get, tS3Put, tS3copy, tS3Close, tS3Delete etc...
• Extensively worked on Talend Rest Components - tRestClient, tRest, tRestRequest, tRestResponse etc...
• Extensively used tRest components in both FTP and SFTP mode to load data from staging files.
• Extensively used CRM tool Snowflake components tSnowflakeConnection, tSnowflakeInput, tSnowflakeOutput, tSnowflakeOutputBulk, tSnowflakeBulkExec.
• Worked with Azure components tAzureStorageConnection, tAzureStoragePut, tAzureStorageGet, tAzureStorageList.
• Owning the Ownership of the Jobs Developed and resolving the defects on the fly if any, once when moved to different environments.
• Performed Unit Testing based on multiple test cases (Positive and Negative Scenarios) and prepared release notes to the framework Joblets.
• Having Problem-solving skills and ability to do hot fixes when required.
• Hands on Experience to create the Routines (User defined functions).
• Designed the jobs and transformations sequential and parallel as per the requirements
• Experience on Data Cleansing and Standardizations of Data.
• Gained knowledge on Data warehouse concepts like Data warehouse Architecture, Star schema, Snowflake schema, and Dimension and Fact tables.
• Having knowledge on Autosys scheduling tool and Source Tree.
• Expert in working close with other IT group and co-ordinate projects.
• Proficient in interacting with Business Analysts, Users and Business executives to understand the requirements and come up with innovative and efficient solutions by working with the data modelers and Architects.
• Good Experience in both Waterfall & Agile Methodology.

TECHNICAL SKILLS

ETL Tools: Talend DI, TAC, BIG DATA and Pervasive data integrator

RDBMS: Snowflake, Amazon Redshift, Hbase, Oracle 11g/10g/9i, MS SQL Server 2008/2005, MySQL

Programming Skills: ANSI SQL, SQL, Oracle PL/SQL, Unix Shell Scripting, HTML, DHTML, XML, Pig, Hive, Java

Tools: TOAD, SQL Plus, Putty, Subversion and SQL Server Management Studio

Operating Systems: Windows 8/7/XP/NT/2x, Unix

Methodologies: Dimensional Modeling - Star / Snowflake.

PROFESSIONAL EXPERIENCE

Confidential

Sr ETL Developer

Responsibilities:

• Understand the mapping specification document and developed the Talend esb jobs.
• Used various Talend components for implementing business logic.
• Created Metadata tables and load job specific information.
• Created various jobs in Talend for implementing business logic.
• Designed and Implemented the ETL process using Talend Enterprise Big Data Edition to load the data from Source to Target Database.
• Worked on Migration project from Web methods to Talend Using RestApi Components.
• Worked with different sources such as tRestClient, tRest and tRestResponse.
• Worked with Azure components tAzureStorageConnection, tAzureStoragePut, tAzureStorageGet, tAzureStorageList.
• Extensively used CRM tool Snowflake components tSnowflakeConnection, tSnowflakeInput, t SnowflakeOutput, tSnowflakeOutput Bulk, tSnowflakeBulkExec.
• Used Matillion ELT for couple of partners to support Snowflake data processes.
• Extensively used tRest components in both FTP and SFTP mode to load data from staging files.
• Used tDBOutput and tSnowflakeOutput component to load data from Webmethods.
• Created context variable to store metadata information of all the sources and targets.
• Using Debugger to find the bottlenecks in the Jobs.
• Prepare unit test cases for the developed etls.

Environment: Talend Real time for Bigdata 7.3.1, Snowflake, Azure blobs, Web methods, Postman, API’s, Flat Files, Oracle 11g, SQL, MS Excel, UNIX Shell Scripts, Talend Administrator Console, SVN, GIT, TMC.

Confidential

ETL Talend Developer

Responsibilities:

• Understand the mapping specification document and developed the Talend big data jobs.
• DevelopedTalendjobs with Hadoop (Big Data) components like HDFS and HIVE components to capture raw data into Hadoop system.
• DevelopedTalendjobs for prestaging and staging areas with all business rules, transformation rules incorporated with them.
• Used various Talend components for implementing business logic.
• Created Metadata tables and load job specific information.
• Created various jobs in Talend for implementing business logic.
• Worked with different sources such as HDFS,MySQL and XML.
• Used HDFS components for extracting the data from HDFS Layer and load Redshift.
• Extensively used tHASH components to load data from staging files.
• Used tImpalaRow component to load data from Hive table.
• Used tDBRow component to load data from S3 Bucket.
• Used different methods/functions in tmap for doing transformation logic.
• Used input and output filters in tmap for filtering the data based on the requirement.
• Created context variable to store metadata information of all the sources and targets.
• Using Debugger to find the bottlenecks in the Jobs.
• Prepare unit test cases for the developed etls.

Environment: Talend Real time for Bigdata 7.3/6.5, AWS S3, Athena, Redshift, Hive, Impala, Parquet files, Flat Files, Oracle 11g, Talend Administrator Console, Talend Management Console, Jira and Agile Methodology.

Confidential

ETL Talend Developer

Responsibilities:

• Understand the mapping document and developed the Talend jobs.
• Used various Talend components for implementing business logic.
• Created various jobs in Talend for implementing business logic.
• Worked with different sources such as Oracle and flat files.
• Used tunite component for combing different sources.
• Extensively used for joining different sources using tmap components.
• Worked on Source tree to Deploy the SQL files into Various environments.
• Used different methods/functions in tmap for doing transformation logic.
• Used input and output filters in tmap for filtering the data based on the requirement.
• Created context variable to store metadata information of all the sources and targets.
• Using Debugger to find the bottlenecks in the Jobs.
• Worked on Autosys scheduling tool to schedule/run the etl jobs.

Environment: Talend 6.1.1/5.6.2 , Oracle 10g, SQL, MS Excel, Flat files, XML, Json, UNIX Shell Scripts, Autosys.

Confidential

ETL Pervasive Data integrator Developer

Responsibilities:

• Understand the FDS document and prepare the TDS design documents before developing the ETL code.
• Performance tuning of SQL queries and stored procedures using SQL profiler and Index tuning advisor.
• Resolved any deadlocks issues with Databases/Servers on a real-time basis.
• Develop the ETL code as per TDS.
• Perform the Unit testing on developed code for minimizing the QA issues and data quality.
• Prepare the deployment document for the developed etls.
• Responsible for code Deployment into SIT and UAT environments.
• Fix the ETL issues for the developed ETLs.

Environment: Pervasive Data integrator, SQL Server 2000 Enterprise Edition, Windows 2000/NT, UNIX, Excel, SQL MS Access.