Sr. Etl/talend Developer Resume
Irving, TX
SUMMARY
- 8 years of experience in IT Industry involving Software Analysis, Design, Implementation, Coding, Development, Testing and Maintenance with focus on Data warehousing applications using ETL tools like Talend and Informatica.
- 3+ years of experience using Talend Integration Suite (6.1/5.x) / Talend Open Studio (6.1/5.x) and 2+ years of experience with Talend Admin Console (TAC).
- Experience working with Data Warehousing Concepts like Kimball/ Inmon methodologies, OLAP, OLTP, Star Schema, Snow Flake Schema, Logical/Physical/ Dimensional Data Modeling.
- In depth understanding of the Gap Analysis i.e., As - Is and To-Be business processes and experience in converting these requirements into Technical Specifications andTest Plans.
- Highly Proficient in Agile, Test Driven, Iterative, Scrum and Waterfall software development life cycle.
- Extensively used ETL methodology for performing Data Profiling, Data Migration, Extraction, Transformation and Loading using Talend and designed data conversions from wide variety of source systems including Netezza, Oracle, DB2, SQL server, Teradata, Hive, Hanaand non-relational sources like flat files, XML and Mainframe Files.
- Experience in analyzing data using HiveQL and Pig Latin in HDFS.
- Extracted data from multiple operational sources for loading staging area, Data warehouse, Data Marts using SCDs (Type 1/Type 2/ Type 3) loads.
- Experience in using cloud components and connectors to make API calls for accessing data from cloud storage (Google Drive, Salesforce, Amazon S3, DropBox) inTalend Open Studio.
- Experience in creatingJoblets in TALEND for the processes which can be used in most of the jobs in a project like to Start job and Commit job.
- Experience in monitoring and scheduling using AutoSys, Control M& Job Conductor (Talend Admin Console) and using UNIX (Korn& Bourn Shell) Scripting.
- Expertise in creating sub jobs in parallel to maximize the performance and reduce overall job execution time with the use of parallelize component of Talend in TIS and using the Multithreaded Executions in TOS.
- Experienced in creating Triggers on TAC server to schedule Talend jobs to run on server.
- Strong experience in Extraction, Transformation, loading (ETL) data from various sources into Data Warehouses and Data Marts using Informatica Power Center (Designer, Workflow Manager, Workflow Monitor, Metadata Manger).
- Strong hands on experience using Teradata utilities like SQL Assistant, B-TEQ, FastLoad, MultiLoad, Fast Export, TPUMP& TPT.
- Worked extensively on Error Handling, Performance Analysis and Performance Tuning of Informatica ETL Components, Teradata Utilities, UNIX Scripts, SQL Scripts etc.
- Strong decision-making and interpersonal skills with result oriented dedication towards goals.
TECHNICAL SKILLS
Operating Systems: Windows 2008/2007/2005/ XP, UNIX (SunSolaris10, HP,AIX) & Linux
ETL Tools: Talend, TOS, TIS, Informatica Power Center 9.x/8.x/7.x/6.x (Designer, Workflow Manager, Workflow Monitor,
Databases: Oracle 12c/11g/10g/9i/8i, MS SQL Server 2012 /2008/2005 , DB2 v8.1, Netezza, Teradata, Hbase.
Modelling: Data Modeling - Physical Modeling, Logical Modeling, Relational Modeling, Dimensional Modeling (Star Schema, Snow-Flake, Fact, Dimensions), Entities, Attributes.
Programming Languages: T-SQL, PL/SQL, HTML, XML, Javascript, Korn shell script & Windows batch scripting
Scheduling Tools: Autosys, Control-M
Testing Tools: QTP, WinRunner, LoadRunner, Quality Center, Test Director, Clear test
Other tools: SQL Developer, AginityWorkBench, Teradata SQL Assistant, Toad, Putty, MS-OfficeVMWare Workstation
PROFESSIONAL EXPERIENCE
Confidential, Irving, Tx
Sr. ETL/Talend Developer
Responsibilities:
- Acquire and interpret business requirements, Create Technical artifacts, and determine the most efficient/appropriate solution design, thinking from an enterprise-wide view.
- Worked in the Data Integration Team to perform data and application integration with a goal of moving moredata more effectively, efficiently and with high performance to assist in business critical projects coming up withhuge data extraction.
- Extensively used tSAPBapi component to load and read data from SAP System.
- Perform Technical analysis, ETL design, Development, Testing, and Deployment of IT solutions as needed by business or IT.
- Participate in designing the overall logical & physical Data warehouse/Data-mart data model and data architectures to support business requirements
- Explore prebuilt ETL metadata, Mappings and DAC metadata and Develop and maintain SQL code as needed for SQL Server database.
- Performed data manipulations using various Talend components like tMap, tJavarow, tjava, tOracleRow, tOracleInput, tOracleOutput, tMSSQLInput and many more.
- Analyzing the source data to know the quality of data by using Talend Data Quality.
- Troubleshoot data integration issues and bugs, analyze reasons for failure, implement optimal solutions, and revise procedures and documentation as needed.
- Worked on Migration projects to migrate data from data warehouses on Oracle/DB2 and migrated those toNetezza.
- Used SQL queries and other data analysis methods, as well as TalendEnterprise Data Quality Platform for profilingand comparison of data, which will be used to make decisions regarding how to measure business rules andquality of the data.
- Worked on TalendRTX ETL tool, develop jobs and scheduled jobs in Talend integration suite.
- Writing Netezza SQL queries to join or any modifications in the table
- Used Talend reusable components like routines, context variable and globalMap variables.
- Responsible to tune ETL mappings, Workflows and underlying data model to optimize load and queryPerformance.
- Developed Talend ESB services and deployed them on ESB servers on different instances.
- Implementing fast and efficient data acquisition using Big Data processing techniques and tools.
- Monitored and supported the Talend jobs scheduled through Talend Admin Center (TAC).
- Developed Oracle PL/SQL, DDLs, and Stored Procedures and worked on performance and fine Tuning of SQL.
Environment: Talend 6.1/5.6, Netezza, Oracle 12c, IBM DB2, TOAD, Aginity, BusinessObjects 4.1, MLOAD, SQL Server 2012, XML, SQL, Hive, Pig, SQL, PL/SQL, HP ALM, JIRA.
Confidential, Natick, MA
Sr. ETL/Talend Developer
Responsibilities:
- Worked with Data mapping team to understand the source to target mapping rules.
- Analyzed the requirements and framed the business logic and implemented it using Talend.
- Involved in ETL design and documentation.
- Analyzed and performed data integration using Talend open integration suite.
- Worked on the design, development and testing of Talend mappings.
- Created ETL job infrastructure using Talend Open Studio.
- Worked on Talend components like tReplace, tmap, tsort and tFilterColumn, tFilterRow, tJava, Tjavarow, tConvertType etc.
- Used Database components like tMSSQLInput, tMsSqlRow, tMsSqlOutput, tOracleOutput, tOracleInput etc.
- Worked with various File components like tFileCopy, tFileCompare, tFileExist, TFileDelete, tFileRename.
- Worked on improving the performance of Talend jobs.
- Created triggers for a Talend job to run automatically on server.
- Worked on Exporting and Imporrting of Talend jobs.
- Created jobs to pass parameters from child job to parent job.
- Exported jobs to Nexus and SVN repository.
- Developed project specific 'Deployment' job responsible to deploy Talend jar files on to the windows environment as a zip file, later, this zip file is unzipped and the files are again deployed to the unix box.
- Also, this deployment job is responsible to maintain versioning of the Talend jobs that are deployed in the unix environment.
- Developed shell scripts in unix environment to support scheduling of the Talend jobs.
- Monitored the daily runs, weekly runs and adhoc runs to load data into the target systems.
- Worked on latest HP Vertica database for high volume data from 3 different regions Americas, Europe and Asia
- Worked on workflows configured to run concurrently having different source system names running in different regions.
- Hands on experience on Tidal scheduler having job groups, to run Informatica ETL jobs, also completed the HP internal Tidal certification.
- Worked on ETL layered approach of Stage or landing tables, Core tables and reporting tables
- Created various ETL components like Change Sets, Data Feeds, Data Elements, Categories, Data Marts and Extracts.
- Involved in coding UNIX scripts to automate multiple ETL Jobs.
- Involved in Tuning the Informatica objects to increase the Performance of the Informatica loads.
- Performed Tuning by identifying and eliminating the bottlenecks occurred for increasing the performance.
- Designed and developed Informatica mappings for data loads and data cleansing. Extensively worked on Informatica Designer and Workflow Manager.
- Extensively used almost all of the transformations of Informatica including lookups, Stored Procedures, Update Strategy and others.
- Developed sessions using Informatica Workflow Manager.
Environment: Talend 5.5.2, UNIX, Shell script, SQL Server, Oracle, Business Objects, ERwin, SVN, Redgate, Capterra, Informatica Power Center 9.1/Metadata Manager, Power Exchange 8.6, Data Analyzer
Confidential, Austin, Tx
Sr. ETL/Talend Developer
Responsibilities:
- Participated in business requirements analysis and closely worked with DataArchitects to design Tables (TAC Tables, AMC Tables)
- Worked with the Data Integration Team to perform data and application integration with a goal of moving data more effectively, efficiently and with high performance to assist in business critical projects coming up with huge data extraction.
- Designed and Developed ETL process using Talend Enterprise DI.
- In parallel to Development acted as a Talend Admin: Creating Projects/ Scheduling Jobs / Migration to Higher Environments & Version Upgrades.
- Created Talend Jobs to populate the data into dimensions and fact table.
- Created complex jobs in Talend using tMap, tJoin, tDie, tConvertType, tFlowMeter, tLogCatchertReplicate, tParallelize, tjava, tJavaFlex, tAggregateRow, tWarn, etc. and created Talend jobs to populate the data into dimensions and fact tables.
- Implemented Talend POC to extract data from Salesforce API as an XML Object & .csv files and load data into SQL Server Database.
- Hands of Experience on many components which are there in the palette to design Jobs & used Context Variables/Groups to Parameterize Talend Jobs.
- Implemented Error Logging, Error Recovery, and Performance Enhancement's & created Audit Process (generic) for various Application teams.
- Experience in using Repository Manager for Migration of Source code from Lower to higher environments.
- Created Projects in TAC and Assign appropriate roles to Developers and integrated SVN (Subversion).
- Worked on Custom Component Design and used to have embedded in Talend Studio used to be on call Support if the Project is deployed to further Phases.
- Used Talend Admin Console Job conductor to schedule ETL Jobs on daily, weekly, monthly and yearly basis (Cron Trigger)
Environment: Talend Enterprise Platform for Data management V5.5.1, UNIX, Oracle, Microsoft SQL Server management Studio, WINDOWS XP.
