Talend Developer Resume
Deerfield, IL
SUMMARY:
- Eight plus (8+) years of professional experience in Data Warehouse, Relational Database and System Integration. Proficiency in gathering and analyzing user requirements and translating them into business solutions.
- Three Plus (3+) Years of Experience in Talend Open Studio and Talend Integration Suite.
- Six Plus (6+) years of strong experience in development and design of ETL (Extract, Transform and Loading data) methodology for supporting data transformations and processing ETL Solutions using Informatica Power Center (9.x/8.x/7.x).
- Excellent experience working on Talend ETL and used features such as Context variables, Database components like tMSSQLInput, tOracleOutput, tmap, tFileCopy, tFileCompare, tFileExist file components, tIterateToFlow, tFlowToIterate, tHashoutput, tHashInput, tRunjob, tJava, tNormalize etc.
- Well versed with Talend BigData, Hadoop, Hive and used Talend Bigdata components like tHdfsoutput, tHdfsInput, and tHiveLoad.
- Performed Data Integration between different Databases and to HDFS, Hive and Hbase using Talend Data Integration and Talend Big Data ETL tools.
- Performed Importing and exporting data into HDFS and Hive using Sqoop.
- Involved in TAC (Talend Administrator Console) activities such as Job Scheduling, Server Monitoring, Job Conductor, Task Creation, Job Deployment etc.
- Extensively executed SQL queries on Oracle using Toad and SQL server tables to view successful transaction of data and to validate data.
- Experience in integration of various data sources from Databases like MS Access, Oracle, SQL Server and formats like flat - files, CSV files, COBOL files and XML files.
- Extensively worked on Informatica Designer Components- Source Analyzer, target Designer, Transformations Developer, Mapplet and Mapping Designer.
- Strong Experience on Workflow Manager Tools - Task Developer, Workflow&Worklet Designer.
- Vast experience in designing and developing complex mappings from varied transformation logic like Unconnected and Connected lookups, Source Qualifier, Router, Filter, Expression, Aggregator, Joiner, Update Strategy, Union, Sequence Generator, Sorter, Rank, Normalizer etc.
- Involved in the Data Analysis for source and target systems and good understanding of Data Warehousing concepts, Staging Tables, Dimensions, Facts and Star, Snowflake Schemas.
- Experience in, performance tuning of informatica mappings.
- Unique ability to understand long-term project development issues at all levels, from interpersonal relationships to the details of coding scripts with strong analytical, organizational, presentation and problem-solving skills
- Excellent communication skills and interpersonal abilities with maximum contribution to attain the team goal.
TECHNICAL SKILLS:
ETL Tools: Talend Studio Data Integration 6.3/6.2.1/5.6.2/5.5.2/5.3.1 Talend Administrator Console
Operating Systems: UNIX, Linux, Windows 98/2000, 2003, Windows NT 4.0
Databases: Oracle 11g/10g/9i/8i, DB2 10.0.5, Oracle, SQL Server 2008/2005/2000 , Hive 0.13, Hadoop.
Languages: XML, SQL, Unix/LINUX shell programming and scripting
Database Tools: SQL developer, SQL Server Management Studio, ToadISeries navigator, QMF for windows, SQL*Loader
PROFESSIONAL EXPERIENCE:
Confidential
Talend Developer, Deerfield, IL
Responsibilities:
- Acquire and interpret business requirements, create technical artifacts, and determine the most efficient/appropriate solution design, thinking from an enterprise-wide view.
- Worked in the Data Integration Team to perform data and application integration with a goal of moving more data more effectively, efficiently and with high performance to assist in business critical projects coming up with huge data extraction.
- Perform technical analysis, ETL design, development, testing, and deployment of IT solutions as needed by business or IT.
- Experience on writing Hive queries to load the data into HDFS.
- Performed data manipulations using various Talend components like tMap, tJavarow, tjava, tAS400input, tAS400output, tMysqlInput, tMysqlOutput, tAggregateRow, tFileExist, tFileCopy, tFileList, tDie, tsendEmail and many more.
- Analyzing the source data to know the quality of data by using Talend Data Quality.
- Designed Talend Jobs Using Big Data components like tHDFSInput, tHDFSOutput, tHDFSput, tHiveLoad, tHiveInput, tHivecreateTable.
- Designed talend jobs to download files from SAP and Talend server using components like tSAPTableinput, tFTPput, tFTPGet.
- Developed jobs to move legacy files to HDFS file location.
- Worked on Migration projects to migrate data from data warehouses on IBM AS400 and migrated those to SAP.
- Worked on develop jobs and scheduled jobs in Talend integration suite.
- Used Talend reusable components like context variable and global Map variables.
- Responsible to tune ETL mappings, Workflows and underlying data model to optimize load and query Performance.
- Worked closely with business team and generated the reports depending on the requirement.
Environment: Talend for Data Integration 6.2.1 & Big Data 6.2.1, TAC, IBM AS400, SAP, Oracle, SQL, XML, Hadoop, Hive, Linux.
Confidential
Big Data /Talend Developer, Lisle, IL
Responsibilities:
- Worked closely with Business Analysts to review the business specifications of the project and also to gather the ETL requirements.
- Created Talend jobs to copy the files from one server to another and utilized Talend FTP components.
- Created and managed Source to Target mapping documents for all Facts and Dimension tables
- Analyzing the source data to know the quality of data by using Talend Data Quality.
- Involved in writing SQL Queries and used Joins to access data from Oracle, and MySQL.
- Prepared ETL mapping Documents for every mapping and Data Migration document for smooth transfer of project from development to testing environment and then to production environment.
- Design and Implemented ETL for data load from heterogeneous Sources to SQL Server and Oracle as target databases and for Fact and Slowly Changing Dimensions SCD-Type1 and SCD-Type2.
- Utilized Big Data components like tHDFSInput, tHDFSOutput, tHiveLoad, tHiveInput, tHbaseInput, tHbaseOutput, tSqoopImport and tSqoopExport.
- Used Talend most used components (tMap, tDie, tConvertType, tFlowMeter, tLogCatcher, tRowGenerator, tSetGlobalVar, tHashInput & tHashOutput and many more)
- Created many complex ETL jobs for data exchange from and to Database Server and various other systems including RDBMS, XML, CSV, and Flat file structures.
- Experienced in using debug mode of talend to debug a job to fix errors.
- Responsible for developing, support and maintenance for the ETL (Extract, Transform and Load) processes using Talend Integration Suite.
- Conducted JAD sessions with business users and SME's for better understanding of the reporting requirements.
- Developed Talend jobs to populate the claims data to data warehouse - star schema.
- Used Talend Admin Console Job conductor to schedule ETL Jobs on daily, weekly, monthly and yearly basis.
- Worked on various Talend components such as tMap, tFilterRow, tAggregateRow, tFileExist, tFileCopy, tFileList, tDie etc.
- Worked Extensively on Talend Admin Console and Schedule Jobs in Job Conductor.
Environment: Talend Data Integration6.3.1, Talend Enterprise Big Data Edition 5.1, TalendAdministrator Console, MS SQL Server 2012/2008, Oracle 11g, Hive, HDFS, Sqoop, TOAD, UNIX.
Confidential
Sr. Talend Developer, Chicago, IL
Responsibilities:
- The project was aimed to support existing clients by changing from manual Process to Automation through ETL development using Talend & Cognos Data Manager
- Closely worked with Data Architects in designing of tables and even involved in modifying technical Specifications.
- Designed and Implemented the ETL process using Talend Enterprise Big Data Edition to load the data from Source to Target Database.
- Involved in Data Extraction from Oracle, Flat files and XML files using Talend by using Java as Backend Language.
- Used tWaitForFile component for file watch event jobs.
- Used over 20+ Components in Talend Like (tMap, tfilelist, tjava, tlogrow, toracleInput, toracleOutput, tsendEmail etc)
- Used debugger and breakpoints to view transformations output and debug mappings.
- Develop ETL mappings for various Sources (.TXT, .CSV, .XML) and also load the data from these sources into relational tables with Talend Enterprise Edition.
- Worked on Global Context variables, Context variables, and extensively used over 100+components in Talend to create jobs
- Created child jobs to use them in parent job in using tRunJob.
- Extracting transformed data from Hadoop to destination systems, as a one-off job, batch process, or Hadoop streaming process.
- Worked on Error handling techniques and tuning the ETL flow for better performance.
- Worked Extensively TAC (Admin Console), where we Schedule Jobs in Job Conductor
- Extensively Used Talend components tMap, tDie, tConvertType, tFlowMeter, tLogCatcher, tRowGenerator, tOracleInput, tOracleOutput, tfileList, tDelimited etc
- Worked with Oracle SQL Developer while Implementing Unit Testing of ETL Talend Jobs.
- Scheduling the ETL mappings on daily, weekly, monthly and yearly basis.
- Working on POC Big Data like loading the data into HDFS and creating Map Reduce Jobs
- Worked on the project documentation and also prepared the Source Target mapping specs with the business logic and also involved in data modeling
- Worked on migrating data warehouses from existing SQL Server to Oracle database.
- Implemented Performance tuning in Mappings and Sessions by identifying the bottlenecks and Implemented effective transformation Logic.
- Created Workflows using various tasks like sessions, control, decision, e-mail, command, worklets, and assignment and worked on scheduling of the workflows.
- Verify the logs to confirm all the relevant jobs are completed successfully and timely and involved in production support to resolve the production issues.
- Migrated the code and release documents from DEV to QA (UAT) and to Production.
Environment : Talend Platformfor Big Data 6.2, Talend OpenStudio5.0.1, UNIX, Oracle 12c, TAC (Admin Center), SQL Server, TOAD, Autosys.
Confidential
ETL/Talend Developer, Sunnyvale, CA
Responsibilities:
- Worked closely with Business Analysts to review the business specifications of the project and to gather the ETL requirements.
- Developed jobs, components and Joblets in Talend
- Designed ETL Jobs/Packages using Talend Integration Suite (TIS)
- Created complex mappings in Talend using tHash, tDenormalize, tMap, tUniqueRow.
- Used tStatsCatcher, tDie, tLogRow to create a generic joblet to store processing stats into a Database tableto record job history.
- Created Talend Mappings to populate the data into dimensions and fact tables.
- Frequently used Talend Administrative Console (TAC)
- Implemented new users, projects, tasks within multiple different environments of TAC (Dev, Test, Prod, and DR).
- Developed complex Talend ETL jobs to migrate the data from flat files to database.
- Implemented custom error handling in Talend jobs and worked on different methods of logging.
- Created ETL/Talend jobs both design and code to process data to target databases.
- Created Talend jobs to load data into various Oracle tables. Utilized Oracle stored procedures and wrote few Java code to capture global map variables and use them in the job.
- Successfully Loaded Data into different targets from various source systems like Oracle Database, DB2, Flat files, XML files etc. into the Staging table and then to the target database.
- Troubleshot long running jobs and fixing the issues.
- Prepared ETL mapping Documents for every mapping and Data Migration document for smooth transfer of project from development to testing environment and then to production environment.
- Performed Unit testing and System testing to validate data loads in the target.
Environment: Talend 5.5.2, UNIX, Shell script, SQL Server, Oracle, Business Objects, ERwin, SVN, Redgate, Capterra.
Confidential
Informatica ETL Developer/ Talend ETL Developer, Covington, KY
Responsibilities:
- Worked with Talend components such as tfileInputDelimited, tFileInputPositional, tFileOutputDelimited, tfileInputExcel, tFileInputXML, tFolder, tFileExist, tMySqlConnection, tMySqlInput, tOracle.
- Created Projects, jobs in Talend Open Studio.
- Used Basic run, debug jobs and used metadata wizard in Talend Open Studio.
- Worked closely with data population developers, multiple business units and a data solution engineer to identify key information that will enhance business decision-making.
- Loaded the relational tables for trade decision support which is consumed by the dashboard for trade decisions.
- Involved in designing the Data warehouse based on the requirement document using Informatica Power Center and Talend Open studio.
- Created stored procedure to be called in Informatica for the nexval from Dualtable of oracle.
- Created reusable expression transformation for Meta columns of Standardization area.
- Fixed numerous bugs with Testers inputs.
- Worked with tools - Source Analyzer, Warehouse designer, Transformation and Mapping Designer, Transformations developer, Informatica Repository Manager and workflow Manager and Informatica workflow monitor.
- Read .CSV and fixed width files and created multi schema output files using Talend Open Studio.
- Created .CSV files from excel spreadsheets and loaded into the target Oracle Database using Talend Open Studio.
- Worked with memory cache for static and dynamic cache for better throughput of sessions containing source qualifier, expression, filter, aggregator, rank, update strategy, lookup, stored procedure, sequence generator, joiner transformations in Informatica.
- Wrote UNIX shell scripts extensively for file handling and job scheduling.
- Worked extensively on using processing components like, tAggregate, tFlowToIterate, tSortRow, tFixedFlowInput, tMap, tJoin, tLogRow, tUnique in Talend Open studio to transform data.
- Developed SCD Type 1 (insert / update) job in Talend Open Studio to insert or update records in target database using flatfiles.
- Optimizing/Tuning mappings/sessions, indexing and partitioning for better performance and efficiency.
- Created the reusable transformations for better performance.
- Design and implement data verification and testing methods for data warehouse.
Environment: Informatica Power center 9.5.1, Oracle 11g, SalesForce, Red Hat Linux, Talend Open Studio for data Integration 4.1, and UNIX Shell Script.
Confidential
Informatica ETL Developer, Chicago, IL
Responsibilities:
- Creation of Informatica mappings to build business rules to load data using transformations like Source Qualifier, Expression, Lookup, Filter, Joiner, Union, Aggregator, Sorter, Sequence generator, Router, Update Strategy, and Stored procedure etc.
- Done extensive testing and wrote queries in SQL to ensure the loading of the data. Perform unit testing at various levels of the ETL and documented the results too.
- Used Informatica debugging techniques to debug the mappings and used session log files and bad files to trace errors occurred while loading.
- Developed Informatica Mappings, Mapplets and Transformations to load data from different relational sources like Oracle, Netezza, DB2, and flat files sources into the data mart.
- Created Netezza views to be used in MicroStrategy for semantic layer on data marts.
- Used Netezza Bulk writer and Netezza Bulk reader in Informatica to load and read data from Netezza.
- Wrote complex SQL queries on Netezza and used them in lookup SQL overrides and Source Qualifier overrides.
- Involved in migration of data from Oracle to Netezza.
- Created NZSQL and NZLOAD scripts to load and unload data from Netezza to external flat files.
- Extensively worked on designing Business views and writing SQL queries using Netezza Sql catering specific business requirement to generate data.
- Used Aginity Work Bench for Pure Data Systems for Analytics to query in Netezza environment.
- Exclusively worked on DB2 database and created various tables and indexes on those tables.
- Responsible for writing new stored procedures and editing existing stored procedures for new changes.
- Done the documentation part like preparing migration checklist, fixing the errors and documenting the changes done, and Testing Results.
- Created and tested Autosys jobs for automated job scheduling for various Informatica mappings and monitored the jobs in QA and Production.
- Worked with offshore team to meet deadlines for the assigned task.
- Worked with QA team to create testcases and validated the source and target tables.
- Worked on moving the code from DEV to QA to PROD and performed complete Unit Testing, Integration Testing, user Acceptance Testing for the three environments while moving the code.
Environment: Informatica 9.1, Netezza, Toad, Oracle SQL Developer, UNIX Shell Scripting, SQL Assistant, DB2.
Confidential
Informatica ETL Developer
Responsibilities:
- Analyzed the source data coming from Flat files and worked with business users.
- Worked with most of the DB client tools like SQL Navigator, TOAD, Data Browser, Teradata SQL Assistant, etc.
- Used various transformations like Source Qualifier, Lookup, Update Strategy, Router, Filter, Sequence Generator, and Joiner on the extracted source data according to the business rules and technical specifications.
- Optimized the Mappings using various optimization techniques and debugged some existing mappings using the Debugger to test and fix the mappings.
- Schedule, Run and Monitor sessions by using Informatica Workflow Manager.
- Redesigned some of the existing mappings in the system to meet new functionality.
- Created Mappings, Reusable transformations and executed workflows to facilitate daily load of data from flat files to Oracle database.
- Involved in the development backend code, altered tables to add new columns, Constraints, Sequences and Indexes as per business requirements.
- Perform DML, DDL Operations as per the Business requirement.
- Used different joins, sub queries and nested query in SQL query.
- Performed data quality analysis to validate the input data based on the cleansing rules.
- Creating views and prepares the Business Reports.
- Resolved production issues by modifying backend code as and when required.
Environment: Informatica 7.1.1, Windows, Oracle 8i, TOAD.
