We provide IT Staff Augmentation Services!

Talend Developer Texas

5.00/5 (Submit Your Rating)

SUMMARY:

  • Having 6 years of experience in Design, Analysis and development of software applications.
  • 3+ years of experience with Talend Open Studio & Talend Enterprise platform for Data Management (V 6.1 and 6.3) and Data Integration.
  • Solid Knowledge on relational database management Systems, Data Warehousing Basics and Dimensional modeling (Snowflake schema and Star schema).
  • Expertise with Talend Data Integration frequently used components tOracleInput, tMysqlnput, tMap, tConvertType, tFlowMeter, tLogCatcher, tRowGenerator, tContextLoad, tXmlmap, tjava, tJavaRow, tHashInput & tHashOutput, tDie and more.
  • Published events to kafka from Talend and consumed events from Kafka.
  • Published events in the form of AVRO records to Kafka.
  • Created XML’s using tXml map from multiple data sources.
  • Experience in using Talend Admin Console (TAC) in deploying, scheduling and Monitoring of the jobs.
  • Worked in Agile environment where we follow Continuous Integration using Bamboo and used GIT as version control to maintain code commits.
  • Excellent knowledge of studying the data dependencies using metadata of Data Stage and preparing job sequences for the existing jobs to facilitate scheduling of multiple jobs.
  • Experience in designing and developing complex Talend/Data Stage jobs, routines.
  • Extensively used ETL methodology for performing Data Profiling, Data Migration, Extraction, Transformation and loading using Talend/SSIS and designed data conversions from wide variety of source systems.
  • Responsible for installation, configuration and maintenance of MS SQL Server on various environments
  • Working in Agile environment and using Atlassian tool set including JIRA, Confluence, Bit Bucket and Bamboo for Continuous Integration.
  • Implemented Error Logging, Error Recovery, and Performance Enhancement's & created Audit Process (generic) for various Application teams.
  • Worked on UNIX shell scripts using Kshell for the Scheduling sessions, automation of processes, pre - and post-session scripts.
  • Experience in working with parallel extender for splitting bulk data into subsets to distribute the data to all available processors to achieve best job performance.
  • Written stored procedures to insert and clean data into the data warehouse tables, fired triggers upon completion of load to obtain the log of all the tables loaded with job name and load date.
  • Ability to solve complex technical problems and have unique ability to understand long-term project development issues at all levels and interpersonal skills with powerful desire to achieve specified goals within the given time frame.
  • Strong interpersonal, written and verbal communication skills. Highly organized professional with strong technical skills.

TECHNICAL SKILLS:

Languages: JAVA, SQL, PL/SQL, UNIX Shell Programming

ETL Tools: Talend Data Management Platform v 6.3, 6.1 and 5.6 and Open Studio, Apache Avro, Apache Kafka 1.1.0

Databases: Oracle 10g/11g, SQL SERVER 6.5/7.0, MYSQL.

Operating Systems: Windows, Linux, Unix

Scheduling Tools: Job conductor (Talend), Autosys, ESP scheduler

Other Tools: Jira, confluence, GIT and Bamboo for CI

PROFESSIONAL EXPERIENCE:

Confidential, Wilmington, DE

Talend Developer/Admin

Responsibilities:
  • Worked in Data Migration project where we use Talend as ETL tool.
  • Developed and implemented Software Release Management strategies for various applications per the agile process.
  • Extensively worked on creating repositories in GIT and assigning roles to developers and creating same projects in TAC.
  • Creating Talend process which will load the extracted data to Kafka Topics in the form of AVRO data format.
  • Responsible for installation, configuration and maintenance of MS SQL Server on various environments.
  • Created custom components tKafkaPublisher and tKafkaConsumer and tWriteAvroRecord and tExtractAvrofields.
  • Developing Talend jobs to consume the data from Kafka Topic and update linkages to connect legacy eco system with newly developed system.
  • Creating shell scripts to execute the jobs in Unix server using automatic scheduler and capturing logs.
  • Maintaining Talend code In repository, publishing artifacts to artifact repository, deploying to Unix servers and making sure configuration file up to date.
  • Used tXmlMap to create xml’s based on XSD and also created nested loop xml’s using tAdvancedXml component as part of development.
  • Used Log4j framework for error logging and used Kibana to display and view.
  • Worked on MetaServlet API and load balancing using TAC and configured virtual servers.
  • Deployed, scheduled and Monitored Talend batch jobs using TAC.
  • Tracked backlogs and fixed bugs using JIRA.
  • Involved in Data Extraction for various Databases & Files using Talend.
  • Extensively used components like tWaitForFile, tIterate, tFlow, tFlowToIterate, tHashoutput, tHashInput, tMap, tRunjob, tJava, tNormalize and tfile components to create Talend jobs.
  • Developed Talend ESB services and deployed them on ESB servers in different scenarios.
  • Transformed data using txmlmap and used routes to publish the data into web services using Talend ESB.
  • Build ESB routines to read data from web services.
  • Created Talend jobs to copy the files from one server to another and utilized Talend FTP components.
  • Experience in creating Joblets in TALEND for the processes which can be used in most of the jobs in a project like to Start job and Commit job.
  • Implemented Talend to extract data from XML & flat files and load data into SQL Server/Oracle Database for downstream process.
  • Worked Extensively on Talend Admin Console & Schedule Jobs in Job Conductors, this option is not available in Talend Open Studio Data Integration.
  • Written shell scripts for scheduling the jobs, moving files between different servers, file modifications or used as additional procedures along with Talend jobs.
  • Worked in Talend Administration Centre (TAC) for scheduling the Jobs using Job Conductor, Execution Plan and Triggers.
  • Incorporated error handling in project level to validate data integrity and completeness in database.
  • Used to be on call if the Project is deployed to further Phases.

Environment: Talend Enterprise Platform for Data management (V6.3.1, 6.1.1), UNIX, JIRA, Oracle, Kafka 1.1.0, WINDOWS XP.

Confidential, Texas

Talend Developer

Responsibilities:
  • Closely worked with Business Analysts to gather requirement's and worked with Data Architects to design Tables (TAC Tables, AMC Tables).
  • Used tStatsCatcher, tDie, tLogRow to create a generic joblet to store processing stats and responsible for Pre and Post migration planning for optimizing Data load performance, capacity planning and user support.
  • Hands of Experience on many components which are there in the palette to design Jobs & used Context Variables/Groups to Parameterize Talend Jobs.
  • In parallel to Development acted as a Talend Admin: Creating Projects/ Scheduling Jobs / Migration to Higher Environments & Version Upgrades.
  • Implemented Error Logging, Error Recovery, and Performance Enhancement's & created Audit Process (generic) for various Application teams.
  • Used Talend reusable components like routines, context variable and global Map variables.
  • Analyzing the source data to know the quality of data by using Talend Data Quality.
  • Involved in implementing common Talend framework process for all the jobs in projects.
  • Extensively worked on Talend Coding and Unit testing activities.
  • Created UNIX scripts to automate the process for long running jobs and failure jobs status reporting.
  • Experienced in versioning, importing and exporting Talend jobs. Set up Triggers for Talend jobs in Job conductor.
  • Maintained and upgraded Jira issue tracker, Crucible code review tool.
  • Schedule Jobs using Autosys (Scheduling), Hermes (Deployment) as we are using Open Studio.
  • Implemented Talend POC to extract data from Salesforce API as an XML Object & .csv files and load data into SQL Server Database.
  • Used Talend Admin Console Job conductor to schedule ETL Jobs on daily, weekly, monthly and yearly basis (Cron Trigger).
  • Developed Talend jobs to push data into Talend MDM and extract data from MDM.
  • Written hive queries for data analysis and to process for data visualization.
  • Developed Map Reduce jobs using hive and pig for analyzing the data.
  • Assisted in migrating the existing data center into AWS environment.
  • Track and report Scrum team velocity.
  • Introduced effective ways of communication and stream-lined use of JIRA Confluence and to maximize productivity and bring discipline between Dev-QA communication gaps.
  • Created Projects in TAC and Assign appropriate roles to Developers and integrated SVN (Subversion).
  • Used to be on call if the Project is deployed to further Phases.

Environment: Talend Open Studio Data Integration (5.6.1/5.6.2 ), UNIX, Oracle, Microsoft SQL Server management Studio, WINDOWS XP.

Confidential

SQL Developer

Responsibilities:
  • Analyzed reports and fixed bugs in stored procedures using SSRS.
  • Used complex expressions to group data, filter and parameterize reports.
  • Used report builder to create reports from given data source.
  • Created linked reports and managed snapshots using SSRS.
  • Provided Production support to analyze and fix the problems and errors on daily basis by modifying SSIS Packages and Stored Procedure if necessary.
  • Conducted performance tuning of complex SQL queries and stored procedures by using SQL Profiler and index tuning wizard.
  • Generated Complex SSRS reports like reports using Cascading parameters, Snapshot reports Drill-down Reports, Drill-Through Reports, Parameterized Reports and Report Models and ad hoc reports using SSRS based on Business Requirement Document.
  • Designed and developed Tables, Stored procedures, Triggers and SQL scripts using TSQL, Perl and Shell scripting for enhancements and maintenance of various database modules.

Environment: MS SQL Server 2005/2008, SSRS, SSIS, SSAS, T-SQL, Erwin, SQL Explorer.

We'd love your feedback!