Etl Talend Developer Resume
SUMMARY:
- ETL Talend Developer 8+ years of experience as a Technical analyst, safety Developer and administrator.
- Extensive experience in Confidential Info Sphere D Confidential Stage - ETL integration with SAP bank analyzer functional module performing d Confidential extract, loading and transformation process for financial general ledger accounts d Confidential .
- Experience in designing and implementing D Confidential Warehouse applications mainly using ETL tool Talend D Confidential Fabric for Big d
- Well versed with XML technology and DOM and SAX parsers
- Experience in UNIX file/d Confidential set management to keep the load ready d Confidential for all financial transactional d Confidential .
- Experience on waterfall and Agile methodology project implementation.
- Involved in complete Software Delivery Life Cycle (SDLC) in large d Confidential warehouse environment for financial d Confidential system.
- Thorough knowledge in d Confidential warehousing, dimensional modeling, d Confidential integration, d Confidential virtualization, d Confidential synchronization, star schema, waterfall schema, ETL development & performance tuning, BI d Confidential analysis, SAP integrating, DFS & HDFS cluster segregation.
- Worked with senior Bio-statisticians and clinical d Confidential managers to provide ETL programs in analyzing the d Confidential, generating safety and efficacy loads, summary tables.
- Excellent oral and written communication skills. A quick learner with an eye for detail and excellent analytical and quantitative skills. Ability to work independently and adept at managing multiple competing tasks.
WORK EXPERIENCE:
ETL Talend Developer
Confidential - Plymouth Meeting, PA
Responsibilities:
- Architect, design, construct, test, tune, and deploy ETL infrastructure based on the Hadoop ecosystem based technologies.
- Work closely with administrators, architects, and application teams to insure applications are performing well and within agreed upon SLAs.
- Work closely with Management and D Confidential Scientist teams to achieve company business objectives.
- Collaborate with other technology teams and architects to define and develop solutions.
- Deploy ETL code that aligns with the ETL Confidential state architecture standards and development standards.
- Research and experiment with emerging ETL technologies and tools related to Big D Confidential .
- Contribute to the Big D Confidential open source ecosystem.
- Work with the team to establish and reinforce disciplined software development, processes, standards, and error recovery procedures are deployed; ensuring a high degree of d Confidential quality.
- Maintain, tune, and support the ETL platform on a day-to-day basis to insure high availability.
ETL Talend Developer
Confidential - Pittsburgh, PA
Responsibilities:
- Developed complex ETL jobs from various sources such as SQL server, Postgressql and other files and loaded into Confidential d Confidential bases using Talend ODS ETL tool.
- Created Talend jobs using the dynamic schema feature.
- Created the Talend jobs for Store Support Center, Coupons jobs and Promotions etc.
- Interact with business community and gathered requirements based on changing needs. Incorporated identified factors into Talend jobs to build the D Confidential Mart.
- Performance tuning - Using the tmap cache properties, Multi-threading and Parallelize components for better performance in case of huge source d Confidential . Tuning the SQL source queries to restrict unwanted d Confidential in ETL process.
- Involved in Preparing Detailed design and technical documents from the functional specifications.
- Prepared low level design documentation for implementing new d Confidential elements to EDW.
- Provided Knowledge Transfer to the end users and created extensive documentation on the design, development, implementation, daily loads and process flow of the mappings.
- Have used AWS components (Amazon Web Services) - Downloading and uploading d Confidential files (with ETL) to AWS system using S3 talend components.
- Used more components in Talend and Few to be mentioned: tMap, tFilterRow, tjava, toracle, txmlMap, tdelimited files, tlogrow, tlogback, components etc. in many of my Jobs Design
- Worked on Joblets (reusable code) & Java routines in Talend.
- Design, Develop and Test ETL processes in order to meet project requirements
- Created Projects in TAC and Assign appropriate roles to Developers and integrated SVN (Subversion)
- Used to be On call Support if the Project is deployed to further Phases
- Used Talend Admin Console Job conductor to schedule ETL Jobs on daily, weekly, monthly and yearly basis (Cron Trigger)
Environment: Talend Open studio V (5.6), UNIX, AWS-S3, Microsoft SQL Server management Studio, Postgres SQL,Netezza D Confidential base, Oracle D Confidential base, XML Processing.
ETL Talend Developer/Admin
Confidential
Responsibilities:
- Created Talend jobs to copy the files from one server to another and utilized Talend FTP components.
- Created and managed Source to Confidential mapping documents for all Facts and Dimension tables.
- Design, develop, validate and deploy the Talend ETL processes for the DWH team using HADOOP (PIG, HIVE) on Hadoop.
- Utilized Big D Confidential components like tHDFSInput, tHDFSOutput, tPigLoad, tPigFilterRow, tPigFilterColumn, tPigStoreResult, tHiveLoad, tHiveInput, tHbaseInput, tHbaseOutput, tSqoopImport and tSqoopExport.
- Extensively used tMap component which does lookup & Joiner Functions, tjava, tOracle, txml, tdelimtedfiles, tlogrow, tlogback components etc. in many of my Jobs Created and worked on over 100+components to use in my jobs.
- Developed multiple tracks (Modules) for the d Confidential migration between multiple different systems like MRA, TIPP to NRSC, LIM to JAS, EPM to MR, ONW to TIPP.
- Used ETL methodologies and best practices to create Talend ETL jobs. Followed and enhanced programming and naming standards.
- Involved in D Confidential Extraction from Flat files and XML files using Talend by using Java as Backend Language.
- Created and deployed physical objects including custom tables, custom views, stored procedures, and Indexes to SQL Server for Staging and D Confidential -Mart environment.
- Develop ETL mappings for various Sources (.TXT, .CSV, XML) and also load the d Confidential from these sources into relational tables with Talend Enterprise Edition.
- Design and Implemented ETL for d Confidential load from heterogeneous Sources to SQL Server and Oracle as Confidential d Confidential bases and for Fact and Slowly Changing Dimensions SCD-Type1 and SCD-Type2.
- Handled importing of d Confidential from various d Confidential sources, performed transformations using Hive, MapReduce, Spark and loaded d Confidential into HDFS.
- Experience in using DOM4J parsing and XML Bean to process, validate, parse and extract d Confidential from XML files.
- Implemented installation and configuration of multi-node cluster on cloud using AWS on EC2.
- Used Talend most used components (tMap, tDie, tConvertType, tFlowMeter, tLogCatcher, tRowGenerator, tSetGlobalVar, tHashInput & tHashOutput and many more)
- Copy d Confidential to AWS S3 for storage and use COPY command to transfer d Confidential to Redshift. Used Talend connectors integrated to Redshift.
- Developed jobs to expose HDFS files to Hive tables and Views depending up on the schema versions.
- Imported d Confidential from RDBMS (MySQL, Oracle) to HDFS and vice versa using Sqoop. (Big D Confidential ETL tool) for Business Intelligence, visualization and report generation.
- Worked on Talend Administration Console (TAC) for scheduling jobs and adding users.
- Worked on various Talend components such as tMap, tFilterRow, tAggregateRow, tFileExist, tFileCopy, tFileList, tDie etc.
- Automated SFTP process by exchanging SSH keys between UNIX servers. Worked Extensively on Talend Admin Console and Schedule Jobs in Job Conductor.
Environment: Talend D Confidential Integration 6.4.0, Talend Enterprise Big D Confidential Edition, TalendAdministrator Console, XML, Oracle 11g, Hive, HDFS, Sqoop, SQL Navigator, Toad, Control M, Putty, Winscp.
ETL Talend Developer
Confidential, AR
Responsibilities:
- Interacted with business team to understand business needs and to gather requirements.
- Designed Confidential tables as per the requirement from the reporting team and also designed Extraction, Transformation and Loading (ETL) using Talend.Worked on D Confidential Integration from different source systems.
- Created Technical Design Document from Source to stage and Stage to Confidential mapping. Worked with Talend Studio (Development area) & Admin Console (Admin area)
- Created Java Routines, Reusable transformations, Joblets using Talend as an ETL Tool.
- Created Complex Jobs and used transformations like tMap, tOracle (Components), tLogCatcher, tStatCatcher, tFlowmeterCatcher, File Delimited components and Error handling components (tWarn, tDie)
- Created many complex ETL jobs for d Confidential exchange from and to D Confidential base Server and various other systems including RDBMS, XML, CSV, and Flat file structures.
- Identified performance issues in existing sources, targets and Jobs by analyzing the d Confidential flow, evaluating transformations and tuned accordingly for better performance.
- Manage all technical aspects of the ETL Jobs process with other team members.
- Developed mappings to load Fact and Dimension tables, SCD Type 1 and SCD Type 2 dimensions and Incremental loading.
- Created contexts to use the values throughout the process to pass from parent child to child jobs and child to parent jobs.Worked on Joblets (reusable code) & Java routines in Talend.
- Expertise in Service Oriented Architecture (SOA) and Involved in publishing Web Services that include components like WSDL, SOAP, UDDI.
- Performed Unit testing and created Unix Shell Scripts and provided on call support. Schedule Talend Jobs using Job Conductor (Scheduling Tool in Talend) - available in TAC.
- Used XML for ORM mapping relations with the java classes and the d Confidential base.
- Retrieved d Confidential from Oracle and loaded into SQL Server d Confidential Warehouse.
- Created many complex ETL jobs for d Confidential exchange and to D Confidential base Server and various other systems including RDBMS, XML, CSV, and Flat file structure.
- Monitoring the D Confidential Quality, generating weekly/monthly/yearly statistics reports on production processes - success / failure rates for causal analysis as maintenance part and Enhancing existing production ETL process.
Environment: Talend Platform 6.2, Big D Confidential, UNIX, Oracle, XML, Oracle, TAC.
ETL Talend Developer
Confidential
Responsibilities:
- Worked closely with Business Analysts to review the business specifications of the project and also to gather the ETL requirements.
- Created Talend jobs to copy the files from one server to another and utilized Talend FTP components.
- Created and managed Source to Confidential mapping documents for all Facts and Dimension tables
- Analyzing the source d Confidential to know the quality of d Confidential by using Talend D Confidential Quality.
- Involved in writing SQL Queries and used Joins to access d Confidential from Oracle, and MySQL.
- Prepared ETL mapping Documents for every mapping and D Confidential Migration document for smooth transfer of project from development to testing environment and then to production environment.
- Design and Implemented ETL for d Confidential load from heterogeneous Sources to SQL Server and Oracle as Confidential d Confidential bases and for Fact and Slowly Changing Dimensions SCD-Type1 and SCD-Type2.
- Utilized Big D Confidential components like tHDFSInput, tHDFSOutput, tPigLoad, tPigFilterRow, tPigFilterColumn, tPigStoreResult, tHiveLoad, tHiveInput, tHbaseInput, tHbaseOutput, tSqoopImport and tSqoopExport.
- Used Talend most used components (tMap, tDie, tConvertType, tFlowMeter, tLogCatcher, tRowGenerator, tSetGlobalVar, tHashInput & tHashOutput and many more)
- Created many complex ETL jobs for d Confidential exchange from and to D Confidential base Server and various other systems including RDBMS, XML, CSV, and Flat file structures.
- Experienced in using debug mode of talend to debug a job to fix errors.
- Responsible for developing, support and maintenance for the ETL (Extract, Transform and Load) processes using Talend Integration Suite.
- Conducted JAD sessions with business users and SME's for better understanding of the reporting requirements.
- Developed Talend jobs to populate the claims d Confidential to d Confidential warehouse - star schema.
- Used Talend Admin Console Job conductor to schedule ETL Jobs on daily, weekly, monthly and yearly basis.
- Worked on various Talend components such as tMap, tFilterRow, tAggregateRow, tFileExist, tFileCopy, tFileList, tDie etc.
- Worked Extensively on Talend Admin Console and Schedule Jobs in Job Conductor.
Environment: Talend D Confidential Integration 5.5.1, Talend Enterprise Big D Confidential Edition 5.1, XML, Talend Administrator Console, MS SQL Server 2012/2008, Oracle 11g, Hive, HDFS, Sqoop, TOAD, UNIX.
Software Engineer - Production Support
Confidential
Responsibilities:
- Interacted with D Confidential Modellers and Business Analysts to understand the requirements and the impact of the ETL on the business.
- Designed ETL specification documents for all the projects. Created Tables, Keys (Unique and Primary) and Indexes in the DB2 server.
- Extracted d Confidential from Flat files, DB2, SQL and Oracle to build an Operation D Confidential Source. Applied business logic to load the d Confidential into Global D Confidential Warehouse.
- Extensively worked on Facts and Slowly Changing Dimension (SCD) tables.
- Extensively used the Add Currently Processed Flat File Name port to load the flat file name and to load contract number coming from flat file name into Confidential .
- Worked on complex Source Qualifier queries, Pre-and Post SQL queries in the Confidential .
- Extensively used workflow variables, mapping parameters and mapping variables.
- Created sessions, batches for incremental load into staging tables and scheduled them to run daily.
- Prepared migration document to move the mappings from development to testing and then to production repositories.
Environment: Informatica Power Center 8.6.1/9.1.0, Oracle 11g, SQLServer2008, Confidential (DB2), MS Access, Windows XP, Toad, Tidal, SQL developer.