We provide IT Staff Augmentation Services!

Sr Etl Talend Developer, Resume

2.00/5 (Submit Your Rating)

Atlanta, GA

SUMMARY

  • 8+ years of experience in Information Technology and 1.5 + years of experience in Talend Studio, Talend Big Data tools and related technologies.
  • Good Experience in Talend DI Administration, Talend Data Quality and Talend Data Mapping.
  • Experience in Talend Big Data Integration for business demands to work towards Hadoop and NoSQL databases.
  • Strong experience in the Analysis, design, development, testing and implementation of Business Intelligence solutions using Data Warehouse/Data Mart Design, ETL, OLAP, OLTP, BI, Client/Server applications.
  • Experience in scheduling jobs on Job Conductor and creating execution plans on Talend Admin Console (TAC).
  • Experience in Informatica, Amazon S3, EC2, SNS, SQS, Lamda and Redshift.
  • Used ETL methodologies and best practices to create Talend ETL jobs for Data Services with Big Data platform (Version: 6.5).
  • Writing heavy stored procedures, Audit triggers views, creating SQL scripts for data loads and Upgrades for data migrations and data validations
  • Well versed with Talend Big Data, Hadoop, Hive and used Talend Big data components like tHDFSInput, tHDFSOutput,tCacheln, tcacheout, tPigLoad, tPigFilterRow, tPigFilterColumn, tPigStoreResult, tHiveLoad, tHiveInput, tHbaseInput, tHbaseOutput, tSqoopImport and tSqoopExport.
  • Proficient in Performance Tuning/Query optimization using indexes
  • Tuning the performance of stored procedures and large T - SQL Queries using Clustered indexes, efficient coding standards
  • Developed jobs to send and read data from AWS S3 buckets using components like tS3Connection, tS3BucketExist, tS3Get, tS3Put.
  • Created complex mappings in Talend 5.2.2 using tMap, tJoin, tReplicate, tParallelize, tJava, tJavaFlex, tAggregateRow, tDie, tWarn, tLogCatcher, etc.
  • Knowlege in Talend Master Data Management tool.
  • Expertise in creating mappings in TALEND using tMap, tJoin, tReplicate, tParallelize, tConvertType, tflowtoIterate, tAggregate, tSortRow, tFlowMeter, tLogCatcher, tRowGenerator, tNormalize, tDenormalize, tSetGlobalVar, tHashInput, tHashOutput, tJava, tJavarow, tAggregateRow, tWarn, tLogCatcher, tMysqlScd, tFilter, tGlobalmap, tDie etc.
  • Highly experienced in whole cycle of DTS/SQL server integration services (SSIS 2005/2008) Packages (Developing, Deploying, Scheduling, Troubleshooting and monitoring) for performing Data transfers and ETL Purposes across different servers.
  • Experience in providing Logging, Error handling by using Event Handler, and Custom Logging for SSIS Packages.
  • Used output xml files, to remove empty delta files and to FTP the output xml files to different server.
  • Scheduling and Monitoring ETL Processes using DTS Exec utilities and batch files.
  • Experience with Talend DI Installation, Administration and development for data warehouse and application integration.
  • Expertise in generating reports using SQL Server Reporting Services, Crystal Reports, and MS Excel spreadsheets and Power Pivot.
  • Expert in designing Enterprise reports using SQL Server Reporting Services (SSRS 2000/2005/2008/2012) generated drill down reports, parameterized reports, linked reports, sub reports, matrix dynamics and filters, charts in SSRS 2005/2008/2012.
  • Experience in creating Ad-hoc reports, data driven subscription reports by using Report Builder in SSRS.
  • Good knowledge of Data Marts, Operational Data Store (ODS), OLAP, Dimensional Data Modeling, Star Schema Modeling, Snowflake Modeling for FACT and Dimensions Tables using Analysis Services.
  • Create ETL Mapping with Talend Integration Suite to pull data from Source, apply transformations, and load data into target database.
  • Developed mappings /Transformation/Joblets and designed ETL Jobs/Packages using Talend Integration Suite (TIS) in Talend5.2.2.

TECHNICAL SKILLS

  • ETL/BI Tools: Talend Data Integration/ Big Data Integration/ Data Quality /7.1/6.5/6.1/5.5/5.0, Talend Administrator Console, Talend Repository manger, Tableau.
  • Databases: Redshift, Salesforce, Oracle 11g/10g, DB2 9.x/8.x, Teradata, Netezza, SQL Server, Hive, HBase, MongoDB, RDBMS, MDM.
  • Programming Languages: Java, Python, Javascript, XML, PL/SQL, SQL, SOQL, Apache Spark SQL,Hive SQL, T-SQL, Unix/LINUX shell programming and scripting
  • Development Tools: Teradata SQL Assistant, SQL developer, SQL Server Management Studio, Toad, iSeries navigator, QMF for windows, SQL*Loader, Aginity Workbench
  • Operating Platforms: Windows 10/8/ 7/XP/2000, Unix, Linux, AIX, Mac OS
  • Other Tools: AutoSys, CA7 Job Scheduler, Maximo, Jira, Tivoli Ticketing System, Altona XML Spy, SQL *Plus, Putty
  • Cloud: Amazon Web Services (AWS), Microsoft Azure, Snowflake

PROFESSIONAL EXPERIENCE

Sr ETL Talend Developer,

Confidential, Atlanta, GA

Responsibilities:

  • Worked closely with Business Analysts to review the business specifications of the project and to gather the ETL requirements.
  • Used Talend most used components (tMap, tDie, tConvertType, tFlowMeter, tLogCatcher, tRowGenerator, tSetGlobalVar, tHashInput & tHashOutput and many more)
  • Created many complex ETL jobs for data exchange from and to Database Server and various other systems including RDBMS, XML, CSV, and Flat file structures.
  • Developed jobs in Talend Enterprise edition from stage to source, intermediate, conversion and target.
  • Developed jobs to send and read data from AWS S3 buckets using components like tS3Connection, tS3BucketExist, tS3Get, tS3Put.
  • Prepared ETL mapping Documents for every mapping and Data Migration document for smooth transfer of project from development to testing environment and then to production environment.
  • Developed Spark jobs in Python to perform big data analytics on ingested data in Amazon S3.
  • Solid experience in implementing complex business rules by creating re-usable transformations and robust mappings using Talend transformations like tConvertType, tSortRow, tReplace, tAggregateRow, tUnite etc.
  • Created Talend jobs to copy the files from one server to another and utilized Talend FTP components.
  • Created and managed Source to Target mapping documents for all Facts and Dimension tables
  • Analyzing the source data to know the quality of data by using Talend Data Quality.
  • Experience in writing Spark SQL scripts by using Python interpreter.
  • Involved in writing SQL Queries and used Joins to access Data from Oracle, and MySQL.
  • Assisted in migrating the existing data center into the AWS environment.
  • Involved in writing SQL Queries and used Joins to access data from Oracle, and MySQL.
  • Used tStatsCatcher, tDie, tLogRow to create a generic joblet to store processing stats.
  • Design and Implemented ETL for data load from heterogeneous Sources to SQL Server and Oracle as target databases and for Fact and Slowly Changing Dimensions SCD-Type1 and SCD-Type2.
  • Utilized Big Data components like tHDFSInput, tHDFSOutput, tPigLoad, tPigFilterRow, tPigFilterColumn, tPigStoreResult, tHiveLoad, tHiveInput, tHbaseInput, tHbaseOutput, tSqoopImport and tSqoopExport.
  • Experienced in using debug mode of Talend to debug a job to fix errors.
  • Responsible for developing, support and maintenance for the ETL (Extract, Transform and Load) processes using Talend Integration Suite.
  • Conducted JAD sessions with business users and SME's for better understanding of the reporting requirements.
  • Developed Talend jobs to populate the claims data to data warehouse - star schema.
  • Used Talend Admin Console Job conductor to schedule ETL Jobs on daily, weekly, monthly and yearly basis.
  • Worked on various Talend components such as tMap, tFilterRow, tAggregateRow, tFileExist, tFileCopy, tFileList, tDie etc.
  • Worked Extensively on Talend Admin Console and Schedule Jobs in Job Conductor.

Environment: Talend Enterprise Edition 7.3.1, Talend Administrator Console, MS SQL Server 2017/2012, Oracle 11g, Hive, HDFS, Sqoop, TOAD, UNIX Enterprise Platform for Data integration, Amazon S3, EC2, SNS, SQS, Python, Teradata, Netezza, Sybase, SSIS, UNIX, Data Management,

Talend BigData Developer,

Confidential, Reston, VA

Responsibilities:

  • Development of Talend ETL jobs for loading data to the new data mart from the existing Everest II data warehouse. Monitored and supported the Talend jobs scheduled through Talend Admin Center (TAC).
  • Developed the Talend mappings using various transformations, Sessions and Workflows. Teradata was the target database, Source database is a combination of Flat files, Oracle tables, Excel files and Teradata database.
  • Design and develop the auditing and logging at mart level.
  • Loaded data in to Teradata Target tables using Teradata utilities (FastLoad, MultiLoad, and FastExport) Queried the Target database using Teradata SQL and BTEQ for validation.
  • Created joblets and used Parameters and Variables to facilitate the reusability of code.
  • Used Talend to Extract, Transform and Load data into Netezza Data Warehouse from various sources like Oracle and flat files.
  • Develop pre-processing and post processing jobs to set the job dependency
  • Created connection to databases like SQL Server, oracle, Netezza and application connections.
  • Involved in Dimensional modeling (Star Schema) of the Data warehouse and used Erwin to design the business process, dimensions and measured facts.
  • Responsible for developing, support and maintenance for the ETL (Extract, Transform and Load) processes using Talend.
  • Applied SCD 2 logic in ETL jobs and creation of rollback strategy for datamart tables.
  • Used various transformations like Filter, Expression, Sequence Generator, Update Strategy, Joiner, Stored Procedure, and Union to develop robust mappings.
  • Developed mapping parameters and variables to support SQL override.
  • Developed Talend ESB services and deployed them on ESB servers on different instances.
  • Created mapplets & reusable transformations to use them in different mappings.
  • Developed mappings to load into staging tables and then to Dimensions and Facts.
  • Developed the Talend jobs and make sure to load the data into HIVE tables & HDFS files and develop the Talend jobs to integrate with Teradata system from HIVE tables
  • Worked on different tasks in Workflows like sessions, events raise, event wait, decision, e-mail, command, worklets, Assignment, Timer and scheduling of the workflow.
  • Unit testing, code reviewing, moving in UAT and PROD.
  • Creation and load of Supplementary tables which are not part of the core data model.
  • Creation of Tivoli jobs and preprod and prod deployment.
  • Involved in Fine-tuning of Talend jobs for initial and Supplementary load.

Environment: Talend Big DataStudio 6..5, Oracle 11i, XML files, Flat files, JSON, 2.4.1, HDFS, Map Reduce,

Sql Server BI (SSIS/SSRS,SSAS) Developer,

Confidential, Chicago, IL

Responsibilities:

  • Involved in analysis, design, development and enhancement of the application that applies business rules on the Revenue and Sales data on weekly basis.
  • Extensively used T-SQL in constructing Stored Procedures, Triggers, Cursors, Tables, User Defined Functions, Views and Indexes.
  • Conducted performance tuning of Stored Procedures.
  • Created Stored Procedures and SQL Queries using SQL Joins, Sub Queries and CTE’s.
  • Using all kinds of SQL Server Constraints (Primary Keys, Foreign Keys, Defaults, Check, Unique etc).
  • Normalized the database into small tables by applying rules of Normalization, defined Check Constraint and applied Business Rules.
  • Implemented Change Data Capture (CDC) on OLTP Databases to capture the history.
  • Created a High Level Data Flow Diagram for ETL of Data.
  • Created ETL packages using Heterogeneous data sources (SQL Server, ORACLE, Flat Files, Excel source files, XML files etc) and then loaded the data into destination tables by performing different kinds of transformations using SSIS.
  • Used SSIS to create ETL packages (.dtsx files) to validate, extract, transform and load data to data warehouse databases, data mart databases.
  • Extensively worked with SSIS tool suite, designed and created mappings using various SSIS transformations like OLEDB Command, Conditional Split, Lookup, Aggregator, Multicast and Derived Column.
  • Expertise in Using different Transformations like Lookups, Derived Column, Merge Join, Fuzzy Lookup, For Loop, For Each Loop, Conditional Split, Union all, Script component and etc.
  • Developed the packages with monitoring features and logging so that audit information of the packages and their execution results are loaded in to the audit table.
  • Automation of existing processes of SQL using Stored Procedures and SSIS packages.
  • Experienced with database programming using ADO.NET
  • Involved in extracting the data using SSIS from OLTP to Staging and Reporting Databases.
  • Created and scheduled SQL jobs to run SSIS packages on a daily basis using SQL Server Agent.
  • Made SSIS packages parameterized using XML Configuration files.
  • Configured SSIS packages using Package Configuration Wizard to allow packages run on different environments.
  • Implemented Error Handling and utilized Event Handlers (On Warning, On Pre and Post Execution, On Task Failed) for automated notifications using SSIS.
  • Implemented Type I, II changes in Slowly Changing Dimension (SCD) tables.
  • VB/ C# Script has been written for scripting the task in SSIS packages.
  • Installed and Managed SQL Server Reporting Services (SSRS) 2008 R2.
  • Generated multiple Enterprise reports (SSRS) from SQL Server Database (OLTP) and SQL Server Analysis Services Database (OLAP) and included various reporting features such as Group By, Drill Down, Drill Through, Sub-Reports and Link Reports.
  • Creating Tabular, Matrix reports, Charts and Graphs as per customer requirements using SSRS.
  • Created Standard and Data Driven Subscription’s for the SSRS reports based on user requirement to deliver the files to users.
  • Involved in Analyzing, designing, building & testing of OLAP cubes with SSAS.
  • Involved in Developing complex SSAS cubes with multiple fact measures groups, and multiple dimension hierarchies based on the OLAP reporting needs.
  • Worked on Dimensional Data Modeling using Star and Snow Flake schemas for Fact and Dimension tables.
  • Creating maintenance plan for performing optimizations and fine Tuning of Database Application.
  • Resolved deadlocks and blocking issues using Performance Monitor, SQL Server Profiler.
  • Experience in Managing Alerts, Notifications and Jobs through SQL Server Agent.

Environment: Microsoft SQL Server 2005/2008/R2, Business Intelligence Development Studio (BIDS), T-SQL, SQL Server Integration Services (SSIS), SQL Server Reporting Services (SSRS), SQL Server Analysis Services (SSAS), Team Foundation Server (TFS), Oracle 10g, Microsoft Visio.

SQL Server BI (SSIS,SSRS,SSAS) Developer,

Confidential, Iselin, NJ

Responsibilities:

  • Involved in installation and configuration of SQL server 2008.
  • Created SSIS Packages to load Data from Existing Data Model to new Data Model and Data Ware House
  • Involved in designing complex packages moving data from various servers and environments using SSIS which also involved data from XML, Flat Files, CSV Files and SQL Server Databases.
  • Performance tuning the SSIS Packages by understanding the Data Flow Buffers and by designing for parallelism.
  • Involved in loading Dimensions and Facts in newly built data ware house which also involved Type 1 and Type 2 Slowly changing dimensions using SSIS.
  • Deploying SSIS Packages on respective server and effectively using configuration files for using same packages on other environments.
  • Scheduling the SSIS packages by creating a Job using SQL Agent in SSMS which involves nightly maintenance.
  • Worked with various transformations like Lookup, Fuzz Lookup, Merge, Sort, Multicast, Conditional Split, Script Component, Loop Containers, Execute SQL Task and lot more using SSIS.
  • Designed dynamic reports on the newly developed ERM Model for financial data users using SSRS.
  • Involved in Performance tuning the SQL Server Queries used in SSRS Report and also used Report Snapshots for better performance.
  • Worked with SSRS module to request data from output tables, design of report templates, use of bar and pie charts, drill-down and drill-through reports, use of parameters, global variables and functions to generate final reports.
  • Created user groups in Report Manager for limited access to the end users in SSRS.
  • Developed Ad Hoc Report Model for specific users is SSRS.
  • In SSAS, created cubes on top of the data warehouse for reporting purpose and wrote MDX.
  • In SSAS, Roles were created on the cubes in such a way that only restricted users had access to the cubes.
  • Closely worked with Data Quality team and Data Architects to identify bugs in the new Data Models and automated the Data Quality process which involved lot of T-SQL programming like Functions, User Defined Functions, Stored Procedures and Views.

Environment: T-SQL, MS SQL Server 2008/2005, BIDS, Management Studio (SSMS), SSIS, SSRS, Analysis Services (SSAS), MDX, Cubes, XML DS, OLAP, Cubes, Data-warehousing, SQL Profiler, Windows 2003, SDLC, ProClarity, C#.

SQL Server BI Developer,

Confidential,

Responsibilities:

  • Created database objects like Tables, Indexes, Stored Procedure, Triggers, Functions, Constraints and Views.
  • Fine-tuned Stored Procedures to improve performance that was achieved by removing unnecessary Cursors and Temporary Tables.
  • Worked on Linked Servers to run distributed queries between SQL server and other data sources like excel using ODBC, OLE DB Drivers.
  • Responsible for Design and Normalization of the database tables.
  • Prepared Data Flow Diagrams, Entity Relationship Diagrams and Table Structure.
  • Created and Migrated DTS packages from SQL Server 2000 to SQL Server 2005 Integration Services (SSIS).
  • Gathered requirements for the creation of Data Flow processes for the SSIS packages.
  • Used various Control Flow Tasks in the development of various complicated packages.
  • Designed and developed SSIS Packages to extract data from various data sources such as Access database, Excel spreadsheet, and flat files into SQL server 2005 for further Data Analysis and Reporting by using multiple transformations provided by SSIS such as Data Conversion, Conditional Split, Bulk Insert, Merge and Union All.
  • Experience in Developing and Publishing Reports in SQL Server 2005 using SSRS (SQL Server Reporting Services).
  • Created various kinds of reports involving Drill Down, Drill through Report, Parameterized Reports and Ad-hoc Reports.
  • Designed the Sales and Manufacturing Summary reports in SSRS 2005 from the requirement document.
  • Generated and formatted Reports using Global Variables and Expressions for the reports. Designed and implemented stylish report layouts.
  • Identified and worked with Parameters for Parameterized Reports in SSRS 2005/2008.
  • Experienced in performance tuning using SQL profiler and Monitored SQL Server Error Logs and Application Logs.

Environment: SQL Server 2000/2005, T-SQL, Windows Server, Microsoft Visio, Performance Monitor, SQL Server Profiler, SQL Server Reporting Services (SSRS), SQL Server Integration Services (SSIS).

We'd love your feedback!