We provide IT Staff Augmentation Services!

Sr. Etl Talend Consultant Resume

Malvern, PA

PROFESSIONAL SUMMARY:

  • 7+ years of IT experience in Analysis, Design, Development, Testing and Implementation of Business Application systems.
  • Extensive experience in ETL methodology for performing Data Profiling, Data Migration, Extraction, Transformation and Loading using Talend and designed data conversions from wide variety of source systems including Oracle, DB2, SQL server, Teradata, Hive, Hana, and flat files, XML and Mainframe files and Active MQ.
  • Experiences on developing & leading the end to end implementation of Big Data projects by using Talend BIGDATA, comprehensive experience as a in Hadoop Ecosystem like Map Reduce, Hadoop Distributed File System (HDFS), Hive.
  • Good hands - on with creating different visualizations using Bars, Lines and Pies, Maps, Scatter plots, Gantts, Bubbles, Histograms, Bullets, Heat maps and Highlight tables.
  • Good Experiences on relational database management systems, experience in integrating data from various data source like Oracle, MSSQL Server, MySQL and Flat files.
  • Hands on experience on Hadoop technology stack (HDFS, Map-Reduce, Hive, HBase, Pig, Sqoop, Oozie, Flume and Spark).
  • Extensively worked on ETL Informatica transformations effectively including - Source Qualifier, Connected - Unconnected Lookup, Filter, Expression, Router, Union, Normalizer, Joiner, Update, Rank, Aggregator, Stored Procedure, Sorter and Sequence Generator and created complex mappings.
  • Experience with NOSQL databases like HBASE and Cassandra
  • Excellent knowledge in deployment process from DEV to QA, UAT and PROD with both Deployment group and Import/Exports method.
  • Ample working experience in Waterfall, Agile methodologies.
  • Familiar with design and implementation of the Data Warehouse life cycle and excellent knowledge on entity-relationship/multidimensional modeling (star schema, snowflake schema).
  • Debugging ETL jobs errors, ETL Sanity and production Deployment in TAC-Talend Administrator Console using SVN.
  • Experience in Trouble shooting and implementing Performance tuning at various levels such as Source, Target, Mapping Session and System in ETL Process.
  • Experience in converting the Store Procedures logic into ETL requirements
  • Good communication and interpersonal skills, ability to learn quickly, with good analytical reasoning and adaptive to new and challenging technological environment.
  • Experienced in ETL methodology for performing Data Migration, Data Profiling, Extraction, Transformation and Loading using Talend and designed data conversions from large variety of source systems including Oracle … DB2, SQL server, Teradata, Hive, Hana and non-relational sources like flat files, XML and Mainframe files.
  • Experiences on Designed tables, indexes and constraints using TOAD and loaded data into the database using SQL*Loader.
  • Involved in code migrations from Dev. to QA and production and providing operational instructions for deployments.
  • Strong Experiences on Data Warehousing ETL experience of using Informatica 9.x/8.x/7.x Power Center Client tools - Mapping Designer, Repository manager, Workflow Manager/Monitor and Server tools - Informatica Server, Repository Server manager.
  • Experience in SQL Plus and TOAD as an interface to databases, to analyze, view and alter data.
  • Formulated and documented requirements for data, logical processes and operating systems.
  • Expertise in Data Warehouse/Data mart, ODS, OLTP and OLAP implementations teamed with project scope, Analysis, requirements gathering, data modeling, Effort Estimation, ETL Design, development, System testing, Implementation and production support.
  • Hands on experience in Pentaho Business Intelligence Server Studio.
  • Extensive experience on Pentaho report designer, Pentaho kettle, Pentaho BI server, BIRT report designer
  • Experienced on designing ETL process using Informatica Tool to load from Sources to Targets through data Transformations.
  • Hands on experience in developing and monitoring SSIS/SSRS Packages and outstanding knowledge of high availability SQL Server solutions, including replication.
  • Hands on experience in Deployment of DTS and SSIS packages using ETL Tool.
  • Excellent experience on designing and developing of multi-layer Web Based information systems using Web Services including Java and JSP.
  • Extensive experience in developing Stored Procedures, Functions, Views and Triggers, Complex SQL queries using SQL Server, TSQL and Oracle PL/SQL.
  • Experienced in resolving on-going maintenance issues and bug fixes; monitoring Informatica sessions as well as performance tuning of mappings and sessions.
  • Worked on Advanced databases like Teradata, Redshift and RDBMS like SQL and Oracle.

TECHNICAL SKILLS:

Development Tools: Talend 6.2, Talend ESB 6.2, informatica, Eclipse, Putty, File Zilla, SQL Developer, Toad, Teradata SQL Assistant, Agnity Workbench for Netezza, Quality Center, Harvest, SQL Server Management Studio.

Programming Languages: Core Java, SQL, PL/SQL,C, C++

Operating Platforms: MS Windows 2010/2000/XP/NT, Mac OS, Unix and Linux.

Web Technologies: HTML, XML, CSS, XSD, JavaScript and JSON.

PROFESSIONAL EXPERIENCE:

Confidential, Malvern, PA

Sr. ETL Talend Consultant

Responsibilities:

  • Interpret business requirements from the business partners. Design and develop objects to facilitate information for data analysis.
  • Created complex mappings in Talend 6.2using tMap, tJoin, tReplicate, tParallelize, tFixedFlowInput, tAggregateRow, tFilterRow, tIterateToFlow, tFlowToIterate, tDie, tWarn, tLogCatcher, tHiveIput, tHiveOutputetc.
  • Write scripts as per the standards of BeeDoo framework.
  • Designed ETL process using Talend Tool to load from Sources to Targets through data Transformations.
  • Design and developed ETL process to load and extract data using BTEQ, MLOAD and Fast Export.
  • Experience in writing SQL*Loader scripts for preparing the test data in Development, TEST environment and while fixing production bugs.
  • Experience in understanding the Explain statements and optimization of queries
  • Handled importing of data from various data sources using Sqoop, performed transformations using Hive, MapReduce and loaded data into HDFS.
  • Excellent knowledge of NOSQL on Mongo and Cassandra DB.
  • Developed jobs in Talend Enterprise edition from stage to source, intermediate, conversion and target.
  • Developing UNIX shell scripts for automating and enhancing streamlining existing manual procedures.
  • Data migration from relational (Oracle. Teradata) databases or external data to HDFS using Sqoop and Flume & Spark.
  • Developed Talend ETL jobs to push the data into Talend MDM and develop the jobs to extract the data from MDM.
  • Developed Talend ESB services and deployed them on ESB servers on different instances.
  • Developed data validation rule in the Talend MDM to confirm the golden record.
  • Designed both Managed and External tables in Hive to optimize performance.
  • Experienced in creating Generic schemas and creating Context Groups and Variables to run jobs against different environments like Dev, Test and Prod.
  • Creating complex user provisioning for the company employees to run on daily basis.
  • Experienced in working with Tac (Talend administration Console).
  • Developed error logging module to capture both system errors and logical errors that contains Email notification and moving files to error directories.
  • Handled the Errors at Control and Data flow level in SSIS Packages.
  • Maintained stored definitions, transformation rules and targets definitions using Informatica repository Manager.
  • Used various transformations like Filter, Expression, Sequence Generator, Update Strategy, Joiner, Stored Procedure, and Union to develop robust mappings.
  • Developed mapping parameters and variables to support SQL override.
  • Developed Talend ESB services and deployed them on ESB servers on different instances.
  • Created mapplets & reusable transformations to use them in different mappings.
  • Developed mappings to load into staging tables and then to Dimensions and Facts.
  • Developed the Talend jobs and make sure to load the data into HIVE tables & HDFS files and develop the Talend jobs to integrate with Teradata system from HIVE tables
  • Worked on different tasks in Workflows like sessions, events raise, event wait, decision, e-mail, command, worklets, Assignment, Timer and scheduling of the workflow.
  • Unit testing, code reviewing, moving in UAT and PROD.
  • Designed the Talend ETL flow to load the data into hive tables and create the Talend jobs to load the data into Oracle and Hive tables.
  • Migrated the code into QA (Testing) and supported QA team and UAT (User).
  • Created detailed Unit Test Document with all possible Test cases/Scripts.
  • Working with high volume of data and tracking the performance analysis on Talend job runs and session.
  • Conducted code reviews developed by my team mates before moving the code into QA.
  • Experience in Batch scripting on windows, Windows 32-bit commands, Quoting, Escaping.
  • Used Talend reusable components like routines, context variable and global Map variables.
  • Provided support to develop the entire warehouse architecture and plan the ETL process.
  • Knowledge on Teradata Utility scripts like FastLoad, MultiLoad to load data from various source systems to Teradata.
  • Modified existing mappings for enhancements of new business requirements.
  • Worked on Migration projects to migrate data from data warehouses on Oracle/DB2 and migrated those to Netezza.
  • Prepared migration document to move the mappings from development to testing and then to production repositories.
  • Configured the hive tables to load the profitability system in Talend ETL Repository and create the Hadoop connection for HDFS cluster in Talend ETL repository
  • Works as a fully contributing team member, under broad guidance with independent planning & execution responsibilities.
  • Implemented Data Integration and migration process with Talend Big Data Integration Suite 6.5 as part of migration from SSIS to Talend, with destination database from SQL to AWS Redshift and new applications development in ETL.

Environment: Talend Big Data 6.2, Talend MDM, RedShift, Hive, Oracle 11G, AWS, XML files, Flat files, HL7 files, JSONTalend Administrator Console, IMS, Agile Methodology.

Confidential, Bloomington, IL

ETL Talend Developer

Responsibilities:

  • Understand Business requirements it terms data analysis. Design visual reports which best reflects ongoing business.
  • Create dashboards by extracting data from different sources.
  • Design and develop interactive dashboard and applied actions (filter, highlight and URL) to dashboard.
  • Created Talend Jobs to retrieve data from Legacy sources and to retrieve user data from the Flat files on monthly and weekly basis.
  • Experienced on writing Hive queries to load the data into HDFS.
  • Documented both High level and Low-level design documents, Involved in the ETL design and development of Data Model.
  • Written Hive Queries to fetch Data from HBase and transferred to HDFS through HIVE.
  • Used debugger and breakpoints to view transformations output and debug mappings
  • Hands-on development assisting users in creating and modifying worksheets and data visualization dashboards.
  • Develop the ETL mappings for XML, CSV, TXT sources and loading the data from these sources into relational tables with Talend ETL Developed Job lets for reusability and to improve performance.
  • Developed complex ETL mappings and worked on the transformations like Source qualifier, Joiner, Expression, Sorter, Aggregator, Sequence generator, Normalizer, Connected Lookup, Unconnected Lookup, Update Strategy and Stored Procedure transformation.
  • Created incremental refreshes for data sources on Tableau server
  • Worked on Talend RTX ETL tool, develop jobs and scheduled jobs in Talend integration suite.
  • Writing Netezza SQL queries to join or any modifications in the table
  • Used Talend reusable components like routines, context variable and global Map variables.
  • Responsible to tune ETL mappings, Workflows and underlying data model to optimize load and query Performance.
  • Processed Daily expenses through SSIS jobs by collecting data from Concur FTP servers.
  • Implementing fast and efficient data acquisition using Big Data processing techniques and tools.
  • Monitored and supported the Talend jobs scheduled through Talend Admin Center (TAC)
  • Developed Oracle PL/SQL, DDLs, and Stored Procedures and worked on performance and fine Tuning of SQL.

Environment: Talend 6.4, Netezza, Oracle 12c, IBM DB2, TOAD, Agility, BusinessObjects 4.1, MLOAD, SQL Server

2012, XML, SQL, Hive, Pig, SQL, PL/SQL, HP ALM, JIRA.

Confidential

SQL Developer

Responsibilities:

  • Created and managed schema objects such as Tables, Views, Indexes and referential integrity depending on user requirements.
  • Designed and developed Mapplets for faster development, standardization and reusability purposes.
  • Implemented Slowly Changing Dimension Type 1 and Type 2 for inserting and updating Target tables for maintaining the history.
  • Used Debugger to validate transformations by creating break points to analyze and monitor Data flow.
  • Tuned performance of Informatica Session by increasing block size, data cache size, sequence buffer length and Target based commit interval, and mappings by dropping and recreation of indexes.
  • Worked along with the QA Team and provided production support by monitoring the processes running daily.
  • Actively involved in the complete software development life cycle for a design of database for new Financial Accounting System.
  • Successfully implemented the physical design of the new designed database into MSSQL Server 2008/2005.
  • Used MS SQL Server 2008/2005 to design, implement and manage data warehouses OLAP cubes and reporting solutions to improve asset management, incident management, data center services, system events support and billing.
  • Involved in pre and post session migration planning for optimizing data load performance.
  • Utilized T-SQL daily in creating customs view for data and business analysis.
  • Utilized Dynamic T-SQL within functions, stored procedures, views, and tables.
  • Used the SQL Server Profiler tool to monitor the performance of SQL Server particularly to analyze the performance of the stored procedures.
  • Stored Procedures and Functions were optimized to handle major business crucial calculations.
  • Implementation of data collection and transformation between different heterogeneous sources such as flat file, Excel and SQL Server 2008/2005 using SSIS.
  • Migrated all DTS packages to SQL Server Integration Services (SSIS) and modified the package according to the advanced feature of SQL Server Integration Services.
  • Defined Check constraints, rules, indexes and views based on the business requirements.
  • Extensively used SQL Reporting Services and Report Builder Model to generate custom reports.
  • Designed and deployed Reports with Drop Down menu option and Linked reports
  • Developed drill down and drill through reports from multi-dimensional objects like star schema and snowflake schema using SSRS and performance point server.
  • Created subscriptions to provide a daily basis reports and managed and troubleshoot report server related issues.
  • Skills Used: MS SQL Server 2005/2008, SSIS, SSRS, Microsoft.NET, MS Office Access2003, Excel, Erwin.

Confidential

SQL Developer

Responsibilities:

  • Created and managed schema objects such as Tables, Views, Indexes and referential integrity depending on user requirements.
  • Actively involved in the complete software development life cycle for a design of database for new Financial Accounting System
  • Successfully implemented the physical design of the new designed database into MSSQL Server 2008/2005
  • Used MS SQL Server 2008/2005 to design, implement and manage data warehouses OLAP cubes and reporting solutions to improve asset management, incident management, data center services, system events support and billing.
  • Utilized T-SQL daily in creating customs view for data and business analysis.
  • Utilized Dynamic T-SQL within functions, stored procedures, views, and tables.
  • Used the SQL Server Profiler tool to monitor the performance of SQL Server particularly to analyze the performance of the stored procedures.
  • Stored Procedures and Functions were optimized to handle major business crucial calculations.
  • Implementation of data collection and transformation between different heterogeneous sources such as flat file, Excel and SQL Server 2008/2005 using SSIS.
  • Migrated all DTS packages to SQL Server Integration Services (SSIS) and modified the package according to the advanced feature of SQL Server Integration Services.
  • Defined Check constraints, rules, indexes and views based on the business requirements.
  • Extensively used SQL Reporting Services and Report Builder Model to generate custom reports.
  • Designed and deployed Reports with Drop Down menu option and Linked reports
  • Developed drill down and drill through reports from multi-dimensional objects like star schema and snowflake schema using SSRS and performance point server.
  • Created subscriptions to provide a daily basis reports and managed and troubleshoot report server related issues.

Environment: MS SQL Server 2005/2008, SSIS, SSRS, Microsoft.NET, MS Office Access2003, Excel, Erwin.

Hire Now