Hadoop/talend Developer Resume
5.00/5 (Submit Your Rating)
Baltimore, MD
SUMMARY
- Senior Applications Developer with 7 years of expertise in the field of Big data technologies, Core java and Relational databases.
- Extensive experience on Talend data fabric on Big data and data integration.
- Good knowledge on Talend DQ & Data profiling.
- Expertise in understanding the agile business methodology and process.
- Hands on experience on Hadoop technology stack (HDFS, Map - Reduce, Hive, HBase, Pig, Cassandra, Flume, Kafka and Spark)
- Created Talend custom components for the various use cases and worked on XML components, Data quality, Processing and Log & Error components.
- Specialized in doing No SQL & Data-ware housing performance tuning and optimization.
- Worked on Talend metadata manager, analyzed and implemented different use cases for handling various types of metadata.
- Good knowledge on Jenkins deployment tool, worked on setting up the Jenkins through Nexus for all the environments.
- Extensively worked on HiveQL, join operations, writing custom UDF's and having good experience in optimizing Hive Queries.
- Extensively worked on Kibana and Elastic Search.
- Worked on Talend Administration Center (TAC), for job deployment and job scheduling.
- Actively participated in review meetings with Talend SME's on Talend performance tuning.
- Wide exposure in using MySQL, PL/SQL and MS SQL server, created triggers, stored procedures.
- Managed a team of 15 with onshore & offshore; worked collaboratively in building the Big data-Data lake.
- Hands on experience in NOSQL databases like HBase, Cassandra and MongoDB.
- Experience in XML related technologies such as XML, DTD, XSD, XSLT, DOM and SAX.
- Involved in developing BDR strategies (Backup and Disaster Recovery) and developed few use cases that assured functionality in HBase.
- Expertise in importing and exporting data into HDFS and HIVE Sqoop.
- Worked on various verticals (Health, Insurance and Digital marketing).
- Experienced in managing and reviewing Hadoop log files.
- Part of social coding and attended various meet-up and technology conferences.
- Active participation on Cloud-Era community blog and Git Hub.
TECHNICAL SKILLS
Development Tools: Eclipse, Putty, File ZillaSQL Developer, ToadTeradata SQL AssistantAgnity Workbench for NetezzaQuality Center, HarvestSQL Server Management Studio.
Programming Languages: C, C++, XQuery and Core Java, SQL, PL/SQL
Web Technologies: HTML, XML, CSS, XSD, JavaScript and JSON.
Operating Platforms: MS Windows 2010/2000/XP/NTMac OS, Unix and Linux
PROFESSIONAL EXPERIENCE
Confidential, Baltimore, MD
Hadoop/Talend Developer
Responsibilities:
- Experienced in writing complex JAVA code using tJava, tJavarow, tJavaFlex and handled Heap Space Issues and memory related issues in Talend.
- Created complex mappings in Talend 6.0.1/5.5 using tMap, tDie, tJoin, tReplicate, tFilterRow, tParallelize, tFixedFlowInput, tAggregateRow, tIterateToFlow, tFlowToIterate, etc.
- To populate the data into dimensions and fact tables, efficiently involved in creating Talend Mappings.
- Created joblets in Talend for the processes which can be used in most of the jobs in a project like to Start job and Commit job.
- Developed jobs to move inbound files to vendor server location based on monthly, weekly and daily frequency.
- Proficient in creating Generic schemas, Context Groups and also context Variables to run jobs against different environments like Dev, Test and Prod.
- Efficiently involved in converting JSON files to XML, and CSV files and also maintained Audit log files and that stats in Talend open studio.
- Involved in loading the Batch files and capturing the error log files from Mongo Database and pushed email notifications.
- Schedule theTalendjobs withTalendAdminConsole, setting up best practices and migration strategy.
- Experienced in Talend Data Integration, Talend Platform Setup on Windows and Unix systems.
- Created contexts to use the values throughout the process to pass from parent to child jobs and child to parent jobs.
- UsedTalendAdminConsole Job conductor to schedule ETL Jobs on daily, weekly, monthly and yearly basis.
- Responsible for developing, support and maintenance for the ETL (Extract, Transform and Load) processes using Talend Integration Suite.
- Involved in migrating objects from DEV to QA and then promoting to Production.
- Developed error logging module to capture both system errors and logical errors that contains Email notification and also moving files to error directories.
- Attended Daily Scrum meetings to provide update on the progress of the user stories Rally and to the Scrum Masterand also to notify blockages and impediments if any.
Confidential, Rochester, MN
Hadoop/Talend Developer
Responsibilities:
- Implemented File Transfer Protocol operations using Talend Studio to transfer files in between network folders.
- Experienced in fixing errors by using debug mode of Talend.
- Created complex mappings using tHashOutput, tMap, tHashInput, tDenormalize, tUniqueRow. tPivotToColumnsDelimited, tNormalize etc.
- Schedule theTalendjobs withTalendAdminConsole, setting up best practices and migration strategy.
- Implemented indexing for logs to Elastic Search and analysis on integrating Kibana with Elastic Search
- Created Context Variables and Groups to run Talend jobs against different environments like Dev, Test and prod.
- Design and developed end-to-end ETL process from various source systems to Staging area, from staging to Data Marts.
- Experienced in creating a generic joblet by using tDie, tLogRow, tStatsCatcher to store processing stats into a Database table to the record job history.
- Experienced in integrating java code inside Talend studio by using tJavaRow, tJavaRow, tJavaFlex and Routines.
- Developed mappings to load Fact and Dimension tables, SCD Type 1 and SCD Type 2 dimensions and Incremental loading and unit tested the mappings.
- Experienced in writing SQL Queries and used Joins to access data from Oracle, and MySQL.
- Broad design, development and testing experience with Talend Integration Suite and knowledge in Performance Tuning of mappings.
- Developed jobs in Talend Enterprise edition from stage to source, intermediate, conversion and target.
- To run sub jobs in parallel, used tParalleize component and multi thread execution. These components are useful to increase job performance.
- Troubleshooting, debugging & altering Talendparticular issues, while maintaining the health and performance of the ETL environment.
Confidential, Bloomfield, CT
SQL Developer
Responsibilities:
- Design advanced SQL queries, stored procedures, triggers, scripts, cursors Create, maintain, modify, and optimize SQL Server databases.
- Perform ETL operations for Business Intelligence reporting solutions using custom VBA and Excel web queries.
- Developed reports using HTML. CSS, JSP and JFee chart.
- Developed JNI classes for Connect to Native languages.
- Involved in preparation of System Use Cases and Unit Test Speciation.
- Generated parameterized/Drilldown reports using SSRS 2008 and Crystal Reports.
- Developed prototype screens using HTML and JavaScript.
- Created Report Snapshots to improve the performance of SSRS.
- Manage Analysis management objects (AMO) using BIDS.
- Used DB Convert database migration tool for Access & MSSQL for data conversion from MS Access database (MDB file) to MS SQL Server.
- Build user interface using JSP and JavaScript.
- Used SOAP based web service to consume web service produced by IBM Content Manager.
- Developer of internal and external performance management dashboards enabling business intelligence reporting including benchmarking, metric identification, performance measurement, and target setting.
- Responsible for writing Stored Procedures in SQL 2000/2005.
- Played role in design of scalable, reusable, and low maintenance ETL templates.
- Used visual studio, SQL server for the analyzing and development of the online systems.
- Responsible for Data migration from SQL Server 2000 to SQL Server 2008 Databases.
- Build efficient SSIS packages for processing fact and dimension tables with complex transforms.
- Used agile methods to promote a disciplined project management process that encourages frequent inspection and adaptation.
Confidential
SQL Developer
Responsibilities:
- Responsible for installation, configuration and maintenance of MS SQL Server on various environments.
- Prepared some procedure to update the internal structures to reflect the newly loaded data.
- To process huge volume of data, used PL/SQL tables, Ref Cursors.
- Prepared the procedures to update the internal structures to reflect the newly loaded data.
- Transformed data from various data sources using OLEDB connection by creating various DTS packages.
- Experienced in creating database objects like tables, views, and sequences.
- Analyzed business requirements and coordinated with the business analyst to develop ETL procedures that confirm to the enterprise standards while maintaining consistency across all applications and systems.
- Developed stored procedures and T-SQL code to accomplish various tasks.
- Created the different user defined functions in the application.
- Prepared Business Requirement Specification which give details about requirements,
- Created various complex stored procedures for ETL as well as maintenance of the database.
- Experienced in developing and modifying scripts to create tables, views and executed them by using SQL plus.
- Expertise in using different functions like Date& Time, Conditional, Aggregation functions, Analytical functions.