SUMMARY:

• Over Twelve years of extensive IT experience in software Development, Implementation and Production Support including 4 years of expert technical knowledge in Big Data Technologies and Talend ETL - mainly in Talend Enterprise Big Data, Hadoop, Hive, Sqoop, Hue, Oozie, NiFi, Hbase, Flume, and Spark.
• Experienced in processing large sets of structured, semi-structured and unstructured data and supporting systems application architecture.
• Experience in Big Data components for Talend Enterprise Big Data.
• Experienced in creating tables, loading data to Hive partitions and creating buckets in Hive.
• Experienced with Compressed data, Mainframe files and XML files.
• Experienced in importing-exporting RDBMS data into HDFS usingSqoop.
• Experienced in building real time data streaming .
• Experienced in using Control-M, Oozie for work flow management to monitor Hadoop jobs.
• Experienced in application development using Java, RDBMS, and Linux shell scripting.
• Experienced in work with different file formats like ORC, Text, CSV, Json, avro, Xml and parquet files.
• Experienced on Apache Spark, Scala, Java and Hbase.

TECHNICAL SKILLS:

Hadoop Distribution: Cloudera, Horton works

Hadoop/BIG Data: HDFS, Hive, Hue, Sqoop, Oozie, Flume, Pig, Spark, Scala, HCatalog, NiFi, Kafka.

No SQL Databases: HBase, Cassandra

Database: SQL Server, DB2, Oracle, MySQL, Netezza and Teradata.

Reporting Tools: Tableau

Version Control: Git, SVN

Operation System: HP-UNIX, RedHat Linux and Windows 10/8.1/7

Methodologies: Agile and Waterfall

Scheduling tools: Oozie, ESP, CA7 and Autosys.

Languages: Scala, Core Java, SQL, Shell Scripting, Python.

Host: COBOL, JCL, VSAM, IMS, CICS, Flat Files, QMF, SPUFI, Endeavor, File-AID.

Others: Bit Bucket, Source tree, CI/CD Jenkin, Jira, Confluence, PuttyDB Visualizer, SSH, SVN, Toad for Hadoop, Win SCPEclipse, IntelliJ, Google Cloud, HTML 5, MS Office, Lotus notes.

WORK EXPERIENCE:

Talend ETL Developer

Confidential

Responsibilities:

• Requirements into Technical Requirements and prepared design documentation.
• Utilized Big Data components like tHDFSInput, tHDFSOutput, tHiveLoad, tHiveInput, tHiveConnection,
• Running Bigdata batch jobs on Spark
• Created many complex ETL jobs for data exchange from and to Database Server and various other
• Created Implicit, local and global Context variables in the job.
• Worked on various Talend components such as tMap, tFilterRow, tAggregateRow, tFileExist, tFileCopy,
• Developed stored procedure to automate the testing process to ease QA efforts and also reduced the
• Handled the production deployment activities, creation of the deployment guide for migration of the code
• Created ticketing in Jira and change requests in RFC.
• Converted the files one format to other format, CSV to JSON, CSV to AVRO
• Expertise in creating mappings in TALEND using tMap, tJoin, tReplicate, tParallelize, tConvertType,,
• Running Bigdata batch jobs on Spark
• Joined the multiple data sources with tMap component.
• Extensively working on Hive tables, partitions and buckets for analyzing large volumes of data.
• Worked on Agile methodology.
• Handled multiple file formats ORC, XML, JSON, Paraquet and CSV using Spark.

Environment: - Talend Data Integration 6, Talend Enterprise Big Data Edition 6.1, Google Cloud, Horton works, Hive, HDFS, Sqoop, Control M, SQL Server, DB2, BigQuery, DBVisulizer, Hbase, Linux, WinSCP, Source Tree, Git, Jira, Spark, Scala, Python, Java.

Sr. Developer

Confidential

Responsibilities:

• Requirements into Technical Requirements and prepared low and high level documentation.
• Extensively working on Hive tables, partitions and buckets for analyzing large volumes of data.
• Utilized Big Data components like tHDFSInput, tHDFSOutput, tHiveLoad, tHiveInput, tHiveConnection,
• Prepared Bigdata batch jobs on Spark
• Created many complex ETL jobs for data exchange from and to Database Server and various other
• Created Implicit, local and global Context variables in the job.
• Worked on various Talend components such as tMap, tFilterRow, tAggregateRow, tFileExist, tFileCopy,
• Expertise in creating mappings in TALEND using tMap, tJoin, tReplicate, tParallelize, tConvertType,,
• Created Hive tables and loading data from SQL Server, Oracle and other sources.
• Joined the multiple data sources with tMap component.
• Worked on Agile methodology.
• Handled multiple file formats ORC, XML, JSON, Paraquet and CSV using Spark.
• Implemented the code deployment through CI/CD Jenkins
• Data loaded from Hive raw table to Data Lake; Data Vault and Business Vault/ Information Mart tables.
• Created tables and loaded data into the Hub, Link, Satellite, Point in timetable and Bridge tables
• Hands on extracting data from different databases and to copy into HDFS file system using Sqoop.
• Given production support and warranty for developed applications and code walkthrough.
• Created HIVE queries as per business requirements.
• Created ticketing in Jira and change requests in RFC.
• Communicate deliverable's status to user/stakeholders, client and drive periodic review meetings.

Environment: - Talend Data Integration 5.5.1, Talend Enterprise Big Data Edition 5x, Horton works, Hive, HDFS, Google cloud, BigQuery, Sqoop, Oozie, SQL Server, MySQL, DB2, DBVisulizer, Hbase, Linux, WinSCP, Putty, Source Tree, BitBucket, CI/CD Jenkins, Confluence, NiFi, Jira, MapReduce, Spark, Scala, Python, Java.

Sr. Programmer Analyst

Confidential

Responsibilities:

• Requirements into Technical Requirements and prepared low and high level documentation.
• Utilized Big Data components like tHDFSInput, tHDFSOutput, tHiveLoad, tHiveInput, tHiveConnection,
• Running Bigdata batch jobs on Spark
• Created Hive tables, partitions and buckets for analyzing large volumes of data.
• Created many complex ETL jobs for data exchange from and to Database Server and various other
• Loaded data from LINUX file system to HDFS.
• Written Spark SQL to process all the log files with rules defined in Spark SQL
• Worked on various Talend components such as tMap, tFilterRow, tAggregateRow, tFileExist, tFileCopy,
• Developed Scala script to use Spark's Data Frame, RDD with hiveContext and Sqlcontext as part of
• Created Oozie coordinated workflow to execute Sqoop incremental job daily.
• Created HIVE queries as per business requirements.

Environment: - Talend Enterprise Big Data Edition 5x, Hortonworks, HDFS, Hive, Sqoop, Oozie, Netezza, SQL Server, Hbase, HQL, Oracle, Linux, Putty, Spark, Python, Java 1.8, Pig, UNIX scripts, GCP, Tableau and DB2.

Sr. Developer

Confidential

Responsibilities:

• Imported the data from the DB2 to Hive and HDFS using SQOOP for One time and daily solution
• Created Hive manage and external tables, worked with Partitioning, bucketing and other optimizations.
• Loaded data from LINUX file system to HDFS.
• Worked on Big Data Hadoop environment on multiple Nodes.
• Worked on integrating HIVE for Online transaction processing support.
• Written Sqoop incremental import job to move new / updated info from Database to HDFS.
• Prepared test data for System Testing, Regression Testing.
• Supporting the production team in case of any critical issues.

Environment: - Cloudera, Linux, HDFS, Hive, Hue, HCatalog, Sqoop, Oozie, Hbase, Putty, Flume, Zookeeper, Java, Unix scripts, Oracle.

Confidential

Responsibilities:

• Loaded data from LINUX file system to HDFS.
• Hands on extracting data from different databases and to copy into HDFS file system using Sqoop.
• Export the data from Sqoop to HDFS.
• Created Oozie coordinated workflow to execute Sqoop incremental job daily.
• Created Hive manage and external tables, worked with Partitioning, bucketing and other optimizations.
• Exported the data from HDFS to MySQL and DB2.
• Defined file system layout and data set permissions.
• Good experience with Hadoop Ecosystem components such as Hive, HBase, Sqoop, Oozie.

Environment: - Hadoop, Cloudera, HDFS, Hue, Oozie, Hive, Teradata, Sqoop, Unix scripts, Yarn, Java (jdk1.6), MySQL, DB2.

System Specialist - Development

Confidential

Responsibilities:

• Worked in the project at various stages of SDLC -- requirements analysis, Design, Coding, Implementation, Unit testing, Integration testing, & post-implementation support
• Responsible for assigning work to Team members and tracking the status to meet the time lines.
• Created Design documents based on Business Requirement Document
• Efforts estimation based upon the requirement analysis
• Identified the impacted Modules in the system in phase wise as per the requirements
• Developed and provided support to Batch and CICS online screens
• Coded more than 100 New Programs and modified the existed modules.
• Investigated and resolved high priority tickets(Production and Post-Production issues) which impacts Revenue out of balances and online screen's
• Used SORT techniques for desired outputs .
• Created and ran successfully End of Day/ End of Month test cycles using Rexx/Clist tool
• Development and maintenances of CICS and APS Online screens
• Participated in test data and test case preparation, unit testing and test results documentation
• Extensively Involved in Unit testing, Integration Testing, System testing and Regression testing.
• Involved in Peer-Review and responsible for reviews, Coding and Test cases.
• Provided knowledge transfer to New comers in projects.
• Guided team members in preparing the Design, Develop, Test and deploy Projects.
• Developed using Java and the Spring framework for migration project.

Environment: COBOL, JCL, DB2, Teradata, VSAM, IMS DB, CICS, Java, Focus, Syncsort, APS Online, Rexx, Endeavor, Insync, Xpediter, Unix, SDSF, File-Aid, QMF, Spufi, NDM, MFT, FTP.

Analyst - System Development

Confidential

Responsibilities:

• Involved in designing and developing enhancements per business requirements.
• Developed JavaScript for the client side validations using JavaScript.
• Designed data structure of the East Billing application.
• Developed Exception Handling Framework
• Developed JSP pages for the presentation.
• Developed JavaScript for the client side validations using JavaScript.
• Created custom composite widgets to make it reusable across the application.
• Developed user interface and custom renderers using JSP, HTML and JavaScript
• Troubleshoot critical QAT and production defects.

Environment: Java, JSP, Servlets, Struts, JDBC, MySQL, WebLogic, HTML4, SVN.

Analyst Programmer

Confidential

Responsibilities:

• Coded New Programs and involved in code review
• Identified the impacted Modules in the system in phase wise as per the requirements
• Maintained and enhancing the existing Modules
• Developed JSP pages for the presentation.
• Developed JavaScript for the client side validations using JavaScript.
• Developed using Java and the Spring framework
• Implemented Customer module using JSPs and Servlets.
• Designed search module using JSP and HTML
• Created Unit test cases end-to-end.

Environment: Java, JSP, Servlets, Struts, JDBC, Oracle, Tomcat, HTML4, CVS.