PROFESSIONAL SUMMARY:

• 9+ years of overall IT experience in Application Development in Hadoop, IBM Datastage, Java, Python, Tableau and Confidential
• Extensive experience of 3+ years in working with Hadoop tools like Confidential, Map Reduce, Apache Pig, Hive and Sqoop.
• Extensive experience of 1.0 year in working with Kafka, Scala and Spark.
• Extensive experience of 2+ years in working with Java, Python2.7
• Extensive experience of 6+ years in working on Analyse, Build, Test and Implementation of ETL functionality using IBM Data Stage8.5/8.7/9.1 .
• Extensive experience of 7+ years in working in Confidential
• Extensive experience of 2+ years in working with Tableau (9 and 9.1) Desktop, Tableau Server and Tableau Reader.
• Extensive experience of 1.0 year in working with Thoughspot reports
• Good understanding of business process and analysis in implementation of proper solution to meet the business need for making better decisions
• Extensive experience in Hadoop tools like Confidential, Map Reduce, Apache Pig, Hive, Sqoop, HBase, Kafka and Spark
• Extensive experience in Java, Python and Scala
• Extensive experience in ETL tools like Data Stage8.0/8.1/8.7 and Informatica
• Extensive experience in Oracle 9i and 10g, Confidential, SQL Server, Greenplum, HANA and Thoughtspot .
• Extensive experience in Tableau, MSTR and OBIEE report tools.
• Having experience in ETL Testing and Selenium testing.
• Extensive knowledge of Data Warehousing concepts.
• Having good Interpersonal skills & Leadership skills.
• Zeal to Learn and adapting new technologies.
• Good written and verbal skills.

TECHNICAL SKILLS:

Hadoop Tools: Confidential, Hive, PIG, SQOOP, HBase, SPARK and Kafka

Programming Tools: Java, Python, Scala

ETL Tools: IBM Data Stagev8.0.1/v8.5/v8.7/v9.1, Informatica

Databases: Confidential, Oracle, SQL Server, Greenplum, SAP Hana, Maria DB, ThoughtSpot

Reporting Tools: Tableau, OBIEE, Micro Strategy, ThoughtSpot

Analytical Tool: Alteryx

Programming Languages: Java Documentum, Java, Servlets, JavaScript, JSP, XML, HTML, XSLT and CSS

Tools: Quality Centre 9.2, SQL Advantage, Clear Quest, Win SCP, Putty, SQL Server 2014 Management Studio, Developer, Confidential Developer Studio, Greenplum developer tool, DBeaver Enterprise

Operating Systems: Windows7, Windows XP, 2000, 2003, Unix and Linux

PROFESSIONAL EXPERIENCE:

Confidential

Hadoop Developer

Responsibilities:

• Interacted with the business users for understanding the business requirements and the existing system
• Conducted the gap analysis to identify the feasibility of the existing system to accommodate the new integrations
• Designed logical and physical dimensional data models using Embarcadero ER Studio into a standard enterprise data warehouse using star schema and database normalization form
• Created Users, Domain, Segment and other tables of Maria DB by using ER Studio
• Created the Scala jobs to receive the data from Kafka and loaded into the Spark RDD.
• Load these RDD into Hive tables.
• Created consumption Hive tables by using the JOIN or other complex queries or PIG scripts
• Created Thoughtspot tables by using Hive consumption table definitions.
• Created bash scripts to load the data into Thoughtspot table from Hive consumption tables for daily and historical.
• Scheduled the Hive, PIG, MapReduce, Thoughtspot scripts in crontab or Atomic scheduler.
• Created Answers and pin board in Thoughtspot for calling web service team in GDP portal under respective domain.
• Done the Unit testing on the Hive data loads, Thoughtspot data loads and Pinboards
• Done effective reviews to avoid defects for meeting the quality goals
• Interacted with the business users in UAT on Data comparison with AM reports
• Participated defect status meetings to report any issues during UAT with root cause analysis and resolution of the defect within the stipulated time
• Moved all sap and non - sap data flat files generated from various retailers to Confidential for further processing for historical load and daily loads.
• Written the Apache PIG scripts to process the Confidential data based on required output Confidential data.
• Created Hive tables to store the processed results in a tabular format.
• Developed the SQOOP scripts to make the interaction between Pig and Confidential, SQL Server Database.
• Writing the script files for processing data and loading to Confidential
• Writing CLI commands using Confidential .
• Developed the UNIX shell scripts for creating the reports from Hive data.
• Setting up corn job to delete Hadoop logs/local old job files/cluster temp files

Confidential

Data Developer

Responsibilities:

• Interacted with the business users for understanding the business requirements and the existing system
• Conducted the gap analysis to identify the feasibility of the existing system to accommodate the new integrations
• Migrate Java code to Python script to standardize the database in future purpose
• Wrote the weather and rain reports to the Confidential by using Python script.
• Involved in gathering the requirements, designing, development and testing.
• Migrate all the bash scripts to point to SQL Server instead of Greenplum Database.
• Moved all sap and non-sap data flat files generated from various retailers to Confidential for further processing for historical load and daily loads.
• Written the Apache PIG scripts to process the Confidential data based on required output Confidential data.
• Created Hive tables to store the processed results in a tabular format.
• Developed the SQOOP scripts to make the interaction between Pig and Confidential, SQL Server Database.
• Writing the script files for processing data and loading to Confidential
• Writing CLI commands using Confidential .
• Developed the UNIX shell scripts for creating the reports from Hive data.
• Setting up crontab job to delete Hadoop logs/local old job files/cluster temp files
• Setup Hive with MySQL as a Remote Metastore
• Moved all log/text files generated by various products into Confidential location
• Written Map Reduce code that will take input as log files and parse the logs and structure them in tabular format to facilitate effective querying on the log data
• Created External Hive Table on top of parsed data.
• Scheduled these jobs in Crontab and Atomic scheduler to run the jobs daily or Weekly or Monthly.

Confidential

Technology Lead

Responsibilities:

• Extensively involved in preparation of low level design documents and unit test case preparation.
• Design Data Stage jobs for the business requirements using ETL specifications extracting data from heterogeneous source systems, transform and load into the target.
• Used Data Stage Designer and Data Stage Director for creating and implementing jobs, schedule running the jobs.
• Developed jobs mainly using various Stages-Aggregator Stage, Filter Stage and Sequential File Stage, Dataset, Join, Lookup and Transformer Stage Etc.
• Used job parameters and various environment variables in all the data stage jobs within the project.
• Used Data Stage Manager for exporting & importing metadata definitions, creating Metadata definitions and view and edit the contents of the repository.
• Involving in performance tuning jobs process identifying and resolve performance issues.
• Involved in using local and shared containers.
• Designed and coded the ETL logic using Data Stage to enable initial load and incremental processing from oracle and SQL.
• Extensively involved in using the various activities like job activity, routine activity, wait for file activity, sequencer activity, termination activity, exception handler activity etc.
• Create script for import and export the data by using Confidential utilities with BTEQ, FastLoad, MultiLoad and FastExport.
• Involved in creating Shell Scripts.
• Involved in unit testing of Data Stage jobs.
• Requirements gathering and creation of technical specifications
• Schedule the designed jobs in Control-M scheduler.
• Load the Confidential into Oracle table by using the Data stage jobs
• Created the Oracle stored procedure to load the data into Oracle final tables
• Adding/Fixing & Monitoring production jobs through Control-M
• Developed multiple tab reports in Tableau Desktop connecting to live or extract based on Historical data or Transactional data that were published to internal team for review.
• Created views in Tableau Desktop that were published to internal team for review and further data analysis and customization using filters and actions.
• Created extract files for improving the performance. Used different Mark types and Mark properties in views to provide better insight into large data sets. Technical support for Micro Strategy report incidents (Decision Center)
• Providing OBIEE and Micro strategy technical support to BIAPPS reporting.
• Monitoring Informatica loads on daily basis through Workflow monitor and DAC (Data warehouse Administrative Console)
• Writing Unix Scripts to auto generate the jobs execution status.

Confidential

ETL Developer

Responsibilities:

• Extensively involved in preparation of low level design documents and unit test case preparation.
• Design Data Stage jobs for the business requirements using ETL specifications extracting data from heterogeneous source systems, transform and load into the target.
• Used Data Stage Designer and Data Stage Director for creating and implementing jobs, schedule running the jobs.
• Developed jobs mainly using various Stages-Aggregator Stage, Filter Stage and Sequential File Stage, Dataset, Join, Lookup and Transformer Stage Etc.
• Used job parameters and various environment variables in all the data stage jobs within the project.
• Used Data Stage Manager for exporting & importing metadata definitions, creating Metadata definitions and view and edit the contents of the repository.
• Involving in performance tuning jobs process identifying and resolve performance issues.
• Involved in using local and shared containers.
• Designed and coded the ETL logic using Data Stage to enable initial load and incremental processing from oracle and SQL.
• Involved in using local and shared containers.
• Extensively involved in using the various activities like job activity, routine activity, wait for file activity, sequencer activity, termination activity, exception handler activity etc.
• Involved in performance tuning activities.
• Involved in code review activity.
• Create script for import and export the data by using Confidential utilities with BTEQ, FastLoad, MultiLoad and FastExport.
• Involved in creating Shell Scripts.
• Involved in unit testing of Data Stage jobs.

Confidential

ETL Developer

Responsibilities:

• Created High Level Design Document’s based on marketing requirement and existing system.
• Created Mapping Documents based on the existing system.
• Created Technical Design Documents based on Confidential .
• Co-ordinated timely availability of business analysts, and key users to actively participate in the project activities and meetings.
• Mentored team members technically.
• Used Data Stage Designer and Data Stage Director for creating and implementing jobs, schedule running the jobs.
• Developed jobs mainly using various Java Client and Java Transformer.
• Used job parameters and various environment variables in all the data stage jobs within the project.
• Involved in code review activity.
• Designing Data Stage jobs for validating and loading data.
• Performed design, coding, and unit testing as per Kraft standards and best practices.
• Involved in creating basic Shell Scripts.
• Experience in running jobs using Job Sequencers, Job Batches.
• Involved in unit testing of Data Stage jobs.

Confidential

Java DocumentumDeveloper

Responsibilities:

• Exposure in documentum applications architecture.
• Good exposure in Connectivity Architecture of DocBrokers/Docbases/Servers.
• Exposure in Object hierarchy in Documentum as well as in Workflows.
• Involved in creating Cabinets, Folders and Documentum ObjectTypes and corresponding Attributes for those documents.
• Well versed with Import/Export/Copy/Move/Delete/CheckOut/Checkin and CancelCheckOut operations.
• Developed Custom classes using DFC as per Business requirements.
• Customized available WDK Components as per the requirements such as properties and import components.
• Facility to email a selected document by creating webtopurl.
• Designed and implemented applications that support the new features using Java, JSP, Documentum, DFC, HTML, Java Script, and XML.
• Responsible for developing folder structure automatically whenever user clicks on
• Import document into the repository.
• Automatic Forward to the Alternate User if the workitem is not opened in the stipulated time.
• Involved in generating reports into JSP layout and thus saving them into repository as excel formats.
• Involved in designing complex workflows consisting both manual and automatic activies.
• Involved in creating Virtual documents and thus developing components using DFC and DQL programming.
• Involved in documenting the process & user guide.
• Strong RDBMS Skills coupled with excellent troubleshooting and analytical skills.
• Hands on experience in writing SQL queries.
• Exposure in complete life cycle of software development.
• Excellent communication and presentation skills as well as vibrant team player.
• Involved in developing User Interfaces using WDK, Jsp, CSS, HTML and JavaScript.