Senior Datastage Developer Resume
2.00/5 (Submit Your Rating)
SUMMARY
- 7+ Years of experience in Data warehouse, ETL processing and data analysis in Retail market research and Telecom domain for TCS both at onshore and offshore at various capacities.
- Extensive experience in using IBM datastage and use the same for implementing various data warehouse concepts.
- Very good knowledge in Netezza hardware, concepts and designing of SQLs making use of appropriate query tuning methodologies.
- Working experience with big data technologies like Sqoop, Hive, Impala and Pig as well as python scripting.
- Experience in UNIX shell scripting and involved in implementation of the file manipulation logics and invoking of Netezza commands, SQL commands and datastage commands from UNIX.
- Led multiple support, BAU, migration and enhancement projects
- Strong problem solving skills and analytical skills and have handled many production Sev - 1 tickets/lower environment issues.
- Quick learner of new technology and processes and great training skills.
- Working experience in Agile working model and DevOps
- Have very good knowledge of Software Development Cycle Lifecycle (SDLC).
TECHNICAL SKILLS
ETL Tools: IBM InfoSphere DataStage 8.5, Datastage 11.5
Programming Languages: UNIX Shell Scripting, NZSQL, SQL, PL/SQL, Python
Database: Netezza, Oracle, Hive, Pig, Impala, Teradata
Version Manager Tools: Tortoise SVN, ADLM Bit bucket
Tools: Atlassian tools, Aginity Workbench, PL/ SQL Developer, Query Analyser,Datastage, Putty, Sqoop, Hue
Domain Knowledge: Retail market research, Telecom
Operating System: Linux 5.x
PROFESSIONAL EXPERIENCE
Confidential
Senior Datastage Developer
Responsibilities:
- Datastage migration from datastage 8.1 to datastage 11.5 for multiple modules
- Datastage projects migration from Oracle to Postgres database.
- Datastage to Talend migration POC.
- Identified scratch disk space utilization and suggested process improvement to clean up the scratch disk files
- Propose and implement cleanup of intermediate datasets used in the project and save disk space.
- Convert transformer stage to copy, filter or modify as and when applicable.
- Attended Talend workshop conducted by Talend business team on the benefits of the product
- SQL queries tuning to reduce the full table scan scenarios and improve performance.
- Reduce the number of database connections by writing multiple SQLs into a file and execute at one shot.
- Reduce dependencies in the process to enable prod support to run numerous processes ahead of time.
- Chunking and parallelism of database operations by spawning multiple threads.
- Enhance processes to track multiple configurable threads and introduce auditing wherever possible
- Provide performance improvement proposals and implement the same.
- Data migration from Netezza to Hadoop using sqoop commands
- Reduce manual touch points in the application and integrating them into TIBCO orchestration
- Automating the process/jobs using TIBCO.
- Retire legacy code and onboard all clients to core platform
- Work on POCs to migrate to freeware and cost effective tools and Hadoop open source platforms.
- Move most database operations to UNIX file level operations to reduce connection times.
Datastage Developer
Confidential
Responsibilities:
- Design,Analysis,Development and Implementation of datastage code.
- Requirement Analysis and preparing low level design documents based on high level design documents.
- Involving in estimation preparation
- Preparation of Unit Test Cases and Perform Unit Testing and support activities
- Performance tracking and improve the quality of the code by working with Performance engineering team.
- Provide KT documents and sessions and prepare deployment checklist with comprehensive list of activities/dependencies and track each activity of the deployment at a granular level.
- Work on POCs to migrate to freeware and cost effective tools and Hadoop open source platforms.
- Build connected Buy platform with data from various countries and process it using big data tools like Hive, Pig and Sqoop
- Write Python scripts to replace unix shell scripts and enable easy code maintenance.
Business Analyst/Tech lead
ConfidentialResponsibilities:
- Understand the business requirements and convert the same into technical requirements.
- Gather the business requirement of the client from the onshore business analyst team and convert them into configurable components in the common shared path
- Providing solutions that reduce the redundancy in the manual work involved in configurations.
- Prepare modelling document for purpose of security enablement at user group level
- Maintain the integrity of configurations across environments.
Tech Lead
Confidential
Responsibilities:
- Execute the process end to end -- from backend refresh to front end enablement
- Prepare the comprehensive standup document with the list of all tasks to be performed
- Work closely with development team in ASM environment to understand the execution process
- Onshore offshore coordination
- Provide KT to operations team on the end to process flow and prepare handoff documents
- Analyze the issues that are faced during standup, find root cause and redirect to the appropriate team.
Production Support Analyst
Confidential
Responsibilities:
- Maintain the day to day activities in the application and cater to the requests from the partners
- Participation in weekly and monthly status reporting to discuss and fine tune the work in progress activities
- Writing queries for extraction of data for high-end business users for taking important business decisions
- Ensuring synchronization of data between upstream and downstream systems and swiftly take necessary actions in case the systems are out of sync.
- Communicating planned and unplanned downtimes to business users and downstream systems