Assistant Consultant Resume
SUMMARY:
- 11 years of professional IT experience and expertise in system data analysis, design, development and implementation of databases and data warehouse systems using ETL tool IBM Infosphere Datastage 11.5/8.5/7.5 and Talend 7.1
- Excellent experience in Designing, Developing, Documenting, Testing of various server and parallel ETL jobs using DataStage to populate tables in Data warehouse.
- Expert in designing parallel jobs using stages Transformer, Join, Lookup, Sort, Merge, Aggregator, Remove duplicates, Filter, Dataset, sequential, Lookup files sets.
- Experience in integration of various data sources like Oracle, IBM DB2,, SQL Server, Netezza, AWS S3, Big Data file stage connectors.
- Experience in Hadoop Distributed File System with high level MapReduce concepts
- Excellent experience in Talend Studio components - tMap, tFileInput, tFileOutput, tDBs, tSqlRow, tFilter, tDBinput, tDBOutput, Hadoop configurations
- Experience in writing and understanding languages like PL/SQL, Shell scripting and Java/Python basics
- Experience in different operating systems - UNIX AIX, Sun Solaris and Windows
- Experience in using GIT, Tortoise version controller.
- Excellent knowledge in troubleshooting of ETL jobs, working on production issues like code bugs, data issues, performance tuning, functionality change and enhancement.
- Experience in upgrading and converting DataStage version from 8.7 to 11.5 version.
- Expert in working with DataStage Designer, Directory, Administrator client, WebSphere consoles
- Experience in using the Scheduler tools Control M to schedule the jobs.
- Familiar with Datastage administrator tasks - project creation, attributes/parameter management server reboot, user role setting, web console monitoring
- Experience in Data Analysis, Data Cleansing, Data Validation and Verification.
- Experience in 24X7 production support, ETL executions and resolving root causes
- Experience in Functional testing, Performance testing, System Testing.
- Knowledge in fundamental services of Amazon Web services - S3, EC2, IAM, VPC and Azure - Blob, ADF, and subscription services.
- Experienced in interacting with Clients, Business Analysts and stakeholders.
- Good analytical, problem solving, communication and interpersonal skills, with ability to interact with individuals at all levels.
TECHNICAL SKILLS:
ETL Tools: IBM WebSphere DataStage 11.5/8.5/7.5 (Designer, Director, Administrator client and Manager), Talend studio 7.1 and Abinitio 3.2.2
Scheduling Tool: Control M 8/7 (Workload Automation, Workload Change Manager), ESP
Web Consoles: InfoSphere App monitoring, Hadoop application monitoring
Languages: SQL, PL/SQL, Unix Shell Scripting
Operating Systems: UNIX, Windows NT/95/98/2000/XP
Database Tools: SQL Developer, Aginity workbench, SQL server management studio (Oracle 10g/11g, DB2 & Netezza)
Ticketing Tools: Service-Now, Remedy & HPSD
Big Data: Hadoop Distributed File System, MapReduce
File Transfer Tool: IBM MFT Gateway, MoveIt
Others: MS Word, Excel, PowerPoint, Visio tools, Putty, Winscp
PROFESSIONAL EXPERIENCE:
Confidential
Assistant Consultant
Responsibilities:
- Collaborate with Business users on regular basis to gather requirements, validate and confirm functional changes in Supply chain applications
- Created high and low level design documents for ETL process, flow diagrams and get sign off from all stake holders.
- Work in star schema data warehouse system
- Used Data Stage Designer, design, develop and maintain parallel jobs
- Make use of Transformer, Join, Lookup, Sort, Merge, Aggregator, Remove duplicates, Filter, Dataset, sequential, Lookup fileset stages to achieve the requirements
- Configure Hadoop connectivity and process big data in Hadoop Distributed File System
- Extract and loading of millions of data in Big data environment
- Work with Oracle administrators on DDL, DML
- Work with infrastructure teams like UNIX, Network for new server setup, password less SSH key creation, firewall setup
- Own DevOps request from operation/BI teams and deliver them on or before deadline
- Integrate with Control M tool for scheduling ETL jobs
- Migrate ETL jobs from On-perm to Azure cloud platform
- Write SQL queries using join and case statements to validate data from different tables
- Own request from users to generate adhoc data reports and ensure data quality in them
- Implement archival scripts in DataStage servers as per data retention policy
- Work in Service now and Remedy ticketing tool for incident, change and problem management
- Fine tuning DataStage jobs by using join stage, using right partition, creating indexes on tables and modifying SQL queries
- Continuous learning about Azure cloud services and Hybrid model
- Leading junior developers at offshore/nearshore and provide knowledge transition
Confidential
Assistant Consultant
Responsibilities:
- Validate and confirm functional requirements with Project Manager, Business Analysts.
- Created high and low level design documents for ETL process, metadata descriptions, file layouts and flow diagrams
- Used Data Stage Designer, design, develop and maintain parallel jobs
- Participated in design of dimensional data model - star and snow flake schema
- Generated surrogate keys for dimensions and fact tables for indexing and faster access of data
- Created shared container and make use in multiple jobs
- Used change data capture concept in parallel jobs
- Implemented partitioning parallelism techniques and ensured load balancing of data
- Worked on job sequences to control the execution of job flow using job Activity, wait for file, Email Notification, sequencer and execute command
- Closely work with Business Intelligence teams to find how reports are affected by a change to the corporate data model
- Performed user acceptance testing, functionality testing, performance testing to ensure that it meets the requirements
- Created UNIX shell scripts to automate regular procedures
- Maintain a detailed schedule and status of assigned deliverables
- Worked in DataStage Manager for importing metadata from repository between projects
- Deploy job using InfoSphere Information Server Manager
- Using DataStage Administrator client, Created Project, define local and global variables, managing user access with InfoSphere Information Server Web console.
- Validate Talend jobs and deploy them in Production using Jenkins
- Work in Service now for incident, change and problem management
- Lead junior developers at offshore and provide knowledge transition
- Control and managing users and projects in Talend Administration Center (TAC)
Confidential
I.T. Analyst
Responsibilities:
- Worked on logical and designs of data warehouse. Understanding business logics, identified sources & targets
- Update all DB connectors using Connector Migration tool
- Correct and verify datatypes of metadata in all stages
- Convert server to parallel jobs by replacing hash file to lookup set files, basic to normal transformers
- Used Parallelism for splitting the data into subsets and achieve better job performance
- Used stage variable to implement complex business logics
- Documented changes made to each stages
- Developed Test plans, Test scenarios and Test cases for code testing
- Create test projects, set parameters using Data Stage Administrator Client
- Work in integration with scheduler tool OpsWise with new DataStage server
- Import and export projects between multiple environments
- Performed user acceptance testing, functionality testing, performance testing to ensure that it meets the requirements
- Deploy all tested jobs into Production environment.
- Team coordination and conducting team meeting to improvise the work effectively
Confidential
I.T. Analyst
Responsibilities:
- Application Study & Analysis, gain knowledge about Architecture
- Problem analysis & Identify Solutions to implement permanent fix for Issues in Applications experienced by Client and that enhances Application stability using various technologies.
- Used DataStage Designer to debug processes and develop jobs for extracting, cleansing, transforming, integrating and loading data into data warehouse database.
- Extensively used DataStage Director to run the workflows/mappings and monitored the session logs in Director.
- Used Control M job Scheduler to schedule the DataStage jobs to run the daily/weekly/monthly jobs.
- Experience in debugging ETL jobs to check in for the errors and warnings associated with each Job run.
- Working with the infrastructure teams to ensure application stability and performance is within defined service levels.
- Extensively used Oracle database with several complex queries for Data quality which involves many business logics and Integrity for Data Updates, Deletes & Inserts.
- Perform defect Tracking and reporting with strong emphasis on root-cause analysis to determine where and why defects are being introduced.
- Provide temporary and permanent fixes for the identified defects.
- Attend meetings with business partners for planning and implementation for various releases and Limited time offers on the website.
- Take Knowledge transitions, documentation and analysis of issues occurring on the new systems and changes made to existing systems
- Transition Activities to offshore team and share knowledge about new releases in application.
- Recovery/Process documentations and update to common Team Repository
- Team coordination and conducting team meeting to improvise the work effectively
