We provide IT Staff Augmentation Services!

Sr Data Stage Etl Designer And Developer Resume

0/5 (Submit Your Rating)

NY

SUMMARY

  • Over 10 years of Professional Experience in IT Industry in Analysis, Design, Development and Testing of various business applications in Banking, Supply chain management and Aerospace/Aviation domain as Sr. ETL developer (Sr. Data Stage developer / Sr. PLSQL developer )
  • Over 5 years of experience in leading the offshore development and support team, and coordination with onsite, and represented the team in client calls to gather requirements and to discuus on weekly status
  • Expertise in ETL design, development for large scale data ware house systems for Business Intelligence and transformation projects with expertise on IBM Info Sphère Information Server Data Stage (Versions 8.1/8.5/9.1/11.3 ) ETL Tool
  • Expertise in ETL design, development for data migration / transformation projects with expertise on Oracle PLSQL /SQL programming and UNIX shell scripting, by creating views, tables, triggers, functions, Stored procedures, packages, Cursors, Unix scripts
  • 3 years of experience in design, development of Air Traffic Management and Air Defense Command Control System in Aviation and Air Defense domain with expertise on C, C++, Ada programming on Linux environment with extensive knowledge on OOPS concepts as Sr. Application Developer
  • Trained on Big data ecosystem related technologies like HDFS, Pig, Hive, Hbase, NoSql and understanding of Map/Reduce jobs to support distributed data processing and process large data sets utilizing the Hadoop cluster and having DataStage experience on connecting to Hadoop/ BIGDATA
  • Strong knowledge of data warehouse architecture and designing star schema, snowflake schema, FACT and Dimensional Tables, Physical and Logical Data modeling using Erwin.
  • Extensive knowledge and experience in using various Parallel processing stages (Aggregator, Change Capture, Change Apply, Copy, Funnel, Filter, Look - up, Join, Merge, Modify, Remove Duplicate, Surrogate Key, Slowly Changing Dimension, Switch, Transformer, Column/Row Generator and Peek) and Server stages.
  • Experience in using Job Sequencer to control the flow of parallel jobs.
  • Experience in implementing slowly changing dimensions (Type I, Type II and Type III), most commonly Type II and setting up Change Data Capture.
  • Expertise on data quality assessment and generate report to do data cleansing
  • Exposure to IBM Information Analyzer and QualityStage to assess data quality and to do data profiling
  • Exposure to Informatica 9.1 ETL tool
  • Created ETL guidelines document which involves coding standards, Naming conventions for Development and troubleshooting of DataStage jobs and PLSQL stored procedures .
  • Designed, developed Oracle PLSQL stored procedures to build generic procedures for Validation and Transformation process to implement ETL flow
  • Designed and developed PLSQL procedures, packages,cursors,trigers,views and also implemented polymorphism in procedures and functions
  • Worked on SQL tuning methodologies like parallelism, table partitions, stats gathering, indexing
  • Performed troubleshooting of Data Stage jobs and Stored Procedures, Functions and addressing production issues like performance tuning and enhancements.
  • Strong knowledge in version control, release management and change management
  • Expertise in debugging the applications using various Debugging Tools (GDB, DDD, GVD).
  • Exposure to various GUI developments with X-Designer, Xwindows languages and Thales GUI libraries, Multi-Threading programming, Inter Process Communication (IPC) and networking concepts like Client Server models TCP/IP, Socket Programming
  • Expertise in implementing Agile methodologies in the development projects and acted as scrum master
  • Worked on offshore and Onshore models
  • Involved in Data migration activities at ANZ banking groups in Hong Kong and Singapore
  • Worked as an Onsite Coordinator for Air Traffic Management system enhancements at THALES (France)
  • Participated in Installation of Software and Site Acceptance Testing (SAT)
  • Possess rich experience in Software Engineering Concepts, Software quality Assurance processes and insight into software development life cycle
  • Worked with a team of business analysts, data architects, application developers, ETL developers and testers, with my objective to deliver projects within scope, time and costs while following department standards, methodologies and guidelines.

TECHNICAL SKILLS

Programming Languages: PL/SQL, SQL, C, C++, Ada

ETL Tools: IBM Info Sphere Information Server DataStage 8.5/8.1/9.1/11.3

Scripting Languages: UNIX Shell Scripting

Database Utilities and Tools: Toad, Sql Developer, SQL Plus, SQL Loader

Other Tools: Putty, Autosys, Remedy, MS Visio, Erwin, Xdesigner, DOORS,MS Word, MS Excel, IBM Information Analyzer

IDE and debugging tools: KDevelop, Eclipse3.x, gedit, ddd, gdb, gvd

Version Control: CVS, Clear Case,VSS, MKS

Databases: Oracle 9i/10g/11g, MySql, NoSql

Web Technologies: HTML

Frame Works: Hadoop (HDFS, Pig, Hive, Hbase)

Operating Systems: UNIX, Linux, Windows-XP/2000/NT and DOS

PROFESSIONAL EXPERIENCE

Confidential, NY

Sr Data Stage ETL Designer and Developer

Environment: IBM Data Stage 8.5, SQL, PLSQL, Toad 9.5, Oracle 11g, AIX,Erwin,MS Visio,SQL Plus

Responsibilities:

  • Involved in requirement analysis and understanding of business requirementsAnd do the source and target data mappings
  • Worked on Data Quality assessments on source data
  • Prepared High Level Design document using Erwin
  • Physical & logical data modeling designed table definitions for each stage of ETL flow
  • Prepared Low level design designed ETL job for each stage (extraction, validation, transformation, error check (referential integrity check) and loading) designed start job and sequencers to integrate all individual ETL jobs
  • Created different source definitions to extract data from flat files and relational databases
  • Designed and developed ETL jobs using IBM Data Stage 8.5 to extract data from flat files and Oracle and to load the data into the target database
  • Extensively worked on Data Stage Designer Active and Passive stages to develop various parallel and sequencer jobs to extract, cleanse, transform
  • Extensively used Parallel Stages like Aggregator, Join, Lookup, Filter, Funnel, Modify, Copy, Sort, Change Capture, Remove Duplicates, Surrogate key Generator, Row generator, Column Generator and Peek for Processing, Development and De-bugging purposes
  • Importing and exporting repositories across the projects, Data stage Components and table definitions are done using Data Stage Designer.
  • Designed Re-Usable jobs in DataStage which saved testing and designing time and can bring down the Development time.
  • Used predefined shell scripts to run jobs and data loads.
  • Developed audit routines to reconcile the extracted and loaded data records.
  • Developed PL/SQL stored procedure to generate field level error reports on rejected records at validation stage to cleans the source data and maintained staging tables at each stage for debugging the data issues
  • Performed troubleshooting of Data Stage jobs addressing production issues like performance tuning, data issues and enhancements.
  • Used DataStage director to monitor, debug and Schedule the job executions.
  • Created Deployment scripts for deploying the code from one environment to other.
  • Conducting peer reviews on deliverables
  • Prepared test cases and Involved in Testing activities like UTP, CIT, SIT
  • Coordinate the Offshore and Onshore team to resolve the dependencies and achieve the project targets.
  • Represented the team in Client calls to gather the requirements and providing periodic updates on project implementation

Confidential, NY

Sr. PLSQL ETL and UNIX Developer, Production Support, Team Mentor

Environment: PLSQL, SQL, Oracle 11g, Toad 10.6, UNIX

Responsibilities:

  • Designed and developed new jobs by creating Oracle PLSQL and Unix scripts to extract, transform, load the data according to the requirements and scheduled those jobs in autosys
  • Implemented Sql loader scripts to load the data from file to tables and scheduled as load jobs to run on daily basis
  • Implemented PLSQL stored procedure to do data validations and to implement data conversions or transformations as per business need
  • Monitoring the Scheduled JDA application data base jobs and debug and provide fixes on time to complete the batch as per SLA time as part of production support
  • Migrating the code from one environment to other environment like development, QA, Production through change management process using MKS repository
  • Analyze the issues during batch execution and proposed the permanent fix as future enhancements
  • Scheduled the jobs in autosys to execute on daily or weekly basis
  • Monitored and acknowledged the Remedy Incidents as per SLA
  • Implemented tuning methods to improve performance of oracle PLSQL proceduresto reduce batch execution time to get more buffer time to resolve issues in case of failures to meet batch SLA all the times
  • Created UNIX scripts to generate automated batch status mails to users for better communication
  • Responded and Resolved various Incidents as per SLA according to incident priority
  • Represented the development and support team in client callsConducted reviews on deliverables to improve the quality

Confidential, New York

Sr. DataStage ETL Designer, Developer, Team Mentor

Environment: IBM Data Stage 8.5, Toad 9.5, Oracle 10g, AIX, SQL, PLSQL, IBM Information Analyzer, SQL*Plus, SQL Navigator, Windows XP/2000

Responsibilities:

  • Involved in building an Enterprise Data-warehouse for the company with the product details needed for Business Intelligence.
  • Prepared HLD and LLD documents and developed various ETL jobs including Data Extractions, Transformations rules based on business requirements using IBM Infosphere Datastage 8.5.
  • Extensively used Data Stage Designer to develop various jobs to extract, cleanse, transform and integrate multiple sources transformed data and load into target data mart to generate reports
  • Worked on daily atomic, monthly atomic and Monthly aggregations of the reporting data mart
  • Extensively worked on Parallel Jobs using various stages like Join, Lookup, Filter, Funnel, Copy, Slowly changing dimension, Change Data Capture (CDC), Sequential File, Oracle Enterprise, DB2/UDB, Merge, Transformer etc...
  • Importing and exporting repositories across the projects, Datastage Components and table definitions are done using Datastage Designer.
  • Extensively used Parallel Stages like Aggregator, Join, Lookup, Filter, Modify, Copy, Sort, Change Capture, Remove Duplicates, Surrogate key Generator, Row generator, Column Generator and Peek for Processing, Development and De-bugging purposes
  • Created jobs using the stages like Change-Capture stage in comparing the data between the two sources and capture this onto a file for further analysis.
  • Performed Job tuning which helps in reducing the production time for the daily job runs.
  • Worked with DataStage Manager to import/export metadata, jobs and routines from repository and also created data elements.
  • Mapped Data Items from Source Systems to the Target System.
  • Involved in source data analysis and data cleansing.
  • Performed file manipulation in UNIX.
  • Created Batches (DS job controls) and Sequencers to control set of DataStage jobs.
  • Added new projects and assigned the user roles and permissions, via. DataStage administrator/ Web Console.
  • Created automated Load jobs using Autosys Scheduler.
  • Participated in discussions with Team leader, Group Members and Technical Manager regarding any technical Business Requirement issues.

Confidential

Sr. PLSQL ETL Developer, Onsite Coordination, Team Mentor

Environment: Oracle PLSQL, Oracle 11g, Toad 10.6, UNIX, Erwin, MS Visio

Responsibilities:

  • Gathering of user requirements and source system analysis and establishing mappings between sources (Finacle7, Midanz) to target (Finacle10) attributes to migrate data as part of banking transformation requirement
  • Designed and developed PL/SQL procedures to extract data from flat files, validate, transform into target table formats and spool to text files to upload into target system
  • Prepared the high level design document
  • Designed transformation flow
  • Designed reconciliation report formats
  • Prepared SQL queries to provide the data quality assessment reports on source datato initiate the data cleansing activities at bank
  • Handled the erroneous records at each stage that is extraction, data validation and transformation and maintained staging tables at each stage to debug if any data issues
  • Designed and developed the stored procedures to reconciled the transformed, uploaded and rejected data
  • Prepared Unix shell scripts to automate the source data load into transformation database
  • Created Unix scripts to trigger the required ETL batch to load the data into target tables
  • Created Tables, Synonyms, Sequences, Views, Functions, Packages and Stored procedures.
  • Developed Indexes for faster retrieval of data.
  • Worked on SQL tuning methodologies like parallelism, table partitions, stats gathering, indexing to tune PLSQL/SQL for maximum efficiency
  • Developed complex queries by using join conditions, group by functions, nested queries and cursors.
  • Worked extensively on Exception handling to trouble-shoot PL/SQL code.
  • Used TOAD for PL/SQL development and database access
  • Mapped Data Items from Source Systems to the Target System.
  • Involved in source data analysis and data cleansing
  • Preparation of Unit test cases and performing Unit test and as well as integration test.
  • Conducting peer reviews on deliverables
  • Coordinate and mentoring the team to achieve the project targets
  • Represented the team in Client calls to gather the requirements and providing periodic updates on project implementation

Confidential

Sr. Data Stage ETL developer

Environment: IBM DataStage 8.1, Toad 9.5, Oracle 10g, AIX, PLSQL, SQL

Responsibilities:

  • Developed DataStage mappings and ETL jobs based on the business requirements using IBM DataStage 8.1
  • Responsible for managing the onsite-offshore co-ordination and delivery.
  • Extensively used DataStage Designer to extract, cleanse, transform, integrate and load data into Data marts.
  • Extensively worked in developing Parallel Jobs using various processing stages such as Join, Lookup, Filter, Funnel, Copy, slowly changing dimension, Change Data Capture (CDC), Remove duplicates and Transformer.
  • Worked on development/debugging, processing, database, file and restructure stages.
  • Performed importing and exporting DataStage Components and table definitions across projects.
  • Prepared shell scripts to automate parameter file generation through START BATCH job and execution of Workflows
  • Created Batches and Sequencers to control the order of DataStage jobs.
  • Worked on reporting data by applying required aggregations on data marts.
  • Designed reusable jobs/ shared containers.
  • Extensively worked on CDC type II for updating and inserting the new records into the data mart.
  • Performed Job tuning which helps in reducing the production time for the daily job runs.
  • Worked with DataStage Manager to import/export metadata, jobs and routines from repository and also created data elements.
  • Mapped data items from Source Systems to the Target System.
  • Involved in source data analysis and data cleansing.
  • Performed file manipulations in UNIX scripts.
  • Added new projects and assigned the user roles and permissions, via. DataStage administrator/ Web Console.
  • Created automated Load jobs using Autosys Scheduler.
  • Mentored team on designing DataStage mappings and development activities
  • Participated in code review activities to improve quality
  • Created Deployment groups for deploying the code from one environment to other.
  • Used heterogeneous data sources Oracle, DB2, Mainframe Files and Flat Files

Confidential

Sr. Application Developer

Environment: ADA, C++, Linux, Kdevelop, DDD debugger

Responsibilities:

  • Programming using C++, Ada
  • Developed the GUIs using MOD (HMI) language and Tool Box which provides the interfaces.
  • Designed developed new enhancements for FDPS component
  • Developed various new Enhancements in the product as per the customer requirements.
  • Implementation of Formation Flights creation.
  • Enhancing the track label display features.
  • Enhancing the Sectorization capabilities.
  • Porting the applications (CSCI) from UNIX to Linux.
  • Run logiscope and code wizard tools to improve code optimization
  • Involved in Testing activities at component level using simulators (MMI, PTG, PLAY, TOST, AIRSPACE) and release document preparation
  • Involved in Development of testing tool (to simulate the interface components)
  • Regression Analysis using AIRSPACE tool
  • Conducting Peer Reviews on deliverables
  • Involved in Defect prevention analysis
  • Created Wiki pages to share knowledge with team
  • Involved in Planning and Effort Estimations.
  • Followed agile methodoligy to implement the project and acted as scrum master
  • Coordinate and support the Team.
  • Represented the team in Client calls to gather the requirements and providing periodic updates on project implementation of different sites like Denmark, Finland, Sweden, Ireland

Confidential

Team Member, C and C++ developer

Environment: C, C++, Linux, Oracle 11g, Kdevelop, X-Designer, DDD debugger

Responsibilities:

  • Designed and developed external systems simulation and interceptor aircraft exploitation solution to the operator based on geometric of target track
  • Developed the User Interface by using XDesigner Tool
  • Programming using C, C++ on Linux
  • Implemented synchronization techniques on multiple threads using mutexes and pipes
  • Designed and developed air defense attacking tactics algorithms and military air bases simulation system.
  • Involved in complete software development lifecycle of air defense command control system
  • Involved in testing activities and release document preparation
  • Participated in Site Acceptance tests conducted in Amritsar.

We'd love your feedback!