Etl Developer Resume
NJ
SUMMARY:
- 9.5 years of Experience in IT of which 7 Years of experience in System Analysis, Design, Development and System Test in Data warehousing, Data Integration, Data Cleansing, Data Profiling and Business Intelligence as ETL Datastage Developer and Tester .
- Experience on IBM InfoSphere DataStage 8.x, 9.x, 11.x using Components like DataStage Designer, DataStage Director and Hadoop Ecosystem including SPARK, SQOOP, SCALA, Hive, HDFS, SBT, Yarn and Oozie.
- Excellent experience in working with large data feeds and heterogeneous systems like Oracle, Netezza, SQL Server, DB2, Teradata, XML files, COBOL/Mainframe files and Flat files.
- Created Mapping document for Source, Landing, Staging and Target stages and processes
- Pervasive knowledge of IT industry domains such as Banking, Health care etc.
- Extensively used various Datastage stages/components like Sequencers, Connectors, Copy, Join, Lookup, Transformer, Sort, Filter, Aggregator, Pivot, Difference, Change Capture, Shared Containers, FTP, Funnel, Routines etc.
- Extensively worked on Performance Tuning for Production Project IBM Infosphere
- Involved in Code Analysis, Coding, Testing, Bug fixing and Production support
- Developed and Tested Unix scripts with Ksh for the project requirements
- Created Mapping document for Source, Landing, Staging and Target stages and processes
- Have good Quality assurance and Software testing skills, right from gathering requirement through project sign off
- Participated in Requirement gathering meetings with Business , Prepared Test Strategy Matrix, Test Plans, Test Result Report, Performed Baseline, Forward and Regression Testing
- Sharing Test Key Controls with Business to get approval and Project sign off.
- Logged Defects and participated in Defect Prevention Analysis meetings
- Excellent knowledge of studying the ER diagrams , data dependencies using Metadata stored in the DataStage Repository.
- Played multiple roles - Programmer Analyst, Application Developer, Software Tester, Quality Analyst, Data Analyst, Module Leader & Front Line Manager .
- Participates in Agile - Scrum standups and Sprint planning meetings
TECHNICAL SKILLS:
Tools/Framework: DataStage v8.x, v9.x, v11.x Designer, Director and Administrator, Spark, Big Data - Hadoop
Schedulers: Control +M, Autosys, CA-7
Operating Systems: Windows 95/98/NT/2000/XP, Unix, Z /OS
Database: Oracle 10g/9i/ 8i/8.x/, SQL Server 2003,DB2, MySQL, Netezza, Teradata
Tools: Putty, ISPF, SQUFI, ENDEVOR, FILEAID, XPEDITOR, Aginity, Toad, SPARK, Hive, JIRA, Sqoop
Methodologies: Star Schema, Snow Flake Schema.
Languages: Cobol, CICS, JCL, Shell Scripting, C, C++, JAVA, PHP, HTML, Java Script, SCALA, Unix Shell Scripting (Ksh)
PROFESSIONAL EXPERIENCE:
Confidential
ETL Developer
Responsibilities:
- Participated in Project Requirement discussions with Business and development teams
- Understood the technical specifications and develop data stage jobs for Extraction Transformation, Cleansing and Loading process of DW.
- Captured data from a variety of sources including Flat Files, Oracle etc.
- Used extensively job Parameters, and Stage Variables in developing jobs.
- Automation is done by using batch logic, scheduling jobs monthly basis depending on the requirement using Autosys.
- Extensively used various Datastage stages/components like Sequencers, Connectors, Copy, Join, Lookup, Transformer, Sort, Filter, Aggregator, Pivot, Difference, Change Capture, Shared Containers, FTP, Funnel, Routines etc.
- Did Datastage upgrade to v11.5, used IBM Infosphere Connector Migration tool, migrated unix scripts, Configuration files, Datastage ETL jobs, other supporting files to the new server
- Involved in various reviews and meetings including Internal and external code review, daily status calls, issue resolution meetings and code acceptance meetings.
- Discussed the Acceptance test scenarios with examples related to requirements and documented them
- Documented Given When Then (GWT) test scenarios and applied shift-left testing approach
- Ran the baseline test and understood the functionality of current system
- Created Unix Scripts and SQLs which are required for QA testing
- Done data refresh and did data set up in System Test environment so that testing can be done
- Did forward testing and documented the test results
- Did regression testing to ensure existing functionality is not been affected
- Defects found are logged and reported to relevant teams, defects are tracked to closure
- Done Defect analysis and the lessons learnt were discussed during the Sprint retrospective meetings
- Coordinated with Developers and Business to fix the development defects and requirement defects
- Participated in Agile - Sprint planning sessions and daily scrum stand-ups
- Delivered System Test Results to Business and got approvals for project signoff
- Provided Key controls and participated in Change Management meeting
Environment: IBM InfoSphere DataStage 11.3, Teradata, Oracle, Autosys, Toad, Putty, UNIX Shell scripting
Confidential, NJ
Software Developer
Responsibilities:
- Participated in project kickoff and project requirements from clients
- Profiling and analyzing data from different sources, addressing the data quality issues, Transforming and processing of data and loading the data into Netezza tables.
- Captured data from a variety of sources including Flat Files and other formats using PULSE appliance to Netezza tables.
- Used extensively job Parameters, and Stage Variables in developing jobs.
- Drafting technical documents like Overview documents, deployment documents for every code release.
- Automation is done by using batch logic, scheduling jobs on a daily, on a weekly and yearly basis depending on the requirement using Autosys.
- Involved in various reviews and meetings including Internal and external code review, daily status calls, issue resolution meetings and code acceptance meetings.
- Assisted SIT testing team, UAT team and Production team during code release with code walk through and presentations and Defect identification, reporting and tracking.
- Prepared System Test plan
- Did testing over the Prod version and current version.
- Involved in a POC to implement the part of Premier’s dataware house product in big data technologies like SQOOP, Hive and SPARK in Hadoop eco system .
- Created RDD, Dataframes used Transformation and Action SPARK commands/functions
- Successfully loaded and unloaded files to Hive and HDFS from/to RDBMS
- Discrepancies are captured and tickets raised for the defect tracking
- Test report is updated with screenshots
- Understood the technical specifications and develop data stage jobs for Extraction Transformation, Cleansing and Loading process of DW.
Environment: InfoSphere DataStage 8.7, Netezza, Autosys, Aginity, Hadoop, Spark, Scala, Hive, Sqoop
Confidential
Delivery Module lead
Responsibilities:
- Understood the technical specifications and develop data stage jobs for Extraction Transformation, Cleansing and Loading process of DW.
- Profiling and analyzing data from different sources, addressing the data quality issues, Transforming and processing of data and loading the data into Teradata.
- Implemented Survive stage & Match Stage for data patterns & data definitions
- Captured data from a variety of sources including DB2, Flat Files, Mainframes and other formats.
- Extensively worked with Data Stage Shared Containers for Re-using the Business functionality.
- Used extensively Reject Link, Job Parameters, and Stage Variables in developing jobs.
- Drafting technical documents like Overview documents, migration and deployment documents for every code release.
- Automation is done by using batch logic, scheduling jobs on a daily, on a weekly and yearly basis depending on the requirement using Autosys.
- Involved in various reviews and meetings including Internal and external code review, weekly status calls, issue resolution meetings and code acceptance meetings.
- Assisted SIT testing team, UAT team and Production team during code release with code walk through and presentations and Defect identification, reporting and tracking.
Environment: InfoSphere DataStage 8.5, Oracle 11g, Fixed width files, COBOL files, Sequential files, DB2, XML files
Confidential
Delivery Module Lead
Responsibilities:
- Developed unit test cases, unit-tested the jobs before migrating the code to QA and Production boxes.
- Responsible for managing scope, planning, tracking, change control, aspects of the project
- Analysed of Business requirements and Specifications
- Coded online and batch programs using COBOL, VME COBOL, CICS, DB2, VSAM, JCL PWB, ALTADATA & ITS
- Prepared of test cases, Unit testing and regression testing
- Responsible for effective communication between the project team and the customer
- Translated customer requirements into formal requirements and design documents
- Established Quality Procedure for the team, monitor and audit to ensure team meets quality goals
- Performed the role of a team lead managing the work allocation, mentoring, ensure co-ordination amongst the team members, gain confidence of the onsite SMEs/leads/business
- Participated actively in team/customer meetings and ensure co-ordination between onsite/offshore team
- Made sure the commitments made to the client, quality of deliverables are met
- Mentored the team in technical/business areas and help them resolve issues related to it
- Reviewed work status and assist the team in all phases of the software engineering cycle as and when required
Environment: IBM - Mainframes - COBOL, VME COBOL, CICS, DB2, VSAM, JCL, PWB, ALTADATA, ITS.
Confidential
Trainee programmer
Responsibilities:
- Analysed of the existing modules to be developed or enhanced
- Performed new modules coding
- Changed code of existing programs
- Prepared of Unit test reports for the Unit testing to be done
- Involved in Unit testing and Logging the Unit test reports for various conditions
- Supported System integration testing and User acceptance testing
- Prepared Quality related documents through out the SDLC process.
Environment: PHP, MySql, HTML, Java, Javascript.
Confidential
IBM Mainframe Trainee
Responsibilities:- Undergone Training on IBM Mainframe Technologies (COBOL, CICS, JCL, DB2, VSAM )
Environment: COBOL, CICS, JCL, DB2, VSAM.
