Senior Etl Lead Resume
New, JersY
SUMMARY
- Around 9 years of experience in developing, testing and maintaining applications in Data Warehouse using ETL tools like IBM Infosphere Information Server & IBM InfoSphere DataStage(Parallel Extender) (Versions 11.x/9.x/8.x) and IBM InfoSphere QualityStage and IBM Information Analyzer,Informatica
- Experience in writing SQL Coding, Views, PL/SQL Stored Procedures, Functions, Packages, Triggers, Cursors, Partitioned Tables
- Experience in Banking, insurance, Healthcare, Automobile domains.
- Experience in IBM Information Analyzer,Business Glossary, FastTrack,metadata, lineage
- Experience in UNIX, Oracle, Microsoft SQL Server,DB2 and Teradata, Netezza
- Experience in Production Support.
- Project lead for multiple projects.
- Experience in Address Verification and Standardization writing rule sets using IBM InfoSphere QualityStage.
- Perform column analysis, rule analysis, primary key analysis, natural key analysis, foreign - key analysis, and cross-domain analysis using IBM Information Analyzer configure and code data quality validation rules within IBM Information Analyzer
- Schedule the jobs through Autosys JIL.
- Extensive experience in extract the data from ERP Systems like SAP HANA,SAP BW
- Experience in writing rule sets using IBM InfoSphere QualityStage.
- Experience in writingSurvivorship rules using IBM InfoSphere QualityStage.
- Identify duplicate Records using Matching Stage through IBM InfoSphere QualityStage.
- Experience Select the best record of a match group using Survivorship stage through IBM InfoSphere QualityStage.
- Experience standardization the address,name,Area using standardization stage through IBM InfoSphere QualityStage.
- Experience in Word Investigations,Character Discrete using Investigate stage
- Experience in Investigate stage,Standardize stage,Match stage
- Information Analyzer administrative tasks such as managing logs, schedules, active sessions and security roles etc
- Experience in Data Analysis and modeling
- Experience in Data modelling, Design and architecture review
- Import/export projects along with rules and bindings successfully from one environment to another using Information Analyzer
- Experience in Hadoop stack(Hive,Pig)
- Experience in estimation, planning, forecasting and tracking for projects
- Co-ordinate with multiple development teams to track the progress of the project
- Experience in all Phases of System/Software Development Life Cycle (Process Consulting, Architecture, Design, Development, Testing, Deployment and Support).
- Extensive experience in design and architecture of ETL interfaces and data marts.
- Familiar with aspects of technology projects like Business Requirements, Technical Architecture, Design Specification, Development and Deployment.
- Proficiency in Data warehousing techniques for data cleansing, Slowly Changing Dimension phenomenon, Surrogate key assignment, change data capture
- Experience in ETL and Datawarehouse systems like Datastage, Informatica
- Experience in Agile Methodology
- Experience in Toad
- Excellent knowledge in Business Intelligence, Analytics and Optimization.
- Proficiency in Data Warehouse Architecture and Designing Star Schema, Snow flake Schema, FACT and Dimensional Tables, Physical and Logical Data Modeling using Erwin and Designer 2000
- Extensive experience in loading high volume data, and performance tuning.
- Excellent interpersonal communication skills and ability to work effectively in a team environment.
ETL: IBM Information Analyzer/IBM Websphere DataStage11.5/9.x/8.x/7.5x2QualityStage,Business Glossary, Information Analyzer, Business Glossary, FastTrack,SSIS
Databases: TeradataV13,V14,Oracle12g/11g/10g/9i,DB2,MicrosoftSQL Server,Netezza, MySQL
Reporting: Tableau
Programming Languages: SQL,PL/SQL,Shell Scripting,XML
Operating System: Unix, Linux, Windows NT/XP/2000/2003 server
Scheduling: Autosys, Crontab, Tivoli
Connectivity: Citrix, Putty, Humming Bird
Datamodeling: Erwin
Version control: Pvcs,Accurev, Tortoise SVN
PROFESSIONAL EXPERIENCE
Confidential, New Jersy
Senior ETL Lead
Responsibilities:
- Worked on full software development cycle activities including analysis, design, development, testing, deployment to production and support.
- Experience in Data modeling through Erwin .
- Strong Experience in BM DataStage(Parallel Extender) 11.X tools: Administrator, Console,Designer, Director, Orchestrate, QualityStage experience utilizing relational data modeling techniques and tools, such as ERWIN
- Developed detailed ETL design documents, ETL specifications and data mappings based on requirements
- Experience in IBM Information Server installation and configuration
- Experience in writing oracle Stored Procedures
- WrittenUNIX scriptsto handle automation of daily batch runs to handle catch up runs by passing last run date, last pull date and use of infrastructure ETL run tables to accomplish daily batch runs catch-up
- Schedule the jobs through Autosys.
- Experience in Address Verification and Standardization writing rule sets using IBM InfoSphere QualityStage.
- Strong Experience in DataStage tools: Administrator,Designer,Director and QualityStage
- Performed Installation and migration of IBM Websphere Datastage/ IBM InfoSphere DataStage Enterprise Edition/PX on UNIX platforms and testing of latest version of Datastage.
- Involved in documentation forDesign Review, Code Review and Production Implementation..
- Experience in writing rule sets using QualityStage.
- Experience in writingSurvivorship rules using QualityStage.
- Experience in Investigate stage,Standardize stage,Match stage
- Identify duplicate Records using Matching Stage through IBM InfoSphere QualityStage.
- Experience Select the best record of a match group using Survivorship stage through IBM InfoSphere QualityStage.
- Experience standardization the address,name,Area using standardization stage through IBM InfoSphere QualityStage.
- Experience in Word Investigations,Character Discrete using Investigate stage
- Experience in writing rule sets using QualityStage.
- Experience in writingSurvivorship rules using QualityStage.
- Perform column analysis, rule analysis, primary key analysis, natural key analysis, foreign-key analysis, and cross-domain analysis using IBM InfoAnalyzer configure and code data quality validation rules within IBM InfoAnalyzer
- Proficiency in Data warehousing techniques for data cleansing, Slowly Changing Dimension phenomenon, Surrogate key assignment, change data capture
- Information Analyzer administrative tasks such as managing logs, schedules, active sessions and security roles etc
- Import/export projects along with rules and bindings successfully from one environment to another using Information Analyzer
- Involved inLow Level designdocument for mapping the files from source to target and implementing business logic.
- Conduct allreview meetingsand explain the process of new implementations.
- Coordinate with team members and administer all onsite and offshore work packages.
- Prepareddocumentationincluding requirement specification
- Worked with Developers to troubleshootand resolve issues in job logic as well as performance.
- Conducted weekly status meetings.
- Maintained Data Warehouse by loading dimensions and facts as part of project.
- Experienced in developing parallel jobs using various Development/debug stages (Peek stage, Head & Tail Stage, Row generator stage, Column generator stage, Sample Stage) and processing stages (Aggregator, Change Capture, Filter, Sort & Merge, Funnel, Remove Duplicate Stage)
- Generation ofSurrogate Keysfor the dimensions and fact tables for indexing and faster access of data in Data Warehouse.
- Debug, test and fix the transformation logic applied in the parallel jobs
- Successfully implemented pipeline and partitioning parallelism techniques and ensured load balancing of data.
- Experience in SSIS.
- Strong understanding of data warehousing concepts, schemas, Slowly Changing Dimensions, Facts and Dimensions and implementation of the same
- Deployed different partitioning methods like Hash by column, Round Robin, Entire, Modulus, and Range for bulk data loading and for performance boost.
- DevelopedUNIX shell scriptsto automate file manipulation and data loading procedures.
- Tuned transformations and jobs for Performance Enhancement.
- Scheduled the jobs usingAutoSys
- Involved in Reading and writing to the XML,IBM MQ, Flat File, mainframe
Environment: IBM InfoSphere Datastage 11.5,SSIS, Information Analyzer, Quality stage & Information Analyzer 11.X,SQL, Business Objects XIR2,DB2,Teradata, Netezza, Microsoft SQL Server,Oracle,Autosys, PVCS, SAP, PLSQL,TOAD, UNIX- AIX, MS Word, Excel, DB2,IBM InfoSphere Master Data Management Enterprise Edition,XML,TOAD,SAP
Confidential, Dearborn, MI
ETL Lead
Responsibilities:
- Developed detailed ETL design documents, ETL specifications and data mappings based on requirements
- Involved inmigration and implementationof data stage code from development to Test and Production environmenUsed theDataStage Director tovalidate, schedule and run the jobs.
- Created jobs in DataStage to import data from heterogeneous data sources like Oracle 9i, Text files and SQL Server
- Experience in writing rule sets using QualityStage.
- Experience in writingSurvivorship rules using QualityStage.
- Experience in Investigate stage,Standardize stage,Match stage
- Perform column analysis, rule analysis, primary key analysis, natural key analysis, foreign-key analysis, and cross-domain analysis using IBM InfoAnalyzer configure and code data quality validation rules within IBM InfoAnalyzer
- Information Analyzer administrative tasks such as managing logs, schedules, active sessions and security roles etc
- Import/export projects along with rules and bindings successfully from one environment to another using Information Analyzer
- Extensively worked on Job Sequences to Control the Execution of the job flow using various Activities & Triggers (Conditional and Unconditional) likeJob Activity, Wait for file, Email Notification, Sequencers, Exception handler activity and Execute Command.
- PerformedUnit Testing, System Integration Testing and User acceptance testing
- Created shell script to run data stage jobs from UNIX and then schedule this script to run data stage jobs through scheduling tool.
- Performed performance tuning of the jobs by interpreting performance statistics of the jobs developed.
- Documented ETL test plans, test cases, test scripts, and validations based on design specifications for unit testing, system testing, functional testing, prepared test data for testing, error handling and analysis.
- Experience in IBM MDM
- Developed Test Plan that included the scope of the release, entrance and exit criteria and overall test strategy. Created detailed Test Cases and Test sets and executed them manually
- Worked onFast load, Multi loadfor loading the data into the Teradata database
- Provided production support and performed enhancement on existing multiple projects.
- Automatethe process of data stage jobs to handle multiple day runs to catch up for any missed day runs
- WrittenUNIX shell scriptto handle automation of daily batch runs to handle catch up runs by passing last run date, last pull date and use of infrastructure ETL run tables to accomplish daily batch runs catch-up
- Validated the current production data, existing data and the programming logic involved
- Responsible in debugging Ticketing issues in the production phase
Environment: - IBM InfoSphere Datastage 8.X, Information Analyzer, IBM MDM, Quality stage & Information Analyzer 8.X,SQL, Business Objects XIR2, Autosys,DB2, Netezza, SQL Server,Oracle,Teradata,PVCS, DB2, TOAD, UNIX- AIX, MS Word, Excel, DB2
Confidential, Dearborn, MI
Senior Specialty Developer
Responsibilities:
- Used the Autosys job Scheduler to schedule the Datasatge jobs to run the daily jobs and weekly jobs.
- Production Support - Identify issues, review errors, approve resolution, and advise of potential downstream impacts
- Experience in debugging ETL jobs to check in for the errors and warnings associated with each Job run
- Worked on data analysis and data correction and cleanup for warehouse tables
- Responsible in debugging Ticketing issues in the production phase
- Password maintain in Production environment
- Code migration in Production environment
- Worked on new generic UNIX scripts and existing scripts to automate some of the warehouse functionality.
- Monitor Automobile Environments and run defined Data Quality Checks
- Maintain relationships with IT and Business.
- First line support for Business Users and Analysts including mailbox support, researching questions and maintaining web-based knowledge base.
Environment: IBM InfoSphere Datastage 8.X, Information Analyzer,, Quality stage & Information Analyzer 8.X, Autosys, Teradata,DB2, Oracle, Netezza,SQL Server,Oracle,Teradata, UNIX,SQL Server,DB2,PVCS,Autosys
Confidential - Bloomfield, CT
Senior Specialty Developer
Responsibilities:
- Designed, developed, tested and attuned Data stage jobs mappings. Analyzed and modified existing ETL objects in order to in corporate new changes in them according to the project requirements
- Extensively developed Data stage parallel & sequence jobs.
- Worked on performance tuning of ETL jobs using SQL queries, data connections, configuration files, parameter sets and environment variables.
- Used Autosys to schedule jobs and e-mailed the status of ETL jobs to operations team daily
- Developing the Parallel jobs using Sequential file, Transformer, Lookup, Funnel, Filter, Remove Duplicate, Oracle and Teradata stages
- Performed Knowledge Transfer KT to team members and lead the whole project in all the phases.
- Used shared containers to re-use stages and links in parallel jobs.
- Document the Production issues and solution, monitoring alerts and fixing Remedy ticket
- Coordinating with the Onsite team during the project tenure.
- Involved in post production support.
Environment: DataStage 7.5, Autosys, Teradata, Oracle, UNIX,SQL Server,DB2