Senior Etl Consultant / Data Analyst Resume
Newark, DE
SUMMARY:
- Over 10 years of extensive experience as ETL Consultant/ Developer and Data Analyst/ Report Writer Roles.
- Good work Experience in Distributed Unix/Linux data warehouse/ OLAP environments and Legacy mainframe Batch/ OLTP environments.
- Good work experience in HP Vertica 5.x/6.x, Teradata 14, IBM ETL Datastage 8.7 and 9.1, Informatica Power Center 7.x, Unix shell scripting, Perl, IBM DB2, Tableau 8.3/10 and Oracle PL/SQL, MS SQL and Z/OS Mainframe Technologies.
- Good Knowledge in OLTP/OLAP Systems, Analysis and Dimensional Modelling, E - R modelling. Involved in ODS/Designing Dimensional Model (Star Schema and Snowflake Schema) Designing logical and physical design data modelling with star schema using TOAD/Visio.
- Developed many parallel jobs for extracting, transforming, integrating and loading data into targets using Vertica VSQL’s /Teradata BTEQ SQL techniques.
- Developed utilities for bulk load options in Teradata and Vertica using C/Java/Perl/Unix Technologies and have extensively worked on creation of the Vertica Projections and knowledge on Database Designer.
- Good work experience in Teradata/Vertica Performance tuning.
- Worked on the Data mapping / Data Profiling activities using the SQL scripts and Data stage information Analyzer.
- Experience in development of Reports and dashboards in Tableau and deploying report solutions using Tableau server.
- Worked on creation of Customized and Interactive dashboards in Tableau using multiple data sources.
- Good knowledge on SQL Queries/fine tuning and MPP Columnar Vertica and RDBMS Database and Teradata concepts.
- Good Knowledge in Hadoop Ecosystem.
- Expertise in all the phases of System development life Cycle (SDLC) using different methodologies like Agile, Waterfall.
- Worked directly with users and gathered requirements to develop and implement priority solutions.
- Experience in Project Evaluation, Project Management and Status tracking with analytical and problem solving skills.
- Good exposure to Confidential Cards & Equities and Options Trading/Settlement domains.
- Good Team player and also worked independently for various projects.
- Experience on both onshore and offshore work models and have led small members team and delivered
TECHNICAL SKILLS:
Scripting/Programming Languages: Unix Shell scripting, Perl, C, COBOL,JCL,CICS
Databases: DB2 V9, HP Vertica 5.x/6.x, Teradata 14, Oracle PL/SQL
Tools: IBM ETL Datastage 8.7 and 9.1, Informatica Power Center 7.x, Tableau 8.3/10, Toad, Oracle SQL developer, Squirrel SQL client, MS SQL, Erwin,Version Control tools SCCS, SVN and Endevor, HP Quality Center, BMC Remedy, Actimize Compliance tool. FILE-AIDE,INSYNC
Scheduler: TWS Meastro, R11 Autosys, CA7
Operating Systems: Windows 95/98/NT/XP, Unix Aix 1.6,Linux 6.5, Mainframe Z/OS V1.9
PROFESSIONAL EXPERIENCE:
Confidential, Newark, DE
Senior ETL Consultant / Data Analyst
Responsibilities:
- Worked on Data mining/profiling activities using the SQL and ETL Datastage Quality stages.
- Worked on Data mapping between SOR and target system.
- Prepared High Level/Low Level Design Documents.
- Created complex ETL Jobs to using Datastage and Teradata/Vertica VSQL Techniques.
- Created complex business transformation logics in Teradata BTEQ/VSQL s as per downstream data mapping requests.
- Created Multiple projections for better VSQL query performance.
- Worked with the Upstream/Downstream applications and defined the required DQ Rules needed for the DQ Framework Tables.
- Worked on performance tuning and enhancement of the Datastage OSH/VSQL process to handle the huge volume of data in efficient ways.
- Involved in all business level discussions, meetings on decision making.
- Enhancements are carried out for existing functionalities to integrate with the applications and thereby providing more scope for application.
- Worked on Data Analysis and converted Old DM extract Queries to New DM custom extract queries for Tableau Reporting.
- Worked directly with LOB s and created story points and Data elements which are needed for the new report creation.
- Converted Old DM excels /Pivot Reports into Tableau BI data/chart reports and published them in Tableau server.
- Have Created new Customer Attrition and Campaign reports for Confidential Wealth Management division using Tableau BI tools
- Worked on Customized and Interactive dashboards creation in Tableau with multiple data sources using Data blending techniques.
- Participated in Daily status meetings and conducted internal and external reviews as well as formal walkthroughs among various teams and documenting the proceedings.
- Coordinated junior analysts and offshore team members to ensure project goals are efficiently met from conception through execution.
- Provided technical software and engineering guidance to junior analysts and offshore Team.
Environment: Aix Unix, Linux, ETL Datastage, Tableau 8.3,Unix Shell Script, Perl, DB2, HP Vertica,Teradata, Oracle SQL, Autosys, SVN, TOAD, SQL developer, Squirrel SQL client.
Confidential, Newark, DE
Senior ETL Consultant / Data Analyst
Responsibilities:
- Worked on Data mining/profiling activities using the SQL and ETL Datastage Quality stages.
- Worked on Data mapping between SOR and target system.
- Prepared High Level/Low Level Design Documents.
- Created complex ETL Jobs to Confidential the Confidential Credit card data into AML application using Datastage and Vertica VSQL Techniques.
- Created complex business transformation logics in VSQL s as per downstream data mapping requests.
- Created Multiple projections for better VSQL query performance.
- Worked with the Upstream/Downstream applications and defined the required DQ Rules needed for the DQ Framework Tables.
- Worked on performance tuning and enhancement of the Datastage OSH/VSQL process to handle the huge volume of data in efficient ways.
- Involved in all business level discussions, meetings on decision making.
- Enhancements are carried out for existing functionalities to integrate with the applications and thereby providing more scope for application.
- Worked on Data Analysis and converted Old DM extract Queries to New DM custom extract queries for Tableau Reporting.
- Worked directly with LOB s and created story points and Data elements which are needed for the new report creation.
- Converted Old DM excels /Pivot Reports into Tableau BI data/chart reports and published them in Tableau server.
Environment: Aix Unix, Linux, ETL Datastage, Tableau 8.3,Unix Shell Script, Perl, DB2, HP Vertica,Teradata, Oracle SQL, Autosys, SVN, TOAD, SQL developer, Squirrel SQL client.
Confidential, Newark, DE
Senior ETL Developer
Responsibilities:
- Gathering business process information, business model and requirements.
- Understanding the Credit card business model. Designing the data model and assigning it to the prior subject area.
- Data mapping between the SOR and the target system.
- Prepared Low Level Design Documents for Policy and Confidential Conversion.
- Involved on the new Vertica database designing and Projection Creations
- Developed a generic C code which will split the binary format file containing different layouts also have developed generic OSH script and invoked from the PERL script.
- Performed the Data Integration between the Upstream and the data in Vertica/Teradata.
- Worked on performance tuning and enhancement of the OSH process and Vertica bulk load which involves huge volume of data.
- Developed on Vertica Space optimisation and prepared the Automated Delete Vector jobs.
- OSH script involves the stages - Import, Export, Transformer, Modify and Aggregator Stages.
- Customized UNIX/PERL scripts as required for pre-processing steps and to validate input and output data elements.
- Participated in Daily status meetings and conducting internal and external reviews as well as formal walkthroughs among various teams and documenting the proceedings.
- Autosys scheduler used for scheduling the jobs.
Environment: IBM Infosphere Datastage 8.7(OSH), Vertica 6.0/6.1, Shell and PERL scripting,Teradata, C program, Putty, COBOL, JCL, VSAM, AIX 6.1, VISIO, IXP Autosys,CA7,Oracle PL/SQL,DB2
Confidential, Newark, DE
Senior ETL Developer
Responsibilities:
- Gathering process information, business model and requirements.
- Prepared Low Level Design Documents for Policy and Confidential Conversion.
- Involved on the R2V Vertica Data model Designing.
- Analysis and design of ETL processes.
- Played as a Technical Lead role in Project and worked as an Onsite coordinator by sharing the information and tasks to the offshore team.
- Worked in Confidential mainframe Layer built using COBOL/JCL.
- Worked in migrating Cobol Logics into Vertica VSQLs SQLs.
- Created many Manual Projections for the VSQL s Better Performance.
- Worked on the Vertica Data Backup and Recovery Jobs.
- Worked in enhancing the OSH process and the Vertica Confidential for better performance.
- Performed data analysis, data processing and cleansing through Error files and Log files.
- Created Multiple SQL scripts to ensure Data Quality of KBE elements.
- Created Data Quality/ Data Control Jobs before processing and loading the data to the Bacardi Tables and before sending the data to the Downstream Applications through Extract Process.
- Customized UNIX/PER scripts as required for pre - processing steps and to validate input and output data elements.
- File to Table load process - primary process executes OSH to read the file and writes into the named pipe, second process reads the named pipe and loads the Vertica W application tables. Reconciliation to verify the accuracy of the loading process.
- Usage of the available framework model to capture the run time stats.
- Developed the C code to cleanse the data - as the files are expected to have unprintable or unreadable characters.
- Participated in Daily status meetings and conducting internal and external reviews as well as formal walkthroughs among various teams and documenting the proceedings.
- Autosys scheduler was used for scheduling the jobs.
- Involved in 24/7 production support during the Post Implementation Warranty period.
Environment: IBM Infosphere Datastage 8.7(OSH), Informatica Power Center 7.x, Vertica 6.0/6.1, Teradata, Shell and PERL scripting, Putty, AIX 6.1, COBOL, JCL,VSAM, VISIO, IXP Autosys, TWS Meastro, CA7, Oracle PL/SQL,DB2
Confidential
Senior ETL Developer /Tech Lead
Responsibilities:
- Prepared ETL mapping and Low Level Design Documents..
- Analysis and design of ETL processes using DataStage/Informatica.
- Extensively worked with the DBA team for preparation and approval of the Data models required for the new Confidential Tables.
- Worked on the Informatica to Datastage Project and migrated 12 POE table Confidential into Datastage ETL jobs.
- Modified the existing RECRIS/W Datastage and Informatica Extract jobs and added new data
- Elements.
- Played as a Technical Lead/developer role and Led 5 Members Offshore Team.
- Developed various jobs using Modify, Aggregator, Sequential file, Transformer stages, Lookup, Sort, Join, Filter, DB2 stages, Remove duplicates, XML etc.
- Have developed web application for the framework.
- Designed sequence jobs using the activities such as Job Activity, Nested Condition, Notification Activity, Sequencer Activity, Terminator Activity and Execute Command.
- Used Shared Containers and created reusable components for local and shared use in the ETL process. Used before and after job Sub Routines for auditing purpose.
- Used Data Stage Director Run Time engine to schedule and execute developed jobs and job sequences and used Log events to monitor job progress and performance.
- Worked on performance tuning and enhancement of DataStage job transformations.
- Maintained the defects involved for proper documentation using Quality Control.
- Involved in all the SDLC phases of the Projects.
Environment: IBM Infosphere Datastage 8.7, Teradata, Informatica Power Center 7.x, DB2 9.7, Shell and PERL scripting, AIX 6.1, Putty, VISIO, Oracle PL/SQL,DB2,TWS Meastro
Confidential
Senior Application Developer
Responsibilities:
- Involved in all SDLC phases of the project
- Involved as a key senior developer to implement the changes to ATOM application and made the system available for 24/7 to support the Confidential $ orders.
- Created the new critical Batch stream for Confidential $ Global orders.
- Involved in the Option Symbology (OSI) project changes for ATOMS
- Application which had a very big impact and made changes in all the critical core programs and user screens.
- Involved in handling and fixing bugs in production environment.
- Testing support in SIT, UAT phases and used QC for Defect tracking.
- Worked on Performance improvement.
- Prepared the weekly project status report.
- Ensured on time delivery.
Environment: Unix, Oracle PL/SQL, Mainframe Z/OS, COBOL, JCL,DB2, CICS, BTB, MQ, CA7,SORT utilities .
Confidential
Application Developer
Responsibilities:
- Involved in all SDLC phases of the project
- Worked on Data mapping to the Actimize business data models.
- Developed the mainframe application to extract the data from different SOR’s to send it to the Actimize data rules engine.
- Developed the Unix Table Confidential to load the data to the Actimize rules engine tables
- Testing support in SIT, UAT phases and used QC for Defect tracking.
- Worked on Performance improvement.
- Prepared weekly project status report.
Environment: Actimize Compliance Tool, UNIX, Oracle PL/SQL, Mainframe Z/OS, COBOL, JCL, DB2, SORT utilities, CA7.