Etl Lead-consultant (etl/bi Architect) Resume
SUMMARY:
- Over20 yearsof IT - experience, with 10+ years asETL Architect/Data Management Leaderand 5 years as Analytics Lead with a strong background inETL,Data-warehousing using Informatica 9.6.1, SSIS-2016, Talend 5.6,.
- Experienced in developing Dashboards and reports for Prescriptive, Predictive and Descriptive Analytics using BI Tools like Tableau 9.x, Business-Objects, Custom-tools and Open-Source tools.
- Experienced inPlanning,DesigningandImplementingData warehouses/Datamarts with concepts of bothrelational&multidimensionaldatabase design using tools like Erwin.
- Experienced inData-Governance, management of Master-Data (MDM), Metadata (MM) and -Data (RDM), Data-Quality and the respective tools like IDQ, MDM and Power-Exchange Adapters.
- Experienced inBigdata Architecture, tools and technologies (HDFS, HIVE, HBASE).
- Knowledgeable about data warehouse tools, techniques and best-practices including ETL, dimensional data-modeling (Star Schema, Snow Flake Schema, FACT & Dimension Tables), Reporting and OLAP Platforms.
- Worked on Natural Language Processing initiatives using Python with different unstructured and semi-structured sources like Machine-logs, Flat-Files, PDFs, MSOffice documents and RDBMS-CLOBs.
- Managed teams (ranging from 5-12) comprising ETL-developers, BI-Developers, DBAs, Architects and Data-Scientists and delivered projects lasting from few months to one year (with budgets up to $4M)
- Worked extensively with various database systems likePostgreSQL, Oracle,TeraData,UDB DB2,Microsoft SQL Server,Sybase, Hive, HDFS, HBase and Microsoft Access(as Sources, Targets and Repositories).
- Effective in establishing great working relationships with customers to understand their requirements and manage their expectations. Worked with and managed resources on offshore teams for 7 years.
- A serving leaderwithgood communication-skills,leadership-skillsand motivational-skills with exemplary analytical and team-building experience.
TECHNICAL SKILLS:
Platforms & Scripting: UNIX/AIX, AS/400, Windows (200*/7), Mainframes (MVS, VM/370), OS2.
SOFTWARE: Teradata, Hadoop, HDFS, Hive, HBase, SQL Server, SSIS, SSRS, PostgreSQL, Talend, Informatica, DataStage, Business-objects, Teradata Oracle, SQL-Plus, SAS, Unix/Windows Scripting, Mainframe Tools/Utilities, NDM/HTTPS/SFTP, MS-Project, MF-COBOL, Testing tools, TOAD, SQLAssistant, SSMS, SQLDeveloper, Pgadmin and MSOffice.
LANGUAGES: Python, JAVA, R, SQL-scripting, Shell-scripting, VBscript, C++ C, BASIC, Mainframe based languages, PERL, PASCAL, VB.Net, Power Builder and Fortran.
PROFESSIONAL EXPERIENCE:
ETL Lead-Consultant (ETL/BI Architect)
Confidential
Responsibilities:
- Designed and developed ETL Architectural-Framework and documentation for Informatica and Teradata platforms.
- Worked with Scrum-masters, Sr. Managers and Directors on initiatives related to building-teams (including creating job descriptions and facilitating interviews), scoping projects, Product-management and architectural guidance
- Developed Database Architecture-Framework, relevant documentation and best practices for Teradata and Hadoop (Hive, HBase and HDFS) by partnering with Teradata and EY Professional services
- Worked with business analysts and Data-Architects to model ODS and Data-warehouse in Erwin. Performed analysis for Master and Data on subject areas of Party, Producer, Billing, Claims and Enrollment.
- Worked with Data-Governance, Data-owners, Data-stewards, MDM-team and Data-Custodians on -Data, Master-Data, Metadata management and Data-Quality management (using profiling tools like IDQ and Developer)
- Implemented ETL Frameworks for new Hadoop-Staging Data-Lake, Operational Data-Store and new Data-warehouse for financial systems
Sr. Database-Developer/Consultant (ETL/BI Architect)
Confidential
Responsibilities:
- Worked with Directors and VPs on Architectural initiatives related to Call-center agent and customer Analytics
- Designed and developed ETL Batch processes in SSIS, SQL-server and UC4 for financial systems
- Implemented RDM and ETL Frameworks for Operational Data-Store and Data-warehouse (Bank IT systems)
- Worked with Data Architect to refine Data Models and handled production support for legacy SQL-server systems
- Worked on Dashboards, Reports, Statistical-Analytics and geo-Analytics using Tableau and SQL-server
- Helped management in building-teams (including creating job descriptions and facilitating technical interviews), scoping projects and architectural guidance
Data Management Leader (Data, Analytics and ETL Architect)
Confidential
Responsibilities:
- Helped management in building my teams and other teams in the company (including creating job descriptions and facilitating technical interviews), scoping projects and architectural guidance
- Developed Data-architecture, ETL Batch processes in Talend, SQL-server and PostgreSQL for Call-center systems including architecture for parsing documents (related to Call-center notes)
- Designed and implemented new environments and ETL frameworks for conformed data delivery and Call-Center-Analytics in Tableau and custom-Analytics platform
- Worked on Dimensional Models, SCDs, Error-event schema, Audit dimensions to satisfy business requirement and worked with development teams to implement the Data-Models, Mapping-docs and ETL to satisfy technical requirements
- Designed and developed Loads (full and incremental) and optimized-jobs as part of black-box solutions
- Led a team (10 BI developers and 2 Data-scientists) for building Analytics solutions and played roles of ETL-Architect, Data-Architect, Analytics-Lead and Scrum Master
- Worked on evaluation of PostgreSQL, MongoDB and other NoSQL databases for text-mining from user-forums on websites created for cancer- Confidential ts
- Worked on NLP initiatives including keyword proximity analysis when parsing textual call-center data
- Evaluated Hadoop unstructured information processing frameworks like UIMA, GATE and NLTK(Python)
- Evaluated Hadoop real-time stream processing frameworks like Storm, Kafka and Spark-Streaming
- Evaluated Open-source frameworks for real-time audio/video stream processing like Sphinx and Kaltura
- As an ETL-architect resolved geocoding issues for Caviar-analytics using Pentaho
- Deployed the black-box solution (talend-jobs) as compiled WAR files for Linux OS
ETL-Lead
Confidential
Responsibilities:
- Led a team of 12 ETL developers and played roles of Lead-Developer, Scrum Master and Project Manager
- Upgraded ETL Batch process to Talend/TAC, gained ETL and development process efficiencies
- Generated and Performed TIFVAL/QA gating reviews for data-conversion
- Designed and implemented new environments and ETL frameworks for network-data conversion and for semi-structured data conversion involving WA-notes/CLOBs
- Worked on complex SQL Queries and produced reports using Talend for Source and Target cleansing
- Worked with Data-Mapping team to implement ETL-code from gathered requirements and Mapping Docs
- Deployed the solution of Talend-jobs as compiled JAR files for Linux OS using Confidential edition scheduler
Business Analyst/Sr. ETL Developer
Confidential
Responsibilities:
- Performed requirements analysis for CRBI.
- Designed and developed mapping documents for ETL (SSIS-2012) batch processes by using Data-profiling, T-SQL.
- Performed testing for ETL (SSIS-2012) and reports (SSRS-2012) maintenance.
- Designed ETL-SSIS framework based on requirements meta-data documentation and implemented, more than half of it, for loading historical data.
- Designed and implemented Parameterized and cascading parameterized reports using SSRS.
- Created ad-hoc reports using SSRS in developing Parameterized, Drill Down, Drill Through, Chart, Graph, Linked, Dashboard, Scorecards, Drill-down and Drill-through reports using SSRS.
Sr. Software Engineer/Sr. ETL Developer
Confidential
Responsibilities:
- Designed and developed ETL batch processes using SAS-DI, Text-miner and Teradata.
- Designed and developed reports in aiding targeted campaigns using Base-SAS, SAS-Campaign Manager and Teradata.
Sr. Software Engineer/ETL Architect
Confidential
Responsibilities:
- Designed and developed data-acquisition and data-delivery systems using tools (Data-Stage, SFTP, HTTPS, encrypted-FTP) and scripts for DST applications and BARS databases.
- Led production support of ETL based transaction processing systems and in the process helped re-architect applications and technologies.
- In the ETL-Architect role evaluated Data-tools for ETL-Development, ETL-testing, BI-Reporting (Cognos, Info-builder), Analytics and Big Data initiatives.
- In the Data-Architect role helped in establishing initiatives like Governance, Business-Recovery and IT Roadmaps.
- Helped setup SLA based reporting on Data-processing systems for acquisition, processing and delivery.
- Evaluated IBM (Pure-Systems/Netezza), SAP and Oracle vendor technologies in Big-Data initiatives including unstructured and semi-structured data.
- Helped in modeling Source, Staging and ODS databases for ETL loads.
Sr. Professional/ETL and DB Conversion Architect
Confidential
Responsibilities:
- Developed on SQL Server Databases using Tables, Indexes, Stored procedures, Views, Triggers, user defined functions, cursors, derived tables, common table expressions (CTEs) and Triggers to facilitate efficient data manipulation and data consistency. Written complex SQL statements using joins, sub queries and correlated sub queries. Designed many Packages using SSIS Designer by using Control Flow, Data-Flow, Lookup, Derived Columns, Condition Split, Script-Task, Aggregate, Pivot Transformation, and Slowly Changing Dimensions.
- Involved in data extractions using SSIS, and designed and produced documentation of data transformations for all extractions. Developed, deployed and monitored SSIS Packages including upgrading DTS to SSIS. Helped design and implement processes for deploying, upgrading, managing, archiving and extracting data for reporting.
- Designed best practices document for ETL and Reporting Systems using Data Warehouse concepts. Experience in Error and Event Handling: Precedence Constraints, Break Points, Check Points, Logging.
- Created SSRS reports using Report Parameters, Drop-Down Parameters, Multi-Valued Parameters Debugging Parameter Issues Matrix Reports and Charts.
- Developed regional-carrier ETL processes for DW/BI and resolved prod issues using Informatica on windows.
- Implemented ETL based test system refresh process through Informatica and DataStage.
- Led EDW Reporting (Business-Objects) team for regional transportation and fulfilled IT-Business liaison roles.
- Migrated mainframe based (delimited files, VSAM, Eztrieve) based reporting system to SSIS/SSRS.
- Developed and Migrated MS-SQLServer based DTS Services to SSIS/SSRS for executive management reporting.
- In the role of ETL-Architect Designed and implemented ETL transformation of data for PowerForward on National-EDW from Oracle to SQL Server DataMart using Informatica on UNIX.
- Developed complex T-SQL queries, stored procedures using temporary tables and designed SSIS packages for data cleansing, transformation and loading. Led ETL-conversion of Teradata-to-Oracle migration of Regional EDW.
- Performed metadata management, reporting and administration of Informatica and Business-Objects.
- Setup cyclone (sftp,ftp, oftp) for Informatica-B2B/EDI teams and helped develop their ETL processes.
- Involved in star-schema data-model build outs for Regional and national EDW and used Data-profiling tools for discovery and data-quality. Automated cross-environment DB2-Data-refresh for people-soft using ETL tools.
- Evaluated appliances like cast-iron systems and technologies like golden-gate and developed SAS-AF replacement software to realize annual savings.
- Customized Smart-TS (a google like source-search engine) for Unix, Windows, SQL-server (SSIS,SSRS), AS/400 and Mainframe platforms for all 3 operating group of companies. Also involved in generating PDF documents and reports regarding the Smart-TS usage. In addition to code also added Smart-TS libraries for searching all business documents like PDFs and Microsoft Office documents. Designed and Developed Code-generators and automated encryption system to encrypt and preserve integrity for People-soft/Payroll test-data.
Sr. Software Engineer
Confidential
Responsibilities:
- Served as a Team-lead, designer and developer for security conversion project, Disaster Recovery, Vantage-One based Fortis Conversion (VIPS, DR), Employee Gross-up payment, and other projects.
- Migrated projects using PRS/Panvalet change managers, SDLC methodology and developed/reviewed Tech/Business and Test/Estimation Specs for these projects and was part of on call support for all the regions.
- Involved in leading Testing efforts with Win-runner and Load-runner for major projects in different regions (System, Integration, Volume, and User-Acceptance) and preparation of Test Plans, RACF setup and execution.
- Monitored Test and Production VAS Storage growth to reduce significantly the storage expenses using SMS and TMS. Developed tools for storage analysis, management-reports/emails and to improve productivity for team members in activities like pulls and refreshes for the Test-regions and developer aids.
- Led ETL team for providing VISTA extracts to mainframe using Oracle ETL Data-Warehouse builder.
- Involved in application performance tuning with CICS/TS1.3 and Batch systems using history-file expansion, job optimization. Extracted data to PC using TERADATA SQL Assistant/Queryman and generated data mining reports on mutual-fund feeds using SAS. Setup CICS/DB2 and AIX test regions and their capacity planning.
- On data-security projects worked as System Security Administrator and architect for conversion project. Led in migration projects: CICS/TS, OS/390, MVS-SYSPLEX-64bit and z/OS VAS Migration. Forecasted the Hardware/Software growth and led the capacity planning for the DST-VAS system.
- Led teams by managing Projects, helping out in requirements (gathering and analysis), High Level Design, Detail Technical Design, Database Modeling, Interface Design, Defect resolution, Development and Production Support for the latest MERS system and Transaction Tracker System (a Web Based Report Viewing System using MQ, OCI, Java, ORACLE, HTML and using Object Oriented Analysis & Design Methodology).
- Worked on generating, indexing and archiving PDF Merchant reports using Mobius
- Fixed major business defects involving handling of unbalanced merchant tree structure in Online and Batch systems for MERS. Involved in performance and tuning on Mainframe. Developed & maintained MERS using IBM Mainframe, AIX and OS/2 products. Involved in scheduling/OPC, Disaster Recovery and project management.
- Generated meta-data reports on MERS reporting.
Sr. Systems Analyst
Confidential
Responsibilities:
- Involved in Design and Reviews of the conversion strategy, capacity planning for Y2K-compliant code conversion of the CTS. Addressed all major changes in the design of conversion process as a team lead.
- Developed all the tools including GDG based processing tools for testing, for manipulation of the IDMS source for CCCA processing using Mainframe Tools, ISPF services, macros and IBM utilities. Coded & Tested COBOL-CICS, VSAM, VTAM-CICS-Macro Assembler programs.
- Also involved in application performance tuning involving CICS and IDMS Led the team by managing the conversion project using MS Project.
Sr. Systems Analyst
Confidential
Responsibilities:
- Maintenance and enhancement of the Assembler code using Expeditor and ISPF for TLM/TMS as a team lead. Tested TLM/TMS with different subsystems like MVS-PARALLEL-SYSPLEX, DB2 and CICS.
- Developed REXX, CLIST, DIALOG MANAGER Tools as a team-lead for enhancing documentation of the Assembler programs and establishing their call structure for the Tape Library Manager.
- Also developed Public Key Cryptography on OS/390 platform in LE and worked on VTAM programming.
- Involved in design, development and testing of ISMF 1.4.0, ISMF 1.5.0 and led the team for automated regression testing of ISMF 1.4.0.
