Lead Consultant - Data Warehouse/integration/etl Resume
OBJECTIVE:
- Seeking an Data Integrate and ETL position in large, complex enterprise data integration and data warehouse, business intelligence system development and support, by utilizing my 17 years hands - on experience in Databases, Data Integration tools, UNIX/LINUX and windows programming.
SUMMARY:
- Over 17 years’ experience in enterprise data integration and data warehouse/mart creation, re-engineering, system conversion; and BI application expanding. Involved in numerous life-cycle data warehouse/mart creation and migration projects.
- Working experience with Kimball, Inmon methods; multiple dimensions (Start schema and snowflake schema structured databases); Complex enterprise data hub and data integration systems.
- 17 plus years hands-on experience in utilizing data integration/ETL tool sets, such as Informatica, Ab Initio, SSIS, SAP BO DS/DI; and major database utilities of Oracle, DB2 UDB/LUW, SQL Server, Teradata.
- Specialized in very large amount data migration and conversion, databases conversion, operating system conversion, and ETL tool migrations (Including repository database migration and conversion).
- Solid relationship databases knowledge, database programming and development working experience in multiple databases including Oracle, DB2 UDB, SQL Server, Netezza, Teradata. And UNIX/LINUX, Windows operating systems, plus strong skills in shell scripting in UNIX/LINUX, and batch file scripting in Windows.
- Strong working experience with database programming languages, including SQLs, PL/SQLs. And database user interface such as TOAD and TOAD liked, TSQL, SQL*Plus, db2, sqlcmd, nzsql, BTEQ.
- Working experience to exchange data between Mainframe, Oracle applications, PeopleSoft, Saleforce.com (use Informatica Plug-in, and cloud connection), and SAP (use Netweaver). Pull data and feed data between Oracle, SQL Server, DB2, Netezza, Teradata, Sybase databases, and SAP BW. Source data from and target data records into flat text file and XML data file.
- 15 plus years of hands-on working experience in ETL system design and creation by using Informatica. Strong skill in ETL system design, performance tuning, real-time control, and ETL system automation by combine OS shell scripts, Database utilities, and ETL tool features.
- Deep understanding of the Informatica Power Center application and hand on experience with PowerCenter, PowerExchange, IDQ, MDM installation, domain setup and configuration in UNIX/LINUX platform. And Informatica repository management, Oracle, PeopleSoft, SQL Server, SAP, Netezza, Web service and cloud connection setup.
- Multiple industrial experience including: Transportation, Retail, Financial/Banking, Manufacture, Defense, Healthcare/Insurance (Plans and Claims), and Publishing.
TECHNICAL SKILLS:
ETL TOOLS: Informatica and working experience with Ab Initio, SSIS, SAP BO DS/DI
DATABASES: Oracle, DB2 UDB/LUW, SQL Server, Netezza, Teradata, and Sybase
OPERATING SYSTEMS: UNIX/LINUX, Windows and Window NT
LANGUAGES: SQLs, PL/SQLs or SQL/PLs, Shell and Perl scripting and Window batch file
APPLICATIONS: Oracle Finance, PeopleSoft, SAP & SAP BW, Salesforce.com and Web Services
DB USER INTERFACES: TOAD, SQL Developer, PL/SQL Developer, TSQL….
DB COMMAND LINE UTILITIES: SQL*Plus, db2, SQLcmd, NzSQL, BTEQ.
BI REPORTING TOOLS: BusinessObjects, Cognos, MicroStrategy, Hyperion
JOB SCHEDULER: AutoSys, Tidal, Maestro, Control-M
PROFESSIONAL EXPERIENCE:
Confidential
Lead Consultant - Data warehouse/integration/ETL
Responsibilities:
- Design, create data integration systems in Informatica suite to integrate data between mainframe, DB2 LUW, SQL Server, Teradata databases, SAP, SAP BW, Salesforce.com, flat text, XML files
- Design, layout, create automatic databases batch processes and data file distributions systems by combine Maestro job streams, UNIX scripts, Oracle, DB2,Teradata, Netezza database stored processes, Informatica PowerCenter, Powerexchange objects.
- Pfizer Data warehouse Teradata to Oracle Exadata database objects and Informatica ETL system conversion project:
- Conversion project scoping and work load estimating, such as database structure migration, data record migration and the ETL system migration.
- Database and ETL system conversion plan in details. Keep the same application functions replace the Teradata/Informatica data warehouse system by Exadata/Inormatica.
- TargetBase’s Clients (Honda, Acura, Abbott) Ad Campaigns Technical Doc.
- Setting technical database (Oracle, SQL Server), Informatica user interface for Off-shore teams.
- Provide technical databases, Informatica ETL system, batch job scheduler, UNIX batch job automation scripting accessing guide line.
Confidential
Sr. Data warehouse/ETL developer
Responsibilities:
- Provide technical consultant service in following projects:
- Install, Set up and configure Informatica MDM repository and service in Oracle/UNIX environment.
- Created a numbers of data marts according to business user’s requirements by gone through physical data modeling, database table layout, DDL and table creation, ETL (Informatica, UNIX shell scripts) system design, coding, test sample select, data validation, function test and unit test, QA and Prod migrations, system go life and documentations.
- Redesign and create a number of difficult ETL processes for improving performance. Such as data sourced from very large flat text file (up to 12 GB in file size), data loading process need go through large numbers of complex looking ups, and remove complex override SQL statements from source qualifier and lookups. Change data capture without using Inforamtica CDC/PowerExchange components. Standardized second type slow change table data loading processes, simplizing
- Design and created text file handling application by utilizing UNIX shell, awk, and sed utilities scripting with functions of data file collection
- Such as larger file split, per-load validate for source and data file distribution, such as file split per business required, post-load data validation, rejected data file repair and reload.
Confidential
Data warehouse developer
Responsibilities:
- Provide Data warehouse consultant service for supporting Expedia’s Vendor Network Hotel booking business operation.
- The technical environments are: Databases & Big Data - DB2 LUW, Oracle, SQL Server, Netezza and Hadoop; Batch processing job scheduled by Perl/Batch file/SQL Server stored procedure and Control-M job scheduler; ETL
- Informatica and database stored procedures; BI Reporting Tool: SAP BusinessObjects, and Excel.
Confidential
Sr. data warehouse developer leader
Responsibilities:
- Provide Data Warehouse and customized drug safety testing report system for FDA and major drug manufacturers. The whole system including testing data collection database
- ETL system (change data capturing), data staging area (a set of database table), metadata management structure (build by a set of lookup tables and SQL programs support user interface for testing report formatting, job setup, and trigger on-demand report create processes).
Confidential
Sr. Informatica/ETL developer
Responsibilities:
- )Provide consulting services in the projects of; ETL system migration from SSIS to Informatica; Informatica ETL system automation, and Informatica version upgrade from 8.6.1 to 9.1.1 version
- Major skills used are; Informatica 8.6.1 and 9.1, Oracle 11g, SQL Server 2005 and 2008. Windows batch file and UNIX shell scripts; and Tidal batch job scheduler.
Confidential
Enterprise Data Integration Developer
Responsibilities:
- Provide Data integrate consultant service to start Confidential Corporation IT’s data integration project. Created data integrate system template including; data hub - it is a set of data files in UNIX with per-loading data validation through MDM system
- Powered by Informatica CDC, clearing, and archiving. Data file transformation - Transfer data files to Informatica host server by SFTP, and Informatica data loading processes to load data into SAP BW database.
- Related technical and software including: SAP ECC, SAP BW, Oracle and SQL Server, Informatica, UNIX and shell scripting.
Confidential
Sr. ETL software engineer/Independent Contractor
Responsibilities:
- Provide Informatica PowerCenter, ETL system consultant service for the enterprise data integration projects of:
- Operational Data Hub project. Use Informatica to extract data from SAP BW through Open Hub with multiple sources. Create near real time data hub (data file system), validate data records through CDC refreshed MDM tables, redistribute data file for information sharing (Informatica mappings and UNIX scripting).
- Data integrate system between SAP and salesforce.com. Design and create Informatica mappings to pull data from SAP BW (Through Open Hub/Infosource) and perform the data transformation, then load into salesforce.com CRM database.
- Finalize Informatica data integration processes for the Confidential ’s state of art of commission system. With the major responsibilities of Informatica defect fix, Unit testing, Informatica mapping and system performance tuning, Informatica workflow recreate and combine with UNIX shell script to automate ETL systems. .
- Fidelity Investments
- Informatica Developer/Independent Contractor
- Provide Informatica consulting service in projects:
- Consolidate Informatica ETL systems for the new data mart creation project. And ETL system production migration. The major data sources are Oracle, SQL Server, and flat text file, data was loaded into Oracle database, and flat files as needed.
- Working with Data Analysts in add new field into data transformation, data transfer logic modification; modify Informatica workflow by re-setup the dependency between related sessions.
- Worked with data analysts, to modify Informatica ETL processes by combine with UNIX shell script. Oracle data stored procedure and Control-M job scheduler.
- Netezza database evaluation research with the tasks of; nzwrite connection setup in Informatica, created batch data moving process to transfer between Oracle and Netezza by using nzload/UNIX for data migration.
Confidential
Sr. ETL Consultant/ Independent Contractor
Responsibilities:
- Provide technical consulting service in ETL batch processes system migration project.
- Automate Informatica batch processes by using shell script and Autosys job scheduler.
- Data warehouse, and ETL system consolidations, migrations including Informatica mapping, workflow, Host machine environment settings, and database staging tables design.
Confidential
Informatica Consultant/ Independent Contractor
Responsibilities:
- Provide technical consulting service in Informatica to support company’s data integration projects to integrate data between databases and Web service.
- Create Informatica mapping/workflow migrate data records from databases (DB2, Oracle, and SQL Server) through Informatica transformations then load into SQL Server database through Web server.
- Setup standard procedure by using WSDL file as XML file definition, create Informatica mapping to read data in XML format, pass Web service call in XML format command, or create target data file in XML format.
Confidential
Sr. ETL/Informatica Developer/ Independent Contractor
Responsibilities:
- Worked as ETL developer consultant in Confidential ’s data warehouse combine Health Care Plans and Claims for to provide Better Health service to clients.
- Designed and created data migration processes by use nzsql/UNIX shell script to migrate data from Oracle to Netezza database in batch. Reset up the ETL system target to Netezza database tables.
- Designed and created data extracting processes by using Windows batch file script/XML to pull data records from salesforce.com in the way of cloud computing.
- Created database queries monitoring, source data files monitoring process by using UNIX shell script, nzsql, and Informatica.
Confidential
Sr. ETL Software Engineer/ Independent Contractor
Responsibilities:
- Within the MDM project by utilizing Informatica CDC, created and re-engineered numerous ETL systems for data consolidation, synchronization, and centrally manage and distribute enterprise data.
- Designed and created ETL system for two new data marts, with data validation, data recovery, and status message sending function. Data sourced from Oracle, targeted to SQL Server, and major lookup tables are in SQL Server database. Automate ETL batch processes by combine script, Informatica and Tidal job scheduler.
- Project leader of five developers, designed and created Pay Roll data files processing system for ecommerce application by using Informatica as data translation tool. The system has data translation, validation, event protection and job failure recovery functions.
- Worked as project lead of three senior developers, upgraded (Through the whole processes of plan, installation, Informatica repository migration, testing, and verification) Informatica server three times successfully; A).
- From 7.6 (UNIX) to 8.1 (UNIX). B). from 8.1 (UNIX) to 8.1 (LINUX). C). from 8.1 (LINUX) to 8.6 (LINUX). These upgrades also include SAP connection and ODBC for SQL server connection upgrade.
Confidential
Data Warehouse Developer
Responsibilities:
- Consolidated the shipment and purchase/receives data marts to become one service level data mart application in order to maintain the aircraft parts distribution contract with major suppliers such as GE and Boeing.
- The system was created by Oracle 10g, SQL and PL/SQL procedures, Informatica processes and UNIX scripts. There are more than 40 batch processes scheduled to run every night to perform the daily loading and updating.
- Finished two full life-cycle data mart application system development projects. Started from creating development/test database and environment, ETL system design to program and system testing, data validation, then final go production.
- These data mart systems uses SQL, PL/SQL, Informatica and Oracle database.
- Designed and created three ETL data movement systems. There are more than 400 different individual PL/SQL procedures, UNIX shell scripts, Informatica maps, and processes. Every one of these has gone through the design, create, test, and go production process.
Confidential
ETL Developer lead
Responsibilities:
- Project lead of three developers in the data consolidation, migration of Associate and Key Bank cards data records into CITI cards data warehouse. More than 7TB data records are migrated.
- Created database table archive/purge system with fully automatic functions by using Ab Initio UNIX shell script, and contol-M job scheduler.
- Worked as lead of a three members project team, layout, design, and create a Web-enabled data loading system by using Java script, ODBJ, DB2 SQL, Ab Initio, and UNIX shell script.
- Lead a project team of two, designed and created automatic daily, weekly, and monthly data load/transforming system for Home Depot credit card usage data mart (New reporting data mart). It is using Informatica, and UNIX shell script.
- Developed numerous automatic data extracting process, report create and distribute processes via Oracle SQL, PL/SQL stored procedure, UNIX shell scripts, Perl, VBA macro and Cognos.
Confidential
Senior ETL Developer
Responsibilities:
- Consolidated two new store chains’ sales inventory data into the corporation data warehouse and BI reporting application system.
- Created and modified numerous automatic data loading and post-loading processes by using SQL*Loader, PL/SQL, UNIX shell script and AutoSys job scheduler.
Confidential
Oracle database programmer
Responsibilities:
- Database programming in Oracle database by using SQL*Loader, PL/SQL, and UNIX shell script.