We provide IT Staff Augmentation Services!

Data Engineer/architect Resume

2.00/5 (Submit Your Rating)

Annapolis, MD

SUMMARY

  • 16 years of IT experience wif special emphasis on Development, Analysis and Design of ETL methodologies in all teh phases of teh Data warehousing life cycle wif knowledge in ETL, Data Analysis, DSS and Data warehousing & OLAP technology.
  • 14 years of experience in IBM Information Server, IBM WebSphere DataStage Ascential DataStage 11.X/8.X/7.X/6.X/5.2 using Components like DataStage Designer, DataStage Manager, DataStage Director, DataStage Administrator and Parallel Extender wif ProfileStage and QualityStage.
  • Over 15 years of programming experience using Oracle (PL/SQL), Azure SQL Database, Big Data, Hadoop, Teradata, Amazon Redshift and DB2.
  • Over 10 years of experience working wif IBM WebSphere MQ Application, MQ Explorer, MQ server and MQ Connector.
  • 15 years of experience in UNIX Shell Scripting, LINUX programming, Python and Perl.
  • Over 4 years of working experience wif BI tools e.g., Cognos, MicroStrategy and Business Objects.
  • Expertise in working wif Tools and Utilities like Hive, HBase, Spark, Autosys, Maestro, Connect Direct, ClearCase, Narrowcast and Tortoise SVN/CVS.
  • Worked extensively on both Star and Snowflake Schema.
  • Worked on Information Analyzer and Quality Stage for Standardization, De - Duplication and Data Integration.
  • Efficient in all phases of teh development lifecycle, coherent wif Data Cleansing, Data Migration, Data Conversion, Performance Tuning, System Testing.
  • Expertise in creating reusable components such as Shared Containers and Local Containers.
  • Familiarity in in corporation of various data sources such as Oracle, MS SQL Server, DB2, XML and Flat files into teh staging area.
  • Skilled in creating custom transformations, functions, and routines.
  • Proven track record in troubleshooting of DataStage jobs and addressing production issues like performance tuning and enhancement.
  • Excellent knowledge of studying teh data dependencies using Metadata stored in teh DataStage Repository.
  • Acquaintance wif PL/SQL, Stored Procedures, Packages, Database Triggers and SQL * Loader.
  • Good working experience in C/C++/C*, JAVA, J2EE, JDBC, JSP and other languages.
  • Strong experience in business processes & interface wif IT.
  • Strong writing and documentation skills for teh management and development.
  • Excellent track record as a leader and team player wif TEMPeffective communication skills.
  • Substantial ability to employ knowledge-based solutions for industry tribulations.
  • Strong diagnostic, indicative, organizational, interactive, learning and team expertise.

TECHNICAL SKILLS

  • IBM Information Server
  • IBM WebSphere DataStage Enterprise Edition
  • Ascential DataStage 11.X/8.X/7.X/6.X/5.2
  • Data Stage Designer
  • DataStage Manager
  • DataStage Director
  • DataStage Administrator and Parallel Extender
  • Exadata CC
  • Oracle 19c/12c/11g/10g/9i/8.x
  • MS SQL Server
  • SSIS
  • Azure SQL database
  • IBM Classic Federation Server 9.x
  • IBM WebSphere MQ Application 8.X/7.X/6.X
  • CDA
  • ERwin
  • Cognos
  • Business Objects
  • MicroStrategy
  • Informatica PowerCenter
  • C/C++
  • SQL*PLUS
  • PL/SQL
  • Sun Solaris 2.6
  • Unix
  • HP-UX
  • AS400
  • XML
  • MS Office Suite
  • Big Data
  • Hadoop
  • Hive
  • HBase
  • Spark
  • DB2
  • DPF
  • Sybase
  • Teradata
  • IBM 308X
  • Mainframe
  • Windows
  • Advanced server
  • Unix shell scripting
  • LINUX
  • HTML
  • C/C++
  • JAVA
  • JDBC
  • JSP
  • Perl
  • Python
  • Connect Direct
  • XML
  • XSL
  • JavaScript
  • Dream weaver
  • Flash

PROFESSIONAL EXPERIENCE

Confidential, Annapolis, MD

Data Engineer/Architect

Responsibilities:

  • Performed Installation and Upgrade for DataStage Server to version 11.5.
  • Configured connections to various on premise and cloud databases (Exadata CC, Azure SQL database, SQL Server, AWS Redshift etc.).
  • Created and configured user accounts and specified roles.
  • Setup Projects, roles, users and autantications for different environments.
  • Worked wif JIS and third-party vendors to configure IBM’s products to interoperate wif industry standard technology, to include installation, configuration, and connectivity.
  • Test/resolve DataStage execution wif new operating system/other application upgrade.
  • Use DataStage stages in Jobs for analyzing and cleansing teh Data.
  • Worked on IBM Classic Federation server to compare IMS data wif Oracle data.
  • Create new jobs or update existing jobs based on requirement due to change in law practices.
  • Use DataStage director to resolve file locks, scheduling, and monitoring for applications.
  • Extract DataStage job log to verify transactional rejects, errors code and ODBC connection failure.
  • Ensure dat technical components function properly independently and when interfaced wif other technology components such as database and mainframe applications.
  • Provide full time support to all DataStage components and applications.
  • Created Jobs and Job Sequencer to load history and county specific data.
  • Integrate DataStage execution wif other components, for example MQ Series, Event Publisher, Database Connectors, and External DataStage components.
  • Installation of patches, Government Rollups and upgrades to IBM product releases to ensure teh success of teh project.
  • Generate DDL scripts using Classic Data Architect to add new entities to existing segment.
  • Created complex DataStage functions/stage variables for teh job requirement.
  • Worked extensively wif DataStage XMETA Repository and metadata asset manager.
  • Worked on WebSphere MQ application for installation, upgrade, maintenance, and migration.
  • Ensure MQ server and channel work properly wif other applications.
  • Work wif MQ Visual Edit to resolve error messages.
  • Resolve invalid object from MQ transaction work queue pending messages.
  • Assist in DataStage job scheduling and on demand execution.
  • Create table definition for IMS mainframe data for sequential files.
  • Generate trace files to monitor DataStage transaction processing.
  • Optimized job performance by carrying out Performance Tuning.
  • Created custom DataStage BuildOps using C++ for application requirements
  • Worked on shell scripts to resolve DataStage Sequencer error.
  • Created Oracle procedures to enable/disable indexes/constraints.
  • Generate PL/SQL statement to analyze Oracle data load.
  • Install/Update DataStage Client software for Windows.
  • Version control using Tortoise CVS for all applications.
  • Create document for DataStage and UNIX component migration.
  • Worked on document to provide support and training related to DataStage.
  • Install Client software for Oracle, WebSphere MQ, Classic Data Architect, Tortoise CVS and FTP on new machines.
  • Work wif IBM to resolve software upgrade and patches related issues.
  • Provide training to support team for DataStage Monitoring.

Environment: IBM WebSphere DataStage 11.5/7.5.X (Designer, Director, Manager, Parallel Extender), Oracle Exadata CC/12c/11g/10g, IBM Classic Federation Server 9.x/8.5, IBM WebSphere MQ 8.X/7.X/6.X, MQ Visual Edit, SQL Server 2016, SSIS, Azure SQL Database, Big Data, Classic Data Architect 9.x, Tortoise CVS, PL/SQL, UNIX, AIX 7.1/6.1/5.3, Linux 7.0, Windows 11/10/7/XP.

Confidential, Hartford, CT

Senior DataStage consultant

Responsibilities:

  • Created DS Jobs to Load teh Data in Oracle tables using Server and PX Edition including version 7.5.X, 8.0 and 8.1.1.
  • Jobs were created to extract data from DB2, Sybase, Flat files, Excel Sheets etc.
  • Upgraded teh DataStage version from 7.5.2 to 8.1.1.
  • Created user groups and profile for DataStage developers.
  • Upgraded teh DS jobs wif adding advantage of Quality Stage while migrating them from 7.5 to 8.1.1.
  • Worked on project versioning and housekeeping for existing projects.
  • Used Quality Stage stages for analyzing and cleansing teh Data.
  • Worked on IBM replication server for automatic data distribution.
  • Designed and tested many Complex Transform functions.
  • Created parallel routines for teh job requirement.
  • Created UNIX and LINUX scripts for Job run and Connect Direct utility.
  • Optimized job performance by carrying out Performance Tuning
  • Used teh DataStage Director and its run-time engine to schedule running teh solution, testing and debugging its components, and monitoring teh resulting executable versions on an ad hoc or scheduled basis.
  • Created jobs sequences to automate teh reporting teh completion of success and failure.
  • Created job schedules to automate teh ETL process.
  • Worked on Error handling and Error correction for existing jobs.
  • Migrated Informatica Mappings to DataStage Jobs.
  • Used Hive to connect to Big Data / Hadoop repositories and extract data.
  • Worked on many BI reports using MicroStrategy tool for customer requirement.
  • Created custom and complex queries for MicroStrategy report building.
  • Used Connect Direct to fetch Data from LAN and also to save teh reports from server to LAN.
  • Also used FTP scripts to retrieve/load data from/to server
  • Created shell scripts for testing teh process in proper manner.
  • Worked on Java services and build up stages for DS Jobs to help creating online portal system.
  • Created DB2 procedures for loading and testing data.
  • Created Batch Job for Overnight Data Loading.
  • Worked on MetaStage to import and export MetaData for repository.
  • Created mapping document for teh Business Intelligence database.
  • Job scheduling using Maestro scheduler.
  • Converted Server Jobs in Parallel for better performance.

Environment: IBM Information Server (DataStage) 8.1.1/8.0, IBM WebSphere DataStage 7.5.X (Designer, Director, Manager, Parallel Extender), MetaStage, Informatica PowerCenter, Oracle 10g, DB2 UDB, Hadoop, Hive, HBase, Sybase, Cognos, SQL Server 2003, Connect Direct, MicroStrategy, MS-Access, XML files, PL/SQL, Python, UNIX, LINUX, AIX, Windows XP.

Confidential, Gaithersburg, MD

Senior DataStage Consultant

Responsibilities:

  • Extracted, transformed and loaded data into Oracle database according to teh required provision by developing DS Jobs in Server as well as PX Edition.
  • Served as DS Administrator for Project maintenance.
  • Installed Enterprise Edition over existing Server Edition.
  • Generated Surrogate IDs for teh dimensions in teh fact table for indexing faster access of data.
  • Created surrogate key tables to map teh required dimensions in teh fact table.
  • Created hash tables for referential integrity and/or otherwise while transforming teh data representing valid information.
  • Used built-in as well as complex custom transformations.
  • Performed Data Migration from Legacy to teh newly designed Oracle datawarehouse.
  • Used teh DataStage Designer to develop process jobs for extracting, cleansing, transforms, integrating and loading data into data warehouse database.
  • Used Quality Stage and Audit Stage for testing and verifying Data Quality.
  • Used scripts to extract data in different files from IBM mainframe source.
  • Used DataStage manager to manage teh Metadata repository and import/export of jobs.
  • Used PL/SQL processes to upload flat files using SQL*Loader.
  • Database Extraction and filtering using Unix Shell Scripts.
  • Worked on JSP, JDBC and Servlets for product integration.
  • For better performance implemented parallel extender jobs using stages like Join, Merge, Sort and Lookup.
  • Optimized job performance by carrying out Performance Tuning.
  • Identified source systems, their connectivity, related tables and fields and ensure data suitably for mapping.
  • Created source table definitions in teh Repository by studying teh data sources.
  • Used Quality stage to handle general errors and created many custom routines for such events.
  • Created Log Tables containing data wif discrepancies to analyze and re-process teh data.
  • Troubleshot teh designed jobs using teh Debugger
  • Also involved in moving from Server to PX edition.

Environment: IBM Websphere DataStage 7.5 (Designer, Director, Manager, Parallel Extender), MetaStage, Profile Stage, Quality Stage, Oracle 10g, SQL Server 2000, MS-Access, XML files, PL/SQL, JAVA, Perl, Cognos 8, UNIX, HP-UX, Windows 7/XP.

Confidential

Oracle Programmer

Responsibilities:

  • Created database objects through development, testing, and production environments.
  • Wrote in-house data entry applications in Visual Basic and Oracle.
  • Provided maintenance and support to business clients.
  • Installed programming restricting user’s actions.
  • Provided assistance to full time computer operators wif tape backups and problem resolution.
  • Participated in system construction, analysis, testing, and implementation.
  • Modified and upgraded database systems to suit company requirements.
  • Responsible for teh testing and debugging of programs.

Environment: Oracle 8i, SQL Loader, PL/SQL, C/C++, Visual Basic, UNIX, Windows NT

We'd love your feedback!