Edw Developer / Etl Architect Resume
Mooresville, NC
SUMMARY:
- Confidential Certified Professional with 8+ years of experience as Confidential /EDW Developer in data migration and Datawarehousing. 3+ Years of experience as Solution Design Architect (SDA) in creation and maintenance of source to target mapping for Datawarehouse using Confidential and Data Stage.
- Strong knowledge of Confidential RDBMS Architecture. Knowledge of Confidential Data Stage, WinSCP, Accurev and Autosys. Used NDM, FileAID, XMIT and other MVS utilities and well versed with JCL/TSO/SSO/Windows/Unix.
- Extensive experience with ETL/Data warehousing tools in Finance, Healthcare & Retail.
- Proficient using MultiLoad, FastLoad, Bteq, FastExport and TPump to design and develop dataflow paths for transforming and loading data.
- Lead and guided development of Data Stage based ETL architecture. Developed ETL solution in highly demanding environment and provide hands on guidance to other team members.
- Analyzed complex ETL requirements and design. Collaborated with Development teams and Senior Designers to develop architectural requirements to ensure client satisfaction with product.
- Assessed requirements for completeness and accuracy. Determined if requirements are actionable for ETL team. Conducted impact assessment and determined size of effort based on requirements. Identified, recommended and implemented ETL process and architecture improvements.
- Assisted and verified design of solution and production of all design phase deliverables. Identified bugs when Developers are not able to do so in UAT.
- Worked with Business to gather new requirements. Analyzed the logical and physical Data Models proposed by DA team, identified the mistakes and got them corrected.
- Identified the categories of various tables in the data warehouse based on the source system processing. Prepared Tables Migration list for complex EPM project, and worked with DA to get them implemented in QA & Production. Proposed Prod. Schedules for new jobs by coordinating with Source Team.
- Strong T - SQL, ANSI SQL coding skills. Skillfully exploited OLAP analytical power of Confidential by using OLAP functions such as Rank, Quantile, and group by etc. to generate detail Reports for Marketing.
- Proficient in Confidential SQL tuning and in using Confidential SQL Assistant. Strong understanding of data warehousing concepts and well versed with Bill Inmon's 3NF and Ralph Kimball's Dimensional modeling. Wrote UNIX Shell scripts and JCL for batch processing.
- Experienced with scheduling tools and ETL processes, using Datastage and Confidential to design source definition, target definition and transformations to build mappings.
- Good knowledge of Performance tuning, Application Development and Application Support on UNIX, MVS and Windows NT Environments. Good knowledge of Logical - Physical data models conversions.
- Experience working in all phases of SDLC. Excellent verbal, written communication skills and a great team player.
TECHNICAL SKILLS:
Operating Systems: Confidential Mainframes, Windows XP, 2000, Unix/Linux.
Databases: Confidential V2R5/V2R6/V2R12/V2R13/V2R15, Oracle 10g/11g, SQL, Server2016 Studio, DB2
Tools: Query Facilities SQL Assistant, Oracle SQL Developer, BTEQ, TOAD, WinSCP, Accurev
Load & Export: FastLoad, MultiLoad, FastExport, BTEQ, OLEload, Oracle SQL Loader
ETL: Data Stage V9.1, Informatica 7.1
Languages: C, C++, JCL
Scripting Languages: UNIX Shell Scripting, JCL, Perl
Automation Tools: CA-7, Tivoli, Autosys and Control M
Other: Business Objects, Webfocus
PROFESSIONAL EXPERIENCE:
Confidential
EDW Developer / ETL Architect
Responsibilities:
- Worked as EDW Developer and Confidential Warehouse Design Architect. Responsibility was to leverage tables/views from Oracle, DB2, SQL Server to Tera Data according to the business requirements. Collaborated with Development team and Senior Designers to develop architectural requirements to ensure client satisfaction with product. Actively involved in team discussions with Business, Source system (Oracle, DB2 and SQL Server) and the Reporting team.
- Extracted, transformed and loaded source files in the Data Warehouse. Used Confidential Multiload, Fast load, Bteq utilities to load data in the Confidential database.
- Created JCL scripts and control cards for batch processing. Created mappings using transformations such as aggregator, filter and update strategy. Extensively used Confidential SQL assistant for unit testing. Used comma delimited files from Oracle data source and transformed into Confidential databases.
- Created tables, temporary tables and views as required. Wrote Multiload scripts on Mainframes platform considering the volumes of load data.
- Created join indexes and temporary tables which improved the query performance.
- Updated the metadata with all necessary information for all tables and fields in the data warehouse. Developed use case specifications for Confidential project based on analysis of business requirements Confidential source system (oracle) and the new Confidential platform.
- Performed System testing before ERM launches of projects to get business concurrence and signoff. Used PUPS and Confidential Migration system and migrated code from test environment to Production environment.
- Ftp'd csv files from source to local environment (MF) and used ftp to get the file from MF. Backfilled metrics on a table according to the Business requirement. Completed data propagation requests for various tables.
- Analyzed Reports and clarified business user concerns. Analyzed discrepancies Confidential two related reports by looking at the input files and what is stored in the Datawarehouse. Used CA-7 scheduling tool to schedule and monitor batch processes.
- Worked on numerous investigation tasks to find the usage of tables/columns. Performed investigation and dropped many physical tables in data warehouse per Data Retention guidelines.
- Represented EDW team in a wider audience, for all the changes that were launched by our Team.
- Aware of lean Agile process and various stages in the Kanban board.
- Performed extensive analysis when legacy files were decommissioned, values changed in many columns and 2 headers in many files were removed. Identified all the staging and metric tables that were impacted by the above. Conducted Code/Test and Prod reviews with Support team.
- Analyzed what ETL changes are needed when a fin label code was added in DB2 Source system for Lincoln Financial services in Canada.
- Worked on 2 EPM projects as both Design Architect and Developer and launched them flawless. Created technical specification documents for mapping data from legacy NA Warehouse to Confidential warehouse. Interacted with business to prepare the technical requirements for 10 ETL Developers.
- Worked with offshore Development team for 2 years as Design Architect during Unit testing and UAT phases.
- ETL blueprint comprised of ODS, Integration and Mart layers. Identified the tables across various layers in the Global Datawarehouse.
- Played lead Architect role in designing a critical Integrated table based on business requirements, and launched it flawlessly. Handled all the transformation issues in UAT.
- Designed Pseudo views and PII views for Reporting needs.
- Prepared Tables Migration list for 1 complex EPM project, and worked with DA’s to get them implemented in QA & Production.
- Proposed schedules for new jobs by coordinating with Source team.
- Worked on new Prod and test MF servers for China projects.
- Worked extensively with Reporting team on mapping templates for various Reports. Coordinated extensively Confidential Source, Design, Development and Data Architect teams to deliver the end product.
- Worked on setting up SQL server and Oracle SQL Developer Connectivity initially for all the test environments and Production.
- Advised Design and Development Team leads to add critical Production launch tasks in the Project plan.
- Reviewed and approved Database Change Requests to get the tables created by the DA Team.
Environment: Confidential V15.10(BTEQ, Fast Load, Multi Load, T-SQL), Confidential Data Stage V9.1, WinSCP, Autosys, Accurev, MVS, JCL, TSO/ISPF, COBOL, DB2, Confidential Mainframes, Confidential, CA-7, Confidential SQL Assistant, Oracle, SQL Server 2016 Studio, Oracle SQL Developer.
Confidential
Developer
Responsibilities:
- Worked for Confidential Center for Medicare and Confidential Services) Project processing all Medicare claims across the US. Loaded billions of health care claims in the Data Mart extensively using AS(Advantage Suite), a proprietary tool that executes the shell scripts in an order to load the data into VDM ( Confidential ) and generates the logs on the UNIX OS.
- Architected and developed Fast Load, Multi Load, Fast Export scripts; developed BTEQ scripts that processed data in staging database.
- Analyzed and designed USI and NUSI based on the columns used in joins during data retrieval.
- Worked with SET and MULTISET tables for performance evaluation of the scripts. Guided the new team members to observe the development methodologies and architecture. Handled production issues by co-coordinating Confidential IC Team and Development team.
- Identified performance bottlenecks and optimized database performance.
- Completed coding and testing of application components using UNIX Shell scripting, SQL, and Confidential . Extensively used Confidential SQL Assistant to extract data from the VDM.
- Performed complex data & technical analysis, developed prototypes, prepared technical specifications.
- Collaborated with teams in data management, configuration management, product management. Estimated/planned development work, tracked/reported task progress, and delivered work on schedule. Extensively used T-SQL case statements to flag the detail records on the warehouse tables.
- Documented recent updates in scripts, processes currently used in the VDM and the execution order of the scripts. Created BTEQ scripts with data transformations for loading the base tables to the VDM.
- Created dynamic BTEQ scripts that generated, dropped and recreated indexes on the tables. Involved in the Transformation and Loading source files in the data warehouse. Created Join indexes and Temporary tables which improved the query processing. Used stages that made joins Confidential tables like pure inner join. Created jobs and stages that implemented lookups and updated data.
- Worked within a structured development environment that included version control, automated unit testing, automated builds, design reviews and code reviews.
Environment: Confidential V2R12/V2R13 (BTEQ, Fast Load, Multi Load, Fast Export, T-SQL), Confidential SQL Assistant, UNIX, Shell, Perl Scripting, Tivoli
Confidential, Mooresville, NC
Lead Consultant
Responsibilities:
- Designed and developed physical models with appropriate Primary, Secondary, UPI and Join Index taking into consideration both planned access of data and even distribution of data across all the available AMPs.
- Architected and developed Fast Load and Multi Load scripts, developed BTEQ scripts in staging database. Lead team of developers and liaised Confidential data modeler business users and developers onsite.
- Worked on loading of data from several flat files sources using Confidential Fast Load and Multi Load.
- Database-to-Database transfer of data (Minimum transformations) using OLE Load.
- Wrote Cobol Programs to extract the data from DB2.Fine-tuned existing mappings and achieved increased performance and reduced load times for faster user query performance.
- Wrote scripts extracting data from Oracle, loaded in Confidential, exported data using Confidential Fast Export.
- Wrote Confidential BTEQ scripts and implemented the business logic. Developed COBOL modules and applied transformation to the source data at load time. Extensively used T-SQL case statements to flag the detail records on the warehouse tables.
Environment: NCR 4800/5100, Confidential V2R5 (BTEQ, Fast Load, Multi Load, T-SQL, Fast Export) MVS, JCL, TSO/ISPF, COBOL, DB2, Oracle
Confidential
EDW Developer
Responsibilities:
- Worked for Confidential that analyzes the performance of DCA's and Confidential 's across Centers in North America. Responsibility was to leverage tables/views from Oracle to Confidential according to the Business requirements. Actively involved in team discussions with source system (Oracle and DB2) and the reporting team.
- Extracted, transformed and loaded source files in the data warehouse. Used Confidential Multi load, Fast load, BTEQ utilities to load data in the Confidential database.
- Created JCL scripts and control cards for batch processing. Created mappings using transformations such as aggregator, filter and update strategy.
- Wrote COBOL programs to extract data from DB2 and load into Confidential . Extensively used Confidential SQL Assistant for unit testing. Used comma delimited files from Oracle data source and transformed into Confidential databases. Created tables, temporary tables and views as required.
- Wrote Multi Load scripts on Mainframes platform considering the volumes of load data.
- Created join indexes and temporary tables which improved the query performance. Updated the Metadata with all necessary information for all tables and fields in the data warehouse.
- Developed Use Case Specifications for Confidential project based on analysis of business requirements Confidential source system (Oracle) and the new Confidential platform. Performed System Testing before ERM Launches of projects to get business concurrence and signoff.
- Used PUPS Migration System and migrated code from test environment to production environment. Suggested and implemented changes for physical database design.
- Ftp'd csv files from source to local environment (MF) and used FTP to get the file from MF. Backfilled metrics on a table done according to the business requirement. Completed data propagation requests for various tables.
- Analyzed reports and clarified Business user concerns. Analyzed discrepancies Confidential two related reports by looking at the input files and what is stored in the data warehouse. Used CA-7 scheduling tool to schedule and monitor batch processes.
Environment: Confidential V2R6(BTEQ, Fast Load, Multi Load, T-SQL), MVS, JCL, TSO/ISPF, COBOL, DB2, CA-7, Confidential SQL Assistant, Oracle, Queryman, PL/SQL, Confidential Mainframes.
Confidential
Confidential Developer
Responsibilities:
- Worked on loading of data from several flat files sources using Confidential Fast Load and Multi Load. Transferred large volumes of data using Confidential Fast Load, Multi Load and T-Pump. Database-to-Database transfer of data (Minimum transformations) using OLE Load.
- Wrote Cobol Programs to extract the data from DB2. Fine-tuned the existing mappings and achieved increased performance and reduced load times for faster user query performance.
- Played key role in upgrading Informatica 6.1 with 7.1 to take better advantage of Confidential load utilities.
- Created customized Multi Load scripts on UNIX platform for Confidential loads using Informatica.
- Sorted data files using Unix Shell scripting. Acted as a single resource with sole responsibility of Informatica - Confidential conversions.
- Wrote scripts to extract the data from Oracle and load into Confidential . Wrote Confidential BTEQ scripts to implement the business logic. Wrote proactive data audit scripts and data quality scripts for new market integration.
- Developed COBOL modules to apply transformation to the source data at load time. Developed complex transformation code for derived duration fields. Used T-SQL case statements to flag the detail records on the warehouse tables. Developed BTEQ scripts to extract data from the detail tables for reporting requirements.
Environment: NCR 4800/5100, Confidential V2R5 (BTEQ, Fast Load, Multi Load, T-SQL, Fast Export) MVS, JCL, TSO/ISPF, COBOL, DB2, Oracle, Informatica Power Center 7.1, Shell-scripting