Dw&bi Developer Resume
Alpharetta, GA
SUMMARY:
- Experience in Data Engineering/Data Standardizing/Data profiling of source systems
- Experience in designing Analytics platforms and creating Corporate Dashboards
- Strong Knowledge in Architecting and building the projects from scratch
- Experience in Recruitment of programmers, designing hierarchy, building and leading teams over size of 20
- Solid IT Consulting background, Outstanding experience in crafting presentations, travelling across USA and winning clients
- Experience in Waterfall and Agile project methodologies
- Solid experience as Enterprise Architect, Team Lead, Tech Lead, Onsite Coordinator, Sole POC
- Extensive experience in Design & development of OLTP, OLAP, DSS, ODS systems
- Strong knowledge on all SDLC phases. Architecting data flow end to end for huge databases with size over 5 TB
- Implemented Data Warehousing projects for Public Utility,Banking,Retail,Life Sciences,Healthcare and Insurance Clients
- Experience in IBM Information Server Installation,Configuration, Administration on Single/Multi Tier environments
- Strong fundamental knowledge with Star and Snowflake schemas, Fact tables, Dimension tables, Normalized/De - normalized tables, Data marts, Data mappings and Ralph-Kimball/Bill Inmon methodology
- Excellent SQL programming knowledge in Oracle 12c/11g, DB2 UDB, Teradata, No SQL,MS SQL
- Experience in writing, testing and implementation of PL/SQL triggers, Procedures, functions
- Strong knowledge of UNIX shell scripting, SQL Loader, Ctrl-M and Autosys scheduling tool
- Proficiency in using ERWIN Data Architect Tool,Embarcadero for generating Logical and Physical Data Model
- Strong knowledge on all IBM Information server suite products- Information Analyzer, Fast track, Business Glossary, QualityStage, Governance Catalog
- Sound knowledge on running POC’s on different DW&BI technologies and identifying the best for the project
TECHNICAL SKILLSET:
ETL Tool: IBM DataStage/QualityStage versions- 11.5/8.5/8.1/7.5 Informatica, Microsoft SSIS, Talend
BI Tool: Business Objects XI R2, Tableau 10.3, Cognos, Power BI
Operating System: Unix systems- AIX 7.1/6.1, Linux, HP-UX and Windows
Database Technologies: Oracle 12C/11g/10g/9i, DB2/UDB, Teradata, Microsoft SQL Server 2008
Bigdata Technologies: Azure SQL, Hadoop Hive/Pig/Cassandra
Languages: SQL, PL/SQL, C, C++, JCL
Scheduling Tools: Control-M, Autosys, Zeke
UNIX Tools: Shell scripts, Cron, awk, Perl, Sed etc
DB Development: SQL* Loader, Datapump, TOAD, PL/SQL developer client, Teradata developer client, T-PUMP, Multi Load, FastLoad, Bteq
PROFESSIONAL EXPERIENCE:
Confidential,Austin, TX
DW&BI/Analytics - Architect/Developer
Environment: IBM DataStage 11.5, Oracle 11g, UNIX Shell Scripting, PLSQL, Oracle Golden Gate 12C, SVN, Tableau, Power BI, IBM Information Server Suite
Responsibilities:
- Responsible for full lifecycle implementation, customization and testing of IBM Information Server DataStage applications
- Designing ETL Architecture, defining SLA’s and data profiling of all the source systems
- Gathering Business requirements and documenting functional and technical requirements
- Defining data flows and publishing architecture diagrams
- Management of technical resource team
- Information Server Installation/Configuration/Administration in Dev, Test, Prod on Multi-Tier AIX Cluster Architecture
- Information Server upgrade from 8.5 to 11.5 version
- Data Profiling of different source systems
- Creating Analytics platform for Corporate Dashboards
- Creating dashboards/reports using Tableau/Power BI analytics tools.
- Data Modeling and DBA activities
- Coding Unix shell scripts for processing complex files, triggering Datastage jobs, automating DS job stats
- Writing complex SQL queries for data mining, data analysis and data profiling
- Creating/Reviewing LLD, HLD, BSD, Unit testing, SIT, UAT, Implementation plan documents
- Creating database and data warehouse sizing documents
- Configuring SVN for version control
- Running POC’s on different DW&BI technologies and identifying the best for the project
Confidential,Alpharetta, GA
DW&BI Architect/Developer
Responsibilities:
- Creating Microsoft SSIS mappings to extract data from SAP systems and transforming and loading into SQL Server Staging tables.
- Interact with clients and ensure that the work products and deliverables are of the high caliber to ensure client satisfaction.
- Writing complex SQL queries for data extract and data profiling.
- Creating/Reviewing LLD, HLD, BSD, Unit testing, SIT, UAT, Implementation plan documents.
- Support modules in SIT, UAT phase and Turnover of code into production.
Confidential,Mooresville, NC
Environment: IBM DataStage 8.5, QualityStage, Information Server Console, Webservices Director, DB2, Teradata, UNIX Shell Scripting, Mainframe, IBM MDM, Cognos, Talend, Hadoop Hive/Pig/Cassandra
Responsibilities:
- Responsible for full lifecycle implementation, customization and testing of IBM DataStage, QualityStage applications.
- Management of technical resource team.
- Information Server Administration-
- Maintenance of IS Server.
- Stopping/Restarting of IS/Websphere/Datastage engine.
- Datasatge Job logs cleanup, Removing locks, Dataset cleanup.
- Xmeta database maintenance.
- Creating new ODBC connections.
- Internal/External User registry maintenance.
- Administration of Web console.
- Stopping/Deployment of Webservices.
- Installing Patches for Information Server.
- Version control of Datastage jobs.
- Datastage jobs migration from 8.1 to 8.5.2 version.
- Designing Datastage jobs using Transformer, ODBC, ChangeCapture, SCD, Filter, Lookup, Join, Merge, Sort, XML stages to extract/load data into DB2 tables.
- Designing Datastage jobs to create XML files using XML output, XML transformer stages.
- Extract data from Teradata enterprise and mask it and load into MDM DB2 tables.
- Designing Qualitystage jobs using Standardize, Investigate, Reference Match, Unduplicate stages to standardize data and apply probabilistic matching.
- Exposing Datastage jobs as Services to process data realtime using Information server console.
- Configuring Datastage jobs for OneWay communication between ESB-Lowes.com and Customer database.
- Interact with clients and ensure that the work products and deliverables are of the high caliber to ensure client satisfaction.
- Coding Unix shell scripts for processing complex files, triggering Datastage jobs, automating DS job stats.
- Loading huge datasets into Teradata tables using T-PUMP, Multi Load, FastLoad, Bteq scripts
- Writing complex SQL queries for data mining, data analysis and data profiling.
- Coding DS sequencers for Purging data from DB2 tables by understanding the referential integrity.
- Running DS sequencers in batch for Validation of Name-Address combination(NADR) and updating change of Address information(NCOA)
- Creating/Reviewing LLD, HLD, BSD, Unit testing, SIT, UAT, Implementation plan documents.
Confidential, Kansas City, MO
Environment: IBM DataStage8.1, Oracle 11g, UNIX Shell Scripting, Autosys scheduler, Teradata developer client
Responsibilities:
- Designing Server/Parallel Datastage jobs using Transformer,Join,Lookup,Changecapture,Remove duplicate,Sort stages to extract/Transform/load data into Oracle tables.
- Interact with clients and ensure that the work products and deliverables are of the high caliber to ensure client satisfaction.
- Coding Unix shell scripts for processing complex files, triggering Datastage jobs, automating DS job stats.
- Writing complex SQL queries for data mining, data analysis and data profiling.
- Creating/Reviewing LLD, HLD, BSD, Unit testing, SIT, UAT, Implementation plan documents.
- Day to day support of the implemented applications.
- Support modules in SIT, UAT phase and Turnover of code into production.
- Scheduling jobs using Autosys tool.
DW&BI Developer
Confidential,EastHanover, NJ
Environment: IBM DataStage 8.1, Oracle 10g, UNIX Shell Scripting, Pl/Sql, CONTROL-M, Cognos, Plsql developer client, Teradata, Toad
Responsibilities:
- Design, development, Unit testing of ETL applications to populate Oracle tables and Teradata tables using Teradata Enterprise, Multiload and T-PUMP mechanism.
- Effort estimates, Impact Analysis, Design the code using best methodologies to ensure existing system is least affected.
- Writing Complex Oracle Sql queries for Aggregating, Joining sales data and loading into Denormalized tables.
- Running Materialized views to provide data for downstream applications.
- Writing complex unix scripts using grep, awk, sed to run multiple steps from transforming data and loading into Oracle tables.
- Loading data in Hierarchy models and writing complex PlSql procedures, functions.
- Providing support for Cognos team.
- Migrating Datastage jobs from 7.5 to 8.1 version.
- Running Datastage jobs in multiple instances and loading Partitioned/Sub partitioned Oracle tables with 180 million records.
- Loading data in steps into Staging (STG), Incremental data store (IDS), Analytical Data store (ADS) tables.
- Understanding of requirements and building different design approaches. Address Quality Issues with the ETL process.
- Writing Complex Unix scripts for restartability of process and running Datastage jobs in 40 instances to load partitioned tables.
- Coding Datastage jobs to load SCD (slowly changing dimension) tables using SCD, Change capture stages.
- Extracting data from Hierarchy Product and Customer tables and loading into Summarized tables.
- Scheduling DS jobs using Ctrl-M scheduler.
- Running explain plans and working with DBA for tuning the queries.
- Implementing different modules into production and running post validation test cases.
Confidential
DW&BI Developer
Environment: IBM DataStage 8.1/7.5, DB2/UDB, Oracle 9i, Pl Sql, UNIX, CONTROL-M, Mainframe, Cognos, Business Objects.
Responsibilities:
- Design, development, Unit testing of ETL applications to populate Oracle, DB2/UDB tables in Data Warehouse system
- Loading Active, History tables using SCD 1, 2, 3 techniques
- Designing complex DS jobs using SCD, Filter, Sort, Transformer, Dataset, Fileset, Lookup, Seq File, Complex File stages
- Design, development, Unit testing of File balancing, NDM mainframe JCL’s
- Writing complex queries for data profiling of Peoplesoft data and Providing support for peoplesoft team
- Integrating Campus Oracle database with HR peoplesoft data
- Creating LLD, HLD, Unit Test case, SIT, UAT documents
- Scheduing datastage sequencers using Ctrl-M tool and defining dependencies for all the jobs
- Performance tuning of DS jobs and addressing quality issues
- Sole POC and provide L2 support for all the ETL processes in the project
- Writing complex Datastage jobs/SQL queries to aggregate daily sales data and load into Month to date and year to date sales tables
- Conversion of Server Datastage Jobs to Parallel/Enterprise version
- Test and implement the process and the tables with help from QA and Operations group
- Board new portfolios and load/Backfill history if required by the business
- Ensure that the Data Warehouse loading meets its daily and monthly SLA’s for the availability and testing of data
- Designing jobs for loading Dimension tables and using Lookup stages to load Fact tables
- Running SQL loader scripts for loading of Oracle tables
