Sr. Bi Architect /data Engineer Resume
SUMMARY
- 15+ Years of overall IT experience in Analysis, Design, Development & Implementation of BI & Data Ware housing
- Skilled in defining and implementing the various components of a data warehouse such as Operational source systems, Data staging, Data presentation and Data access tools.
- 12 Years of Strong experience in ETL & BI design and development.
- Expert in Designing Dimensional Modeling (Star Schemas, Snow flake schema) and Operational Data store (ODS) Data Warehouse design.
- Over 15 years of experience with ETL tools such as Oracle Data Integrator, Oracle Warehouse Builder, Informatica (Power Mart/Power Center).
- 4 years of experience with Azure Data Factory (ADF) V2, Azure Databricks, Azure Data Lake (ADLS) Managing Database, Azure Data Platform services Data Lake Analytics, NoSQL DB, SQL Server, Oracle, Data Warehouse etc.
- Experience in working in hybrid connectivity environment between Azure and on - premise using virtual networks, VPN and Express Route
- Plan and Develop roadmaps and deliverables to advance the migration of existing solutions on-premise systems/applications to Azure cloud.
- Recreating existing application logic and functionality in the Azure Data Lake, Data Factory, Oracle data warehouse environment
- Engage with business users to gather requirements, design visualizations and provide training to use self-service BI tools.
- Over eight years of experience working different Python packages.
- Over 8 years of experience with different BI tools Business Objects, power BI, Spotfire, Tableau, Cognos.
- Experience in implementing Oracle, SQL Server and Teradata database applications.
- Proficiency in data warehousing techniques for data cleansing, Slowly Changing Dimension phenomenon, surrogate key assignment and change data capture.
- Involved in identification of facts and dimensions and hierarchies for OLAP models.
- Over 10 years of experience in Unix Shell Scripting to implement post and pre-session shell scripts and scripts which are responsible for sending some reports and files as email attachments and ftp’ing xml files to remote servers.
- Extensive experience working with End Users and Business System Analysts in understanding their requirements, assisting in providing technical solutions and implementing them
- Quick Learner, highly motivated, organized, result oriented professional and an enthusiastic team player with strong technical and communication skills.
- Expertise in scheduling tools Tidal and control M.
TECHNICAL SKILLS
Operating System/Network: Windows XP/7, hp-ux, Sun Solaris
Databases: Oracle9i, 10g, 11g, 12c, Teradata14/15, DB2, snowflake
BI tools: POWER BI, Tableau Desktop 2018.1, Tableau Prep 2018.1.1, Business Objects 6.5/XIR2/XIR3/4.0/4.2, SAP Business Objects Dashboard Design
Cloud technologies: Azure, AWS
ETL Tools: ODI10/11/12C, OWB, Informatica, Azure Data Factory, Azure Data Bricks
Languages: SQL, Oracle PL/SQL, Shell Scripting, C,C++,JAVA, Python
Scheduling: Tidal, ControlM
PROFESSIONAL EXPERIENCE
Confidential
Sr. BI Architect /Data Engineer
Responsibilities:
- Responsible for source system analysis, data transformation, data loading and data validation from source systems to Data warehouse Applications.
- Involved in analysis and translation of business requirements into technical lineage documents.
- Created ODI (Sunopsis) interfaces for loading the data from Source System to DW and from DW to different Datamart.
- Knowledge modules are used to achieve client requirements such as connecting to specific technology, extracting data from it, transforming the data, checking it, integrating it, etc.
- Analyze, Design, Development and Testing of Data warehousing applications using ETL and Reporting tools.
- Assisting in Developing of Dimensions and Facts for the Data Warehouse.
- Worked with different sources like oracle, sql server, csv, excel and xml files.
- Architect & implement medium to large scale BI solutions on Azure using Azure Data Platform services Azure Data Lake, Data Factory, Azure Data Bricks.
- Working as Cloud Administrator on Microsoft Azure, involved in configuring virtual machines, storage accounts, resource groups .
- Created of virtual networks, subnets to provide security for azure resources.
- Hands on experience with availability sets, availability zones and redundancy .
- Created different azure storage accounts for blobs, files and disks .
- Worked with azure policies, IAM access permissions and RBAC roles.
- Launched different types of virtual machines for data factory and data bricks services .
- Responsible to create linked services for data factory to connect to different data sources. worked with data factory operations copy data, pipe line creation and parameters. worked with conditional activities, look up activities in azure data factory to resolve complex issues.
- Experienced with data factory dynamic pipelines .
- Respons i ble to load data from on premises to azure data lake .
- Build multiple Data Lakes . Build how the data will be received, validated, transformed and then published
- Created data clusters, work spaces for data bricks . responsible to create Azure data bricks notebooks and load data into different azure targets. created job schedules for data factory and data bricks .
- Used Spark SQL with Python for creating data frames and performed transformations on data frames like adding schema manually, casting, joining data frames before storing them.
- Have utilized Python libraries such as NumPy and Pandas for processing tabular format data.
- Used the Python's modules Seaborn, matplotlib for generating complex graphical data, creation of histograms , barchart, Scatterplot, boxplot etc.
- Development of Python APIs to dump the array structures in the Processor at the failure point for debugging.
- Wrote python scripts to parse XML documents and load the data in database.
- Developed a Python Script to load the CSV files into the S3 buckets and created AWS S3buckets, performed folder management in each bucket, managed logs and objects within each bucket.
- Wrote Python normalizations scripts to find duplicate data in different environments.
- Expertise in establishing database connections for Python by configuring packages like MySQL-Python .
- Define views in snowflake to use them as data sources for report layer .
- Build custom views with time travel feature to compare with current data.
- Responsible to create different snowflake data provider accounts for different users.
- Created snow flake secure views to conceal identity of views.
- Hands on with data share feature to share data between different accounts of snowflake.
- Written jython scripts for file level validations. resolved repository id i ssues between development, test and production environments.
- Created odi generic pacakges to automate the ftp, file load and archive process.
- Implemented Error Handling functionality in all ODI interfaces.
- Improved performance by enabling right parameters in odi knowledge modules .
- Extensively used SQL Loader to load flat files into Oracle Tables .
- Responsible to create control tables to control scheduling process of ETL maps .
- Responsible for writing unix shell scripts to do file level validat ions .
- Well versed with awk, sed, splitting big files, merging files .
- Worked with partitioned tables to decrease response times on large volume tables.
- Have used analytic functions instead of group by queries to perform accumulated calculations.
- Worked with external tables, file keeping activities related to external tables.
- Used Oracle performance tuning hints Ordered, use Merge, use hash, Parallel and Index hints.
Confidential, NJ
Technical Onsite Lead
Responsibilities:
- Analyze, Design, Development and Testing of Data warehousing applications using ETL and Reporting tools.
- Assisting in Developing of Dimensions and Facts for the Data Warehouse.
- Designing ETL strategy for both Initial and Incremental & CDC Loads.
- Understand and develop business process & requirements as it pertains to data within the OLTP systems.
- Responsible for source system analysis, data transformation, data loading and data validation from source systems to Data warehouse Applications.
- ODI designer used to importing tables from database and to create interfaces.
- Security manager is used to manage user privileges.
- Worked on WebI reports on Business Objects XI R2 server platform for auditing database MS SQL Server 2005.
- Extensively used SQL Loader to load flat files into Oracle Tables.
- Created process flows to execute mappings in serial and parallel order.
- Responsible to create control tables to control scheduling process of ETL maps.
- Written complex SQL, PL/Sql Procedures and functions.
- Worked with partitioned tables to decrease response times on large volume tables.
- Implemented Unix Shell scripts to process the feed files and check the fields in the feed files
- Developed Unix scripts to maintain and mail the error log files using scripts.
- Created various database objects, including tables, indexes, views, sequences, packages, and procedures and Troubleshoots with regard to database problems.
- Wrote many complex stored procedures and functions. Created Indexes to make the procedure run faster. Modified triggers, views, procedures, functions, sequences according to the user requests.
- Worked with external tables, file keeping activities related to external tables.
- Have used FTP process to get files form FTP server and put files back onto FTP servers.
Confidential
Sr. Business Objects Developer / BO Solution Lead
Responsibilities:
- Involved in design of MMP data Mart.
- OWB Interfaces successfully created and deployed to DW.
- OWB designer used to importing tables from database and to create interfaces.
- Security manager is used to manage user privileges.
- Created OWB interfaces for loading the data from source to Data Warehouse.
- OWB Designer is used for importing tables from database, reverse engineering, to develop projects, and release scenarios.
- Knowledge modules are used to achieve client requirements such as connecting to specific technology, extracting data from it, transforming the data, checking it, integrating it, etc.
- Operator operates to monitor sessions.
- Security Manager is used to manage user privileges.
- Created OWB interfaces for loading the data from Source System to DW and from DW to different Datamart.
- Implemented Error Handling functionality in all OWB interfaces.
- Has developed many physical/logical layers for multiple databases.
Confidential, GA
Sr. Business Objects Developer / BO Solution LeadResponsibilities:
- Understand the current Architecture, databases
- Created workflows and development of ETL jobs in Informatica
- Analyzed current jobs in informatica for enhancement of ETL flows
- Installing & upgrading BO server, Software installations, Adding patches
- Test new features available in BO latest releases and make sure the new upgrades/patches are stable and compatible to BO server before applying this in production
- Monitoring BO servers running with optimal performance
- All Webi system administrations - Check sessions/activities, User/Group management, Creating folder structures and assign to users, universe connection, Monitoring scheduled jobs in Broadcast Agent, Creating publications
- Creation/modification of audit universes and reports to audit the sessions/users/performance of the environment effectively
- Performance tuning of reports/universes
- Troubleshooting any issues with BO reports/universe or dashboards
- Used Published Wizard, Import wizard in XI 2.0 environment in publishing and migrating reports.
Confidential
ETL Developer / Data Analyst
Responsibilities:
- Created mappings with different transformations.
- Scheduling sessions and batches, Performance tuning of Sessions.
- Created sequential batches concurrent batches using server manager
- Created mapping specifications and unit test plans.
