We provide IT Staff Augmentation Services!

Senior Data Engineer/bi Architect Resume

4.00/5 (Submit Your Rating)

NJ

SUMMARY:

  • Results - driven senior Data Manager with extensive experience in corporate data analysis, architect and integration along with production of comprehensive dashboards and reporting. Furnish insights, analytics and business intelligence to advance opportunity identification, process reengineering and corporate growth.

TECHNICAL SKILLS:

Databases: Hadoop, SQL Server, Oracle, MS Access, DB2, PeopleSoft, Oracle Financial Cloud

GUIs: Java, Visual Basic, MS Access, MS DOS & Windows Utilities

Languages: SQL, T-SQL, PL/SQL, VB.NET, ActiveX Script, Java Script, C#, Shell scripting, COBOL, Python

Operating Systems: Windows, W2K, W2K3, LINUX, OS / 2, MS DOS

PROFESSIONAL EXPERIENCE:

Confidential, NJ

Senior Data Engineer/BI Architect

Responsibilities:

  • Conducted major stakeholder interviews involving SME’s, Business Analysts, and other stakeholders to determine the requirements.
  • Led the project in gathering business requirements to collect, summarize, and communicate facts about existing issues and focused on to search for optimum solution to solve the problem.
  • Performed data analysis and design, and creates and maintains large, complex logical and physical data models including creation of tables, referential integrity, keys and constraints using Case Erwin.
  • Designed enterprise data solutions, applications, and integrations in Snowflake Data Warehouse environment.
  • Developed and monitored ETL Data Pipeline and Data Model solutions for integrating new data sets into the Snowflake Enterprise Data Warehouse
  • Performed data quality issue analysis using Snow SQL by building analytical Snowflake Enterprise Data Warehouse
  • Developed ETL procedures to ensure conformity, compliance with minimal redundancy, translated business rules and functionality requirements into ETL procedures.
  • Built various SSIS packages having different tasks and transformations for various clients and Scheduled SSIS packages.
  • Involved in various Transformation and data cleansing activities using various Control flow and data flow tasks in SSIS packages during data migration.
  • Designed and Developed ETL jobs to extract data from Oracle, SQL Server and load it in data mart in Redshift.
  • Designed tables and columns in Redshift for data distribution across data nodes in the cluster keeping columnar database design considerations.
  • Automated the manual steps of AWS Lake Formation required to build a data lake and provided a single security mechanism across all organization data,
  • Designed and developed Power BI reports and dashboards from multiple data sources using data blending for visualization solutions with business requirement documents.
  • Utilized Power Query in Power BI to Pivot and Un-pivot the data model for data cleansing and data massaging.

Confidential, NY

Senior Data Engineer/BI Architect

Responsibilities:

  • Led architected data systems, strategies and business processes operational data store and warehouse models for Global Sourcing Pipeline (GSP) and created dimensional model for reporting system by identifying required dimensions and facts using Erwin 9X.
  • Developed Data Mapping, Data Governance, Transformation and Cleansing rules for the Master Data Management Architecture involving OLTP, ODS and OLAP.
  • Designed and operationalized large-scale data and analytics solutions on Snowflake Cloud Data Warehouse
  • Created complex SQL queries, scripts, user defined functions, views, and triggers for business logic implementation in Snowflake Enterprise Data Warehouse
  • Used various SSIS tasks such as Conditional Split, Multicast, Fuzzy Lookup etc., which did Data Scrubbing, including data validation checks during Staging, before loading the data into the Data warehouse and created and Modified Tables, Stored Procedures , Views, Indexes , User-defined Functions, and Triggers as required.
  • Assisted in applying protection of PIFI (Personally Identifiable Financial Information) suppliers’ data for unfair financial market trades.
  • Performed Exploratory Data Analysis using R . Also involved in generating various graphs and charts for analyzing the data using Python Libraries.
  • Built, evaluated and deployed predictive models in global sourcing pipeline using Python.
  • Developed predictive models, including (but not limited to) purchase/retention models, customer segmentation and ON and Off purchase orders using Python libraries.
  • Created PeopleSoft queries to extract AP/PO (General Ledger) source data for Pipeline ETL and reporting.
  • Developed predictive model using annual failure rate and standard cost basis for the new supplier Purchase orders services using Python Libraries.
  • Designed and Developed ETL Processes in AWS Glue to migrate Campaign data from external sources like S3, ORC/Parquet/Text Files into AWS Redshift.
  • Enabled Amazon IAM service to grant permissions and resources to users. Managed roles and permissions of users with coordination of AWS IAM.
  • Used security groups, network ACL’s, internet gateways and route tables to ensure a secure zone for organization in AWS public cloud.
  • Responsible for data cleansing and analysis, using pivot tables, formulas (v-lookup and others), data validation, conditional formatting, and graph and chart manipulation.
  • Designed and implemented end-to-end systems for Data Analytics and Automation, integrating custom visualization tools using R, and Power BI .
  • Designed Power BI visualization of Dashboards & Scorecards ( KPI ) for Global procurement Department and created Dax Queries to generate computed columns and Measures in Power BI for data analysis.
  • Scheduled Automatic refresh and scheduling refresh in power bi service.

Confidential, NJ

Senior Data Engineer/BI Architect

Responsibilities:

  • Conducted major stakeholder interviews involving SME’s, Business Analysts and other stakeholders to determine the requirements.
  • Led the project in gathering business requirements to collect, summarize, and communicate facts about existing issues and focused on to search for optimum solution to solve the problem.
  • Performed data analysis and design, and creates and maintains large, complex logical and physical data models including creation of tables, referential integrity, keys and constraints using Oracle Data Modeler.
  • Created dimensional model comprising Star and Snowflake schemas for the reporting system by identifying required dimensions and facts using Oracle Data Modeler.
  • Led efforts to analyze data for source/target mappings, created PL/SQL and Shell scripts for data processing and automations.
  • Developed ETL procedures to ensure conformity, compliance with minimal redundancy, translated business rules and functionality requirements into ETL procedures.
  • Developed PL/SQL packages to load Data Warehouse and Data Mart tables.
  • Worked on Informatica Power Center tools- Designer, Repository Manager, Workflow Manager, and Workflow Monitor.
  • Used various transformations like Filter, Expression, Sequence Generator, Update Strategy, Joiner, Stored Procedure, and Union to develop robust mappings in the Informatica Designer.
  • Controlled Personally Identifiable Information (PII) of students and Sensitive Data Risk for Self-Service BI using Power BI Data Protection.
  • Designed tables and columns in Redshift for data distribution across data nodes in the cluster keeping columnar database design considerations.
  • Built S3 and EC2 buckets and managed policies for S3 buckets and used S3 bucket and Glacier for storage and backup on AWS.
  • Automated the manual steps of AWS Lake Formation required to build a data lake and provided a single security mechanism across all organization data,
  • Designed and developed Power BI reports and dashboards from multiple data sources using data blending for visualization solutions with business requirement documents.
  • Utilized Power Query in Power BI to Pivot and Un-pivot the data model for data cleansing and data massaging.
  • Published Power BI Reports in the required originations and Made Power BI Dashboards available in Web clients.

Confidential, NJ

VP BI Analyst/Data Architect

Responsibilities:

  • Supported cross-functional efforts related to system development lifecycle methodologies for complex projects with the emphasis on the analysis, testing and deployment stages.
  • Created tables, views, indexes, Stored Procedures and User Defined Functions using SQL Server 2014 T-SQL Scripting for complex business logic.
  • Designed and developed Data Mappings and Integration, Workflow Solutions and Extract, Transform, and Load (ETL) solutions for data warehousing and data marts using SQL Server Integration Service (SSIS) and Informatica.
  • Developed ETL procedures using SSIS Packages for overall data transfer from the OLTP having multiple data sources like SQL Server, Oracle, DB2, XML, Flat file, Excel file and MS Access file to OLAP.
  • Developed predictive models and statistical analysis for data mining and campaign business performance using Python and R.
  • Designed and executed various MYSQL database queries from python using Python-MySQL connector and MySQL dB package.
  • Used DDL and DML to retrieve, modify, create and modify the structure of database objects using PL/SQL.
  • Extensively involved in SQL Server Performance tuning using SQL Profiler Plan and tuning tips like normalization, creating indexes and collect statistics.
  • Responsible for Data Analysis and logical and physical data modeling for Data Mart applications as well as Operational applications enhancements and new development application utilizing CA Erwin 9.0 focusing on Star Schema Dimensional methodology.
  • Handled importing data from various data sources, performed transformations using HIVE, MapReduce, SQOOP and loaded data Hadoop Big Data Environment HDFS.
  • Used Sqoop, HIVE and HBASE in Hadoop for structuring any unstructured data and then exporting the semi-structured or structured data into traditional databases for further analysis.
  • Involved in loading data from UNIX file system to HDFS.
  • Exported and Imported data into HDFS, HBase and Hive using Sqoop.
  • Developed predictive models and statistical analysis for GWM and campaign business performance using Python and R.
  • Developed and implemented SAS packages and jobs for data transformation from Mainframe to RDBS.
  • Effectively created and managed Key Performance Indicator (KPI) and metrics to evaluate company’s success based on specific business goals and targets.
  • Designed and configured Jasper Reports using iReport Designer (6.x) for various business areas using SQL Server as data provider’s tool.
  • Created Tableau Standard, Cross-tab and Sub reports for GWM.
  • Generated Tableau Dashboards with interactive views, trends and drill downs along with user level security.

Confidential, NY/NJ

Senior Systems/Business Intelligence Analyst

Responsibilities:

  • Translated business requirement into tangible solutions utilizing the appropriate technological platform and tools that best enables the business.
  • Created Stored Procedures, Views and Triggers using T-SQL for BI reporting and ETL process.
  • Optimized the performance of queries with modifications in T-SQL queries, using SQL profiler, Execution Plan, eliminated redundant and inconsistent data, normalized tables, established joins and created indexes whenever necessary.
  • Developed stored procedures, functions, views and triggers using PL/SQL.
  • Wrote T-SQL/and PL/SQL statements using DML and DDL for retrieval of the data.
  • Created OLAP Cubes and performed data mining on the data using the fact table and the dimension using SSAS 2008 supporting data marts.
  • Utilized JIRA for bug tracking, issue tracking and project management software.
  • Designed and configured Jasper Reports using iReport Designer (5.0) for various business areas Oracle as data provider’s tool.
  • Created new Domains for super users to facilitate in creating custom reports using Jasper Server 5.0.
  • Developed and deployed dashboards in Jasper Reports Server environment.
  • Created BO WEBI reports using Web Intelligence Rich Client using BO XI 4.0

Confidential, NYC, NY

Senior Systems/Business Intelligence Analyst

Responsibilities:

  • Involved in gathering and analyzing requirements and documenting them for further implementation.
  • Designed and configured Jasper Reports using iReport Designer (4.7) for various business areas having SQL Server and Oracle as data providers tools.
  • Developed and deployed dashboard-targeted reports in Jasper Reports Server environment.
  • Design, develop and configure Dashboards, Answers requests, Prompts, and BI Publisher reports using OBIEE as per user requirements.
  • Created Session variable, Repository variable, Metrics and KPI in RPD and used the same Dynamic calculation using OBIEE Administrative Tools.
  • Created Stored Procedures, Views and Triggers using PL/SQL and T-SQL for BI reporting and SSIS (ETL) process.
  • Maintain referential integrity and column integrity by using the available options such as constraints etc.
  • Responsible for diagnostic phases of SQL queries, stored procedures and reporting for performance tuning.

Confidential, New York, NY

Senior Systems/Business Intelligence Analyst

Responsibilities:

  • Worked extensively with the end user’s team in understanding the business rules and writing requirement specs, technical specs and mapping documents from staging to data mart, cubes and reporting needs to the end user community.
  • Created store procedures, tables, views, and functions; implement best practices to maintain optimal performance.
  • Provided on-call support to production system to resolve any issues.
  • Designed and architect end-to-end ETL process including data Extraction, Transformation and Loading from source to target systems using SQL Server Integration Services (SSIS).
  • Involved in Performance tuning, optimization of stored procedures and queries.
  • Analyzed the data to figure out the business logic and implemented daily ETL process in the Data Warehouse.
  • Designed and Developed Models and published Packages using Cognos Framework Manager to support report development.

Confidential, NJ

Senior Database/Systems Analyst

Responsibilities:

  • Responsible for gathering Business Requirements from Users & Business Analysts for data analysis and designing reports.
  • Created new Universes as per the user requirements by identifying the required tables from Data mart.
  • Extracted, transformed, cleansed and loaded data using SQL Server 2008 (SSIS) ETL Packages.
  • Designed WEB Intelligence (SAP Business Objects XIR3) reports by linking data from various departments, using Universes and stored procedures.
  • Designed, Developed and Implemented reports using Crystal Reports for various departments.

Confidential, NJ

Senior Database/Systems Analyst

Responsibilities:

  • Provided Research, Development and System Development Life Cycle Software Engineering support.
  • Designed Universes, developed and generated complex, Adhoc, Web Intelligence Reports.
  • Created daily, weekly, monthly, quarterly and Ad hoc Reports using SSRS.
  • Extensively used Business Objects (BOXIR2) Business Intelligence reporting functionalities such as Master Detailed, Slice/dice.

We'd love your feedback!