Bi Specialist, Data Engineer Resume
Miami, NashvillE
SUMMARY
- me has extensive experience designing end - to-end solutions from ETL Pipelines, algorithms, databases, reports & other software products for startups & already established corporations.
TECHNICAL SKILLS
Data warehousing Tools: SQL Server Integration Services (SSIS), Talend 10.0, Informatica Power Center 8.6, 9.0, 9.6, 10.1, Informatica Cloud, Dell Boomi.
Data Modeling: Dimensional Data Modeling (Star Schema, Snow-Flake, FACT, Dimensions), Physical and Logical Data modeling, Entities, Attributes, ER Diagrams, Oracle SQL Data Modeler, MS Visio.
Job Scheduling: Tidal, Confidential, Control M,Cron Job
Database Management System: AWS Redshift
Databases: MS SQL Server, Oracle, Teradata, MongoDB, MS-Access
Reporting & Tools: SQL Server Reporting Services(SSRS), Power BI, Pycharm, Jupyter & Tableau
Languages: HTML, C#, XML, VB.NET, ASP.NET, .NET Frame Work, Python 2.6, 3.7, JavaScript.
Version control: SVN, GitHub, TFS, Bit Bucket, and Octopus.
Operating Systems: Unix, Linux, Windows XP/NT/ r2, DOS
PROFESSIONAL EXPERIENCE
Confidential, Miami/Nashville
BI Specialist, Data Engineer
Responsibilities:
- Accounting & Solar DG applications (AWS, Oracle, MSBI & PowerBI)
- Developed various AWS Lambda functions to retrieve data from Java applications and load into S3 bucket & load data from S3 bucket to Amazon Redshift.
- Created Multiple Talend jobs to retrieve semi-structured data from Web API and load into S3 bucket.
- Create AWS Lambda function in NodeJS & Python to pull the data from various sources and load into S3 buckets & Redshift.
- Migrated data from Legacy, Oracle to Dynamo Db & PostgreSQL.
- Implement enhancements in the Accountable & Solar DG applications hosted on SharePoint Site using Visual Studio.
- Migrated data storage from on premise server to AWS Cloud architecture.
- Analyze, designs, develops, tests, debugs, implements, maintains and/or enhances existing or new systems that are reliable & efficient.
- Designed data flows & various dashboards in Power BI.
- Decommissioned Jasper reports & generated similar critical report system in SSRS for end users.
- Created an Extraction process in Oracle to pull in Phoenix & SAP information based on set of business rules.
- Provided ad-hoc code fixes in case of any issue in the production environment.
- Conducted Code Reviews of team members, unit & regression testing results prior to deliver the solution to accomplish Test Driven Development (TDD) to make it compatible for CI/CD environment.
- Lead the BI development team and designed whilst mentoring the other developers in best practice, design and technical solution deliverables.
- Build critical reports for Business accounting Ledger.
- Responsible for the development and integration of new or existing applications into the technical infrastructure and existing business processes.
- Deployed Talend jobs using Cron Job.
- Sunset the SharePoint & moved all reports to PowerBI Report Server & PowerBI Service.
- Deployed all the DB scripts using SCALA.
- Prepare high - level Architecture designs for the SSAS/SSRS/PowerBI reporting solutions.
- Provides technical or functional guidance to project or work teams as needed within a specific discipline.
- Leveraged all aspects of BI technologies and architecture such as delivery mechanisms (portals, dashboards, OLAP), data model/architecture, data integration/ETL and reporting tools
- Designing oracle pipelines from raw data.
- Analyze the current Software applications, Workflows, Procedures of the organization to recommend better solutions.
- Worked with stakeholders, Product owner & Business Analysts to understand inefficiencies in existing business applications and recommend solutions.
Confidential, Brentwood, TN
BI Specialist, Data Engineer
Responsibilities:
- Created Power BI reports including Confidential based on
- Business requirements with linked content, drill-downs, nested parameters, slicers & dicers.
- Performed Data Analysis and created reports with Pandas & Matplotlib.
- Identified the new data sources & modeled them into ODS and Tabular Data warehouse using Oracle SQL Data Modeler.
- Develop reports concepts, analytics & visualizations using DAX, SQL, tuning, data models and semantic models.
- Develop & implement custom database solutions using C# in the ETL process.
- Used PowerShell scripting to deploy SSIS Packages, SSAS cube & Power BI reports to various environments using CI/CD mechanism.
- Implementing various SSIS packages having different tasks and transformations and scheduled SSIS packages.
- Written complex Merge Procedures (T-SQL) to load Facts & Dimensions into ODS, Data warehouse for reporting.
- Used Processing options like Process update, Process full, Process data in while creating SSIS package using Analysis
- Services execute task
- Developed & maintained existing SSRS reports and supported business for adhoc requests.
- Loaded the data into SQL on premises using custom pragmatic works custom plug-ins from Salesforce in SSIS.
- Modeled the existing SSAS Tabular cube architecture to bring new Fact & Dimensions & improved existing performance.
- Developed complex Dashboards using DAX & used bookmarks to navigate between different pages.
- Written Python code to separate the emails from different users & performed data analytics.
- Used Custom visual layouts like drill down donut charts, power kpi’s, calculated columns & measures to support the visuals.
- Developed ETL solutions using SSIS for supporting multiple Power BI dashboards and SSRS reports.
- Configured & monitored workflows in Confidential tool to run the existing packages on all existing environments
Confidential, Norfolk, VA
Data Engineer, Full Stack Developer
Responsibilities:
- Created MongoDB database for saving unstructured EDI files (820,835,834,837I, 837P) converting files to JSON format.
- Created SQL unit cases, deployment scripts using SQL Red Gate Tool.
- Migrated data from Heterogeneous data sources (Excel, Flat File and CSV file, X12 EDI files, Teradata, Oracle) to SQL
- Server database using SQL server integration services (SSIS).
- Created Web API’s to load data from JSON files to SQL Server.
- Developed client UI in Angular, HTML5, CSS3 and Bootstrap frameworks.
- Implemented ‘LINQ to Entities’ queries to achieve performance-improved code.
- Developed complex Stored procedures,Indexes,Tables,Functions,Triggers,Views and other T-SQL code and SQL joins for new state applications.
- Optimized existing SQL queries (T-SQL) for integration of other applications.
- Created SSRS Reports (Parameterized, Linked, Drilldown, and Drill through) for reconciliation purpose.
Confidential, Pleasanton, CA
Data Lead Engineer
Responsibilities:
- Developed ETL maps for supporting extraction, transformation, and loading of data using Informatica Cloud (IICS).
- Created worklets, workflow and tasks to schedule the loads at required frequency using workflow manager.
- Optimized SQL queries and stored procedures, and built Individual DataMart’s from the Data warehouse for internal reporting.
- Extensive working experience in Teradata utilities viz TPUMP Fast Export Fast Load MultiLoad TPUMP etc.
- Worked heavily on client reporting in Tableau, enabling interactive reports to analyze user data.
- Performed replication from Salesforce to SQL server premise using Informatica Cloud (IICS).
- Expert in Data Visualization development using Tableau to create complex, intuitive, and innovative dashboards.
- Combined visualizations into Interactive Dashboards and publish them to the web.
- Created BTEQ Scripts for pre population of mortgage tables prior to the main load process.
- Worked on Tableau Dashboards in Tableau 8.0. Demonstrated noledge in dealing with various functionalities like context filters, global filters, guided navigation, customization, conditional formatting of reports to satisfy the end users.
- Imported the incoming data using Teradata SQL Assistant & developed packages to load the data from Teradata Confidential to SQL server on premise.
- Created complex mapping using unconnected & connected lookups, update strategy, stored procedures, java normalizer and router transformation for population the target SQL tables in efficient manner.
- Extensively worked on creating calculated fields and Analysis depending on the user requirements.
- TEMPEffectively used data blending, filters, actions, Hierarchies feature in tableau.
Confidential, San Francisco, CA
Database Engineer
Responsibilities:
- Designed dynamic SSIS packages to transfer data crossing multiple platforms & archived data files for different Confidential .
- Migrated Crystal reports to SSRS & PowerBI.
- Responsible to monitor the SSIS, Dell Boomi jobs in Splunk,Dynatrace & SQL Sentry.
- Architected a high performance, scalable ETL solution using SSIS, SQL for loading multi-terabyte datawarehouse by integrating data from over 20+ data sources.
- Written complex Stored procedures to migrate (US and Canada data from) SQL Server to Confidential Cloud.
- Implemented perspectives and KPI’s using calculated measures based on requirements for sales teams.
- Developed new custom stored procedures, which were used with the API to make the business user GUI’s user
- Friendly; optimized/tuned them for top performance.
- Built TEMPeffective queries for high-performance reporting and rendered them to HTML, XML, PDF and Excel format using
- Reporting Services.
- Parsed & Extracted heavy XML Auto-ship data using Python.
- Established Pyodbc connection to perform CRUD operation using Python.
Confidential
Lead SSAS, ETLResponsibilities:
- Created SSAS storage and partitions and Aggregations, calculation of queries with MDX, Data Mining Models, & developed reports using MDX and SQL.
- Designed and developed a Unified Dimensional Model (UDM) in SSAS to combine data from multiple databases into a
- Single model.
- Involved in SSAS Cubes design by creating KPI, Actions and Perspective from huge dataset using SQL Server 2008
- Analysis Services (SSAS).
- Developed SSIS packages to load the data from OLTP to OLAP in incremental manner.
- Developed stored procedures with advanced programming techniques including minimal logging, accurate execution plans
- & index seeking methodologies.
- Developed and extended SSAS Cubes, Dimensions and data source views.
- Developed reports on Performance Point (SharePoint) & deployed to SharePoint.
- Implemented core ETL Methodologies using Snowflake Schema.
- Created & formatted Cross-tab, Conditional, Drill down, Top N, Summary, Form, OLAP, Sub Reports, adhoc Reports
- Parameterized Reports, and Interactive Reports & Custom Reports.
Confidential, Houston, TX
Data Modeler, ETL Developer
Responsibilities:
- Performance Tuned the existing production custom SSIS packages using counters, error handling, event handling.
- Developed complex C# code to perform Coded-UI Testing to capture the ASP.Net applications’ page response.
- Extensively involved in designing the SSIS packages to export data of flat file source, Oracle to SQL Server database.
- Worked with application development team to implement data flows.
- Developed & deployed complex SSIS packages using proper control and data flow elements with error handling.
- Applied business needs into data models supporting long-term solutions.
- Implemented Error Handling in SSIS packages and notified process results to various user communities.
- Created complex Stored Procedures, Triggers, Functions, Indexes, Tables, Views, Temporary Tables, Cursors and
- Other T-SQL code and SQL joins for applications following SQL code standards.
- Managed indexes & statistics, and tuned queries by using execution plan for optimizing the performance of the databases.
- Developed custom selection of reports ordering using SQL Server Reporting Services (SSRS).
- Developed reports in Performance point and deployed them to Share point for business users.
