We provide IT Staff Augmentation Services!

Sr. Bi/dw/etl Developer Resume

2.00/5 (Submit Your Rating)

Waltham, MA

SUMMARY

  • Over 8 years of experience in IT industry performing Database Design, Data warehouse Development using SQL Server 2008/2005, Oracle 10g/11g in DEV, TEST and PRODUCTION environments with various domains like Financial, Insurance and Communication, Advertisement, Marketing.
  • Experience in Data Warehouse development working with Data Migration, Data Conversion, and Extraction/Transformation/Loading using Pentaho Data Integration (Spoon) with Oracle, SQL Server.
  • Working experience on transforming data from various data sources to a Data warehouse using PDI 4.1/4.0 and Kettle 3.2 and interacting with the Business Analysts in identifying the needs and the requirements of the system.
  • Created PDI Jobs and Transformations in enterprise repositories according to requirement to integrate source data in to Target data ware house.
  • Installation and administration experience of Pentaho Spoon 4.0, 4.4 on Windows and Linux Servers.
  • Highly experienced in Data Warehousing Business Intelligence using Pentaho BI Suite( Pentaho Report Designer, Pentaho BI Server)
  • Experience in creating ETL transformation/ jobs using Pentaho Kettle Spoon designer and Pentaho Data Integration and scheduling them on Pentaho BI Server using various scheduler.
  • Sound knowledge in Pentaho Enterprise BI Suite (Data Integration, Report Designer, Schema Workbench, Analyzer, Mondrian, Design Studio, Dashboard Designer, User Console and Enterprise Console).
  • Experience in software Analysis, Design, Development, Testing, Implementation and Production Support of Client/Server and Web based applications.
  • Expertise in Configuration, Logging, Error Reporting and Variables expressions in PDI to make Jobs/Transformations portable which Deployment and Troubleshooting.
  • Experience in performing Data Conversion, Data Scrubbing, and Data Transformations with complex Transformations/Jobs and stored Procedures.
  • Strong working experience of end to end Data Warehouse techniques and practices, experience including ETL processes, dimensional data modeling (Star Schema, Snow Flake Schema), OLAP and Database performance tuning.
  • Experience in design and implement processes for Deploying, Upgrading, Managing, and extracting data for reporting using SQL Server Objects.
  • Experience in data normalization and data modeling using Erwin and Visio.
  • Experience in Performance Tuning, T - SQL Query Optimization and Solving Blocking issues using Execution Plan/Explain plan, Profiler and DTA.
  • Wrote complex Stored Procedure to Scrub and Fetch the Data from HTML source, and loaded into SQL Server staging Database.
  • Good knowledge of working with MySQL, DB2 and OOPS Concepts.
  • Having good knowledge of entire phases of Software Development Life Cycle SDLC .
  • Highly organized with the ability to manage multiple projects and meet deadlines.
  • A team player with excellent interpersonal, communication and presentation skills.

TECHNICAL SKILLS

Database/ETL Tools: Pentaho Data Integrations (PDI Spoon), Oracle 10g/11g, Toad for Oracle/SQL Server 10.5/11.6, MS SQL Server 2008, 2005, 2000,7.0, Business Intelligence Development Studio, Enterprise Manager, SQL Profiler, DDL, DML, Stored Procedures, UDF, Triggers, DTS, Database Tuning Wizard, SSIS, SSAS, SSRS.

Operating Systems: Windows Server 2008/2003/2000 , Windows NT 4.0, Windows 7/Vista/XP/98.

Data Migration: Pentaho Wizard, MSDTS, BCP, Data Migration, Import/Export Wizard.

Languages/IDEs: Java Scripting, Expression, C, C++, C#, T-SQL, VB6.0

Data Modeling: Toad Modeling for Oracle, ERWIN 4.x, MS Visio 2007/2003.

Web Technologies: ADO.NET, IIS, HTML, DHTML, XML, Web Services, Visual Studio 2005, MS FrontPage 2000/98

Reporting Tools: Pentaho Reporting Tools, Microstrategy 9.2/9.3, SQL Server 2008/2005 Reporting Services, Crystal Reports 9/10/11, Pentaho BI Suite 3.7/3.6

Office Suite / Tools: MS Office 2007/2003, MS Team Foundation Server 2008

PROFESSIONAL EXPERIENCE

Confidential, Waltham, MA

Sr. BI/DW/ETL Developer

Responsibilities:

  • Worked with business users/Analytics team, data architect to identify the business requirements and developed designed document for ETL flow and created various complex Pentaho Transformation and Jobs using PDI Spoon.
  • Gathered business requirement by understanding business Processes and needs
  • Involved in building Data warehouse whose primary source of data comes from external vendors and corporate sources which includes the data from various source system like Oracle 10g, Flat files, and Microsoft Excel file, XML files.
  • Participated in design of Staging Databases and Data Warehouse/Data mart database using Star Schema/Snowflakes schema in data modeling
  • Load data into STAGE/ARCHDATA/DW/DM by using Transformations/Jobs which consists of 150+ Transformations and 30+ Jobs all together using SMART Master ETL Job.
  • By using Pentaho inbuilt Change Data Capture utility (CDC) to get the data from source system/ Load data into Data Mart(DM)
  • Create Database logging for each Transformation/Jobs into ETL PDI TRANS and setup Email notification failure on each Component level.
  • Load Data warehouse by using Slowly Changing Dimension (SCD - Type 0,1)
  • Implemented Logic with Database lookup table to maintain Parent- Child relationship and maintain hierarchy.
  • Used bunch of transformations in Pentaho transformations including Row Normalizer, Row Demoralizer, Database Lookup, Database Join, Calculator, Add Sequence, Add Constants and various types of inputs and outputs for various data sources including Tables, Access, Text File, Excel and CSV file.
  • Used transformation component like Merge Join, database Join, XML components to load XML files.
  • Use Pentaho Import Export utility to Migrate Pentaho Transformations and Job from one environment to others (DEV/QA/PREPROD/PROD).
  • Create Transformations/Jobs to take daily back up of Enterprise repository for DEV/QA/PREPROD/PROD.
  • Use pentaho Scheduler to schedule daily/weekly/Monthly ETL jobs.
  • Developed complex ETL Procedures to migrate huge amount of data from the old system to the new one.
  • Applied Configuration, Logging, Error reporting to all Transformation and Jobs to make it deployment easy and troubleshoot package on run time.
  • Used Pentaho Enterprise Console (PEC) to monitor the ETL Jobs/Transformation on Production Database.
  • Resolved connectivity issue on different server by using Kettle.Properties file and setup Variable for each DB connection.
  • Create Deployment build (15+ Build) and documentation for DB objects/PDI Jobs and Transformations using one script build.
  • Used Oracle Connection managers to configure database connections for Oracle 11g and Data Warehouse Databases
  • Worked with team members to tune the SQL queries using Oracle explain plan. Create necessary Index/Partition on huge fact table for getting a better performance in ETL
  • Automated file transfer processes and mail notifications by using FTP Task and Send Mail task in Transformations
  • Implementing maintaining database security(Create and maintain users and roles and Login access, assign privileges) to each schema level permission.
  • Providing Production support to operational team for daily/weekly/Monthly job failure in Production environments.
  • Created deployment documentation with the help of other users and operational team to deploy the new release in Production environment
  • Validating various reports in Microstrategy 9.2 for data validation with existing DM and compare data with source system before sending out to UAT .

Environment: s: Oracle 11g/10g, Pentaho Data Integration Spoon 4.2.0/4.1.2 , Windows Server 2008, Oracle Toad 10.6, PL/SQL, Pentaho Enterprise console, Microstrategy 9, SQL server 2008

Confidential, Alexandria, VA

Sr.SQL Developer/SSIS Developer

Responsibilities:

  • Interacted with business analysts and End client to understand technical and functional requirements for creating new Job.
  • Developed complex custom reports using Pentaho Report Designer which includes developing Cascading pick-lists, Drill-throughs, Hyperlinks, sub-reports etc, functionality into these reports.
  • Developed several Pentaho Reports, Dashboards, XActions and Analyzer Reports for the client.
  • Designed and deployed custom dashboards on Pentaho User Console.
  • Integrated Pentaho reports and dashboards with the client’s existing front-end application and web portals.
  • Used Pentaho Data Integration 4.0 for ETL extraction, transformation and loading data from heterogeneous source systems such as excel and flat files.
  • Developed various transformations and jobs where the data is extracted from the sources like Oracle 11g, SQL Server 2005 and then loaded into staging tables from staging tables data loaded into relational tables and from Relational tables data loaded into Hubs, Satellites and Links
  • Used PDI transformations to cleanse data for duplication, derived values and address parsing.
  • Created complex PDI mappings to load the data warehouse, the mappings involved extensive use of transformations like Dimension Lookup/Update, Generate data, Get data from Variable
  • Extensively worked with enterprise Repositories, PDI Job Servers and Enterprise console.
  • Responsible for Debugging and testing of PDI Jobs.
  • Optimize data mappings to achieve faster load
  • Experience in debugging and performance tuning of sources, targets and mappings
  • Worked with Parameters/Variables in PDI jobs and transformations to achieve automation.
  • Created Java Scripts and worked with Conditional statements and While Loops to implement complex logic.
  • Extensively used “Define Error Handling” to handle exceptions and wrote Scripts to automate the Job Process
  • Performance tuning of the SQL queries by restructuring the Joins, creation of required indexes to avoid table scans, error handling of queries etc.
  • Loading Data into Target using from flat files, XML and database tables used as source.
  • Experience in migration of Data from Excel, Sybase, Flat file, Oracle, and MS SQL Server.
  • Tested and Validated PDI ETL Jobs, monitored Daily PDI ETL schedules.
  • Performed troubleshooting and provided resolutions to ETL issues.
  • Extracted aggregated data from CAM Data mart according to business requirements into CSV file, and use those files as input for SAP Business Object’s Profitability and Cost Management (PCM) software to creates reports for end users
  • Actively participated review meetings with Sr. Business Analyst and Project Manager to ensure that the development of projects meet business and system requirements.
  • Perform different DBA task like database backups, Query optimization and performance tuning by using performance tuning tools.
  • Created Run book which includes step by step explanation of deploying the SSIS packages on the new server.
  • Run Import/export wizard to load data between TEST and DEV Server, provided CSV and Excel files to mangers for the particular records they want for different meetings.
  • Wrote requirements and technical specification documentation, Operational guide, for ETL Packages, Scripts, Migration documents
  • Designed ETL technical architecture, High level process flow for CAM, E-R diagram of data-mart for CAM by using data modeling tool MS Visio 2007.

Environment: s: Pentaho Spoon 4.0, MS SQL Server 2008, Windows Server 2008, Enterprise Management Studio, MS Query Analyzer, SQL profiler and Pentaho Reporting 2008, MS Visio 2007

Confidential, Montvale, NJ

Sr.SQL Developer/SSIS Developer

Responsibilities:

  • Installed and Configure Oracle 10g and SQL Server 2008 on Windows Server 2008 and Windows Vista according to requirements.
  • Reviewed the project requirements, and participated in design ODS and PDMT Data Ware House.
  • Pulled the data from various data source like Oracle, Flat files, HTML, CSV etc., loaded in to Staging Database.
  • Created a Linked Server for ORACLE to fetch the data into SQL Server on Integration Service Machine.
  • Expert in Extraction, Transforming and Loading (ETL) using SSIS creating mappings/ complex workflows to extract data from SQL Server, Excel file, other databases and Flat File sources and load into various Business Entities.
  • Written SQL Server Open query to fetch the Data from Oracle by using dynamic SQL
  • Using FTP task, Execute Process task, File System task, For each Loop Container, unzip the folder from particular web location and copy it on the Local Server.
  • Wrote complex Stored Procedure to Scrub and Fetch the Data from HTML source, and loaded into SQL Server staging Database.
  • Used Look up, Pivot, Merge Join, Union all, Derived Column, Conditional Split, and Aggregate transformation to manipulate data in SSIS package data flow.
  • Created deployment utility to deploy SSIS Packages, and Deploy Packages on MSDB.
  • Wrote some C# scripts to insert and update the value into a table by using Script Component.
  • Filtered data staging to EDW by using Complex T-SQL statements in Execute SQL Query Task and in Transformations and implemented various Constraints and Triggers for data consistency and to preserve data integrity.
  • Created dynamic package Configuration using Environmental Variable and SQL Server Configuration to make package portable and created Event handlers for handling package error by using a Custom Logging.
  • Created Drill Down, Drill Through, Parameterized Reports, Chart Reports, and Gauge Reports from Cube using MDX and Tables using T-SQL based on business requirement.
  • Design OLAP cube using SQL Server Analysis Service. Design natural and navigational hierarchies in dimension
  • Created BI reports based on existing cube.
  • Expertise in deploying SSIS Package, SSRS Reports and SSAS Cubes using command line utilities.
  • Worked closely with DBA team to regularly monitor system for bottlenecks and implement appropriate solutions.
  • Created Run book which includes step by step explanation of deploying the SSIS packages on the new server.
  • Ran Import/export wizard to load data between TEST and DEV Server, provided CSV and Excel files to mangers for the particular records they want for different meetings.
  • Co-ordinate with QA team (Dallas) for Deploy Packages and solve Configuration problem on the QA server and helping them to understand the flow of packages.
  • Created a BAT file of each SQL Server Agent Job to execute it by using Windows Command Prompt

Environment: s: MS SQL Server 2008, Oracle 10g, SQL Server Integration Services(SSIS), Windows Server 2008, Enterprise Management Studio, MS Query Analyzer, SQL profiler and SQL Server Reporting Services(SSRS), MS Team Foundation Server 2008, HTML, XML, Databus.

Confidential, Overland Park, KS

SQL Server Developer/ BI Developer

Responsibilities:

  • Installed and Configure of MS SQL Server 2008 on Windows XP Professions and Windows Server 2003.
  • Actively participated as in team to gather requirements to Develop BI Project and also participated Designed Physical and Logical of Data warehouse.
  • Participated in design of Staging Databases and Data Warehouse database
  • Implemented ETL to Extract and Transform data from Flat File or CSV, SQL Server 2005 instances and to load into Staging Database. The main purpose to load into staging database is to change all string values to integer. And then to Data Warehouse for further Data Analysis by using multiple transformations provided by SSIS such as Data Conversion, Lookup, Conditional Split, Slowly Changing Dimension, Merge and Union all.
  • Applied Configuration, Logging, Error reporting to all packages to make package deployment easy and troubleshoot package on run time.
  • Load data in Data ware House by using Slowly Changing Dimension (SCD - Type 1, 2)
  • Implemented Logic with lookup table to maintain Parent- Child relationship and maintain hierarchy.
  • Used transformation like Merge Join, Pivot, lookup, Fuzzy lookup and slowly changing Dimension.
  • Use Package Configuration to Migrate SSIS package from one environment to other.
  • Use event handling to send E-mail on event like on error.
  • Created different user level groups, and assigned appropriate permission level to the database using Credentials tool. This made sure that only the right person with enough authorizations would be able to see their corresponding Information
  • Use Data Viewers in SSIS Packages to check the flow of data during Execution of Packages
  • Generated reports using SSRS that could be used to send information to different managers of Different Branch.
  • Standardized company reports by implementing SQL Server Reporting Services.
  • Designed and deployed Reports with Drop Down menu option and Linked reports
  • Deploying and scheduling Reports using SSRS to generate all daily, weekly, monthly and quarterly Reports including current status.
  • Deployed and Scheduled the Reports in Report Manager.
  • Scheduled and maintained routine jobs, tasks, and alerts. For instance an alert would be sent to the manager of department, if the entire field were not entered by the data entry person regarding screening using SQL Server Agent
  • Prepared user manual and technical support manual

Environment: MS SQL Server 2005/2008, SQL Server Integration Services, MS Access 2003/2007, Enterprise Management Studio, MS Query Analyzer, SQL profiler and SSRS.

Confidential, Atlanta, GA

SQL Server Developer

Responsibilities:

  • Involved in the complete Software development Life Cycle of the system and also in the design and development of the database for the system using various data modeling techniques.
  • Participated in designing the Logical model by using Erwin based on the business requirement.
  • Implemented the logical design to the physical design by creating tables.
  • Designed SSIS packages to migrate the data from different sources to ETL tier.
  • Tested, Cleaned and Standardized Data meeting the business standards using Fuzzy /exact lookups.
  • Extracted, cleaned and validated from XML file into database using SSIS task (XML source).
  • Created SSIS Packages by using advance tools (i.e. pivot Transformation, Fuzzy Lookup, Derived Columns, Condition Split, Term extraction, Aggregate).
  • Develop Functional/Technical specifications for SQL Server Reporting Services reports.
  • Created different type of reports including: Cross-tab, Conditional, Drill-down, Sub reports, Drill-down and Parameter prompts.
  • Designed and deployed Reports with Drop down menu option and Linked reports.
  • Deploying and scheduling Reports using SSRS to generate all daily, weekly, monthly and quarterly Reports including current status.
  • Created Custom Reports using VB.Net assembly and Expressions in SSRS
  • Generated the various kinds of reports using Graphs and Images
  • Deployed and Scheduled the Reports in Report Manager.
  • Created Stored Procedures that generated XML reports from SQL Server tables and vice versa using Open XML, For XML, and XML Paths.
  • Used DDL and DML to writing triggers, stored procedure to check the data entry and payment verification at early stages before calling them
  • Created and Executed the Stored Procedures and Complex Queries for Reports.
  • Used DBCC commands to check physical and logical consistency of the databases and Rebuild indexes
  • Optimized the performance of queries by modifying the existing index system and rebuilding indexes again with respect to the I/O.
  • Maintained data integrity by Creating Constraints and Triggers.
  • Facilitated easy user interface implementation and consistent data entry into the database by creating Views with triggers.
  • Converted complex business logic into SQL Stored Procedures and User-defined functions to achieve functionality required by the UI team and to support efficient data storage.

Environment: Microsoft SQL Server 2005, Microsoft SQL Server Integration Services (SSIS), Microsoft SQL Server Reporting Services (SSRS), Microsoft Access 2003, Microsoft Excel 2003, Microsoft Visual Studio .NET 2003, ASP.NET, XML, SQL Profiler, ER-Win, T-SQL.

Confidential, Providence, RI

SQL Server Developer

Responsibilities:

  • Created new database logical and physical design to fit new business requirement and implemented new design into SQL Server 2005.
  • Migrated DTS packages to SSIS and modified the packages accordingly to the new features of SSIS and carried out a migration of databases from SQL Server .
  • Participated in database logical design to fit new business requirement, and implemented new design in SQL Server 2005
  • Filtered bad data from legacy systems using T-SQL statements, and implemented various constraint and triggers for data consistency.
  • Deployed reports to Report Manager and Troubleshooting for any error occur in execution.
  • Scheduled the Reports to run on daily and weekly basis in Report Manager and also email them to director and analysts to review in Excel Sheet.
  • Identified, tested, and resolved database performance issues (monitoring and tuning) to ensure database optimization
  • Maintaining remote and central databases for Synchronization of data and preparing plans for Replication.
  • Documentation of all the processes involved in maintaining the database for future reference.
  • Develop documentation that sufficiently describes technical deliverable as required for internal controls and maintaining documentation of the database for future reference.

Environment: s: SQL Server 2000/2005, SQL Server Integration Services, MS Excel 2003, MS Access 2003, Enterprise Manager, Management Studio, SQL Profiler, and SSRS.

We'd love your feedback!