Etl/informatica Developer Resume
Waltham, MA
SUMMARY
- A technical professional with 5+ years of IT experience in various industry - standards with ETL, Informatica Tools, BI Reporting Solutions, MS Azure and Amazon Web Services Tools, analyzing large & complex data sets using SQL & python and generating insights through visualizations.
- Experience in Analysis, Design, Development, Implementation, Testing and Support of Data Warehousing, Data Integration Solutions and expertise in performing data analysis using ETL, Informatica and Power BI.
- Strong Data Warehousing ETL experience of using Informatica 9.6.1/9.5.1/8.6.1/8.5/8.1/7.1 Power Center Client tools (Repository Manager, Designer, Workflow Manager, Workflow Monitor, Metadata Manger), Power Exchange, Power Connect as ETL tool on Oracle, DB2 and SQL Server Databases).
- Used Microsoft Power BI to extract data from external sources and modify data to certain format as required in Excel, and created SSIS packages to load excel sheets from PC to database.
- Used Power BI Power Pivot to develop data analysis prototype, and used Power View and Power Map to visualize reports.
- Experience in Design, development of Business Intelligence Solutions using Tableau.
- Expertise in writing complex DAX functions in Power BI and Power Pivot
- Expert in Extracting and Transforming data (ETL) from various heterogeneous sources and creating packages using SSIS/DTS, Import, Export Data, Bulk Insert and BCP utilities.
- Experience in Performance Tuning in SSIS packages by using Row Transformations, Block and Unblock Transformations.
- Experience in configuration and maintain Report Manager and Report Server for SSRS, Deployed and Scheduled the Reports in Report Manager.
- Experience in Performing root cause analysis on all processes and resolve all production issues and validate all data and perform routine tests on databases and provide support to all ETL applications.
- Extensive experience in developing Stored Procedures, Functions, Views and Triggers, Complex SQL queries using SQL Server and Oracle PL/SQL.
- Proficient in the Integration of various data sources with multiple relational databases like Oracle11g /Oracle10g/9i, MS SQL Server, DB2, Teradata, and Flat Files into the staging area, ODS, Data Warehouse and Data Mart.
- Experience with dimensional modeling using star schema and snowflake models.
- Created UNIX shell scripts to run the Informatica workflows and controlling the ETL flow.
- Exposure to building data models and applying learning algorithms in both supervised and semi-supervised learning projects.
- Good Hands on Experience in training Machine Learning models (Scikit-learn, TensorFlow, Keras) and Cleaning, blending and visualizing data.
- Hands on experience in Amazon Web Services (EC2, S3, RDS, Elastic Load Balancing, SQS, Identity and access management, AWS Cloud Watch, EBS and Amazon CloudFront).
- Strong software engineering skills including experience of a modern agile development workflow using Git, unit testing and CI/CD pipeline using Jenkins.
- Worked with Docker container snapshots, attaching to a running container, managing containers, directory structures.
- Performed unit testing using JUnit and Mockito aiding test driven Development in some sce narios.
TECHNICAL SKILLS
BI/ETL Tools: Informatica PowerCenter 9.5.1/9.1/8. x/7.1, SSIS, Talend, Alteryx, SSMS, SSRS, SSAS, SAS, Hadoop, Visual studio, SAP
Databases: Oracle 11g/10g/9i/8i, Teradata V2R5/R6/R12/R13, SQL Server 2008/2005, DB2 9.5
Data Visualization: Tableau, Power BI, Qlik Sense, Looker, Matplotlib, Plotly, Seaborn, UI/UX
Programming Languages: Python, SQL , T-SQL, C++, DAX queries, Azure SQL,HTML,CSS
Cloud Services: AWS, Microsoft Azure, Google Big query, Docker
Sales/Marketing Tools: CRM , Salesforce, Einstein Analytics, Informatica, SharePoint, Google analytics
Other Tools: SQL plus, Teradata SQL Assistant, Oracle SQL developer, PLSQL developer, Web Services, MS Office, MS Visio, TOAD, FTP, SVN, Putty, WinSCP, HP QC
Operating Systems: Windows NT,2000/03/XP/Vista/7, Linux Red Hat, Unix AIX 5.0/5.2/6.0, Solaris
Scheduler Tools: Autosys, Control M, CA7, Informatica Scheduler, DataStage director.
Data Modeling: ERWin r7.3/4/3.5, MS-Visio 2010/2007
Programming Skills: Python,JAVA (Eclipse IDE and Net Beans IDE), HTML, JAVA Script, J2EE, CSS.
PROFESSIONAL EXPERIENCE
Confidential, Waltham, MA
ETL/Informatica Developer
Responsibilities:
- Analyze and understand the Technical Specification Document (Source to Target matrix) for all mappings and clarify the issues with Data Architects.
- Responsible for developing, support and maintenance for the ETL (Extract, Transform and Load) processes using Informatica Power Center 9.6.1.
- Extensively used Informatica client tools - Source Analyzer, Warehouse designer, Mapping designer, Mapplet Designer, Informatica Repository Manager and Informatica Workflow Manager.
- Created sessions and batches to run the mappings and set the session parameters to improve the load performance. Developed Mapplet, reusable transformations.
- Utilized Power BI (Power Pivot/View) to design multiple scorecards and dashboards to display information required by different departments and upper level management.
- Created reports utilizing SSRS, Excel services, Power BI and deployed them on SharePoint Server as per business requirements.
- Designed complex data intensive reports in Power BI utilizing various graph features such as gauge, funnel, line better business analysis.
- Involved in Dimensional modeling (Star Schema) of the Data warehouse and used Erwin to design the business process, dimensions and measured facts.
- Developed Workflows using task developer, Worklet designer and workflow designer in Workflow manager and monitored the results using workflow monitor.
- Responsible for Performance Tuning at the Mapping Level, Session Level, Source Level and the Target Level for Slowly Changing Dimensions Type1, Type2 for Data Loads.
- Used debugger in identifying bugs in existing mappings by analyzing data flow, evaluating transformations.
- Designed workflows with many sessions with decision, assignment task, event wait, and event raise tasks, used informatica scheduler to schedule jobs.
- Extensively used SQL* loader to load data from flat files to the database tables in Oracle.
- Building Reports according to user Requirement.
- Strong experience in writing UNIX shell scripts for data file validation and working with Informatica components in Unix environment .
- Prepared Unit/ Systems Test Plan and the test cases for the developed mappings.
Environment: Informatica Power Center 9.6.1, Oracle 11g, DB2, SQL Server, SQL Loader, SQL developer, PLSQL developer, Putty, PL/SQL, UNIX Shell Scripting.
Confidential
ETL/ Informatica Developer
Responsibilities:
- Used Informatica power center 9.5.1 to Extract, Transform and Load data into Oracle data Warehouse from various sources like flat files, xml files, Oracle tables, DB2 tables etc.
- Designed various mappings using transformations like Source Qualifier, Normalizer, Expression, Filter, Router, and Update strategy, Stored Procedure, Sorter, Lookup, Aggregator and Joiner in the mappings.
- Developed mappings/reusable objects/transformation/mapplets by using mapping designer, transformation developer and mapplet designer in Informatica Power Center.
- Designed and developed Power BI graphical and visualization solutions with business requirement documents and plans for creating interactive dashboards.
- Utilized Power BI (Power View) to create various analytical dashboards that depicts critical KPIs such as legal case matter, billing hours and case proceedings along with slicers and dicers enabling end-user to make filters.
- Generated ad-hoc reports in Excel Power Pivot and sheared them using Power BI to the decision makers for strategic planning.
- Utilized Power Query in Power BI to Pivot and Un-pivot the data model for data cleansing and data massaging.
- Implemented several DAX functions for various fact calculations for efficient data visualization in Power BI.
- Utilized Power BI gateway to keep dashboards and reports up to-date with on premise data sources.
- Using different types of tasks like decision, timer and event initial/bulk load process wait and command to maintain the dependencies between the sessions and load balancing within Informatica workflow.
- Working with various transformations like router, expression, SQL, lookup, normalizer, and aggregator in building complex mapping.
- Wrote Oracle packages and functions to implement business rules and transformations after staging is done.
- Worked with pre and post sessions, and extracted data from transaction system into staging area.
- Using Oracle SQL developer, TOAD, Teradata SQL Assistant to analyze the existing data and design complex SQL queries.
- Developed Business Intelligence solutions using SSIS, SSRS and T-SQL .Expertise in Relational Database Systems and Data warehousing like Oracle, DB2, Teradata, MS Access, SQL Server.
- Coding UNIX shell scripts and Perl scripts to automate the data loading tasks.
- Developing mappings based on Change Data Capture CDC techniques.
- Performed code reviews with peers and created unit test plan document.
- Created test cases for Unit test, System Integration test and UAT to check the data quality.
Environment: Informatica Power Center 9.5.1, Informatica Data Quality (IDQ), MS Access, MS SQL Server 2008, MySQL Database, IBM DB2, SQL, PL/SQL, OBIEE 10.1.3.x, Unix, Oracle SQL developer, Web Services Hub.
Confidential
Data Analyst
Responsibilities:
- Participated in all phases of SDLC from Requirements gathering, Design, Development, testing, Production, user training and support for production environment.
- Used various sources to pull data into Power BI such as Sql Server, SAP BW, Oracle, SQL Azure etc.. .
- Installed and configured Enterprise gateway and Personal gateway in Power bi service.
- Created Workspace and content packs for business users to view the developed reports.
- Scheduled Automatic refresh and scheduling refresh in power bi service.
- Weekly presentation to the business users about the reports and their changes as required.
- Worked on all types of transformations that are available in Power BI query editor.
- Created stored procedures and SQL queries to pull data into power pivot model.
- Database creation (DDL, DML, DCL), database tuning, SQL tuning, performance planning.
- Extensively used Joins and Sub-Queries to simplify complex queries involving multiple tables.
- Developed tabular queries for efficient analysis of report using Pivot/Un pivot in T-SQL.
- Transformed complex business logic into Database design and maintaining it by using SQL objects like Stored Procedures, User Defined Functions, Views, T-SQL Scripting and Jobs.
- Creating and Modifying Tables, Stored Procedures, Views, Indexes, User-defined Functions, and Triggers as required.
- Created Jobs Performance report that queries system tables to track the duration of each job and weekly-average duration using SSRS.
- Designed and created data extracts, supporting SSRS, POWER BI, Tableau or other visualization tools reporting applications.
- Creating data blending in case of merging two different datasets using Tableau
- Created Datasets in T-SQL, stored procedures for SSRS.
- Developed Excel PowerView, PowerQuery and PowerPivot dashboards for data analysis
- Developed confidential proprietary analytical tools and reports with Confidential Excel, and Power Pivot and Power Point.
- Performed Index analysis for tables and came up with more efficient solutions to use Clustered and Non-Clustered Indexes for significant performance boost using index tuning wizard.
- Created SSIS packages to import data from Access, Excel, XML, OLE DB Source and Flat Files.
- Filtered bad data using Derived column, Lookups, Fuzzy Lookups, Conditional split.
- Designed SSIS packages to import and transform data between databases and external data sources using various transformations like Data conversion, File system task, Row counts, OLE DB Source, OLE DB Destination, OLE DB Command, Merge Join, Look up, Sort, Data flow task.
- Designed and created data extracts, supporting SSRS, Power BI, Tableau or other visualization tools reporting applications.
- Debugging SSIS packages, Performance tuning on Slowly running SSIS Packages.
- Configure and maintain using Report Manager and Report Server for SSRS, Deployed and Scheduled the Reports in Report Manager
- Created Reports using Charts, Gauges, Tables, matrix.
- Created Parameterized Report, Dashboard Report, Linked report and Sub Report by Year, Quarter, Month, and Week.
- Created Drill Down Reports, Drill Through Report by Region.
Environment: Power BI, SQL Server 2012, SSMS, SSIS, SSRS, SSAS, Pentaho, T-SQL, Tableau, Power BI, Windows 7, MS Word, MS Excel, C#, Visio, Share Point Jira, SQL Profiler
