Business Intelligence, Data Warehouse and Data Lake

SQT10 Using Azure Synapse with Azure Data Lake

11/15/2022

4:15pm - 5:30pm

Level: Intermediate

Thomas LeBlanc

Data Warehouse Architect

3Cloud Solutions

Slowly changing type 2 dimensions are typical in data warehouses. This enables historical tracking of attributes in a dimensional model. Power BI does not need a special indicator for this, just good modeling at the dimension and fact levels. Data Factory is the ETL/ELT tool used with Azure data services. Azure Synapse uses the same interface for pipelines. The slowly changing dimensions pattern is required for anyone integrating source data into a data mart. This session will demo a technique for implementing a pipeline for tracking historical changes in a dimension table.

You will learn:

  • What is Synapse
  • External table on blob storage
  • Understanding the levels of a Modern Data Warehouse - Bronze, Silver and Gold