Business Intelligence, Data Warehouse and Data Lake

SQT10 Using Azure Synapse with Azure Data Lake

11/15/2022

4:15pm - 5:30pm

Level: Intermediate

Thomas LeBlanc

Data Warehouse Architect/MVP

Data on the Geaux

The modern data warehouse methodology has changed the patterns used for populating data warehouses. One of those is staging the data in a data lake. The data lake is a raw storage (bronze) of exported data from a source system. Some steps include cleaning this raw data and placing in the next stage – silver. The final dimensional model might be formatted into the data lake stage called gold. From there, it might be a one-to-one match in a relational table structure of dimension and fact tables. The Serverless option in Synapse Analytics lets you skip the relational data resource and place external table structures to reference the gold data lake format. You might think of these external tables like a SQL view. Please join me on creating this new paradigm during this session with many demos.

You will learn:

  • What is Synapse
  • External table on blob storage
  • Understanding the levels of a Modern Data Warehouse - Bronze, Silver and Gold