Microsoft Fabric

DPW05 Using AI to Improve Spark Development in Microsoft Fabric

11/20/2024

2:00pm - 3:15pm

Level: Intermediate

Ginger Grant

Principal Data Geek

Desert Isle Group

When workloads increase, you may need a copilot to help you improve the quality and speed of development. Microsoft Fabric Spark has implemented a number of different AI methods to assist documentation, development, error handling and debugging via Copilot. Learn how to utilize Copilot’s prompts to create code snippets to use in your notebook to resolve issues with your data. In this session we will show you how to implement these features either inside of the Fabric UI or within VSCode. We will also review other time saving development techniques to assist in common data transformation and analysis tasks. If you want to improve your Spark productivity in Fabric, you won’t want to miss this session.

You will learn:

  • Understand the use of Copilot magic commands and how they can be used to implement Copilot features when writing pySpark in Microsoft Fabric
  • Explore how you can use Data Wrangler to transform your data with auto-generated Python code.
  • How to use Copilot prompts to generate code for your specific data