Data EngineeringData Engineering & ArchitectureFeatured
Demystifying Spark Profile Optimizations In Microsoft Fabric
This session is primarily about data engineering & architecture within the Microsoft Fabric and SQL ecosystem. Optimizing Spark workloads in Microsoft Fabric can be a complex endeavor, given the array of available configurations and techniques. Terms like V-Order, Z-Order, and considerations for read-heavy versus write-heavy profiles often add to the confusion. In this session, we'll bring clarity to these concepts, offering a structured overview of each optimization strategy.
Key takeaways
- Collection of Spark configurations, bundling settings & optimizations
- spark.conf.set("spark.fabric.resourceProfile", "writeHeavy")
Internal notes
No internal notes yet.

