Explore Microsoft Fabric and Apache Spark capabilities through practical examples, runtime guidance, limitations, and downloadable code. Each guide identifies its supported runtime and links to supporting documentation.
Runtime guides and hands-on tutorials
-
Bring Your SQL Skills to Fabric Runtime 2.0: Spark 4.1 in Practice
Reuse your SQL skills in Fabric Runtime 2.0 with hands-on Spark 4.1 examples for session variables, CTEs, recursion, SQL scripting, and safer dynamic SQL.
-
Spark SQL That Reads Like PySpark: A Pipe Syntax Tutorial
Learn Spark SQL pipe syntax in Fabric Runtime 2.0 with copy-paste examples, PySpark comparisons, joins, aggregation, window functions, and result checks.
-
Run Spark from Anywhere with the Microsoft Fabric Livy API
Call Fabric Spark Livy APIs from any language that supports REST requests. Follow Python examples for authentication, OneLake access, batch jobs, and High Concurrency.
-
Native Python UDFs in Fabric Runtime 2.0: What Gets Faster, What Still Matters
Explore current Python UDF support in Fabric's Native Execution Engine: scalar versus Pandas performance, a runnable example, setup steps, and a benchmark checklist.
-
The Variant Data Type in Fabric Runtime 2.0: Native Semi‑Structured Data Without the JSON Tax
Learn how the Variant data type in Spark 4.x and Delta Lake 4.x eliminates repeated JSON parsing, replacing fragile STRING-based patterns with a binary, query-optimized semi-structured type in Fabric Runtime 2.0.
-
Identity Columns in Fabric Runtime 2.0: From Workarounds to First‑Class Support
Learn how Fabric Runtime 2.0 brings native identity column support to Delta Lake, replacing fragile Spark-side workarounds with transactionally safe surrogate key generation.
-
Fabric Runtime 2.0: Why It Matters for Spark Developers
Fabric Runtime 2.0 upgrades to Spark 4.x and Delta Lake 4.x. Here is what changed and why it matters for data engineers building on Microsoft Fabric.
Subscribe to the RSS feed for new articles.