Reliable surrogate keys for modern lakehouse workloads As data platforms evolve from traditional data warehouses to open lakehouse architectures, one requirement has remained constant: the need for stable, unique surrogate keys. With Fabric Runtime 2.0, built on Apache Spark 4.x and Delta...

Continue reading

A modern Spark and Delta foundation for the next generation of analytics and AI in Microsoft Fabric Data teams are under pressure to do more than run batch jobs faster. They are expected to deliver reliable lakehouse pipelines, support AI scenarios, preserve...

Continue reading

Welcome. I am Arshad Ali, and this blog is where I share practical insights from building and evolving data and analytics platforms, with a strong focus on Microsoft Fabric and Spark Runtime.

Continue reading