Local Development of your Microsoft Fabric Lakehouse with Spark jobs & Organizing Microsoft Fabric Adoption (IN-PERSON @ AE, Leuven)

Local Development of your Microsoft Fabric Lakehouse with Spark jobs

Speaker: Thibault Croonenborghs

While Microsoft has significantly enhanced the developer experience for notebooks in Fabric, encouraging their use for daily workloads, Spark job definitions offer a compelling alternative for ETL code development. This session explores some advantages of using Spark job definitions over notebooks, with a focus on local development practices that optimize both efficiency and resource utilization.

We will cover the setup of a local development environment, techniques for developing and testing Spark job definitions locally on your machine and how to integrate your jobs into robust CI/CD pipelines. Whether you’re looking to optimize resource usage, improve code quality, or streamline your deployment process, this presentation will provide valuable insights for data engineers and developers working with Microsoft Fabric.

Organizing Microsoft Fabric Adoption

Speaker: Eduard Koekkoek

A data or analytics Center of Excellence (COE) is an internal team of technical and business experts. The team actively assists others within the organization who are working with data. A federated COE comprises a shared services team (the core COE members) plus satellite members from each functional area or major business unit (by definition of Microsoft Learn).  We will draft an approach of the roadmap for Fabric based on Eduard’s 5 years of experience with Power BI Adoption at Royal Heijmans of The Netherlands.

As a data analytics engineer or a team manager, you can be confronted with the price of success of your data platform and self-service users creating dashboards from it. Get practical approaches to actively involve your management, key users, and other stakeholders. At Heijmans the Power BI community consists of more than 350 dashboard creators for about 200 daily readers. Learn from our lessons for cultivating data culture by organizing from mandate through support, training, and user services for Fabric.

Discover in this session the considerations for the different COE-aproaches, a data platform architecture for enterprise- and streaming data, and organize means of communication and services with and for internal audiences.

Speakers

Register now!