A data engineer uses a Fabric notebook with Spark Structured Streaming to ingest order events into a lakehouse Delta table named BronzeOrders. The
writeStream query uses output mode append and stores its checkpoint under the lakehouse Files area. A second streaming query will later write a different feed to a separate table.Select one answer per row
The second streaming query can safely reuse the BronzeOrders checkpoint location.
The second streaming query can safely reuse the BronzeOrders checkpoint location.
The checkpoint lets the BronzeOrders query resume from its recorded progress after a restart.
The checkpoint lets the BronzeOrders query resume from its recorded progress after a restart.
Moving the checkpoint to local driver storage would preserve streaming progress across application stops.
Moving the checkpoint to local driver storage would preserve streaming progress across application stops.
With the Delta table sink, checkpointing supports exactly-once processing of the order events.
With the Delta table sink, checkpointing supports exactly-once processing of the order events.