Module mz_adapter::coord::introspection

source ·
Expand description

Support for unified compute introspection.

Unified compute introspection is the process of collecting introspection data exported by individual replicas through their logging indexes and then writing that data, tagged with the respective replica ID, to “unified” storage collections. These storage collections then allow querying introspection data across all replicas and regardless of the health of individual replicas.

§Lifecycle of Introspection Subscribes

  • After a new replica was created, the coordinator calls install_introspection_subscribes to install all defined introspection subscribes on the new replica.
  • The coordinator calls handle_introspection_subscribe_batch for each response it receives from an introspection subscribe, to write received updates to their corresponding storage-managed collection.
  • Before a replica is dropped, the coordinator calls drop_introspection_subscribes to drop all introspection subscribes previously installed on the replica.
  • When a replica disconnects without being dropped (e.g. because of a crash or network failure), handle_introspection_subscribe_batch reacts on the corresponding error responses by reinstalling the failed introspection subscribes.

Structs§

Constants§