Function mz_storage::source::kafka::render_metadata_fetcher
source ยท fn render_metadata_fetcher<G: Scope<Timestamp = KafkaTimestamp>>(
scope: &G,
connection: KafkaSourceConnection,
config: RawSourceCreationConfig,
) -> (Stream<G, MetadataUpdate>, Stream<G, Probe<KafkaTimestamp>>, PressOnDropButton)
Expand description
Render the metadata fetcher of a Kafka source.
The metadata fetcher is a single-worker operator that is responsible for periodically fetching the Kafka topic metadata (partition IDs and high watermarks) and making it available as a Timely stream.