Module mz_storage::source::kafka

Structs

• GlueConsumerContext 🔒
  An implementation of ConsumerContext that forwards statistics to the worker
• HealthStatus 🔒
• KafkaResumeUpperProcessor
  Processes resume_uppers stream updates, committing them upstream and storing them in the progress_statistics to be emitted later.
• KafkaSourceReader
  Contains all information necessary to ingest data from Kafka
• PartialProgressStatistics 🔒
  A partially-filled version of ProgressStatisticsUpdate. This allows us to only emit updates when offset_known is updated by the metadata thread.
• PartitionCapability 🔒
• PartitionConsumer 🔒
  Wrapper around a partition containing the underlying consumer
• WatermarkOffsets 🔒
  Represents the low and high watermark offsets of a Kafka partition.

Enums

• KafkaHeaderParseError

Functions

• construct_source_message 🔒
• fetch_partition_info 🔒
  Fetches the list of partitions and their corresponding high watermark