Module mz_storage_types::sources

Types and traits related to the introduction of changing collections into dataflow.

Re-exports

• pub use crate::sources::envelope::SourceEnvelope;
• pub use crate::sources::kafka::KafkaSourceConnection;
• pub use crate::sources::load_generator::LoadGeneratorSourceConnection;
• pub use crate::sources::mysql::MySqlSourceConnection;
• pub use crate::sources::postgres::PostgresSourceConnection;

Modules

• encoding
  Types and traits related to the decoding of data for sources.
• envelope
  Types related to source envelopes
• kafka
  Types related kafka sources
• load_generator
  Types related to load generator sources
• mysql
  Types related to mysql sources
• postgres
  Types related to postgres sources
• proto_compression
  Nested message and enum types in ProtoCompression.
• proto_ingestion_description
  Nested message and enum types in ProtoIngestionDescription.
• proto_source_connection
  Nested message and enum types in ProtoSourceConnection.
• proto_source_data
  Nested message and enum types in ProtoSourceData.
• proto_timeline
  Nested message and enum types in ProtoTimeline.

Structs

• IngestionDescription
  A description of a source ingestion
• MzOffset
  Universal language for describing message positions in Materialize, in a source independent way. Individual sources like Kafka or File sources should explicitly implement their own offset type that converts to/From MzOffsets. A 0-MzOffset denotes an empty stream.
• ProtoCompression
• ProtoIngestionDescription
• ProtoMzOffset
• ProtoSourceConnection
• ProtoSourceData
• ProtoSourceDesc
• ProtoTimeline
• SourceData
• SourceDataDecoder
  An implementation of PartDecoder for SourceData.
• SourceDataEncoder
  An implementation of PartEncoder for SourceData.
• SourceDesc
  An external source of updates for a relational collection.
• SourceExport

Enums

• Compression
• GenericSourceConnection
• Timeline
  The meaning of the timestamp number produced by data sources. This type is not concerned with the source of the timestamp (like if the data came from a Debezium consistency topic or a CDCv2 stream), instead only what the timestamp number means.

Traits

• SourceConnection
  A connection to an external system
• SourceTimestamp