Module mz_storage_types::sources

Types and traits related to the introduction of changing collections into dataflow.

Re-exports

• pub use crate::sources::envelope::SourceEnvelope;
• pub use crate::sources::kafka::KafkaSourceConnection;
• pub use crate::sources::load_generator::LoadGeneratorSourceConnection;
• pub use crate::sources::mysql::MySqlSourceConnection;
• pub use crate::sources::postgres::PostgresSourceConnection;

Modules

• encoding
  Types and traits related to the decoding of data for sources.
• envelope
  Types related to source envelopes
• kafka
  Types related kafka sources
• load_generator
  Types related to load generator sources
• mysql
  Types related to mysql sources
• postgres
  Types related to postgres sources
• proto_compression
  Nested message and enum types in ProtoCompression.
• proto_ingestion_description
  Nested message and enum types in ProtoIngestionDescription.
• proto_source_connection
  Nested message and enum types in ProtoSourceConnection.
• proto_source_data
  Nested message and enum types in ProtoSourceData.
• proto_timeline
  Nested message and enum types in ProtoTimeline.

Structs

• ExportReference
  A fraternal twin of UnresolvedItemName that can implement Arbitrary.
• IngestionDescription
  A description of a source ingestion
• MzOffset
  Universal language for describing message positions in Materialize, in a source independent way. Individual sources like Kafka or File sources should explicitly implement their own offset type that converts to/From MzOffsets. A 0-MzOffset denotes an empty stream.
• ProtoCompression
• ProtoIngestionDescription
• ProtoMzOffset
• ProtoSourceConnection
• ProtoSourceData
• ProtoSourceDesc
• ProtoTimeline
• SourceData
• SourceDataColumnarDecoder
• SourceDataColumnarEncoder
• SourceDataDecoder
  An implementation of PartDecoder for SourceData.
• SourceDataEncoder
  An implementation of PartEncoder for SourceData.
• SourceDesc
  An external source of updates for a relational collection.
• SourceExport
• SourceReferenceResolver
  Stores and resolves references to a &[T: ExternalCatalogReference].

Enums

• Compression
• ExternalReferenceResolutionError
• GenericSourceConnection
• SourceDataRowColumnarDecoder
  A decoder for Rows within SourceData.
• SourceDataRowColumnarEncoder
  An encoder for Rows within SourceData.
• Timeline
  The meaning of the timestamp number produced by data sources. This type is not concerned with the source of the timestamp (like if the data came from a Debezium consistency topic or a CDCv2 stream), instead only what the timestamp number means.

Constants

• _IMPL_ARBITRARY_FOR_Compression 🔒
• _IMPL_ARBITRARY_FOR_GenericSourceConnection 🔒
• _IMPL_ARBITRARY_FOR_IngestionDescription 🔒
• _IMPL_ARBITRARY_FOR_MzOffset 🔒
• _IMPL_ARBITRARY_FOR_SourceData 🔒
• _IMPL_ARBITRARY_FOR_SourceDesc 🔒
• _IMPL_ARBITRARY_FOR_SourceExport 🔒
• _IMPL_ARBITRARY_FOR_Timeline 🔒

Traits

• ExternalCatalogReference
  Describes how external references should be organized in a multi-level hierarchy.
• SourceConnection
  A connection to an external system
• SourceTimestamp

Functions

• arb_source_data_for_relation_desc
  Given a RelationDesc returns an arbitrary SourceData.