Module mz_storage_client::types::sources
source · Expand description
Types and traits related to the introduction of changing collections into dataflow
.
Modules
Types and traits related to the decoding of data for sources.
Nested message and enum types in
ProtoCompression
.Nested message and enum types in
ProtoDebeziumSourceProjection
.Nested message and enum types in
ProtoIncludedColumnSource
.Nested message and enum types in
ProtoIngestionDescription
.Nested message and enum types in
ProtoKeyEnvelope
.Nested message and enum types in
ProtoLoadGeneratorSourceConnection
.Nested message and enum types in
ProtoPostgresSourceConnection
.Nested message and enum types in
ProtoSourceConnection
.Nested message and enum types in
ProtoSourceData
.Nested message and enum types in
ProtoSourceEnvelope
.Nested message and enum types in
ProtoTimeline
.Nested message and enum types in
ProtoUpsertStyle
.Macros
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
try 🔒
Structs
A column that was created via an
INCLUDE
expressionA description of a source ingestion
Universal language for describing message positions in Materialize, in a source independent
way. Individual sources like Kafka or File sources should explicitly implement their own offset
type that converts to/From MzOffsets. A 0-MzOffset denotes an empty stream.
An implementation of PartEncoder for SourceData.
An external source of updates for a relational collection.
A
SourceToken
manages interest in a source.Enums
Debezium generates records that contain metadata about the upstream database. The structure of
this metadata depends on the type of connection used. This struct records the relevant indices
in the record, calculated during planning, so that the dataflow operator can unpack the
structure and extract the relevant information.
Which piece of metadata a column corresponds to
Whether and how to include the decoded key of a stream in dataflows
SourceEnvelope
s describe how to turn a stream of messages from SourceDesc
s
into a differential stream, that is, a stream of (data, time, diff)
triples.The meaning of the timestamp number produced by data sources. This type
is not concerned with the source of the timestamp (like if the data came
from a Debezium consistency topic or a CDCv2 stream), instead only what the
timestamp number means.
UnplannedSourceEnvelope
is a SourceEnvelope
missing some information. This information
is obtained in UnplannedSourceEnvelope::desc
, where
UnplannedSourceEnvelope::into_source_envelope
creates a full SourceEnvelope
__Field 🔒
__Field 🔒
__Field 🔒
__Field 🔒
__Field 🔒
__Field 🔒
__Field 🔒
__Field 🔒
__Field 🔒
__Field 🔒
__Field 🔒
__Field 🔒
__Field 🔒
__Field 🔒
__Field 🔒
__Field 🔒
__Field 🔒
__Field 🔒
__Field 🔒
__Field 🔒
__Field 🔒
__Field 🔒
__Field 🔒
__Field 🔒
__Field 🔒
__Field 🔒
__Field 🔒
__Field 🔒
__Field 🔒
__Field 🔒
__Field 🔒
Constants
FIELDS 🔒
FIELDS 🔒
FIELDS 🔒
FIELDS 🔒
FIELDS 🔒
FIELDS 🔒
FIELDS 🔒
FIELDS 🔒
FIELDS 🔒
FIELDS 🔒
FIELDS 🔒
FIELDS 🔒
FIELDS 🔒
FIELDS 🔒
FIELDS 🔒
FIELDS 🔒
FIELDS 🔒
FIELDS 🔒
FIELDS 🔒
FIELDS 🔒
FIELDS 🔒
VARIANTS 🔒
VARIANTS 🔒
VARIANTS 🔒
VARIANTS 🔒
VARIANTS 🔒
VARIANTS 🔒
VARIANTS 🔒
VARIANTS 🔒
VARIANTS 🔒
VARIANTS 🔒
Statics
Traits
Functions
Inner 🔒
Inner 🔒
Inner 🔒
Inner 🔒
Inner 🔒
Inner 🔒
Computes the indices of the value’s relation description that appear in the key.