Module mz_storage_client::types::sources

Types and traits related to the introduction of changing collections into dataflow.

Modules

encoding

Types and traits related to the decoding of data for sources.

proto_compression

Nested message and enum types in ProtoCompression.

proto_debezium_source_projection

Nested message and enum types in ProtoDebeziumSourceProjection.

proto_included_column_source

Nested message and enum types in ProtoIncludedColumnSource.

proto_ingestion_description

Nested message and enum types in ProtoIngestionDescription.

proto_key_envelope

Nested message and enum types in ProtoKeyEnvelope.

proto_load_generator_source_connection

Nested message and enum types in ProtoLoadGeneratorSourceConnection.

proto_postgres_source_connection

Nested message and enum types in ProtoPostgresSourceConnection.

proto_source_connection

Nested message and enum types in ProtoSourceConnection.

proto_source_data

Nested message and enum types in ProtoSourceData.

proto_source_envelope

Nested message and enum types in ProtoSourceEnvelope.

proto_timeline

Nested message and enum types in ProtoTimeline.

proto_upsert_style

Nested message and enum types in ProtoUpsertStyle.

Macros

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

try 🔒

Structs

DebeziumDedupProjection

DebeziumEnvelope

DebeziumTransactionMetadata

IncludedColumnPos

A column that was created via an INCLUDE expression

IngestionDescription

A description of a source ingestion

KafkaSourceConnection

LoadGeneratorSourceConnection

MapWrapper 🔒

MzOffset

Universal language for describing message positions in Materialize, in a source independent way. Individual sources like Kafka or File sources should explicitly implement their own offset type that converts to/From MzOffsets. A 0-MzOffset denotes an empty stream.

NoneEnvelope

PostgresSourceConnection

PostgresSourcePublicationDetails

ProtoCompression

ProtoCounterLoadGenerator

ProtoDebeziumDedupProjection

ProtoDebeziumEnvelope

ProtoDebeziumSourceProjection

ProtoDebeziumTransactionMetadata

ProtoIncludedColumnPos

ProtoIncludedColumnSource

ProtoIngestionDescription

ProtoKafkaSourceConnection

ProtoKeyEnvelope

ProtoLoadGeneratorSourceConnection

ProtoMzOffset

ProtoNoneEnvelope

ProtoPostgresSourceConnection

ProtoPostgresSourcePublicationDetails

ProtoSourceConnection

ProtoSourceData

ProtoSourceDesc

ProtoSourceEnvelope

ProtoTestScriptSourceConnection

ProtoTimeline

ProtoTpchLoadGenerator

ProtoUpsertEnvelope

ProtoUpsertStyle

ScalarWrapper 🔒

ScalarWrapper 🔒

ScalarWrapper 🔒

ScalarWrapper 🔒

ScalarWrapper 🔒

ScalarWrapper 🔒

SourceData

SourceDataEncoder

An implementation of PartEncoder for SourceData.

SourceDesc

An external source of updates for a relational collection.

SourceExport

SourceToken

A SourceToken manages interest in a source.

TestScriptSourceConnection

UpsertEnvelope

__FieldVisitor 🔒

__FieldVisitor 🔒

__FieldVisitor 🔒

__FieldVisitor 🔒

__FieldVisitor 🔒

__FieldVisitor 🔒

__FieldVisitor 🔒

__FieldVisitor 🔒

__FieldVisitor 🔒

__FieldVisitor 🔒

__FieldVisitor 🔒

__FieldVisitor 🔒

__FieldVisitor 🔒

__FieldVisitor 🔒

__FieldVisitor 🔒

__FieldVisitor 🔒

__FieldVisitor 🔒

__FieldVisitor 🔒

__FieldVisitor 🔒

__FieldVisitor 🔒

__FieldVisitor 🔒

__FieldVisitor 🔒

__FieldVisitor 🔒

__FieldVisitor 🔒

__FieldVisitor 🔒

__FieldVisitor 🔒

__FieldVisitor 🔒

__FieldVisitor 🔒

__FieldVisitor 🔒

__FieldVisitor 🔒

__FieldVisitor 🔒

__Visitor 🔒

__Visitor 🔒

__Visitor 🔒

__Visitor 🔒

__Visitor 🔒

__Visitor 🔒

__Visitor 🔒

__Visitor 🔒

__Visitor 🔒

__Visitor 🔒

__Visitor 🔒

__Visitor 🔒

__Visitor 🔒

__Visitor 🔒

__Visitor 🔒

__Visitor 🔒

__Visitor 🔒

__Visitor 🔒

__Visitor 🔒

__Visitor 🔒

__Visitor 🔒

__Visitor 🔒

__Visitor 🔒

__Visitor 🔒

__Visitor 🔒

__Visitor 🔒

__Visitor 🔒

__Visitor 🔒

__Visitor 🔒

__Visitor 🔒

__Visitor 🔒

Enums

Compression

DebeziumSourceProjection

Debezium generates records that contain metadata about the upstream database. The structure of this metadata depends on the type of connection used. This struct records the relevant indices in the record, calculated during planning, so that the dataflow operator can unpack the structure and extract the relevant information.

GeneratorMessageType

GenericSourceConnection

IncludedColumnSource

Which piece of metadata a column corresponds to

KeyEnvelope

Whether and how to include the decoded key of a stream in dataflows

LoadGenerator

SourceEnvelope

SourceEnvelopes describe how to turn a stream of messages from SourceDescs into a differential stream, that is, a stream of (data, time, diff) triples.

Timeline

The meaning of the timestamp number produced by data sources. This type is not concerned with the source of the timestamp (like if the data came from a Debezium consistency topic or a CDCv2 stream), instead only what the timestamp number means.

UnplannedSourceEnvelope

UnplannedSourceEnvelope is a SourceEnvelope missing some information. This information is obtained in UnplannedSourceEnvelope::desc, where UnplannedSourceEnvelope::into_source_envelope creates a full SourceEnvelope

UpsertStyle

__Field 🔒

__Field 🔒

__Field 🔒

__Field 🔒

__Field 🔒

__Field 🔒

__Field 🔒

__Field 🔒

__Field 🔒

__Field 🔒

__Field 🔒

__Field 🔒

__Field 🔒

__Field 🔒

__Field 🔒

__Field 🔒

__Field 🔒

__Field 🔒

__Field 🔒

__Field 🔒

__Field 🔒

__Field 🔒

__Field 🔒

__Field 🔒

__Field 🔒

__Field 🔒

__Field 🔒

__Field 🔒

__Field 🔒

__Field 🔒

__Field 🔒

Constants

FIELDS 🔒

FIELDS 🔒

FIELDS 🔒

FIELDS 🔒

FIELDS 🔒

FIELDS 🔒

FIELDS 🔒

FIELDS 🔒

FIELDS 🔒

FIELDS 🔒

FIELDS 🔒

FIELDS 🔒

FIELDS 🔒

FIELDS 🔒

FIELDS 🔒

FIELDS 🔒

FIELDS 🔒

FIELDS 🔒

FIELDS 🔒

FIELDS 🔒

FIELDS 🔒

SOURCE_DATA_ERROR 🔒

STRUCT_NAME 🔒

STRUCT_NAME 🔒

STRUCT_NAME 🔒

STRUCT_NAME 🔒

STRUCT_NAME 🔒

STRUCT_NAME 🔒

STRUCT_NAME 🔒

STRUCT_NAME 🔒

STRUCT_NAME 🔒

STRUCT_NAME 🔒

STRUCT_NAME 🔒

STRUCT_NAME 🔒

STRUCT_NAME 🔒

STRUCT_NAME 🔒

STRUCT_NAME 🔒

STRUCT_NAME 🔒

STRUCT_NAME 🔒

STRUCT_NAME 🔒

STRUCT_NAME 🔒

STRUCT_NAME 🔒

STRUCT_NAME 🔒

STRUCT_NAME 🔒

STRUCT_NAME 🔒

STRUCT_NAME 🔒

STRUCT_NAME 🔒

VARIANTS 🔒

VARIANTS 🔒

VARIANTS 🔒

VARIANTS 🔒

VARIANTS 🔒

VARIANTS 🔒

VARIANTS 🔒

VARIANTS 🔒

VARIANTS 🔒

VARIANTS 🔒

_IMPL_ARBITRARY_FOR_Compression 🔒

_IMPL_ARBITRARY_FOR_DebeziumDedupProjection 🔒

_IMPL_ARBITRARY_FOR_DebeziumEnvelope 🔒

_IMPL_ARBITRARY_FOR_DebeziumSourceProjection 🔒

_IMPL_ARBITRARY_FOR_DebeziumTransactionMetadata 🔒

_IMPL_ARBITRARY_FOR_GenericSourceConnection 🔒

_IMPL_ARBITRARY_FOR_IncludedColumnPos 🔒

_IMPL_ARBITRARY_FOR_IncludedColumnSource 🔒

_IMPL_ARBITRARY_FOR_KeyEnvelope 🔒

_IMPL_ARBITRARY_FOR_LoadGenerator 🔒

_IMPL_ARBITRARY_FOR_LoadGeneratorSourceConnection 🔒

_IMPL_ARBITRARY_FOR_MzOffset 🔒

_IMPL_ARBITRARY_FOR_NoneEnvelope 🔒

_IMPL_ARBITRARY_FOR_PostgresSourcePublicationDetails 🔒

_IMPL_ARBITRARY_FOR_SourceEnvelope 🔒

_IMPL_ARBITRARY_FOR_TestScriptSourceConnection 🔒

_IMPL_ARBITRARY_FOR_Timeline 🔒

_IMPL_ARBITRARY_FOR_UpsertStyle 🔒

Statics

KAFKA_PROGRESS_DESC

LOAD_GEN_PROGRESS_DESC

PG_PROGRESS_DESC

TEST_SCRIPT_PROGRESS_DESC

Traits

Generator

SourceConnection

A connection to an external system

SourceTimestamp

Functions

Inner 🔒

Inner 🔒

Inner 🔒

Inner 🔒

Inner 🔒

Inner 🔒

KeyWrapper 🔒

ScalarWrapper 🔒

ScalarWrapper 🔒

ScalarWrapper 🔒

ScalarWrapper 🔒

ScalarWrapper 🔒

ScalarWrapper 🔒

ScalarWrapper 🔒

ScalarWrapper 🔒

ScalarWrapper 🔒

ScalarWrapper 🔒

ScalarWrapper 🔒

ScalarWrapper 🔒

ScalarWrapper 🔒

ScalarWrapper 🔒

ScalarWrapper 🔒

ScalarWrapper 🔒

ScalarWrapper 🔒

ScalarWrapper 🔒

ScalarWrapper 🔒

ScalarWrapper 🔒

ScalarWrapper 🔒

ScalarWrapper 🔒

ScalarWrapper 🔒

ScalarWrapper 🔒

ScalarWrapper 🔒

ScalarWrapper 🔒

ScalarWrapper 🔒

ValueWrapper 🔒

fake_relation_desc 🔒

match_key_indices 🔒

Computes the indices of the value’s relation description that appear in the key.

Opaque Types

 🔒