Module dataflow_types::sources [−][src]
Expand description
Types and traits related to the introduction of changing collections into dataflow.
Modules
Structs
A role for Materialize to assume when performing AWS API calls.
AWS configuration overrides for a source or sink.
A column that was created via an INCLUDE expression
Universal language for describing message positions in Materialize, in a source independent way. Invidual sources like Kafka or File sources should explicitly implement their own offset type that converts to/From MzOffsets. A 0-MzOffset denotes an empty stream.
A source of updates for a relational collection.
Enums
AWS credentials for a source or sink.
Ordered means we can trust Debezium high water marks
Debezium generates records that contain metadata about the upstream database. The structure of this metadata depends on the type of connector used. This struct records the relevant indices in the record, calculated during planning, so that the dataflow operator can unpack the structure and extract the relevant information.
Which piece of metadata a column corresponds to
Whether and how to include the decoded key of a stream in dataflows
A Source of Object Key names, the argument of the DISCOVER OBJECTS clause
The meaning of the timestamp number produced by data sources. This type is not concerned with the source of the timestamp (like if the data came from a Debezium consistency topic or a CDCv2 stream), instead only what the timestamp number means.
Functions
Legacy logic included something like an offset into almost data streams