Module mz_storage::source

source ยท
Expand description

Types related to the creation of dataflow raw sources.

Raw sources are streams (currently, Timely streams) of data directly produced by the upstream service. The main export of this module is create_raw_source, which turns RawSourceCreationConfigs and SourceConnections implementations into the aforementioned streams.

The full source, which is the differential stream that represents the actual object created by a CREATE SOURCE statement, is created by composing create_raw_source with decoding, SourceEnvelope rendering, and more.

Modulesยง

Structsยง

Functionsยง

  • Creates a source dataflow operator graph from a source connection. The type of SourceConnection determines the type of connection that should be created.