Enum DataSource

pub enum DataSource<T> {
    Ingestion(IngestionDescription),
    IngestionExport {
        ingestion_id: GlobalId,
        details: SourceExportDetails,
        data_config: SourceExportDataConfig,
    },
    Introspection(IntrospectionType),
    Progress,
    Webhook,
    Table {
        primary: Option<GlobalId>,
    },
    Other,
    Sink {
        desc: ExportDescription<T>,
    },
}

Describes how data is written to the collection.

Variants

Ingestion(IngestionDescription)

Ingest data from some external source.

IngestionExport

This source receives its data from the identified ingestion, from an external object identified using SourceExportDetails.

The referenced ingestion must be created before all of its exports.

Fields

ingestion_id: GlobalId

details: SourceExportDetails

data_config: SourceExportDataConfig

Introspection(IntrospectionType)

Data comes from introspection sources, which the controller itself is responsible for generating.

Progress

Data comes from the source’s remapping/reclock operator.

Webhook

Data comes from external HTTP requests pushed to Materialize.

Table

The adapter layer appends timestamped data, i.e. it is a TABLE.

Fields

primary: Option<GlobalId>

This table has had columns added or dropped to it, so we’re now a “view” over the “primary” Table/collection. Within the storage-controller we the primary as a dependency.

Other

This source’s data does not need to be managed by the storage controller, e.g. it’s a materialized view or the catalog collection.

Sink

This collection is the output collection of a sink.

Fields

desc: ExportDescription<T>

Implementations

impl<T> DataSource<T>

pub fn in_txns(&self) -> bool

Returns true if the storage controller manages the data shard for this source using txn-wal.

Trait Implementations

impl<T: Clone> Clone for DataSource<T>

fn clone(&self) -> DataSource<T>

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<T: Debug> Debug for DataSource<T>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<T: PartialEq> PartialEq for DataSource<T>

fn eq(&self, other: &DataSource<T>) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl<T: Eq> Eq for DataSource<T>

impl<T> StructuralPartialEq for DataSource<T>