Enum mz_storage::internal_control::InternalStorageCommand

pub enum InternalStorageCommand {
    SuspendAndRestart {
        id: GlobalId,
        reason: String,
    },
    CreateIngestionDataflow {
        id: GlobalId,
        ingestion_description: IngestionDescription<CollectionMetadata>,
        as_of: Antichain<Timestamp>,
        resume_uppers: BTreeMap<GlobalId, Antichain<Timestamp>>,
        source_resume_uppers: BTreeMap<GlobalId, Vec<Row>>,
    },
    RunSinkDataflow(GlobalId, StorageSinkDesc<MetadataFilled, Timestamp>),
    DropDataflow(Vec<GlobalId>),
    UpdateConfiguration {
        storage_parameters: StorageParameters,
    },
    StatisticsUpdate {
        sources: Vec<(usize, SourceStatisticsRecord)>,
        sinks: Vec<(usize, SinkStatisticsRecord)>,
    },
}

Internal commands that can be sent by individual operators/workers that will be broadcast to all workers. The worker main loop will receive those and act on them.

Variants

SuspendAndRestart

Suspend and restart the dataflow identified by the GlobalId.

Fields

id: GlobalId

The id of the dataflow that should be restarted.

reason: String

The reason for the restart request.

CreateIngestionDataflow

Render an ingestion dataflow at the given resumption frontier.

Fields

id: GlobalId

ID of the ingestion/sourve.

ingestion_description: IngestionDescription<CollectionMetadata>

The description of the ingestion/source.

as_of: Antichain<Timestamp>

The frontier beyond which ingested updates should be uncompacted. Inputs to the ingestion are guaranteed to be readable at this frontier.

resume_uppers: BTreeMap<GlobalId, Antichain<Timestamp>>

A frontier in the Materialize time domain with the property that all updates not beyond it have already been durably ingested.

source_resume_uppers: BTreeMap<GlobalId, Vec<Row>>

A frontier in the source time domain with the property that all updates not beyond it have already been durably ingested.

RunSinkDataflow(GlobalId, StorageSinkDesc<MetadataFilled, Timestamp>)

Render a sink dataflow.

DropDataflow(Vec<GlobalId>)

Drop all state and operators for a dataflow. This is a vec because some dataflows have their state spread over multiple IDs (i.e. sources that spawn subsources); this means that actions taken in response to this command should be permissive about missing state.

UpdateConfiguration

Update the configuration for rendering dataflows.

Fields

storage_parameters: StorageParameters

The new configuration parameters.

StatisticsUpdate

For moving statistics updates to worker 0.

Fields

sources: Vec<(usize, SourceStatisticsRecord)>

Local statistics, with their epochs.

sinks: Vec<(usize, SinkStatisticsRecord)>

Local statistics, with their epochs.

Trait Implementations

impl Clone for InternalStorageCommand

fn clone(&self) -> InternalStorageCommand

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for InternalStorageCommand

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for InternalStorageCommand

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl PartialEq for InternalStorageCommand

fn eq(&self, other: &InternalStorageCommand) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Serialize for InternalStorageCommand

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for InternalStorageCommand