Struct PartitionedStorageState

pub struct PartitionedStorageState<T> {
    parts: usize,
    uppers: BTreeMap<GlobalId, (MutableAntichain<T>, Vec<Option<Antichain<T>>>)>,
    oneshot_source_responses: BTreeMap<Uuid, BTreeMap<usize, Vec<Result<ProtoBatch, String>>>>,
}

Maintained state for partitioned storage clients.

This helper type unifies the responses of multiple partitioned workers in order to present as a single worker.

Fields

parts: usize

Number of partitions the state machine represents.

uppers: BTreeMap<GlobalId, (MutableAntichain<T>, Vec<Option<Antichain<T>>>)>

Upper frontiers for sources and sinks, both unioned across all partitions and from each individual partition.

oneshot_source_responses: BTreeMap<Uuid, BTreeMap<usize, Vec<Result<ProtoBatch, String>>>>

Staged batches from oneshot sources that will get appended by environmentd.

Implementations

impl<T> PartitionedStorageState<T>

where T: Timestamp,

fn observe_command(&mut self, command: &StorageCommand<T>)

fn insert_new_uppers<I: IntoIterator<Item = GlobalId>>(&mut self, ids: I)

Shared implementation for commands that install uppers with controllable behavior with encountering existing uppers.

If any ID was previously tracked in self and skip_existing is false, we return the ID as an error.

Trait Implementations

impl<T: Debug> Debug for PartitionedStorageState<T>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<T> PartitionedState<StorageCommand<T>, StorageResponse<T>> for PartitionedStorageState<T>

where T: Timestamp + Lattice,

fn split_command( &mut self, command: StorageCommand<T>, ) -> Vec<Option<StorageCommand<T>>>

Splits a command into multiple partitions.

fn absorb_response( &mut self, shard_id: usize, response: StorageResponse<T>, ) -> Option<Result<StorageResponse<T>, Error>>

Absorbs a response from a single partition.