Struct mz_storage::source::reclock::ReclockOperator

pub struct ReclockOperator<FromTime: Timestamp, IntoTime: Timestamp + Lattice, Handle: RemapHandle<FromTime = FromTime, IntoTime = IntoTime>> {
    upper: Antichain<IntoTime>,
    source_upper: MutableAntichain<FromTime>,
    remap_handle: Handle,
}

The ReclockOperator is responsible for observing progress in the FromTime domain and consume messages from a ticker of progress in the IntoTime domain. When the source frontier advances and the ticker ticks the ReclockOperator will generate the data that describe this correspondence and write them out to its provided remap handle. The output generated by the reclock operator can be thought of as Collection<G, FromTime> where G::Timestamp is IntoTime.

The ReclockOperator will always maintain the invariant that for any time IntoTime the remap collection accumulates into an Antichain where each FromTime timestamp has frequency 1. In other words the remap collection describes a well formed Antichain<FromTime> as it is marching forwards.

Fields

upper: Antichain<IntoTime>

Upper frontier of the partial remap trace

source_upper: MutableAntichain<FromTime>

The upper frontier in terms of FromTime. Any attempt to reclock messages beyond this frontier will lead to minting new bindings.

remap_handle: Handle

A handle allowing this operator to publish updates to and read back from the remap collection

Implementations

impl<FromTime, IntoTime, Handle> ReclockOperator<FromTime, IntoTime, Handle>

where FromTime: Timestamp, IntoTime: Timestamp + Lattice, Handle: RemapHandle<FromTime = FromTime, IntoTime = IntoTime>,

pub async fn new( remap_handle: Handle, ) -> (Self, ReclockBatch<FromTime, IntoTime>)

Construct a new ReclockOperator from the given collection metadata

async fn sync( &mut self, target_upper: AntichainRef<'_, IntoTime>, ) -> ReclockBatch<FromTime, IntoTime>

Syncs the state of this operator to match that of the persist shard until the provided frontier

pub async fn mint( &mut self, binding_ts: IntoTime, new_into_upper: Antichain<IntoTime>, new_from_upper: AntichainRef<'_, FromTime>, ) -> ReclockBatch<FromTime, IntoTime>

async fn append_batch( &mut self, updates: Vec<(FromTime, IntoTime, Diff)>, new_upper: &Antichain<IntoTime>, ) -> Result<ReclockBatch<FromTime, IntoTime>, UpperMismatch<IntoTime>>

Appends the provided updates to the remap collection at the next available minting IntoTime and updates this operator’s in-memory state accordingly.

If an attempt to mint bindings fails due to another process having raced and appended bindings concurrently then the current global upper will be returned as an error. This is the frontier that this operator must be synced to for a future append attempt to have any chance of success.

Trait Implementations

impl<FromTime: Debug + Timestamp, IntoTime: Debug + Timestamp + Lattice, Handle: Debug + RemapHandle<FromTime = FromTime, IntoTime = IntoTime>> Debug for ReclockOperator<FromTime, IntoTime, Handle>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.