Struct dataflow::source::timestamp::TimestampProposer

pub struct TimestampProposer {
    bindings: HashMap<PartitionId, MzOffset>,
    timestamp: Timestamp,
    last_update_time: Instant,
    update_interval: u64,
    now: NowFn,
}

This struct holds state for proposed timestamps and proposed bindings from offsets to timestamps.

Fields

bindings: HashMap<PartitionId, MzOffset>

Working set of proposed offsets to assign to a new timestamp.

timestamp: Timestamp

Current timestamp we are assigning new data to.

last_update_time: Instant

Last time we updated the timestamp.

update_interval: u64

Interval at which we are updating the timestamp.

now: NowFn

Implementations

impl TimestampProposer

fn new(update_interval: u64, now: NowFn) -> Self

fn propose_binding(
    &mut self,
    partition: PartitionId,
    offset: MzOffset
) -> Timestamp

Attempt to propose that (partition, offset) be bound to time, which means that all offsets < offset get bound to time for partition.

This proposal will be ignored if the time does not match the current time this proposer is operating at, and also if another reader has already proposed a binding for an offset greater than offset. The only exception here is if time is 0, which is accepted to bootstrap the timestamp proposal.

fn update_timestamp(
    &mut self
) -> Option<(Timestamp, Vec<(PartitionId, MzOffset)>)>

Attempt to mint the currently proposed timestamp bindings, and open up for proposals on a new timestamp.

This function needs to be called periodically in order for RT sources to make progress.

fn upper(&self) -> Timestamp

Returns the current upper frontier (timestamp at which all future updates will occur).

Trait Implementations

impl Debug for TimestampProposer

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.