Struct MergeBatcher 

pub struct MergeBatcher<Chu, M: Extractor, S> { /* private fields */ }

Creates batches from chunks of sorted, consolidated tuples.

Chunking input is Chu’s business, merging chunks is M’s, and sealing the extracted chain into a batch is S’s; the batcher’s own work is the carve-by-frontier over its MergeLadder.

Implementations

impl<Chu: Default, M: Extractor, S> MergeBatcher<Chu, M, S>

pub fn new(logger: Option<Logger>, operator_id: usize) -> Self

Allocates a new empty batcher.

The logger and operator identifier are used to report the batcher’s memory footprint, attributed to the operator that owns it.

Trait Implementations

impl<C, Chu, M, S> Batcher<C> for MergeBatcher<Chu, M, S>

where M: Extractor<Time: Timestamp>, Chu: ContainerBuilder<Container = M::Chunk> + for<'a> PushInto<&'a mut C>, S: Sealer<M::Chunk>,

fn insert(&mut self, container: &mut C)

Takes the updates in container, leaving it in an undefined state.

impl<Chu, M, S> Extract for MergeBatcher<Chu, M, S>

where M: Extractor<Time: Timestamp>, Chu: ContainerBuilder<Container = M::Chunk>, S: Sealer<M::Chunk>,

type Time = <M as Extractor>::Time

The timestamps by which updates are carved out.

type Output = <S as Sealer<<M as Merger>::Chunk>>::Output

The batches released by extraction.

fn extract<'a>( &'a mut self, upper: AntichainRef<'_, M::Time>, ) -> (Option<S::Output>, AntichainRef<'a, M::Time>)

Extracts the updates upper unblocks as a batch, and lower bounds the times of those retained.