Skip to main content

Module merge_batcher

Module merge_batcher 

Source
Expand description

A Batcher implementation based on merge sort.

The MergeBatcher requires a “merger” that implements the Merger trait, which provides hooks for manipulating sorted “chains” of chunks as needed by the merge batcher: merging chunks and also splitting them apart based on time.

Callers feed already-chunked, sorted-and-consolidated input into the batcher via PushInto. Forming such chunks from raw data is the responsibility of the caller (typically a chunker living in the surrounding dataflow operator).

Modules§

vec
A Merger implementation for vector update containers.

Structs§

MergeBatcher
Creates batches from chunks of sorted, consolidated tuples.

Traits§

Merger
A trait to describe interesting moments in a merge batcher.