Skip to main content

Module batcher

Module batcher 

Source
Expand description

Types for consolidating, merging, and extracting columnar update collections.

Structs§

Chunker
A chunker to transform input data into sorted columns.
ColumnChunker
A chunker that consolidates Column<(D, T, R)> updates into sorted ColumnBody chunks, without round-tripping through columnation.
ColumnMerger
Counterpart to ColInternalMerger (which merges ColumnationStack chunks). Drives the merge batcher with ColumnBody chunks, no columnation detour, by way of the inherent merge_from / extract methods on ColumnBody<(D, T, R)> below.

Traits§

MergeChunk
A chunk the merge and extract bodies below write to: the merger’s ColumnBody, and the column pager’s Column until that pager is retired.

Functions§

extract
Partition records of source starting at *position into keep (times beyond upper, retained for the next round) and ship (times not beyond upper, sealed into the output batch). Updates frontier with the times of kept records.
merge_from
Merge items from sorted inputs into target, advancing positions.