pub fn columnar_consolidate<'scope, T>(
collection: Collection<'scope, T, Column<(Row, T, Diff)>>,
name: &str,
) -> Collection<'scope, T, Column<(Row, T, Diff)>>where
T: RenderTimestamp,Expand description
Consolidates a ColumnarCollection natively, without a row round-trip.
A ChunkChunker sorts and consolidates the input columns and an
AccountedChunkBatcher merges them, both holding their data in columnar form, so
nothing outside the exchange pact visits a record or materializes an owned Row.
The batcher’s chains are chunks, so the process buffer pool spills them while the
chunk spill gate is set, bounding what a consolidation holds resident.
Uses consolidate_pact rather than mz_arrange_core: a consolidate emits a
consolidated collection, so building and reading back a maintained trace would be
wasted work.