Skip to main content

columnar_consolidate

Function columnar_consolidate 

Source
pub fn columnar_consolidate<'scope, T>(
    collection: Collection<'scope, T, Column<(Row, T, Diff)>>,
    name: &str,
) -> Collection<'scope, T, Column<(Row, T, Diff)>>
where T: RenderTimestamp,
Expand description

Consolidates a ColumnarCollection natively, without a row round-trip.

A ColumnChunker sorts and consolidates the input columns and a ColumnMergeBatcher merges them, both holding their data in Column, so nothing outside the exchange pact visits a record or materializes an owned Row.

Uses consolidate_pact rather than mz_arrange_core: a consolidate emits a consolidated collection, so building and reading back a maintained trace would be wasted work.