Enum CollectionEdge 

pub enum CollectionEdge<'scope, T: RenderTimestamp> {
    Vec(VecCollection<'scope, T, Row, Diff>),
    Columnar(Collection<'scope, T, Column<(Row, T, Diff)>>),
}

A dataflow edge carrying records as either a row-based VecCollection or a ColumnarCollection.

Producers choose a variant; consumers must accept either. Variant-mixing concats repack the row-based inputs and produce the columnar variant.

Variants

Vec(VecCollection<'scope, T, Row, Diff>)

Row-formatted collection. Today’s default for every producer.

Columnar(Collection<'scope, T, Column<(Row, T, Diff)>>)

Columnar collection. Currently unused by any producer; reserved for the producer flip at the end of the migration.

Implementations

impl<'scope, T: RenderTimestamp> CollectionEdge<'scope, T>

pub fn scope(&self) -> Scope<'scope, T>

The scope containing this edge.

pub fn enter_region<'inner>( self, region: Scope<'inner, T>, ) -> CollectionEdge<'inner, T>

Brings the edge into a sub-region of its current scope.

pub fn leave_region<'outer>( self, outer: Scope<'outer, T>, ) -> CollectionEdge<'outer, T>

Leaves a sub-region back to the outer scope.

pub fn into_vec(self) -> VecCollection<'scope, T, Row, Diff>

The edge as a row-based VecCollection.

The Vec arm is returned as is. The columnar arm decodes through columnar_to_vec, which allocates an owned Row per record. Consumers that can work on the columnar form directly should do so instead of calling this.

pub fn negate(self) -> Self

Negates the diff on every record in this edge.

Preserves variant. The columnar arm uses columnar_negate, which negates diffs without decoding rows.

pub fn concat_many<I>(scope: Scope<'scope, T>, edges: I) -> Self

where I: IntoIterator<Item = Self>,

Concatenates a collection of edges.

Edges of one shared variant concatenate natively. Mixed inputs upgrade the row-based edges through vec_to_columnar and produce the columnar variant. Repacking rows into columns copies bytes but allocates no per-record Rows, so upgrading is the cheap direction.

pub fn flat_map_datums<DCB, L>( self, max_demand: usize, logic: L, ) -> (Stream<'scope, T, DCB::Container>, StreamVec<'scope, T, (DataflowErrorSer, T, Diff)>)

where DCB: ContainerBuilder, L: for<'a> FnMut(&'a mut DatumVecBorrow<'_>, T, Diff, &mut Session<'_, '_, T, DCB, Capability<T>>, &mut Session<'_, '_, T, ConsolidatingContainerBuilder<Vec<(DataflowErrorSer, T, Diff)>>, Capability<T>>) -> usize + 'static,

Applies logic to each record in this edge, exposing the record as a borrowed DatumVecBorrow and giving it ok and err output sessions.

max_demand bounds the number of columns decoded per row; pass usize::MAX to decode all columns.

This is the canonical unified entry point for “decoding consumers” (operators that read mz_repr::Datums from each row anyway). The Vec arm uses DatumVec::borrow_with_limit on each Row; the Columnar arm iterates the columnar batch directly without going through an owned Row.

pub fn consolidate_named(self, name: &str) -> Self

Consolidates updates in the edge, preserving variant.

Trait Implementations

impl<'scope, T: Clone + RenderTimestamp> Clone for CollectionEdge<'scope, T>

fn clone(&self) -> CollectionEdge<'scope, T>

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.