mz_timely_util::operator

Function consolidate_pact

Source
pub fn consolidate_pact<Ba, P, G>(
    stream: &StreamCore<G, Ba::Input>,
    pact: P,
    name: &str,
) -> Stream<G, Vec<Ba::Output>>
where G: Scope, Ba: Batcher<Time = G::Timestamp> + 'static, Ba::Input: Container + Clone + 'static, Ba::Output: Container + Clone, P: ParallelizationContract<G::Timestamp, Ba::Input>,
Expand description

Aggregates the weights of equal records into at most one record.

Produces a stream of chains of records, partitioned according to pact. The data is sorted according to Ba. For each timestamp, it produces at most one chain.

The data are accumulated in place, each held back until their timestamp has completed.