Function mz_storage::source::persist_source::persist_source
source · [−]pub fn persist_source<G, YFn>(
scope: &G,
source_id: GlobalId,
persist_clients: Arc<Mutex<PersistClientCache>>,
metadata: CollectionMetadata,
as_of: Option<Antichain<Timestamp>>,
until: Antichain<Timestamp>,
map_filter_project: Option<&mut MfpPlan>,
yield_fn: YFn
) -> (Stream<G, (Row, Timestamp, Diff)>, Stream<G, (DataflowError, Timestamp, Diff)>, Rc<dyn Any>)where
G: Scope<Timestamp = Timestamp>,
YFn: Fn(Instant, usize) -> bool + 'static,
Expand description
Creates a new source that reads from a persist shard, distributing the work of reading data to all timely workers.
All times emitted will have been advanced by the given as_of
frontier.
All updates at times greater or equal to until
will be suppressed.
The map_filter_project
argument, if supplied, may be partially applied,
and any un-applied part of the argument will be left behind in the argument.