mz_storage::source::source_reader_pipeline

Function source_render_operator

Source 
fn source_render_operator<G, C>(
    scope: &mut G,
    config: &RawSourceCreationConfig,
    source_connection: C,
    probed_upper_tx: Sender<Option<Probe<C::Time>>>,
    resume_uppers: impl Stream<Item = Antichain<C::Time>> + 'static,
    start_signal: impl Future<Output = ()> + 'static,
) -> (BTreeMap<GlobalId, StackedCollection<G, Result<SourceMessage, DataflowError>>>, Stream<G, Infallible>, Stream<G, HealthStatusMessage>, Vec<PressOnDropButton>)
where
    G: Scope<Timestamp = C::Time>,
    C: SourceRender + 'static,
Expand description

Renders the source dataflow fragment from the given SourceConnection. This returns a collection timestamped with the source specific timestamp type. Also returns a second stream that can be used to learn about the source_upper that all the source reader instances know about. This second stream will be used by the remap_operator to mint new timestamp bindings into the remap shard.