Function mz_storage::render::build_ingestion_dataflow
source · pub fn build_ingestion_dataflow<A: Allocate>(
timely_worker: &mut Worker<A>,
storage_state: &mut StorageState,
primary_source_id: GlobalId,
description: IngestionDescription<CollectionMetadata>,
as_of: Antichain<Timestamp>,
resume_uppers: BTreeMap<GlobalId, Antichain<Timestamp>>,
source_resume_uppers: BTreeMap<GlobalId, Vec<Row>>,
)
Expand description
Assemble the “ingestion” side of a dataflow, i.e. the sources.
This method creates a new dataflow to host the implementations of sources for the dataflow
argument, and returns assets for each source that can import the results into a new dataflow.