Function mz_storage::render::build_ingestion_dataflow

source ·
pub fn build_ingestion_dataflow<A: Allocate>(
    timely_worker: &mut Worker<A>,
    storage_state: &mut StorageState,
    primary_source_id: GlobalId,
    description: IngestionDescription<CollectionMetadata>,
    as_of: Antichain<Timestamp>,
    resume_uppers: BTreeMap<GlobalId, Antichain<Timestamp>>,
    source_resume_uppers: BTreeMap<GlobalId, Vec<Row>>
)
Expand description

Assemble the “ingestion” side of a dataflow, i.e. the sources.

This method creates a new dataflow to host the implementations of sources for the dataflow argument, and returns assets for each source that can import the results into a new dataflow.