Module dataflow 

Assembly of compute DataflowDescriptions for the headless test driver.

DataflowBuilder is the generic boundary between tests and the dataflow assembly mechanism. A test describes its dataflow in terms of persist imports, MIR objects to compute, and index exports; the builder owns the parts that are hard and reusable — the MIR-to-LIR lowering, the RenderPlan conversion, the CollectionMetadata attachment, and the SqlRelationType-versus- ReprRelationType bookkeeping — and produces a DataflowDescription<RenderPlan, CollectionMetadata> ready to ship as ComputeCommand::CreateDataflow.

index_dataflow is thin sugar over the builder for the common single-index shape.

Structs

DataflowBuilder

Builds a compute dataflow from generic parts, hiding the lowering and persist wiring mechanism.

Input

A handle to an imported collection or built object, used to reference it when constructing MIR for further objects.

PersistSink

A persist-backed target shard for a materialized-view sink to write to.

PersistSource

A persist-backed storage collection to import into a dataflow.

Functions

count_over_index

Build a dataflow that counts the rows of an existing index and exports the count as a new, peekable index.

index_dataflow

Build a single-index dataflow over a persist shard.