Skip to main content

Module dataflow

Module dataflow 

Source
Expand description

Whole-dataflow optimization

A dataflow may contain multiple views, each of which may only be optimized locally. However, information like demand and predicate pushdown can be applied across views once we understand the context in which the views will be executed.

Structs§

DataflowMetainfo
Extra information about the dataflow. This is not going to be shipped, but has to be processed in other ways, e.g., showing notices to the user, or saving meta-information to the catalog.

Functions§

optimize_dataflow
Optimizes the implementation of each dataflow.
optimize_dataflow_demand_inner
Pushes demand through views in view_sequence in order, removing columns not demanded.
optimize_dataflow_filters_inner
Pushes filters down through views in view_sequence in order.
optimize_dataflow_monotonic
Propagates information about monotonic inputs through operators, using mz_repr::optimize::OptimizerFeatures from ctx for crate::analysis::Analysis.
optimize_dataflow_snapshot
Determine whether we require snapshots from our durable source imports. (For example, these can often be skipped for simple subscribe queries.)