Struct timely::dataflow::operators::generic::builder_rc::OperatorBuilder

pub struct OperatorBuilder<G: Scope> { /* private fields */ }

Builds operators with generic shape.

Implementations

impl<G: Scope> OperatorBuilder<G>

pub fn new(name: String, scope: G) -> Self

Allocates a new generic operator builder from its containing scope.

pub fn set_notify(&mut self, notify: bool)

Indicates whether the operator requires frontier information.

pub fn new_input<C: Container, P>( &mut self, stream: &StreamCore<G, C>, pact: P ) -> InputHandleCore<G::Timestamp, C, P::Puller>

where P: ParallelizationContract<G::Timestamp, C>,

Adds a new input to a generic operator builder, returning the Pull implementor to use.

pub fn new_input_connection<C: Container, P>( &mut self, stream: &StreamCore<G, C>, pact: P, connection: Vec<Antichain<<G::Timestamp as Timestamp>::Summary>> ) -> InputHandleCore<G::Timestamp, C, P::Puller>

where P: ParallelizationContract<G::Timestamp, C>,

Adds a new input with connection information to a generic operator builder, returning the Pull implementor to use.

The connection parameter contains promises made by the operator for each of the existing outputs, that any timestamp appearing at the input, any output timestamp will be greater than or equal to the input timestamp subjected to a Summary greater or equal to some element of the corresponding antichain in connection.

Commonly the connections are either the unit summary, indicating the same timestamp might be produced as output, or an empty antichain indicating that there is no connection from the input to the output.

pub fn new_output<C: Container>( &mut self ) -> (OutputWrapper<G::Timestamp, C, Tee<G::Timestamp, C>>, StreamCore<G, C>)

Adds a new output to a generic operator builder, returning the Push implementor to use.

pub fn new_output_connection<C: Container>( &mut self, connection: Vec<Antichain<<G::Timestamp as Timestamp>::Summary>> ) -> (OutputWrapper<G::Timestamp, C, Tee<G::Timestamp, C>>, StreamCore<G, C>)

Adds a new output with connection information to a generic operator builder, returning the Push implementor to use.

The connection parameter contains promises made by the operator for each of the existing inputs, that any timestamp appearing at the input, any output timestamp will be greater than or equal to the input timestamp subjected to a Summary greater or equal to some element of the corresponding antichain in connection.

Commonly the connections are either the unit summary, indicating the same timestamp might be produced as output, or an empty antichain indicating that there is no connection from the input to the output.

pub fn build<B, L>(self, constructor: B)

where B: FnOnce(Vec<Capability<G::Timestamp>>) -> L, L: FnMut(&[MutableAntichain<G::Timestamp>]) + 'static,

Creates an operator implementation from supplied logic constructor.

pub fn build_reschedule<B, L>(self, constructor: B)

where B: FnOnce(Vec<Capability<G::Timestamp>>) -> L, L: FnMut(&[MutableAntichain<G::Timestamp>]) -> bool + 'static,

Creates an operator implementation from supplied logic constructor.

Unlike build, the supplied closure can indicate if the operator should be considered incomplete. The build method indicates that the operator is never incomplete and can be shut down at the system’s discretion.

pub fn index(&self) -> usize

Get the identifier assigned to the operator being constructed

pub fn global(&self) -> usize

The operator’s worker-unique identifier.

pub fn shape(&self) -> &OperatorShape

Return a reference to the operator’s shape

pub fn operator_info(&self) -> OperatorInfo

Creates operator info for the operator.

Trait Implementations

impl<G: Debug + Scope> Debug for OperatorBuilder<G>

where G::Timestamp: Debug,

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.