Module timely::dataflow::operators

Extension traits for Stream implementing various operators.

A collection of functions taking typed Stream objects as input and producing new Stream objects as output. Many of the operators provide simple, composable functionality. Some of the operators are more complicated, for use with advanced timely dataflow features.

The Operator trait provides general operators whose behavior can be supplied using closures accepting input and output handles. Most of the operators in this module are defined using these two general operators.

Re-exports

• pub use self::input::Input;
• pub use self::unordered_input::UnorderedInput;
• pub use self::partition::Partition;
• pub use self::map::Map;
• pub use self::inspect::Inspect;
• pub use self::inspect::InspectCore;
• pub use self::filter::Filter;
• pub use self::delay::Delay;
• pub use self::exchange::Exchange;
• pub use self::broadcast::Broadcast;
• pub use self::branch::Branch;
• pub use self::branch::BranchWhen;
• pub use self::result::ResultStream;
• pub use self::to_stream::ToStream;
• pub use self::generic::Operator;
• pub use self::generic::Notificator;
• pub use self::generic::FrontierNotificator;
• pub use self::reclock::Reclock;
• pub use self::count::Accumulate;
• pub use self::core::enterleave;
• pub use self::core::enterleave::Enter;
• pub use self::core::enterleave::Leave;
• pub use self::core::feedback;
• pub use self::core::feedback::Feedback;
• pub use self::core::feedback::LoopVariable;
• pub use self::core::feedback::ConnectLoop;
• pub use self::core::concat;
• pub use self::core::concat::Concat;
• pub use self::core::concat::Concatenate;
• pub use self::core::inspect;
• pub use self::core::exchange;
• pub use self::core::probe;
• pub use self::core::probe::Probe;
• pub use self::core::capture;
• pub use self::core::capture::Capture;
• pub use self::core::ok_err;
• pub use self::core::ok_err::OkErr;
• pub use self::core::rc;
• pub use self::core::reclock;

Modules

• aggregation
  Aggregation operators of various flavors
• branch
  Operators that separate one stream into two streams based on some condition
• broadcast
  Broadcast records to all workers.
• core
  Extension traits for StreamCore implementing various operators that are independent of specific container types.
• count
  Counts the number of records at each time.
• delay
  Operators acting on timestamps to logically delay records
• filter
  Filters a stream by a predicate.
• flow_controlled
  Methods to construct flow-controlled sources.
• generic
  Generic operators defined by user-provided closures.
• input
  Create new Streams connected to external inputs.
• map
  Extension methods for Stream based on record-by-record transformation.
• partition
  Partition a stream of records into multiple streams.
• result
  Extension methods for Stream containing Results.
• to_stream
  Conversion to the Stream type from iterators.
• unordered_input
  Create new Streams connected to external inputs.

Structs

• ActivateCapability
  Capability that activates on drop.
• Capability
  The capability to send data with a certain timestamp on a dataflow edge.
• CapabilitySet
  A set of capabilities, for possibly incomparable times.
• DowngradeError
  An error produced when trying to downgrade a capability with a time that’s not less than or equal to the current capability
• InputCapability
  An capability of an input port. Holding onto this capability will implicitly holds onto a capability for all the outputs ports this input is connected to, after the connection summaries have been applied.