Enum timely::worker::ProgressMode

pub enum ProgressMode {
    Eager,
    Demand,
}

Different ways in which timely’s progress tracking can work.

These options drive some buffering and accumulation that timely can do to try and trade volume of progress traffic against latency. By accumulating updates longer, a smaller total volume of messages are sent.

The ProgressMode::Demand variant is the most robust, and least likely to lead to catastrophic performance. The Eager variant is useful for getting the smallest latencies on systems with few workers, but does risk saturating the system with progress messages and should be used with care, or not at all.

If you are not certain which option to use, prefer Demand, and perhaps monitor the progress messages through timely’s logging infrastructure to see if their volume is surprisingly high.

Variants

Eager

Eagerly transmit all progress updates produced by a worker.

Progress messages are transmitted without consideration for the possibility that they may unblock other workers. This can result in a substantial volume of messages that do not result in a change to the lower bound of outstanding work.

Demand

Delay transmission of progress updates until any could advance the global frontier of timestamps.

As timely executes, the progress messages inform each worker of the outstanding work remaining in the system. As workers work, they produce changes to this outstanding work. This option delays the communication of those changes until they might possibly cause a change in the lower bound of all outstanding work.

The most common case this remedies is when one worker transmits messages to other workers, that worker holds a capability for the operator and timestamp. Other workers will receive messages, and with this option will not immediately acknowledge receiving the messages, because the held capability is strictly prior to what the messages can affect. Once the capability is released, the progress messages are unblocked and transmitted, in accumulated form.

Trait Implementations

impl Clone for ProgressMode

fn clone(&self) -> ProgressMode

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ProgressMode

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for ProgressMode

fn default() -> ProgressMode

Returns the “default value” for a type.

impl FromStr for ProgressMode

type Err = String

The associated error which can be returned from parsing.

fn from_str(s: &str) -> Result<ProgressMode, String>

Parses a string s to return a value of this type.

impl PartialEq for ProgressMode

fn eq(&self, other: &ProgressMode) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for ProgressMode

impl Eq for ProgressMode

impl StructuralPartialEq for ProgressMode