Struct dataflow::render::sources::PersistedSourceManager

pub struct PersistedSourceManager {
    compaction_handles: HashMap<GlobalId, Weak<BoundedCompactionHandle>>,
}

A PersistedSourceManager stores maps from global identifiers to the one rendered persistent instance of a source.

NOTE: There can only ever be one running (rendered) instance of a persisted source. The manager will panic when trying to add more than one instance for a given source id.

Fields

compaction_handles: HashMap<GlobalId, Weak<BoundedCompactionHandle>>

Handles that allow setting the compaction frontier for a persisted source.

Implementations

impl PersistedSourceManager

pub fn new() -> Self

pub fn add_source(
    &mut self,
    source_id: &GlobalId,
    source_name: &str,
    frontier_probe: ProbeHandle<Timestamp>,
    compaction_handle: MultiWriteHandle
) -> Rc<dyn Any>

Binds the given frontier_probe and compaction_handle to the source_id. This will panic if there is already a source for the given id. This returns a “token” that should be stashed in the customary places to prevent the stored information from vanishing before its time.

pub fn allow_compaction(&mut self, id: GlobalId, frontier: Antichain<Timestamp>)

Enables compaction of sources associated with the identifier.

pub fn del_source(&mut self, id: &GlobalId) -> bool

Removes the maintained state for source id.