Module shard_source

Source
Expand description

A source that reads from a persist shard.

Structsยง

LeaseManager ๐Ÿ”’

Enumsยง

ErrorHandler
Many dataflows, including the Persist source, encounter errors that are neither data-plane errors (a la SourceData) nor bugs. This includes:
FilterResult
The result of applying an MFP to a part, if we know it.
SnapshotMode
An enum describing whether a snapshot should be emitted

Functionsยง

shard_source
Creates a new source that reads from a persist shard, distributing the work of reading data to all timely workers.
shard_source_descs ๐Ÿ”’
shard_source_fetch ๐Ÿ”’