Skip to main content

Module shard_source

Module shard_source 

Source
Expand description

A source that reads from a persist shard.

StructsΒ§

LeaseManager πŸ”’
ReaderLeaseExpired πŸ”’
A fetch failed because the reader that leased the part lost its lease.

EnumsΒ§

ErrorHandler
Many dataflows, including the Persist source, encounter errors that are neither data-plane errors (a la SourceData) nor bugs. This includes:
FilterResult
The result of applying an MFP to a part, if we know it.
SnapshotMode
An enum describing whether a snapshot should be emitted

FunctionsΒ§

missing_blob_error πŸ”’
The error for a fetch that found its part’s blob missing. Counts a lost lease in expired_live_read.
shard_source
Creates a new source that reads from a persist shard, distributing the work of reading data to all timely workers.
shard_source_descs πŸ”’
shard_source_fetch πŸ”’