Expand description
A source that reads from a persist shard.
StructsΒ§
- Lease
Manager π - Reader
Lease πExpired - A fetch failed because the reader that leased the part lost its lease.
EnumsΒ§
- Error
Handler - Many dataflows, including the Persist source, encounter errors that are neither data-plane errors (a la SourceData) nor bugs. This includes:
- Filter
Result - The result of applying an MFP to a part, if we know it.
- Snapshot
Mode - An enum describing whether a snapshot should be emitted
FunctionsΒ§
- missing_
blob_ πerror - The error for a fetch that found its partβs blob missing. Counts a lost
lease in
expired_live_read. - shard_
source - Creates a new source that reads from a persist shard, distributing the work of reading data to all timely workers.
- shard_
source_ πdescs - shard_
source_ πfetch