Module mz_txn_wal::operator
source Β· Expand description
Timely operators for the crate
Structs§
- A helper for subscribing to a data shard using the timely operators.
- A handle to a DataSubscribe running in a task.
- The process global
TxnsRead
that any operator can communicate with.
Constants§
Functions§
- Retry configuration for txn-wal data shard override of
next_listen_batch
. - An operator for translating physical data shard frontiers into logical ones.
- TODO: Iβd much prefer the communication protocol between the two operators to be exactly remap as defined in the reclocking design doc. However, we canβt quite recover exactly the information necessary to construct that at the moment. Seems worth doing, but in the meantime, intentionally make this look fairly different (
Stream
ofDataRemapEntry
instead ofCollection<FromTime>
) to hopefully minimize confusion. As a performance optimization, we only re-emit this when the physical upper has changed, which means that the frontier of theStream<DataRemapEntry<T>>
indicates updates to the logical_upper of the most recentDataRemapEntry
(i.e. the one with the largest physical_upper). - An alternative implementation of
txns_progress_source_global
that opens a newTxnsCache
local to the operator.