Module stash 

The upsert-v2 source stash: the consolidating diff, the stash batcher types, and the per-flavor UpsertStashArms.

Structs

ChunkedArm 🔒

The chunked flavor: time-major UpsertChunkBatcher stash, FeedbackSpine feedback arrangement, bulk-probe drain.

PagedArm 🔒

The paged flavor: UpsertPagedBatcher stash, ValRowSpine feedback arrangement, cursor drain. Cold chains page out of RSS through the storage-owned column pager, captured once per batcher at construction.

UpsertDiff 🔒

UpsertDiffContainer 🔒

Derived columnar container for a struct.

UpsertDiffReference 🔒

Derived columnar reference for a struct.

Traits

UpsertStashArm 🔒

The flavor-specific pieces of the upsert-v2 operator: the stash batcher, the feedback arrangement’s spine, and how the drain reads prior state. build_upsert_operator holds the flavor-independent operator loop and calls through this trait at the few points where the flavors diverge.

Functions

flush_through 🔒

The shared body of the arms’ flush: writes each update into a raw column through record, consolidates it through chunker, and hands each readied chunk to push.

next_outer 🔒

The least time past every time sharing ts’s mz_repr::Timestamp, or None when that timestamp is the maximum.

seal_upper 🔒

The start of the mz_repr::Timestamp after persist_upper’s, capped at input_upper so no unfinalized time is extracted.

Type Aliases

TimeMajorChunker 🔒

UpsertChunker’s time-major counterpart, for the chunked stash.

TimeMajorUpdate 🔒

One chunked-flavor stash update: UpsertUpdate with the time copied into the data, so the batcher sorts by (time, key).

UpsertChunk 🔒

One chunked-flavor stash chunk: a sorted, consolidated run of time-major updates, resident or spilled to the buffer pool.

UpsertChunkBatcher 🔒

The chunked flavor’s stash: differential’s chunk merge batcher over ColumnChunks. Data is pushed in unsorted. The batcher maintains geometrically-sized sorted chains and consolidates via the UpsertDiff Semigroup automatically. Committed chunks spill their bodies to the process buffer pool (see mz_timely_util::columnar::chunk), so the not-yet-eligible backlog (the snapshot / persist-lag window) pages out of RSS instead of growing it.

UpsertChunker 🔒

The chunker that sorts and consolidates raw input into the Column chunks the paged stash batcher consumes.

UpsertPagedBatcher 🔒

The paged flavor’s stash: the paged columnar merge batcher, consolidating like UpsertChunkBatcher but storing each chain entry as a Column routed through the storage-owned pager, which pages cold chains out of RSS.

UpsertUpdate 🔒

One source-stash update: a key, its dataflow time, and the payload diff. O is the columnar order key projected from the source FromTime (see UpsertSourceTime).