Skip to main content

Module upsert_stash_spill

Module upsert_stash_spill 

Source
Expand description

The storage spill gate (mz_timely_util::columnar::chunk::StorageSpill), used by the chunked upsert-v2 stash flavor.

In that flavor the source stash and feedback arrangement spill through the process buffer pool: committed chunk bodies land in the pool once compute’s config handler has installed and budgeted it (storage and compute run in the same clusterd process). The gate is consulted at every chunk commit, so flips apply to running dataflows.

Functions§

set_enabled
Enable or disable spilling of upsert chunk bodies to the buffer pool.