Function mz_storage::render::persist_sink::write_batches
source ยท fn write_batches<G>(
scope: &G,
collection_id: GlobalId,
operator_name: &str,
target: &CollectionMetadata,
batch_descriptions: &Stream<G, (Antichain<Timestamp>, Antichain<Timestamp>)>,
desired_collection: &Collection<G, Result<Row, DataflowError>, Diff>,
persist_clients: Arc<PersistClientCache>,
storage_state: &StorageState,
busy_signal: Arc<Semaphore>,
) -> (Stream<G, HollowBatchAndMetadata<Timestamp>>, PressOnDropButton)
Expand description
Writes desired_collection
to persist, but only for updates
that fall into batch a description that we get via batch_descriptions
.
This forwards a HollowBatch
(with additional metadata)
for any batch of updates that was written.
This operator assumes that the desired_collection
comes pre-sharded.
This also and updates various metrics.