Crate mz_persist

source ·
Expand description

Persistence for differential dataflow collections


  • Configuration for crate::location implementations.
  • Persistence related errors.
  • File backed implementations for testing and benchmarking.
  • Generated protobuf code and companion impls.
  • A persistent, compacting, indexed data structure of (Key, Value, Time, i64) updates.
  • Test utilities for trapping and injecting responses in external storage.
  • Abstractions over files, cloud storage, etc used in persistence.
  • In-memory implementations for testing and benchmarking.
  • Implementation-specific metrics for persist blobs and consensus
  • Implementation of Consensus backed by Postgres.
  • Retry utilities.
  • An S3 implementation of Blob storage.
  • Test utilities for injecting latency and errors.
  • A configurable data generator for benchmarking.