Module mz_storage_types::dyncfgs

Dyncfgs used by the storage layer. Despite their name, these can be used “statically” during rendering, or dynamically within timely operators.

Constants

• DELAY_SOURCES_PAST_REHYDRATION
  Whether rendering should use mz_join_core rather than DD’s JoinCore::join_core. Configuration for basic hydration backpressure.
• ENFORCE_EXTERNAL_ADDRESSES
  Whether or not to enforce that external connection addresses are global (not private or local) when resolving them.
• KAFKA_CLIENT_ID_ENRICHMENT_RULES
  Rules for enriching the client.id property of Kafka clients with additional data.
• KAFKA_FAST_FORWARD_SEEK_TIMEOUT
  The timeout when seeking through a consumer when fast-forwarding it. We expect this to happen quickly.
• KAFKA_POLL_MAX_WAIT
  The maximum time we will wait before re-polling rdkafka to see if new partitions/data are available.
• MYSQL_OFFSET_KNOWN_INTERVAL
  Interval to fetch offset_known, from @gtid_executed
• MYSQL_REPLICATION_HEARTBEAT_INTERVAL
  Replication heartbeat interval requested from the MySQL server.
• PG_FETCH_SLOT_RESUME_LSN_INTERVAL
  Interval to poll confirmed_flush_lsn to get a resumption lsn.
• PG_OFFSET_KNOWN_INTERVAL
  Interval to fetch offset_known, from pg_current_wal_lsn
• STORAGE_DOWNGRADE_SINCE_DURING_FINALIZATION
  When enabled, force-downgrade the controller’s since handle on the shard during shard finalization.
• STORAGE_ROCKSDB_CLEANUP_TRIES
  How many times to try to cleanup old RocksDB DB’s on disk before giving up.
• STORAGE_ROCKSDB_USE_MERGE_OPERATOR
  Whether to enable the merge operator in upsert for the RocksDB backend.
• STORAGE_UPSERT_MAX_SNAPSHOT_BATCH_BUFFERING
  If storage_upsert_prevent_snapshot_buffering is true, this prevents the upsert operator from buffering too many events from the upstream snapshot. In the absence of hydration flow control, this could prevent certain workloads from causing egregiously large writes to RocksDB.
• STORAGE_UPSERT_PREVENT_SNAPSHOT_BUFFERING
  Whether or not to prevent buffering the entire upstream snapshot in memory when processing it in memory. This is generally understood to reduce memory consumption.

Functions

• all_dyncfgs
  Adds the full set of all storage Configs.