Module progress 

A “non-critical” operator that tracks the progress of a SqlServerSourceConnection.

The operator does the following:

• At some cadence timestamp_interval will probe the source for the max Lsn, emit the upstream known offset, and update SourceStatistics.
• Listen to a provided futures::Stream of resume uppers, which represents the durably committed uppers of the subsources/exports associated with this source. As the source makes progress this operator does two things:
  1. If CDC_CLEANUP_CHANGE_TABLE is enabled, will delete entries from each capture instance’s change table that all of its exports have ingested.
  2. Update each export’s SourceStatistics to notify listeners of its new “committed LSN”.

Statics

PROGRESS_WORKER 🔒

Used as a partition ID to determine the worker that is responsible for handling progress.

Functions

committed_lsn 🔒

The Lsn that every export in exports has durably committed through.

render 🔒