Struct mz_stash::postgres::Consolidator

struct Consolidator {
    config: Arc<Mutex<Config>>,
    tls: MakeTlsConnector,
    schema: Option<String>,
    sinces_rx: UnboundedReceiver<ConsolidateRequest>,
    consolidations: BTreeMap<i64, (Antichain<Timestamp>, Vec<Sender<()>>)>,
    client: Option<Client>,
    reconnect: Interval,
    stmt_candidates: Option<Statement>,
    stmt_insert: Option<Statement>,
    stmt_delete: Option<Statement>,
}

The Consolidator receives since advancements on a channel and transactionally consolidates them. These can safely be done at a later time in a separate connection that doesn’t do leader or epoch checking because 1) having data that needs to be consolidated is not a correctness error and 2) the operations here are idempotent (can safely be run concurrently with a second stash).

Fields

config: Arc<Mutex<Config>>

tls: MakeTlsConnector

schema: Option<String>

sinces_rx: UnboundedReceiver<ConsolidateRequest>

consolidations: BTreeMap<i64, (Antichain<Timestamp>, Vec<Sender<()>>)>

client: Option<Client>

reconnect: Interval

stmt_candidates: Option<Statement>

stmt_insert: Option<Statement>

stmt_delete: Option<Statement>

Implementations

impl Consolidator

fn start( config: Arc<Mutex<Config>>, schema: Option<String>, tls: MakeTlsConnector, sinces_rx: UnboundedReceiver<ConsolidateRequest> )

fn spawn(self)

fn insert(&mut self, req: ConsolidateRequest)

async fn consolidate( &mut self, id: i64, since: &Antichain<Timestamp>, attempt: u64 ) -> Result<(), StashError>

async fn connect(&mut self) -> Result<(), StashError>