Struct dataflow::source::SourceConfig

pub struct SourceConfig<'a, G> {

    pub name: String,
    pub sql_name: String,
    pub upstream_name: Option<String>,
    pub id: SourceInstanceId,
    pub scope: &'a G,
    pub worker_id: usize,
    pub worker_count: usize,
    pub timestamp_histories: Option<TimestampBindingRc>,
    pub timestamp_frequency: Duration,
    pub active: bool,
    pub encoding: SourceDataEncoding,
    pub logger: Option<Logger>,
    pub now: NowFn,
    pub base_metrics: &'a SourceBaseMetrics,
}

Shared configuration information for all source types.

Fields

name: String

The name to attach to the underlying timely operator.

sql_name: String

The name of the SQL object this source corresponds to

upstream_name: Option<String>

The name of the upstream resource this source corresponds to (For example, a Kafka topic)

id: SourceInstanceId

The ID of this instantiation of this source.

scope: &'a G

The timely scope in which to build the source.

worker_id: usize

The ID of the worker on which this operator is executing

worker_count: usize

The total count of workers

timestamp_histories: Option<TimestampBindingRc>

Data-timestamping updates: information about (timestamp, source offset)

timestamp_frequency: Duration

Source Type Timestamp Frequency: frequency at which timestamps should be closed (and capabilities downgraded)

active: bool

Whether this worker has been chosen to actually receive data.

encoding: SourceDataEncoding

Data encoding

logger: Option<Logger>

Timely worker logger for source events

now: NowFn

The function to return a now time.

base_metrics: &'a SourceBaseMetrics

The metrics & registry that each source instantiates.