Enum mz_dataflow_types::sources::SourceEnvelope
source · [−]pub enum SourceEnvelope {
None(NoneEnvelope),
Debezium(DebeziumEnvelope),
Upsert(UpsertEnvelope),
CdcV2,
}
Expand description
SourceEnvelope
s describe how to turn a stream of messages from SourceDesc
s
into a differential stream, that is, a stream of (data, time, diff)
triples.
Some sources (namely postgres and pubnub) skip any explicit envelope handling, effectively
asserting that SourceEnvelope
is None
with KeyEnvelope::None
.
Variants
None(NoneEnvelope)
The most trivial version is None
, which typically produces triples where the diff
is 1
. However, some sources are able to produce values with more exotic diff’s,
such as the posgres source. Currently, this is the only variant usable with
those sources.
If the KeyEnvelope
is present,
include the key columns as an output column of the source with the given properties.
Debezium(DebeziumEnvelope)
Debezium
avoids holding onto previously seen values by trusting the required
before
and after
value fields coming from the upstream source.
Upsert(UpsertEnvelope)
Upsert
holds onto previously seen values and produces 1
or -1
diffs depending on
whether or not the required key outputed by the source has been seen before. This also
supports a Debezium
mode.
CdcV2
CdcV2
requires sources output messages in a strict form that requires a upstream-provided
timeline.
Trait Implementations
sourceimpl Arbitrary for SourceEnvelope
impl Arbitrary for SourceEnvelope
type Parameters = (<NoneEnvelope as Arbitrary>::Parameters, <DebeziumEnvelope as Arbitrary>::Parameters, <UpsertEnvelope as Arbitrary>::Parameters)
type Parameters = (<NoneEnvelope as Arbitrary>::Parameters, <DebeziumEnvelope as Arbitrary>::Parameters, <UpsertEnvelope as Arbitrary>::Parameters)
The type of parameters that arbitrary_with
accepts for configuration
of the generated Strategy
. Parameters must implement Default
. Read more
type Strategy = TupleUnion<((u32, Arc<Map<<NoneEnvelope as Arbitrary>::Strategy, fn(_: NoneEnvelope) -> Self>>), (u32, Arc<Map<<DebeziumEnvelope as Arbitrary>::Strategy, fn(_: DebeziumEnvelope) -> Self>>), (u32, Arc<Map<<UpsertEnvelope as Arbitrary>::Strategy, fn(_: UpsertEnvelope) -> Self>>), (u32, Arc<fn() -> Self>))>
type Strategy = TupleUnion<((u32, Arc<Map<<NoneEnvelope as Arbitrary>::Strategy, fn(_: NoneEnvelope) -> Self>>), (u32, Arc<Map<<DebeziumEnvelope as Arbitrary>::Strategy, fn(_: DebeziumEnvelope) -> Self>>), (u32, Arc<Map<<UpsertEnvelope as Arbitrary>::Strategy, fn(_: UpsertEnvelope) -> Self>>), (u32, Arc<fn() -> Self>))>
sourcefn arbitrary_with(_top: Self::Parameters) -> Self::Strategy
fn arbitrary_with(_top: Self::Parameters) -> Self::Strategy
sourceimpl Clone for SourceEnvelope
impl Clone for SourceEnvelope
sourcefn clone(&self) -> SourceEnvelope
fn clone(&self) -> SourceEnvelope
Returns a copy of the value. Read more
1.0.0 · sourcefn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from source
. Read more
sourceimpl Debug for SourceEnvelope
impl Debug for SourceEnvelope
sourceimpl<'de> Deserialize<'de> for SourceEnvelope
impl<'de> Deserialize<'de> for SourceEnvelope
sourcefn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error> where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error> where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
sourceimpl PartialEq<SourceEnvelope> for SourceEnvelope
impl PartialEq<SourceEnvelope> for SourceEnvelope
sourcefn eq(&self, other: &SourceEnvelope) -> bool
fn eq(&self, other: &SourceEnvelope) -> bool
This method tests for self
and other
values to be equal, and is used
by ==
. Read more
sourcefn ne(&self, other: &SourceEnvelope) -> bool
fn ne(&self, other: &SourceEnvelope) -> bool
This method tests for !=
.
sourceimpl RustType<ProtoSourceEnvelope> for SourceEnvelope
impl RustType<ProtoSourceEnvelope> for SourceEnvelope
sourcefn into_proto(&self) -> ProtoSourceEnvelope
fn into_proto(&self) -> ProtoSourceEnvelope
Convert a Self
into a Proto
value.
sourcefn from_proto(proto: ProtoSourceEnvelope) -> Result<Self, TryFromProtoError>
fn from_proto(proto: ProtoSourceEnvelope) -> Result<Self, TryFromProtoError>
Consume and convert a Proto
back into a Self
value. Read more
sourceimpl Serialize for SourceEnvelope
impl Serialize for SourceEnvelope
impl Eq for SourceEnvelope
impl StructuralEq for SourceEnvelope
impl StructuralPartialEq for SourceEnvelope
Auto Trait Implementations
impl RefUnwindSafe for SourceEnvelope
impl Send for SourceEnvelope
impl Sync for SourceEnvelope
impl Unpin for SourceEnvelope
impl UnwindSafe for SourceEnvelope
Blanket Implementations
sourceimpl<T> BorrowMut<T> for T where
T: ?Sized,
impl<T> BorrowMut<T> for T where
T: ?Sized,
const: unstable · sourcefn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
sourceimpl<Q, K> Equivalent<K> for Q where
Q: Eq + ?Sized,
K: Borrow<Q> + ?Sized,
impl<Q, K> Equivalent<K> for Q where
Q: Eq + ?Sized,
K: Borrow<Q> + ?Sized,
sourcefn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to key
and return true
if they are equal.
sourceimpl<T> FutureExt for T
impl<T> FutureExt for T
sourcefn with_context(self, otel_cx: Context) -> WithContext<Self>
fn with_context(self, otel_cx: Context) -> WithContext<Self>
sourcefn with_current_context(self) -> WithContext<Self>
fn with_current_context(self) -> WithContext<Self>
sourceimpl<T> Instrument for T
impl<T> Instrument for T
sourcefn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
sourcefn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
sourceimpl<T> IntoRequest<T> for T
impl<T> IntoRequest<T> for T
sourcefn into_request(self) -> Request<T>
fn into_request(self) -> Request<T>
Wrap the input message T
in a tonic::Request
sourceimpl<T> ProgressEventTimestamp for T where
T: Data + Debug + Any,
impl<T> ProgressEventTimestamp for T where
T: Data + Debug + Any,
sourceimpl<P, R> ProtoType<R> for P where
R: RustType<P>,
impl<P, R> ProtoType<R> for P where
R: RustType<P>,
sourcefn into_rust(self) -> Result<R, TryFromProtoError>
fn into_rust(self) -> Result<R, TryFromProtoError>
See RustType::from_proto
.
sourcefn from_rust(rust: &R) -> P
fn from_rust(rust: &R) -> P
See RustType::into_proto
.
sourceimpl<T> ToOwned for T where
T: Clone,
impl<T> ToOwned for T where
T: Clone,
type Owned = T
type Owned = T
The resulting type after obtaining ownership.
sourcefn clone_into(&self, target: &mut T)
fn clone_into(&self, target: &mut T)
toowned_clone_into
)Uses borrowed data to replace owned data, usually by cloning. Read more
sourceimpl<T> WithSubscriber for T
impl<T> WithSubscriber for T
sourcefn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self> where
S: Into<Dispatch>,
fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self> where
S: Into<Dispatch>,
Attaches the provided Subscriber
to this type, returning a
WithDispatch
wrapper. Read more
sourcefn with_current_subscriber(self) -> WithDispatch<Self>
fn with_current_subscriber(self) -> WithDispatch<Self>
Attaches the current default Subscriber
to this type, returning a
WithDispatch
wrapper. Read more