pub enum ComputeResponse<T = Timestamp> {
FrontierUpper {
id: GlobalId,
upper: Antichain<T>,
},
PeekResponse(Uuid, PeekResponse, OpenTelemetryContext),
SubscribeResponse(GlobalId, SubscribeResponse<T>),
CopyToResponse(GlobalId, CopyToResponse),
Status(StatusResponse),
}
Expand description
Compute protocol responses, sent by replicas to the compute controller.
Replicas send ComputeResponse
s in response to ComputeCommand
s they previously received
from the compute controller.
Variants§
FrontierUpper
Fields
FrontierUpper
announces the advancement of the upper frontier of the specified compute
collection. The response contain a collection ID and that collection’s new upper frontier.
Upon receiving a FrontierUpper
response, the controller may assume that the replica has
finished computing the given collection up to at least the given frontier. It may also
assume that the replica has finished reading from the collection’s inputs up to that
frontier.
Replicas must send FrontierUpper
responses for compute collections that are indexes or
storage sinks. Replicas must not send FrontierUpper
responses for subscribes.
Replicas must never report regressing frontiers. Specifically:
- The first frontier reported for a collection must not be less than that collection’s
initial
as_of
frontier. - Subsequent reported frontiers for a collection must not be less than any frontier reported previously for the same collection.
Replicas must send a FrontierUpper
response reporting advancement to the empty frontier
for a collection in two cases:
- The collection has advanced to the empty frontier (e.g. because its inputs have advanced to the empty frontier).
- The collection was dropped in response to an
AllowCompaction
command that advanced its read frontier to the empty frontier. (#16275)
Once a collection was reported to have been advanced to the empty upper frontier:
- It must no longer read from its inputs.
- The replica must not send further
FrontierUpper
responses for that collection.
The replica must not send FrontierUpper
responses for collections that have not
been created previously by a CreateDataflow
command or by a CreateInstance
command.
PeekResponse(Uuid, PeekResponse, OpenTelemetryContext)
PeekResponse
reports the result of a previous Peek
command. The peek is identified by
a Uuid
that matches the command’s Peek::uuid
.
The replica must send exactly one PeekResponse
for every Peek
command it received.
If the replica did not receive a CancelPeek
command for a peek, it must not send a
Canceled
response for that peek. If the replica did receive a CancelPeek
command
for a peek, it may send any of the three PeekResponse
variants.
The replica must not send PeekResponse
s for peek IDs that were not previously specified
in a Peek
command.
SubscribeResponse(GlobalId, SubscribeResponse<T>)
SubscribeResponse
reports the results emitted by an active subscribe over some time
interval.
For each subscribe that was installed by a previous CreateDataflow
command, the
replica must emit Batch
responses that cover the entire time interval from the
minimum time until the subscribe advances to the empty frontier or is
dropped. The time intervals of consecutive Batch
es must be increasing, contiguous,
non-overlapping, and non-empty. All updates transmitted in a batch must be consolidated and
have times within that batch’s time interval. All updates’ times must be greater than or
equal to as_of
. The upper
of the first Batch
of a subscribe must not be less than
that subscribe’s initial as_of
frontier.
The replica must send DroppedAt
responses if the subscribe was dropped in response to
an AllowCompaction
command that advanced its read frontier to the empty frontier. The
DroppedAt
frontier must be the upper frontier of the last emitted batch.
The replica must not send a DroppedAt
response if the subscribe’s upper frontier
(reported by Batch
responses) has advanced to the empty frontier (e.g. because its
inputs advanced to the empty frontier).
Once a subscribe was reported to have advanced to the empty frontier, or has been dropped:
- It must no longer read from its inputs.
- The replica must not send further
SubscribeResponse
s for that subscribe.
The replica must not send SubscribeResponse
s for subscribes that have not been
created previously by a CreateDataflow
command.
CopyToResponse(GlobalId, CopyToResponse)
CopyToResponse
reports the completion of an S3-oneshot sink.
The replica must send exactly one CopyToResponse
for every S3-oneshot sink previously
created by a CreateDataflow
command.
The replica must not send CopyToResponse
s for S3-oneshot sinks that were not previously
created by a CreateDataflow
command.
Status(StatusResponse)
Status
reports status updates from replicas to the controller.
Status
responses are a way for replicas to stream back introspection data that the
controller can then announce to its clients. They have no effect on the lifecycles of
compute collections. Correct operation of the Compute layer must not rely on Status
responses being sent or received.
Status
responses that are specific to collections must only be sent for collections that
(a) have previously been created by a CreateDataflow
command and (b) have not yet
been reported to have advanced to the empty frontier.
Trait Implementations§
source§impl Arbitrary for ComputeResponse<Timestamp>
impl Arbitrary for ComputeResponse<Timestamp>
§type Strategy = Union<BoxedStrategy<ComputeResponse>>
type Strategy = Union<BoxedStrategy<ComputeResponse>>
Strategy
used to generate values of type Self
.§type Parameters = ()
type Parameters = ()
arbitrary_with
accepts for configuration
of the generated Strategy
. Parameters must implement Default
.source§fn arbitrary_with(_: Self::Parameters) -> Self::Strategy
fn arbitrary_with(_: Self::Parameters) -> Self::Strategy
source§impl<T: Clone> Clone for ComputeResponse<T>
impl<T: Clone> Clone for ComputeResponse<T>
source§fn clone(&self) -> ComputeResponse<T>
fn clone(&self) -> ComputeResponse<T>
1.0.0 · source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
source
. Read moresource§impl<T: Debug> Debug for ComputeResponse<T>
impl<T: Debug> Debug for ComputeResponse<T>
source§impl<'de, T> Deserialize<'de> for ComputeResponse<T>where
T: Deserialize<'de>,
impl<'de, T> Deserialize<'de> for ComputeResponse<T>where
T: Deserialize<'de>,
source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
source§impl<T: Send> GenericClient<ComputeCommand<T>, ComputeResponse<T>> for Box<dyn ComputeClient<T>>
impl<T: Send> GenericClient<ComputeCommand<T>, ComputeResponse<T>> for Box<dyn ComputeClient<T>>
source§fn send<'life0, 'async_trait>(
&'life0 mut self,
cmd: ComputeCommand<T>
) -> Pin<Box<dyn Future<Output = Result<(), Error>> + Send + 'async_trait>>where
Self: 'async_trait,
'life0: 'async_trait,
fn send<'life0, 'async_trait>(
&'life0 mut self,
cmd: ComputeCommand<T>
) -> Pin<Box<dyn Future<Output = Result<(), Error>> + Send + 'async_trait>>where
Self: 'async_trait,
'life0: 'async_trait,
source§impl<T: PartialEq> PartialEq for ComputeResponse<T>
impl<T: PartialEq> PartialEq for ComputeResponse<T>
source§fn eq(&self, other: &ComputeResponse<T>) -> bool
fn eq(&self, other: &ComputeResponse<T>) -> bool
self
and other
values to be equal, and is used
by ==
.source§impl<T> Partitionable<ComputeCommand<T>, ComputeResponse<T>> for (ComputeCommand<T>, ComputeResponse<T>)
impl<T> Partitionable<ComputeCommand<T>, ComputeResponse<T>> for (ComputeCommand<T>, ComputeResponse<T>)
§type PartitionedState = PartitionedComputeState<T>
type PartitionedState = PartitionedComputeState<T>
source§fn new(parts: usize) -> PartitionedComputeState<T>
fn new(parts: usize) -> PartitionedComputeState<T>
PartitionedState
for the command–response pair.source§impl<T> PartitionedState<ComputeCommand<T>, ComputeResponse<T>> for PartitionedComputeState<T>
impl<T> PartitionedState<ComputeCommand<T>, ComputeResponse<T>> for PartitionedComputeState<T>
source§fn split_command(
&mut self,
command: ComputeCommand<T>
) -> Vec<Option<ComputeCommand<T>>>
fn split_command( &mut self, command: ComputeCommand<T> ) -> Vec<Option<ComputeCommand<T>>>
source§fn absorb_response(
&mut self,
shard_id: usize,
message: ComputeResponse<T>
) -> Option<Result<ComputeResponse<T>, Error>>
fn absorb_response( &mut self, shard_id: usize, message: ComputeResponse<T> ) -> Option<Result<ComputeResponse<T>, Error>>
source§impl RustType<ProtoComputeResponse> for ComputeResponse<Timestamp>
impl RustType<ProtoComputeResponse> for ComputeResponse<Timestamp>
source§fn into_proto(&self) -> ProtoComputeResponse
fn into_proto(&self) -> ProtoComputeResponse
Self
into a Proto
value.source§fn from_proto(proto: ProtoComputeResponse) -> Result<Self, TryFromProtoError>
fn from_proto(proto: ProtoComputeResponse) -> Result<Self, TryFromProtoError>
source§impl<T> Serialize for ComputeResponse<T>where
T: Serialize,
impl<T> Serialize for ComputeResponse<T>where
T: Serialize,
impl<T> StructuralPartialEq for ComputeResponse<T>
Auto Trait Implementations§
impl<T> RefUnwindSafe for ComputeResponse<T>where
T: RefUnwindSafe,
impl<T> Send for ComputeResponse<T>where
T: Send,
impl<T> Sync for ComputeResponse<T>where
T: Sync,
impl<T> Unpin for ComputeResponse<T>where
T: Unpin,
impl<T> UnwindSafe for ComputeResponse<T>where
T: UnwindSafe,
Blanket Implementations§
source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
source§impl<T> FmtForward for T
impl<T> FmtForward for T
source§fn fmt_binary(self) -> FmtBinary<Self>where
Self: Binary,
fn fmt_binary(self) -> FmtBinary<Self>where
Self: Binary,
self
to use its Binary
implementation when Debug
-formatted.source§fn fmt_display(self) -> FmtDisplay<Self>where
Self: Display,
fn fmt_display(self) -> FmtDisplay<Self>where
Self: Display,
self
to use its Display
implementation when
Debug
-formatted.source§fn fmt_lower_exp(self) -> FmtLowerExp<Self>where
Self: LowerExp,
fn fmt_lower_exp(self) -> FmtLowerExp<Self>where
Self: LowerExp,
self
to use its LowerExp
implementation when
Debug
-formatted.source§fn fmt_lower_hex(self) -> FmtLowerHex<Self>where
Self: LowerHex,
fn fmt_lower_hex(self) -> FmtLowerHex<Self>where
Self: LowerHex,
self
to use its LowerHex
implementation when
Debug
-formatted.source§fn fmt_octal(self) -> FmtOctal<Self>where
Self: Octal,
fn fmt_octal(self) -> FmtOctal<Self>where
Self: Octal,
self
to use its Octal
implementation when Debug
-formatted.source§fn fmt_pointer(self) -> FmtPointer<Self>where
Self: Pointer,
fn fmt_pointer(self) -> FmtPointer<Self>where
Self: Pointer,
self
to use its Pointer
implementation when
Debug
-formatted.source§fn fmt_upper_exp(self) -> FmtUpperExp<Self>where
Self: UpperExp,
fn fmt_upper_exp(self) -> FmtUpperExp<Self>where
Self: UpperExp,
self
to use its UpperExp
implementation when
Debug
-formatted.source§fn fmt_upper_hex(self) -> FmtUpperHex<Self>where
Self: UpperHex,
fn fmt_upper_hex(self) -> FmtUpperHex<Self>where
Self: UpperHex,
self
to use its UpperHex
implementation when
Debug
-formatted.source§impl<T> FutureExt for T
impl<T> FutureExt for T
source§fn with_context(self, otel_cx: Context) -> WithContext<Self>
fn with_context(self, otel_cx: Context) -> WithContext<Self>
source§fn with_current_context(self) -> WithContext<Self>
fn with_current_context(self) -> WithContext<Self>
source§impl<T> Instrument for T
impl<T> Instrument for T
source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
source§impl<T> IntoRequest<T> for T
impl<T> IntoRequest<T> for T
source§fn into_request(self) -> Request<T>
fn into_request(self) -> Request<T>
T
in a tonic::Request
source§impl<T, U> OverrideFrom<Option<&T>> for Uwhere
U: OverrideFrom<T>,
impl<T, U> OverrideFrom<Option<&T>> for Uwhere
U: OverrideFrom<T>,
source§impl<T> Pipe for Twhere
T: ?Sized,
impl<T> Pipe for Twhere
T: ?Sized,
source§fn pipe<R>(self, func: impl FnOnce(Self) -> R) -> Rwhere
Self: Sized,
fn pipe<R>(self, func: impl FnOnce(Self) -> R) -> Rwhere
Self: Sized,
source§fn pipe_ref<'a, R>(&'a self, func: impl FnOnce(&'a Self) -> R) -> Rwhere
R: 'a,
fn pipe_ref<'a, R>(&'a self, func: impl FnOnce(&'a Self) -> R) -> Rwhere
R: 'a,
self
and passes that borrow into the pipe function. Read moresource§fn pipe_ref_mut<'a, R>(&'a mut self, func: impl FnOnce(&'a mut Self) -> R) -> Rwhere
R: 'a,
fn pipe_ref_mut<'a, R>(&'a mut self, func: impl FnOnce(&'a mut Self) -> R) -> Rwhere
R: 'a,
self
and passes that borrow into the pipe function. Read moresource§fn pipe_borrow<'a, B, R>(&'a self, func: impl FnOnce(&'a B) -> R) -> R
fn pipe_borrow<'a, B, R>(&'a self, func: impl FnOnce(&'a B) -> R) -> R
source§fn pipe_borrow_mut<'a, B, R>(
&'a mut self,
func: impl FnOnce(&'a mut B) -> R
) -> R
fn pipe_borrow_mut<'a, B, R>( &'a mut self, func: impl FnOnce(&'a mut B) -> R ) -> R
source§fn pipe_as_ref<'a, U, R>(&'a self, func: impl FnOnce(&'a U) -> R) -> R
fn pipe_as_ref<'a, U, R>(&'a self, func: impl FnOnce(&'a U) -> R) -> R
self
, then passes self.as_ref()
into the pipe function.source§fn pipe_as_mut<'a, U, R>(&'a mut self, func: impl FnOnce(&'a mut U) -> R) -> R
fn pipe_as_mut<'a, U, R>(&'a mut self, func: impl FnOnce(&'a mut U) -> R) -> R
self
, then passes self.as_mut()
into the pipe
function.source§fn pipe_deref<'a, T, R>(&'a self, func: impl FnOnce(&'a T) -> R) -> R
fn pipe_deref<'a, T, R>(&'a self, func: impl FnOnce(&'a T) -> R) -> R
self
, then passes self.deref()
into the pipe function.source§impl<T> Pointable for T
impl<T> Pointable for T
source§impl<T> ProgressEventTimestamp for T
impl<T> ProgressEventTimestamp for T
source§impl<P, R> ProtoType<R> for Pwhere
R: RustType<P>,
impl<P, R> ProtoType<R> for Pwhere
R: RustType<P>,
source§fn into_rust(self) -> Result<R, TryFromProtoError>
fn into_rust(self) -> Result<R, TryFromProtoError>
RustType::from_proto
.source§fn from_rust(rust: &R) -> P
fn from_rust(rust: &R) -> P
RustType::into_proto
.source§impl<T> Tap for T
impl<T> Tap for T
source§fn tap_borrow<B>(self, func: impl FnOnce(&B)) -> Self
fn tap_borrow<B>(self, func: impl FnOnce(&B)) -> Self
Borrow<B>
of a value. Read moresource§fn tap_borrow_mut<B>(self, func: impl FnOnce(&mut B)) -> Self
fn tap_borrow_mut<B>(self, func: impl FnOnce(&mut B)) -> Self
BorrowMut<B>
of a value. Read moresource§fn tap_ref<R>(self, func: impl FnOnce(&R)) -> Self
fn tap_ref<R>(self, func: impl FnOnce(&R)) -> Self
AsRef<R>
view of a value. Read moresource§fn tap_ref_mut<R>(self, func: impl FnOnce(&mut R)) -> Self
fn tap_ref_mut<R>(self, func: impl FnOnce(&mut R)) -> Self
AsMut<R>
view of a value. Read moresource§fn tap_deref<T>(self, func: impl FnOnce(&T)) -> Self
fn tap_deref<T>(self, func: impl FnOnce(&T)) -> Self
Deref::Target
of a value. Read moresource§fn tap_deref_mut<T>(self, func: impl FnOnce(&mut T)) -> Self
fn tap_deref_mut<T>(self, func: impl FnOnce(&mut T)) -> Self
Deref::Target
of a value. Read moresource§fn tap_dbg(self, func: impl FnOnce(&Self)) -> Self
fn tap_dbg(self, func: impl FnOnce(&Self)) -> Self
.tap()
only in debug builds, and is erased in release builds.source§fn tap_mut_dbg(self, func: impl FnOnce(&mut Self)) -> Self
fn tap_mut_dbg(self, func: impl FnOnce(&mut Self)) -> Self
.tap_mut()
only in debug builds, and is erased in release
builds.source§fn tap_borrow_dbg<B>(self, func: impl FnOnce(&B)) -> Self
fn tap_borrow_dbg<B>(self, func: impl FnOnce(&B)) -> Self
.tap_borrow()
only in debug builds, and is erased in release
builds.source§fn tap_borrow_mut_dbg<B>(self, func: impl FnOnce(&mut B)) -> Self
fn tap_borrow_mut_dbg<B>(self, func: impl FnOnce(&mut B)) -> Self
.tap_borrow_mut()
only in debug builds, and is erased in release
builds.source§fn tap_ref_dbg<R>(self, func: impl FnOnce(&R)) -> Self
fn tap_ref_dbg<R>(self, func: impl FnOnce(&R)) -> Self
.tap_ref()
only in debug builds, and is erased in release
builds.source§fn tap_ref_mut_dbg<R>(self, func: impl FnOnce(&mut R)) -> Self
fn tap_ref_mut_dbg<R>(self, func: impl FnOnce(&mut R)) -> Self
.tap_ref_mut()
only in debug builds, and is erased in release
builds.source§fn tap_deref_dbg<T>(self, func: impl FnOnce(&T)) -> Self
fn tap_deref_dbg<T>(self, func: impl FnOnce(&T)) -> Self
.tap_deref()
only in debug builds, and is erased in release
builds.