Struct mz_compute::logging::ConsolidateBuffer
source · pub struct ConsolidateBuffer<'a, T, D, R: Semigroup, P>where
P: Push<Bundle<T, (D, T, R)>> + 'a,
T: Clone + Lattice + Ord + TimelyTimestamp + 'a,
D: 'a + ExchangeData,{
buffer: Vec<(D, T, R)>,
output_handle: OutputHandle<'a, T, (D, T, R), P>,
cap: Option<Capability<T>>,
port: usize,
}
Expand description
A buffer that consolidates updates
The buffer implements a wrapper around OutputHandle consolidating elements pushed to it. It is backed by a capacity-limited buffer, which means that compaction only occurs within the dimensions of the buffer, i.e. the number of unique keys is less than half of the buffer’s capacity.
A cap is retained whenever the current time changes to be able to flush on drop or when the time changes again.
The buffer is filled with updates until it reaches its capacity. At this point, the updates are consolidated to free up space. This process repeats until the consolidation recovered less than half of the buffer’s capacity, at which point the buffer will be shipped.
The buffer retains a capability to send data on flush. It will flush all data once dropped, if time changes, or if the buffer capacity is reached.
Fields§
§buffer: Vec<(D, T, R)>
§output_handle: OutputHandle<'a, T, (D, T, R), P>
§cap: Option<Capability<T>>
§port: usize
Implementations§
source§impl<'a, T, D: ExchangeData, R: Semigroup, P> ConsolidateBuffer<'a, T, D, R, P>where
T: Clone + Lattice + Ord + TimelyTimestamp + 'a,
P: Push<Bundle<T, (D, T, R)>> + 'a,
impl<'a, T, D: ExchangeData, R: Semigroup, P> ConsolidateBuffer<'a, T, D, R, P>where
T: Clone + Lattice + Ord + TimelyTimestamp + 'a,
P: Push<Bundle<T, (D, T, R)>> + 'a,
sourcepub fn new(output_handle: OutputHandle<'a, T, (D, T, R), P>, port: usize) -> Self
pub fn new(output_handle: OutputHandle<'a, T, (D, T, R), P>, port: usize) -> Self
Create a new ConsolidateBuffer, wrapping the provided session.
output_handle
: The output to send data to.- ‘port’: The output port to retain capabilities for.
sourcepub fn give(&mut self, cap: &CapabilityRef<'_, T>, data: (D, T, R))
pub fn give(&mut self, cap: &CapabilityRef<'_, T>, data: (D, T, R))
Give an element to the buffer
Trait Implementations§
Auto Trait Implementations§
impl<'a, T, D, R, P> !RefUnwindSafe for ConsolidateBuffer<'a, T, D, R, P>
impl<'a, T, D, R, P> !Send for ConsolidateBuffer<'a, T, D, R, P>
impl<'a, T, D, R, P> !Sync for ConsolidateBuffer<'a, T, D, R, P>
impl<'a, T, D, R, P> Unpin for ConsolidateBuffer<'a, T, D, R, P>where
D: Unpin,
R: Unpin,
T: Unpin,
impl<'a, T, D, R, P> !UnwindSafe for ConsolidateBuffer<'a, T, D, R, P>
Blanket Implementations§
source§impl<T> FutureExt for T
impl<T> FutureExt for T
source§fn with_context(self, otel_cx: Context) -> WithContext<Self>
fn with_context(self, otel_cx: Context) -> WithContext<Self>
source§fn with_current_context(self) -> WithContext<Self>
fn with_current_context(self) -> WithContext<Self>
source§impl<T> Instrument for T
impl<T> Instrument for T
source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
source§impl<T> IntoRequest<T> for T
impl<T> IntoRequest<T> for T
source§fn into_request(self) -> Request<T>
fn into_request(self) -> Request<T>
T
in a tonic::Request
source§impl<T> Pointable for T
impl<T> Pointable for T
source§impl<P, R> ProtoType<R> for Pwhere
R: RustType<P>,
impl<P, R> ProtoType<R> for Pwhere
R: RustType<P>,
source§fn into_rust(self) -> Result<R, TryFromProtoError>
fn into_rust(self) -> Result<R, TryFromProtoError>
RustType::from_proto
.source§fn from_rust(rust: &R) -> P
fn from_rust(rust: &R) -> P
RustType::into_proto
.