Struct mz_persist::indexed::encoding::BlobTraceBatchPart

source ·
pub struct BlobTraceBatchPart<T> {
    pub desc: Description<T>,
    pub index: u64,
    pub updates: Vec<ColumnarRecords>,
}
Expand description

The structure serialized and stored as a value in crate::location::Blob storage for data keys corresponding to trace data.

This batch represents the data that was originally written at some time in [lower, upper) (more precisely !< lower and < upper). The individual record times may have later been advanced by compaction to something <= since. This means the ability to reconstruct the state of the collection at times < since has been lost. However, there may still be records present in the batch whose times are < since. Users iterating through updates must take care to advance records with times < since to since in order to correctly answer queries at times >= since.

Invariants:

  • The [lower, upper) interval of times in desc is non-empty.
  • The timestamp of each update is >= to desc.lower().
  • The timestamp of each update is < desc.upper() iff desc.upper() > desc.since(). Otherwise the timestamp of each update is <= desc.since().
  • The values in updates are sorted by (key, value, time).
  • The values in updates are “consolidated”, i.e. (key, value, time) is unique.
  • All entries have a non-zero diff.

TODO: disallow empty trace batch parts in the future so there is one unique way to represent an empty trace batch.

Fields§

§desc: Description<T>

Which updates are included in this batch.

There may be other parts for the batch that also contain updates within the specified [lower, upper) range.

§index: u64

Index of this part in the list of parts that form the batch.

§updates: Vec<ColumnarRecords>

The updates themselves.

Implementations§

source§

impl<T: Timestamp + Codec64> BlobTraceBatchPart<T>

source

pub fn validate(&self) -> Result<(), Error>

Asserts the documented invariants, returning an error if any are violated.

source

pub fn encode<B>(&self, buf: &mut B)
where B: BufMut,

Encodes an BlobTraceBatchPart into the Parquet format.

source

pub fn decode( buf: &SegmentedBytes, metrics: &ColumnarMetrics ) -> Result<Self, Error>

Decodes a BlobTraceBatchPart from the Parquet format.

source

pub fn key_lower(&self) -> &[u8]

Scans the part and returns a lower bound on the contained keys.

Trait Implementations§

source§

impl<T: Clone> Clone for BlobTraceBatchPart<T>

source§

fn clone(&self) -> BlobTraceBatchPart<T>

Returns a copy of the value. Read more
1.0.0 · source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more
source§

impl<T: Debug> Debug for BlobTraceBatchPart<T>

source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more

Auto Trait Implementations§

§

impl<T> Freeze for BlobTraceBatchPart<T>

§

impl<T> RefUnwindSafe for BlobTraceBatchPart<T>
where T: RefUnwindSafe,

§

impl<T> Send for BlobTraceBatchPart<T>
where T: Send,

§

impl<T> Sync for BlobTraceBatchPart<T>
where T: Sync,

§

impl<T> Unpin for BlobTraceBatchPart<T>
where T: Unpin,

§

impl<T> UnwindSafe for BlobTraceBatchPart<T>
where T: UnwindSafe,

Blanket Implementations§

source§

impl<T> Any for T
where T: 'static + ?Sized,

source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
source§

impl<T> Borrow<T> for T
where T: ?Sized,

source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
source§

impl<T, U> CastInto<U> for T
where U: CastFrom<T>,

source§

fn cast_into(self) -> U

Performs the cast.
source§

impl<R, O, T> CopyOnto<ConsecutiveOffsetPairs<R, O>> for T
where R: Region<Index = (usize, usize)>, O: OffsetContainer<usize>, T: CopyOnto<R>,

source§

fn copy_onto( self, target: &mut ConsecutiveOffsetPairs<R, O> ) -> <ConsecutiveOffsetPairs<R, O> as Region>::Index

Copy self into the target container, returning an index that allows to look up the corresponding read item.
source§

impl<T> DynClone for T
where T: Clone,

source§

fn __clone_box(&self, _: Private) -> *mut ()

source§

impl<T> From<T> for T

source§

fn from(t: T) -> T

Returns the argument unchanged.

source§

impl<T> FromRef<T> for T
where T: Clone,

source§

fn from_ref(input: &T) -> T

Converts to this type from a reference to the input type.
source§

impl<T> FutureExt for T

source§

fn with_context(self, otel_cx: Context) -> WithContext<Self>

Attaches the provided Context to this type, returning a WithContext wrapper. Read more
source§

fn with_current_context(self) -> WithContext<Self>

Attaches the current Context to this type, returning a WithContext wrapper. Read more
source§

impl<T> Instrument for T

source§

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more
source§

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
source§

impl<T, U> Into<U> for T
where U: From<T>,

source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

source§

impl<T> IntoRequest<T> for T

source§

fn into_request(self) -> Request<T>

Wrap the input message T in a tonic::Request
source§

impl<Unshared, Shared> IntoShared<Shared> for Unshared
where Shared: FromUnshared<Unshared>,

source§

fn into_shared(self) -> Shared

Creates a shared type from an unshared type.
source§

impl<T> Pointable for T

source§

const ALIGN: usize = _

The alignment of pointer.
§

type Init = T

The type for initializers.
source§

unsafe fn init(init: <T as Pointable>::Init) -> usize

Initializes a with the given initializer. Read more
source§

unsafe fn deref<'a>(ptr: usize) -> &'a T

Dereferences the given pointer. Read more
source§

unsafe fn deref_mut<'a>(ptr: usize) -> &'a mut T

Mutably dereferences the given pointer. Read more
source§

unsafe fn drop(ptr: usize)

Drops the object pointed to by the given pointer. Read more
source§

impl<T> ProgressEventTimestamp for T
where T: Data + Debug + Any,

source§

fn as_any(&self) -> &(dyn Any + 'static)

Upcasts this ProgressEventTimestamp to Any. Read more
source§

fn type_name(&self) -> &'static str

Returns the name of the concrete type of this object. Read more
source§

impl<P, R> ProtoType<R> for P
where R: RustType<P>,

source§

impl<R, T> PushInto<FlatStack<R>> for T
where R: Region + Clone + 'static, T: CopyOnto<R>,

source§

fn push_into(self, target: &mut FlatStack<R>)

Push self into the target container.
source§

impl<T> PushInto<Vec<T>> for T

source§

fn push_into(self, target: &mut Vec<T>)

Push self into the target container.
source§

impl<T> Same for T

§

type Output = T

Should always be Self
source§

impl<T> ToOwned for T
where T: Clone,

§

type Owned = T

The resulting type after obtaining ownership.
source§

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more
source§

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more
source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

§

type Error = Infallible

The type returned in the event of a conversion error.
source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
source§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

source§

fn vzip(self) -> V

source§

impl<T> WithSubscriber for T

source§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more
source§

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more
source§

impl<T> Data for T
where T: Clone + 'static,