Struct mz_persist_client::usage::ShardUsageAudit

pub struct ShardUsageAudit {
    pub current_state_batches_bytes: u64,
    pub current_state_rollups_bytes: u64,
    pub referenced_not_current_state_bytes: u64,
    pub not_leaked_not_referenced_bytes: u64,
    pub leaked_bytes: u64,
}

Expand description

A breakdown of the size of various contributions to a shard’s blob (S3) usage.

This is structured as a “funnel”, in which the steps are additive. Specifically 1=2a+2b, 2a=3a+3b, 3a=4a+4b, 4a=5a+5b (so the “a“s are the funnel and the “b“s are places where data splits out of the funnel).

Fields§

§current_state_batches_bytes: u64

5a: Data in batches/parts referenced by the most recent version of state.

§current_state_rollups_bytes: u64

5b: Data in rollups referenced by the most recent version of state.

§referenced_not_current_state_bytes: u64

4b: Data referenced by a live version of state that is not the most recent.

Possible causes:

SeqNo hold
Waiting for a GC run

§not_leaked_not_referenced_bytes: u64

3b: Data not referenced by any live version of state.

Possible causes:

A batch or rollup that’s about to be linked into state
A batch leaked by a crash, but the writer has not yet been force expired
A rollup leaked by a crash, but GC has not yet advanced past the SeqNo

§leaked_bytes: u64

2b: Data that is eligible for reclamation by a (future) leaked blob cleanup task (#17322).

Possible causes:

A batch or rollup written by a process which crashed (or was rolled) before it could be linked into state.

Implementations§

impl ShardUsageAudit

pub fn current_state_bytes(&self) -> u64

4a: Data referenced by the most recent version of state.

pub fn referenced_bytes(&self) -> u64

3a: Data referenced by any live version of state.

pub fn not_leaked_bytes(&self) -> u64

2a: Data that would not be reclaimed by a (future) leaked blob cleanup task (#17322).

pub fn total_bytes(&self) -> u64

1: Raw blob (S3) usage.

NB: Due to race conditions between reads of blob and consensus in the usage code, this might be a slight under-counting.

Trait Implementations§

impl Clone for ShardUsageAudit

fn clone(&self) -> ShardUsageAudit

Returns a copy of the value. Read more

1.0.0 · source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more

impl Debug for ShardUsageAudit

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more

impl Display for ShardUsageAudit

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more

Auto Trait Implementations§

impl Freeze for ShardUsageAudit

impl RefUnwindSafe for ShardUsageAudit

impl Send for ShardUsageAudit

impl Sync for ShardUsageAudit

impl Unpin for ShardUsageAudit

impl UnwindSafe for ShardUsageAudit

Blanket Implementations§

impl<T> Any for T
where T: 'static + ?Sized,

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more

impl<T> Borrow<T> for T
where T: ?Sized,

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more

impl<T> BorrowMut<T> for T
where T: ?Sized,

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more

impl<T, U> CastInto<U> for T
where U: CastFrom<T>,

fn cast_into(self) -> U

Performs the cast.

impl<R, O, T> CopyOnto<ConsecutiveOffsetPairs<R, O>> for T
where R: Region<Index = (usize, usize)>, O: OffsetContainer<usize>, T: CopyOnto<R>,

fn copy_onto( self, target: &mut ConsecutiveOffsetPairs<R, O> ) -> <ConsecutiveOffsetPairs<R, O> as Region>::Index

Copy self into the target container, returning an index that allows to look up the corresponding read item.

impl<T> DynClone for T
where T: Clone,

fn __clone_box(&self, _: Private) -> *mut ()

impl<T> From<T> for T

fn from(t: T) -> T

Returns the argument unchanged.

impl<T> FromRef<T> for T
where T: Clone,

fn from_ref(input: &T) -> T

Converts to this type from a reference to the input type.

impl<T> FutureExt for T

fn with_context(self, otel_cx: Context) -> WithContext<Self>

Attaches the provided Context to this type, returning a WithContext wrapper. Read more

fn with_current_context(self) -> WithContext<Self>

Attaches the current Context to this type, returning a WithContext wrapper. Read more

impl<T> Instrument for T

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more

impl<T, U> Into<U> for T
where U: From<T>,

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

impl<T> IntoRequest<T> for T

fn into_request(self) -> Request<T>

Wrap the input message T in a tonic::Request

impl<Unshared, Shared> IntoShared<Shared> for Unshared
where Shared: FromUnshared<Unshared>,

fn into_shared(self) -> Shared

Creates a shared type from an unshared type.

impl<T> Pointable for T

const ALIGN: usize = _

The alignment of pointer.

type Init = T

The type for initializers.

unsafe fn init(init: <T as Pointable>::Init) -> usize

Initializes a with the given initializer. Read more

unsafe fn deref<'a>(ptr: usize) -> &'a T

Dereferences the given pointer. Read more

unsafe fn deref_mut<'a>(ptr: usize) -> &'a mut T

Mutably dereferences the given pointer. Read more

unsafe fn drop(ptr: usize)

Drops the object pointed to by the given pointer. Read more

impl<T> ProgressEventTimestamp for T
where T: Data + Debug + Any,

fn as_any(&self) -> &(dyn Any + 'static)

Upcasts this ProgressEventTimestamp to Any. Read more

fn type_name(&self) -> &'static str

Returns the name of the concrete type of this object. Read more

impl<P, R> ProtoType<R> for P
where R: RustType<P>,

fn into_rust(self) -> Result<R, TryFromProtoError>

See RustType::from_proto.

fn from_rust(rust: &R) -> P

See RustType::into_proto.

impl<R, T> PushInto<FlatStack<R>> for T
where R: Region + Clone + 'static, T: CopyOnto<R>,

fn push_into(self, target: &mut FlatStack<R>)

Push self into the target container.

impl<T> PushInto<Vec<T>> for T

fn push_into(self, target: &mut Vec<T>)

Push self into the target container.

impl<T> Same for T

type Output = T

Should always be Self

impl<T> ToOwned for T
where T: Clone,

type Owned = T

The resulting type after obtaining ownership.

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more

impl<T> ToString for T
where T: Display + ?Sized,

default fn to_string(&self) -> String

Converts the given value to a String. Read more

impl<T, U> TryFrom<U> for T
where U: Into<T>,

type Error = Infallible

The type returned in the event of a conversion error.

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

fn vzip(self) -> V

impl<T> WithSubscriber for T

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more

impl<T> Data for T
where T: Clone + 'static,