Struct mz_persist::indexed::columnar::ColumnarRecordsBuilder

pub struct ColumnarRecordsBuilder {
    len: usize,
    key_data: BinaryBuilder,
    val_data: BinaryBuilder,
    timestamps: Vec<i64>,
    diffs: Vec<i64>,
}

An abstraction to incrementally add ((Key, Value), Time, i64) records in a columnar representation, and eventually get back a ColumnarRecords.

Fields

len: usize

key_data: BinaryBuilder

val_data: BinaryBuilder

timestamps: Vec<i64>

diffs: Vec<i64>

Implementations

impl ColumnarRecordsBuilder

pub fn with_capacity(items: usize, key_bytes: usize, val_bytes: usize) -> Self

Reserve space for the given number of items with the given sizes in bytes. If they end up being too small, the underlying buffers will be resized as usual.

pub fn len(&self) -> usize

The number of (potentially duplicated) ((Key, Val), Time, i64) records stored in Self.

pub fn can_fit(&self, key: &[u8], val: &[u8], limit: usize) -> bool

Returns if the given key_offsets+key_data or val_offsets+val_data fits in the limits imposed by ColumnarRecords.

Note that limit is always KEY_VAL_DATA_MAX_LEN in production. It’s only override-able here for testing.

pub fn total_bytes(&self) -> usize

The current size of the columnar records data, useful for bounding batches at a target size.

pub fn push(&mut self, record: ((&[u8], &[u8]), [u8; 8], [u8; 8])) -> bool

Add a record to Self.

Returns whether the record was successfully added. A record will not a added if it exceeds the size limitations of ColumnarBatch. This method is atomic, if it fails, no partial data will have been added.

pub fn finish(self, _metrics: &ColumnarMetrics) -> ColumnarRecords

Finalize constructing a ColumnarRecords.

pub fn columnar_record_size( key_bytes_len: usize, value_bytes_len: usize, ) -> usize

Size of an update record as stored in the columnar representation

Trait Implementations

impl Debug for ColumnarRecordsBuilder

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for ColumnarRecordsBuilder

fn default() -> Self

Returns the “default value” for a type.