Struct DataGenerator

pub struct DataGenerator {
    pub record_count: usize,
    pub record_size_bytes: usize,
    pub batch_max_count: usize,
    key_buf: Vec<u8>,
    val_buf: Vec<u8>,
}

A configurable data generator for benchmarking.

Fields

record_count: usize

The total number of records to produce.

record_size_bytes: usize

The number of “goodput” bytes to make each record.

batch_max_count: usize

The maximum number of records included in a generated batch of records.

key_buf: Vec<u8>

val_buf: Vec<u8>

Implementations

impl DataGenerator

pub fn new( record_count: usize, record_size_bytes: usize, batch_max_count: usize, ) -> Self

Returns a new DataGenerator.

pub fn small() -> Self

Returns a new DataGenerator specifically for testing small data volumes.

pub fn goodput_bytes(&self) -> u64

Returns the number of “goodput” bytes represented by the entire dataset produced by this generator.

pub fn goodput_pretty(&self) -> String

Returns a more easily human readable version of Self::goodput_bytes.

pub fn gen_batch(&mut self, batch_idx: usize) -> Option<ColumnarRecords>

Generates the requested batch of records.

fn gen_record(&mut self, record_idx: usize) -> ((&[u8], &[u8]), u64, i64)

pub fn batches(&self) -> DataGeneratorBatchIter

Returns an Iterator of all records in batches.

pub fn records(&self) -> impl Iterator<Item = ((Vec<u8>, Vec<u8>), u64, i64)>

Returns an Iterator of all records.

Trait Implementations

impl Clone for DataGenerator

fn clone(&self) -> DataGenerator

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for DataGenerator

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for DataGenerator

fn default() -> Self

Returns the “default value” for a type.