Module arrow

Source
Expand description

Apache Arrow encodings and utils for persist data

ConstantsΒ§

ENABLE_ARROW_LGALLOC_CC_SIZES πŸ”’
ENABLE_ARROW_LGALLOC_NONCC_SIZES πŸ”’

FunctionsΒ§

decode_arrow_batch
Converts an arrow RecordBatch into a BlobTraceUpdates and reallocate the backing data.
encode_arrow_batch
Converts a ColumnarRecords into arrow columns.
realloc_any
Re-allocate the backing storage for an array ref using lgalloc, if it’s configured. (And hopefully-temporarily work around a parquet decoding issue upstream.)
realloc_array
Re-allocate the backing storage for a specific array using lgalloc, if it’s configured. (And hopefully-temporarily work around a parquet decoding issue upstream.)
realloc_buffer πŸ”’
realloc_data πŸ”’