Module parquet

Structs

ParquetFile 🔒

Helper to tie the lifecycle of the ArrowBuilder, ArrowWriter, and S3MultiPartUploader together for a single parquet file.

ParquetUploader 🔒

A ParquetUploader that writes rows to parquet files and uploads them to S3.

Constants

DEFAULT_ARRAY_BUILDER_DATA_CAPACITY 🔒

Set the default buffer capacity for the string and binary array builders inside the ArrowBuilder. This is the number of bytes each builder can hold before it needs to allocate more memory.

DEFAULT_ARRAY_BUILDER_ITEM_CAPACITY 🔒

Set the default capacity for the array builders inside the ArrowBuilder. This is the number of items each builder can hold before it needs to allocate more memory.