Module mz_storage_operators::s3_oneshot_sink::parquet
source ยท Structsยง
- Parquet
File ๐Helper to tie the lifecycle of theArrowBuilder
,ArrowWriter
, andS3MultiPartUploader
together for a single parquet file. - Parquet
Uploader ๐AParquetUploader
that writes rows to parquet files and uploads them to S3.
Constantsยง
- Set the default buffer capacity for the string and binary array builders inside the ArrowBuilder. This is the number of bytes each builder can hold before it needs to allocate more memory.
- Set the default capacity for the array builders inside the ArrowBuilder. This is the number of items each builder can hold before it needs to allocate more memory.