mz_storage_operators::s3_oneshot_sink

Module parquet

Source

Structs§

  • Helper to tie the lifecycle of the ArrowBuilder, ArrowWriter, and S3MultiPartUploader together for a single parquet file.
  • A ParquetUploader that writes rows to parquet files and uploads them to S3.

Constants§

  • Set the default buffer capacity for the string and binary array builders inside the ArrowBuilder. This is the number of bytes each builder can hold before it needs to allocate more memory.
  • Set the default capacity for the array builders inside the ArrowBuilder. This is the number of items each builder can hold before it needs to allocate more memory.