Module mz_storage_operators::s3_oneshot_sink::parquet

source ยท

Structsยง

  • ParquetFile ๐Ÿ”’
    Helper to tie the lifecycle of the ArrowBuilder, ArrowWriter, and S3MultiPartUploader together for a single parquet file.
  • ParquetUploader ๐Ÿ”’
    A ParquetUploader that writes rows to parquet files and uploads them to S3.

Constantsยง

  • Set the default buffer capacity for the string and binary array builders inside the ArrowBuilder. This is the number of bytes each builder can hold before it needs to allocate more memory.
  • Set the default capacity for the array builders inside the ArrowBuilder. This is the number of items each builder can hold before it needs to allocate more memory.