#[non_exhaustive]pub struct IcebergCompactionConfigurationBuilder { /* private fields */ }Expand description
A builder for IcebergCompactionConfiguration.
Implementations§
Source§impl IcebergCompactionConfigurationBuilder
impl IcebergCompactionConfigurationBuilder
Sourcepub fn strategy(self, input: CompactionStrategy) -> Self
pub fn strategy(self, input: CompactionStrategy) -> Self
The strategy to use for compaction. Valid values are:
-
binpack: Combines small files into larger files, typically targeting sizes over 100MB, while applying any pending deletes. This is the recommended compaction strategy for most use cases. -
sort: Organizes data based on specified columns which are sorted hierarchically during compaction, improving query performance for filtered operations. This strategy is recommended when your queries frequently filter on specific columns. To use this strategy, you must first define a sort order in your Iceberg table properties using thesort_ordertable property. -
z-order: Optimizes data organization by blending multiple attributes into a single scalar value that can be used for sorting, allowing efficient querying across multiple dimensions. This strategy is recommended when you need to query data across multiple dimensions simultaneously. To use this strategy, you must first define a sort order in your Iceberg table properties using thesort_ordertable property.
If an input is not provided, the default value 'binpack' will be used.
Sourcepub fn set_strategy(self, input: Option<CompactionStrategy>) -> Self
pub fn set_strategy(self, input: Option<CompactionStrategy>) -> Self
The strategy to use for compaction. Valid values are:
-
binpack: Combines small files into larger files, typically targeting sizes over 100MB, while applying any pending deletes. This is the recommended compaction strategy for most use cases. -
sort: Organizes data based on specified columns which are sorted hierarchically during compaction, improving query performance for filtered operations. This strategy is recommended when your queries frequently filter on specific columns. To use this strategy, you must first define a sort order in your Iceberg table properties using thesort_ordertable property. -
z-order: Optimizes data organization by blending multiple attributes into a single scalar value that can be used for sorting, allowing efficient querying across multiple dimensions. This strategy is recommended when you need to query data across multiple dimensions simultaneously. To use this strategy, you must first define a sort order in your Iceberg table properties using thesort_ordertable property.
If an input is not provided, the default value 'binpack' will be used.
Sourcepub fn get_strategy(&self) -> &Option<CompactionStrategy>
pub fn get_strategy(&self) -> &Option<CompactionStrategy>
The strategy to use for compaction. Valid values are:
-
binpack: Combines small files into larger files, typically targeting sizes over 100MB, while applying any pending deletes. This is the recommended compaction strategy for most use cases. -
sort: Organizes data based on specified columns which are sorted hierarchically during compaction, improving query performance for filtered operations. This strategy is recommended when your queries frequently filter on specific columns. To use this strategy, you must first define a sort order in your Iceberg table properties using thesort_ordertable property. -
z-order: Optimizes data organization by blending multiple attributes into a single scalar value that can be used for sorting, allowing efficient querying across multiple dimensions. This strategy is recommended when you need to query data across multiple dimensions simultaneously. To use this strategy, you must first define a sort order in your Iceberg table properties using thesort_ordertable property.
If an input is not provided, the default value 'binpack' will be used.
Sourcepub fn min_input_files(self, input: i32) -> Self
pub fn min_input_files(self, input: i32) -> Self
The minimum number of data files that must be present in a partition before compaction will actually compact files. This parameter helps control when compaction is triggered, preventing unnecessary compaction operations on partitions with few files. If an input is not provided, the default value 100 will be used.
Sourcepub fn set_min_input_files(self, input: Option<i32>) -> Self
pub fn set_min_input_files(self, input: Option<i32>) -> Self
The minimum number of data files that must be present in a partition before compaction will actually compact files. This parameter helps control when compaction is triggered, preventing unnecessary compaction operations on partitions with few files. If an input is not provided, the default value 100 will be used.
Sourcepub fn get_min_input_files(&self) -> &Option<i32>
pub fn get_min_input_files(&self) -> &Option<i32>
The minimum number of data files that must be present in a partition before compaction will actually compact files. This parameter helps control when compaction is triggered, preventing unnecessary compaction operations on partitions with few files. If an input is not provided, the default value 100 will be used.
Sourcepub fn delete_file_threshold(self, input: i32) -> Self
pub fn delete_file_threshold(self, input: i32) -> Self
The minimum number of deletes that must be present in a data file to make it eligible for compaction. This parameter helps optimize compaction by focusing on files that contain a significant number of delete operations, which can improve query performance by removing deleted records. If an input is not provided, the default value 1 will be used.
Sourcepub fn set_delete_file_threshold(self, input: Option<i32>) -> Self
pub fn set_delete_file_threshold(self, input: Option<i32>) -> Self
The minimum number of deletes that must be present in a data file to make it eligible for compaction. This parameter helps optimize compaction by focusing on files that contain a significant number of delete operations, which can improve query performance by removing deleted records. If an input is not provided, the default value 1 will be used.
Sourcepub fn get_delete_file_threshold(&self) -> &Option<i32>
pub fn get_delete_file_threshold(&self) -> &Option<i32>
The minimum number of deletes that must be present in a data file to make it eligible for compaction. This parameter helps optimize compaction by focusing on files that contain a significant number of delete operations, which can improve query performance by removing deleted records. If an input is not provided, the default value 1 will be used.
Sourcepub fn build(self) -> IcebergCompactionConfiguration
pub fn build(self) -> IcebergCompactionConfiguration
Consumes the builder and constructs a IcebergCompactionConfiguration.
Trait Implementations§
Source§impl Clone for IcebergCompactionConfigurationBuilder
impl Clone for IcebergCompactionConfigurationBuilder
Source§fn clone(&self) -> IcebergCompactionConfigurationBuilder
fn clone(&self) -> IcebergCompactionConfigurationBuilder
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
source. Read moreSource§impl Default for IcebergCompactionConfigurationBuilder
impl Default for IcebergCompactionConfigurationBuilder
Source§fn default() -> IcebergCompactionConfigurationBuilder
fn default() -> IcebergCompactionConfigurationBuilder
Source§impl PartialEq for IcebergCompactionConfigurationBuilder
impl PartialEq for IcebergCompactionConfigurationBuilder
Source§fn eq(&self, other: &IcebergCompactionConfigurationBuilder) -> bool
fn eq(&self, other: &IcebergCompactionConfigurationBuilder) -> bool
self and other values to be equal, and is used by ==.impl StructuralPartialEq for IcebergCompactionConfigurationBuilder
Auto Trait Implementations§
impl Freeze for IcebergCompactionConfigurationBuilder
impl RefUnwindSafe for IcebergCompactionConfigurationBuilder
impl Send for IcebergCompactionConfigurationBuilder
impl Sync for IcebergCompactionConfigurationBuilder
impl Unpin for IcebergCompactionConfigurationBuilder
impl UnsafeUnpin for IcebergCompactionConfigurationBuilder
impl UnwindSafe for IcebergCompactionConfigurationBuilder
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more