Struct IntegrationPartitionBuilder 

#[non_exhaustive]
pub struct IntegrationPartitionBuilder { /* private fields */ }

A builder for IntegrationPartition.

Implementations

impl IntegrationPartitionBuilder

pub fn field_name(self, input: impl Into<String>) -> Self

The field name used to partition data on the target. Avoid using columns that have unique values for each row (for example, `LastModifiedTimestamp`, `SystemModTimeStamp`) as the partition column. These columns are not suitable for partitioning because they create a large number of small partitions, which can lead to performance issues.

pub fn set_field_name(self, input: Option<String>) -> Self

The field name used to partition data on the target. Avoid using columns that have unique values for each row (for example, `LastModifiedTimestamp`, `SystemModTimeStamp`) as the partition column. These columns are not suitable for partitioning because they create a large number of small partitions, which can lead to performance issues.

pub fn get_field_name(&self) -> &Option<String>

The field name used to partition data on the target. Avoid using columns that have unique values for each row (for example, `LastModifiedTimestamp`, `SystemModTimeStamp`) as the partition column. These columns are not suitable for partitioning because they create a large number of small partitions, which can lead to performance issues.

pub fn function_spec(self, input: impl Into<String>) -> Self

Specifies the function used to partition data on the target. The accepted values for this parameter are:

• identity - Uses source values directly without transformation

• year - Extracts the year from timestamp values (e.g., 2023)

• month - Extracts the month from timestamp values (e.g., 2023-01)

• day - Extracts the day from timestamp values (e.g., 2023-01-15)

• hour - Extracts the hour from timestamp values (e.g., 2023-01-15-14)

pub fn set_function_spec(self, input: Option<String>) -> Self

Specifies the function used to partition data on the target. The accepted values for this parameter are:

• identity - Uses source values directly without transformation

• year - Extracts the year from timestamp values (e.g., 2023)

• month - Extracts the month from timestamp values (e.g., 2023-01)

• day - Extracts the day from timestamp values (e.g., 2023-01-15)

• hour - Extracts the hour from timestamp values (e.g., 2023-01-15-14)

pub fn get_function_spec(&self) -> &Option<String>

Specifies the function used to partition data on the target. The accepted values for this parameter are:

• identity - Uses source values directly without transformation

• year - Extracts the year from timestamp values (e.g., 2023)

• month - Extracts the month from timestamp values (e.g., 2023-01)

• day - Extracts the day from timestamp values (e.g., 2023-01-15)

• hour - Extracts the hour from timestamp values (e.g., 2023-01-15-14)

pub fn conversion_spec(self, input: impl Into<String>) -> Self

Specifies the timestamp format of the source data. Valid values are:

• epoch_sec - Unix epoch timestamp in seconds

• epoch_milli - Unix epoch timestamp in milliseconds

• iso - ISO 8601 formatted timestamp

Only specify ConversionSpec when using timestamp-based partition functions (year, month, day, or hour). Glue Zero-ETL uses this parameter to correctly transform source data into timestamp format before partitioning.

Do not use high-cardinality columns with the identity partition function. High-cardinality columns include:

• Primary keys

• Timestamp fields (such as LastModifiedTimestamp, CreatedDate)

• System-generated timestamps

Using high-cardinality columns with identity partitioning creates many small partitions, which can significantly degrade ingestion performance.

pub fn set_conversion_spec(self, input: Option<String>) -> Self

Specifies the timestamp format of the source data. Valid values are:

• epoch_sec - Unix epoch timestamp in seconds

• epoch_milli - Unix epoch timestamp in milliseconds

• iso - ISO 8601 formatted timestamp

Only specify ConversionSpec when using timestamp-based partition functions (year, month, day, or hour). Glue Zero-ETL uses this parameter to correctly transform source data into timestamp format before partitioning.

Do not use high-cardinality columns with the identity partition function. High-cardinality columns include:

• Primary keys

• Timestamp fields (such as LastModifiedTimestamp, CreatedDate)

• System-generated timestamps

Using high-cardinality columns with identity partitioning creates many small partitions, which can significantly degrade ingestion performance.

pub fn get_conversion_spec(&self) -> &Option<String>

Specifies the timestamp format of the source data. Valid values are:

• epoch_sec - Unix epoch timestamp in seconds

• epoch_milli - Unix epoch timestamp in milliseconds

• iso - ISO 8601 formatted timestamp

Only specify ConversionSpec when using timestamp-based partition functions (year, month, day, or hour). Glue Zero-ETL uses this parameter to correctly transform source data into timestamp format before partitioning.

Do not use high-cardinality columns with the identity partition function. High-cardinality columns include:

• Primary keys

• Timestamp fields (such as LastModifiedTimestamp, CreatedDate)

• System-generated timestamps

Using high-cardinality columns with identity partitioning creates many small partitions, which can significantly degrade ingestion performance.

pub fn build(self) -> IntegrationPartition

Consumes the builder and constructs a IntegrationPartition.

Trait Implementations

impl Clone for IntegrationPartitionBuilder

fn clone(&self) -> IntegrationPartitionBuilder

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for IntegrationPartitionBuilder

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for IntegrationPartitionBuilder

fn default() -> IntegrationPartitionBuilder

Returns the “default value” for a type.

impl PartialEq for IntegrationPartitionBuilder

fn eq(&self, other: &IntegrationPartitionBuilder) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for IntegrationPartitionBuilder