Struct IntegrationPartition 

#[non_exhaustive]
pub struct IntegrationPartition {
    pub field_name: Option<String>,
    pub function_spec: Option<String>,
    pub conversion_spec: Option<String>,
}

A structure that describes how data is partitioned on the target.

Fields (Non-exhaustive)

Non-exhaustive structs could have additional fields added in future. Therefore, non-exhaustive structs cannot be constructed in external crates using the traditional Struct { .. } syntax; cannot be matched against without a wildcard ..; and struct update syntax will not work.

field_name: Option<String>

The field name used to partition data on the target. Avoid using columns that have unique values for each row (for example, `LastModifiedTimestamp`, `SystemModTimeStamp`) as the partition column. These columns are not suitable for partitioning because they create a large number of small partitions, which can lead to performance issues.

function_spec: Option<String>

Specifies the function used to partition data on the target. The accepted values for this parameter are:

• identity - Uses source values directly without transformation

• year - Extracts the year from timestamp values (e.g., 2023)

• month - Extracts the month from timestamp values (e.g., 2023-01)

• day - Extracts the day from timestamp values (e.g., 2023-01-15)

• hour - Extracts the hour from timestamp values (e.g., 2023-01-15-14)

conversion_spec: Option<String>

Specifies the timestamp format of the source data. Valid values are:

• epoch_sec - Unix epoch timestamp in seconds

• epoch_milli - Unix epoch timestamp in milliseconds

• iso - ISO 8601 formatted timestamp

Only specify ConversionSpec when using timestamp-based partition functions (year, month, day, or hour). Glue Zero-ETL uses this parameter to correctly transform source data into timestamp format before partitioning.

Do not use high-cardinality columns with the identity partition function. High-cardinality columns include:

• Primary keys

• Timestamp fields (such as LastModifiedTimestamp, CreatedDate)

• System-generated timestamps

Using high-cardinality columns with identity partitioning creates many small partitions, which can significantly degrade ingestion performance.

Implementations

impl IntegrationPartition

pub fn field_name(&self) -> Option<&str>

The field name used to partition data on the target. Avoid using columns that have unique values for each row (for example, `LastModifiedTimestamp`, `SystemModTimeStamp`) as the partition column. These columns are not suitable for partitioning because they create a large number of small partitions, which can lead to performance issues.

pub fn function_spec(&self) -> Option<&str>

Specifies the function used to partition data on the target. The accepted values for this parameter are:

• identity - Uses source values directly without transformation

• year - Extracts the year from timestamp values (e.g., 2023)

• month - Extracts the month from timestamp values (e.g., 2023-01)

• day - Extracts the day from timestamp values (e.g., 2023-01-15)

• hour - Extracts the hour from timestamp values (e.g., 2023-01-15-14)

pub fn conversion_spec(&self) -> Option<&str>

Specifies the timestamp format of the source data. Valid values are:

• epoch_sec - Unix epoch timestamp in seconds

• epoch_milli - Unix epoch timestamp in milliseconds

• iso - ISO 8601 formatted timestamp

Only specify ConversionSpec when using timestamp-based partition functions (year, month, day, or hour). Glue Zero-ETL uses this parameter to correctly transform source data into timestamp format before partitioning.

Do not use high-cardinality columns with the identity partition function. High-cardinality columns include:

• Primary keys

• Timestamp fields (such as LastModifiedTimestamp, CreatedDate)

• System-generated timestamps

Using high-cardinality columns with identity partitioning creates many small partitions, which can significantly degrade ingestion performance.

impl IntegrationPartition

pub fn builder() -> IntegrationPartitionBuilder

Creates a new builder-style object to manufacture IntegrationPartition.

Trait Implementations

impl Clone for IntegrationPartition

fn clone(&self) -> IntegrationPartition

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for IntegrationPartition

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for IntegrationPartition

fn eq(&self, other: &IntegrationPartition) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for IntegrationPartition