Struct S3DeltaDirectTarget 

#[non_exhaustive]
pub struct S3DeltaDirectTarget {
    pub name: String,
    pub inputs: Vec<String>,
    pub partition_keys: Option<Vec<Vec<String>>>,
    pub path: String,
    pub compression: DeltaTargetCompressionType,
    pub number_target_partitions: Option<String>,
    pub format: TargetFormat,
    pub additional_options: Option<HashMap<String, String>>,
    pub schema_change_policy: Option<DirectSchemaChangePolicy>,
    pub auto_data_quality: Option<AutoDataQuality>,
}

Specifies a target that writes to a Delta Lake data source in Amazon S3.

Fields (Non-exhaustive)

Non-exhaustive structs could have additional fields added in future. Therefore, non-exhaustive structs cannot be constructed in external crates using the traditional Struct { .. } syntax; cannot be matched against without a wildcard ..; and struct update syntax will not work.

name: String

The name of the data target.

inputs: Vec<String>

The nodes that are inputs to the data target.

partition_keys: Option<Vec<Vec<String>>>

Specifies native partitioning using a sequence of keys.

path: String

The Amazon S3 path of your Delta Lake data source to write to.

compression: DeltaTargetCompressionType

Specifies how the data is compressed. This is generally not necessary if the data has a standard file extension. Possible values are "gzip" and "bzip").

number_target_partitions: Option<String>

Specifies the number of target partitions for distributing Delta Lake dataset files across Amazon S3.

format: TargetFormat

Specifies the data output format for the target.

additional_options: Option<HashMap<String, String>>

Specifies additional connection options for the connector.

schema_change_policy: Option<DirectSchemaChangePolicy>

A policy that specifies update behavior for the crawler.

auto_data_quality: Option<AutoDataQuality>

Specifies whether to automatically enable data quality evaluation for the S3 Delta direct target. When set to true, data quality checks are performed automatically during the write operation.

Implementations

impl S3DeltaDirectTarget

pub fn name(&self) -> &str

The name of the data target.

pub fn inputs(&self) -> &[String]

The nodes that are inputs to the data target.

pub fn partition_keys(&self) -> &[Vec<String>]

Specifies native partitioning using a sequence of keys.

If no value was sent for this field, a default will be set. If you want to determine if no value was sent, use .partition_keys.is_none().

pub fn path(&self) -> &str

The Amazon S3 path of your Delta Lake data source to write to.

pub fn compression(&self) -> &DeltaTargetCompressionType

Specifies how the data is compressed. This is generally not necessary if the data has a standard file extension. Possible values are "gzip" and "bzip").

pub fn number_target_partitions(&self) -> Option<&str>

Specifies the number of target partitions for distributing Delta Lake dataset files across Amazon S3.

pub fn format(&self) -> &TargetFormat

Specifies the data output format for the target.

pub fn additional_options(&self) -> Option<&HashMap<String, String>>

Specifies additional connection options for the connector.

pub fn schema_change_policy(&self) -> Option<&DirectSchemaChangePolicy>

A policy that specifies update behavior for the crawler.

pub fn auto_data_quality(&self) -> Option<&AutoDataQuality>

Specifies whether to automatically enable data quality evaluation for the S3 Delta direct target. When set to true, data quality checks are performed automatically during the write operation.

impl S3DeltaDirectTarget

pub fn builder() -> S3DeltaDirectTargetBuilder

Creates a new builder-style object to manufacture S3DeltaDirectTarget.

Trait Implementations

impl Clone for S3DeltaDirectTarget

fn clone(&self) -> S3DeltaDirectTarget

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for S3DeltaDirectTarget

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for S3DeltaDirectTarget

fn eq(&self, other: &S3DeltaDirectTarget) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for S3DeltaDirectTarget