Struct S3GlueParquetTarget 

#[non_exhaustive]
pub struct S3GlueParquetTarget {
    pub name: String,
    pub inputs: Vec<String>,
    pub partition_keys: Option<Vec<Vec<String>>>,
    pub path: String,
    pub compression: Option<ParquetCompressionType>,
    pub number_target_partitions: Option<String>,
    pub schema_change_policy: Option<DirectSchemaChangePolicy>,
    pub auto_data_quality: Option<AutoDataQuality>,
}

Specifies a data target that writes to Amazon S3 in Apache Parquet columnar storage.

Fields (Non-exhaustive)

Non-exhaustive structs could have additional fields added in future. Therefore, non-exhaustive structs cannot be constructed in external crates using the traditional Struct { .. } syntax; cannot be matched against without a wildcard ..; and struct update syntax will not work.

name: String

The name of the data target.

inputs: Vec<String>

The nodes that are inputs to the data target.

partition_keys: Option<Vec<Vec<String>>>

Specifies native partitioning using a sequence of keys.

path: String

A single Amazon S3 path to write to.

compression: Option<ParquetCompressionType>

Specifies how the data is compressed. This is generally not necessary if the data has a standard file extension. Possible values are "gzip" and "bzip").

number_target_partitions: Option<String>

Specifies the number of target partitions for Parquet files when writing to Amazon S3 using Glue.

schema_change_policy: Option<DirectSchemaChangePolicy>

A policy that specifies update behavior for the crawler.

auto_data_quality: Option<AutoDataQuality>

Specifies whether to automatically enable data quality evaluation for the S3 Glue Parquet target. When set to true, data quality checks are performed automatically during the write operation.

Implementations

impl S3GlueParquetTarget

pub fn name(&self) -> &str

The name of the data target.

pub fn inputs(&self) -> &[String]

The nodes that are inputs to the data target.

pub fn partition_keys(&self) -> &[Vec<String>]

Specifies native partitioning using a sequence of keys.

If no value was sent for this field, a default will be set. If you want to determine if no value was sent, use .partition_keys.is_none().

pub fn path(&self) -> &str

A single Amazon S3 path to write to.

pub fn compression(&self) -> Option<&ParquetCompressionType>

Specifies how the data is compressed. This is generally not necessary if the data has a standard file extension. Possible values are "gzip" and "bzip").

pub fn number_target_partitions(&self) -> Option<&str>

Specifies the number of target partitions for Parquet files when writing to Amazon S3 using Glue.

pub fn schema_change_policy(&self) -> Option<&DirectSchemaChangePolicy>

A policy that specifies update behavior for the crawler.

pub fn auto_data_quality(&self) -> Option<&AutoDataQuality>

Specifies whether to automatically enable data quality evaluation for the S3 Glue Parquet target. When set to true, data quality checks are performed automatically during the write operation.

impl S3GlueParquetTarget

pub fn builder() -> S3GlueParquetTargetBuilder

Creates a new builder-style object to manufacture S3GlueParquetTarget.

Trait Implementations

impl Clone for S3GlueParquetTarget

fn clone(&self) -> S3GlueParquetTarget

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for S3GlueParquetTarget

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for S3GlueParquetTarget

fn eq(&self, other: &S3GlueParquetTarget) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for S3GlueParquetTarget