Struct S3HudiDirectTarget 

#[non_exhaustive]
pub struct S3HudiDirectTarget {
    pub name: String,
    pub inputs: Vec<String>,
    pub path: String,
    pub compression: HudiTargetCompressionType,
    pub number_target_partitions: Option<String>,
    pub partition_keys: Option<Vec<Vec<String>>>,
    pub format: TargetFormat,
    pub additional_options: HashMap<String, String>,
    pub schema_change_policy: Option<DirectSchemaChangePolicy>,
    pub auto_data_quality: Option<AutoDataQuality>,
}

Specifies a target that writes to a Hudi data source in Amazon S3.

Fields (Non-exhaustive)

Non-exhaustive structs could have additional fields added in future. Therefore, non-exhaustive structs cannot be constructed in external crates using the traditional Struct { .. } syntax; cannot be matched against without a wildcard ..; and struct update syntax will not work.

name: String

The name of the data target.

inputs: Vec<String>

The nodes that are inputs to the data target.

path: String

The Amazon S3 path of your Hudi data source to write to.

compression: HudiTargetCompressionType

Specifies how the data is compressed. This is generally not necessary if the data has a standard file extension. Possible values are "gzip" and "bzip").

number_target_partitions: Option<String>

Specifies the number of target partitions for distributing Hudi dataset files across Amazon S3.

partition_keys: Option<Vec<Vec<String>>>

Specifies native partitioning using a sequence of keys.

format: TargetFormat

Specifies the data output format for the target.

additional_options: HashMap<String, String>

Specifies additional connection options for the connector.

schema_change_policy: Option<DirectSchemaChangePolicy>

A policy that specifies update behavior for the crawler.

auto_data_quality: Option<AutoDataQuality>

Specifies whether to automatically enable data quality evaluation for the S3 Hudi direct target. When set to true, data quality checks are performed automatically during the write operation.

Implementations

impl S3HudiDirectTarget

pub fn name(&self) -> &str

The name of the data target.

pub fn inputs(&self) -> &[String]

The nodes that are inputs to the data target.

pub fn path(&self) -> &str

The Amazon S3 path of your Hudi data source to write to.

pub fn compression(&self) -> &HudiTargetCompressionType

Specifies how the data is compressed. This is generally not necessary if the data has a standard file extension. Possible values are "gzip" and "bzip").

pub fn number_target_partitions(&self) -> Option<&str>

Specifies the number of target partitions for distributing Hudi dataset files across Amazon S3.

pub fn partition_keys(&self) -> &[Vec<String>]

Specifies native partitioning using a sequence of keys.

If no value was sent for this field, a default will be set. If you want to determine if no value was sent, use .partition_keys.is_none().

pub fn format(&self) -> &TargetFormat

Specifies the data output format for the target.

pub fn additional_options(&self) -> &HashMap<String, String>

Specifies additional connection options for the connector.

pub fn schema_change_policy(&self) -> Option<&DirectSchemaChangePolicy>

A policy that specifies update behavior for the crawler.

pub fn auto_data_quality(&self) -> Option<&AutoDataQuality>

Specifies whether to automatically enable data quality evaluation for the S3 Hudi direct target. When set to true, data quality checks are performed automatically during the write operation.

impl S3HudiDirectTarget

pub fn builder() -> S3HudiDirectTargetBuilder

Creates a new builder-style object to manufacture S3HudiDirectTarget.

Trait Implementations

impl Clone for S3HudiDirectTarget

fn clone(&self) -> S3HudiDirectTarget

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for S3HudiDirectTarget

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for S3HudiDirectTarget

fn eq(&self, other: &S3HudiDirectTarget) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for S3HudiDirectTarget