#[non_exhaustive]pub struct DataQualityGlueTable {
pub database_name: String,
pub table_name: String,
pub catalog_id: Option<String>,
pub connection_name: Option<String>,
pub additional_options: Option<HashMap<String, String>>,
pub pre_processing_query: Option<String>,
}Expand description
The database and table in the Glue Data Catalog that is used for input or output data for Data Quality Operations.
Fields (Non-exhaustive)§
This struct is marked as non-exhaustive
Struct { .. } syntax; cannot be matched against without a wildcard ..; and struct update syntax will not work.database_name: StringA database name in the Glue Data Catalog.
table_name: StringA table name in the Glue Data Catalog.
catalog_id: Option<String>A unique identifier for the Glue Data Catalog.
connection_name: Option<String>The name of the connection to the Glue Data Catalog.
additional_options: Option<HashMap<String, String>>Additional options for the table. Currently there are two keys supported:
-
pushDownPredicate: to filter on partitions without having to list and read all the files in your dataset. -
catalogPartitionPredicate: to use server-side partition pruning using partition indexes in the Glue Data Catalog.
pre_processing_query: Option<String>SQL Query of SparkSQL format that can be used to pre-process the data for the table in Glue Data Catalog, before running the Data Quality Operation.
Implementations§
Source§impl DataQualityGlueTable
impl DataQualityGlueTable
Sourcepub fn database_name(&self) -> &str
pub fn database_name(&self) -> &str
A database name in the Glue Data Catalog.
Sourcepub fn table_name(&self) -> &str
pub fn table_name(&self) -> &str
A table name in the Glue Data Catalog.
Sourcepub fn catalog_id(&self) -> Option<&str>
pub fn catalog_id(&self) -> Option<&str>
A unique identifier for the Glue Data Catalog.
Sourcepub fn connection_name(&self) -> Option<&str>
pub fn connection_name(&self) -> Option<&str>
The name of the connection to the Glue Data Catalog.
Sourcepub fn additional_options(&self) -> Option<&HashMap<String, String>>
pub fn additional_options(&self) -> Option<&HashMap<String, String>>
Additional options for the table. Currently there are two keys supported:
-
pushDownPredicate: to filter on partitions without having to list and read all the files in your dataset. -
catalogPartitionPredicate: to use server-side partition pruning using partition indexes in the Glue Data Catalog.
Sourcepub fn pre_processing_query(&self) -> Option<&str>
pub fn pre_processing_query(&self) -> Option<&str>
SQL Query of SparkSQL format that can be used to pre-process the data for the table in Glue Data Catalog, before running the Data Quality Operation.
Source§impl DataQualityGlueTable
impl DataQualityGlueTable
Sourcepub fn builder() -> DataQualityGlueTableBuilder
pub fn builder() -> DataQualityGlueTableBuilder
Creates a new builder-style object to manufacture DataQualityGlueTable.
Trait Implementations§
Source§impl Clone for DataQualityGlueTable
impl Clone for DataQualityGlueTable
Source§fn clone(&self) -> DataQualityGlueTable
fn clone(&self) -> DataQualityGlueTable
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
source. Read moreSource§impl Debug for DataQualityGlueTable
impl Debug for DataQualityGlueTable
Source§impl PartialEq for DataQualityGlueTable
impl PartialEq for DataQualityGlueTable
Source§fn eq(&self, other: &DataQualityGlueTable) -> bool
fn eq(&self, other: &DataQualityGlueTable) -> bool
self and other values to be equal, and is used by ==.impl StructuralPartialEq for DataQualityGlueTable
Auto Trait Implementations§
impl Freeze for DataQualityGlueTable
impl RefUnwindSafe for DataQualityGlueTable
impl Send for DataQualityGlueTable
impl Sync for DataQualityGlueTable
impl Unpin for DataQualityGlueTable
impl UnsafeUnpin for DataQualityGlueTable
impl UnwindSafe for DataQualityGlueTable
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more