Skip to main content

Module sinks

Module sinks 

Source
Expand description

Types and traits related to reporting changing collections out of dataflow.

Modules§

s3_oneshot_sink

Structs§

IcebergSinkConnection
KafkaSinkConnection
KafkaSinkFormat
S3UploadInfo
Info required to copy the data to s3.
StorageSinkDesc
A sink for updates to a relational collection.

Enums§

KafkaIdStyle
KafkaSinkCompressionType
KafkaSinkFormatType
S3SinkFormat
SinkEnvelope
StorageSinkConnection

Constants§

ICEBERG_APPEND_DIFF_COLUMN
Column name appended by MODE APPEND Iceberg sinks to record the diff (+1/−1).
ICEBERG_APPEND_TIMESTAMP_COLUMN
Column name appended by MODE APPEND Iceberg sinks to record the logical timestamp.
ICEBERG_UINT64_DECIMAL_PRECISION
The precision needed to store all UInt64 values in a Decimal128. UInt64 max value is 18,446,744,073,709,551,615 which has 20 digits.
MAX_S3_SINK_FILE_SIZE
MIN_S3_SINK_FILE_SIZE

Functions§

iceberg_type_overrides
Type overrides for Iceberg-compatible Arrow schemas.