Module kafka_util

Provides parsing and convenience functions for working with Kafka from the sql package.

Structs

KafkaSinkConfigOptionExtracted

KafkaSourceConfigOptionExtracted

Functions

ensure_topic_exists

Validates that we can connect to the broker and obtain metadata about the topic.

fetch_end_offset 🔒

lookup_start_offsets

Returns start offsets for the partitions of topic and the provided START TIMESTAMP option.

validate_start_offsets

Validates that the provided start offsets are valid for the specified topic. At present, the validation is merely that there are not more start offsets than parts in the topic.