Struct dataflow::source::kafka::PartitionConsumer

struct PartitionConsumer {
    pid: i32,
    partition_queue: PartitionQueue<GlueConsumerContext>,
}

Wrapper around a partition containing the underlying consumer

Fields

pid: i32

the partition id with which this consumer is associated

partition_queue: PartitionQueue<GlueConsumerContext>

The underlying Kafka partition queue

Implementations

impl PartitionConsumer

fn new(pid: i32, partition_queue: PartitionQueue<GlueConsumerContext>) -> Self

Creates a new partition consumer from underlying Kafka consumer

fn get_next_message(
    &mut self
) -> Result<Option<SourceMessage<Option<Vec<u8>>, Option<Vec<u8>>>>, KafkaError>

Returns the next message to process for this partition (if any).

fn pid(&self) -> i32

Return the partition id for this PartitionConsumer