Struct dataflow::source::FileSourceReader [−][src]
pub struct FileSourceReader {
id: SourceInstanceId,
receiver_stream: Receiver<Result<MessagePayload, Error>>,
current_file_offset: FileOffset,
}
Expand description
Contains all information necessary to ingest data from file sources
Fields
id: SourceInstanceId
Unique source ID
receiver_stream: Receiver<Result<MessagePayload, Error>>
Receiver channel that ingests records
current_file_offset: FileOffset
Current File Offset. This corresponds to the offset of last processed message (initially 0 if no records have been processed)
Trait Implementations
type Value = MessagePayload
fn new(
_name: String,
source_id: SourceInstanceId,
worker_id: usize,
_worker_count: usize,
consumer_activator: SyncActivator,
connector: ExternalSourceConnector,
_restored_offsets: Vec<(PartitionId, Option<MzOffset>)>,
encoding: SourceDataEncoding,
_: Option<Logger>,
_: SourceBaseMetrics
) -> Result<(FileSourceReader, Option<PartitionId>), Error>
fn new(
_name: String,
source_id: SourceInstanceId,
worker_id: usize,
_worker_count: usize,
consumer_activator: SyncActivator,
connector: ExternalSourceConnector,
_restored_offsets: Vec<(PartitionId, Option<MzOffset>)>,
encoding: SourceDataEncoding,
_: Option<Logger>,
_: SourceBaseMetrics
) -> Result<(FileSourceReader, Option<PartitionId>), Error>
Create a new source reader. Read more
Returns the next message available from the source. Read more
Auto Trait Implementations
impl !RefUnwindSafe for FileSourceReader
impl Send for FileSourceReader
impl !Sync for FileSourceReader
impl Unpin for FileSourceReader
impl !UnwindSafe for FileSourceReader
Blanket Implementations
Mutably borrows from an owned value. Read more
Attaches the provided Subscriber
to this type, returning a
WithDispatch
wrapper. Read more
Attaches the current default Subscriber
to this type, returning a
WithDispatch
wrapper. Read more