Struct ArrowFileReader 

pub struct ArrowFileReader { /* private fields */ }

ArrowFileReader is a wrapper around a FileRead that impls parquets AsyncFileReader.

Implementations

impl ArrowFileReader

pub fn new(meta: FileMetadata, r: Box<dyn FileRead>) -> Self

Create a new ArrowFileReader

Trait Implementations

impl AsyncFileReader for ArrowFileReader

fn get_byte_ranges( &mut self, ranges: Vec<Range<u64>>, ) -> BoxFuture<'_, Result<Vec<Bytes>>>

Override the default get_byte_ranges which calls get_bytes sequentially. The parquet reader calls this to fetch column chunks for a row group, so without this override each column chunk is a serial round-trip to object storage. Adapted from object_store’s coalesce_ranges in util.rs.

fn get_bytes(&mut self, range: Range<u64>) -> BoxFuture<'_, Result<Bytes>>

Retrieve the bytes in range

fn get_metadata( &mut self, _options: Option<&ArrowReaderOptions>, ) -> BoxFuture<'_, Result<Arc<ParquetMetaData>>>

Return a future which results in the ParquetMetaData for this Parquet file.