Module arrow_reader

Expand description

Contains reader which reads parquet data into arrow RecordBatch

Modules§

metrics: ArrowReaderMetrics for collecting metrics about the Arrow reader
statistics: StatisticsConverter to convert statistics in parquet format to arrow ArrayRef.

ArrowPredicateFn: An ArrowPredicate created from an FnMut and a ProjectionMask
ArrowReaderBuilder: Builder for constructing Parquet readers that decode into Apache Arrow arrays.
ArrowReaderMetadata: The metadata necessary to construct a ArrowReaderBuilder
ArrowReaderOptions: Options that control how ParquetMetaData is read when constructing an Arrow reader.
ParquetRecordBatchReader: Reads Parquet data as Arrow RecordBatches
ReadPlan: A plan reading specific rows from a Parquet Row Group.
ReadPlanBuilder: A builder for ReadPlan
RowFilter: Filter applied during the parquet read process
RowSelection: RowSelection allows selecting or skipping a provided number of rows when scanning the parquet file.
RowSelector: RowSelection is a collection of RowSelector used to skip rows when scanning a parquet file

RowSelectionCursor: Cursor for iterating a RowSelection during execution within a ReadPlan.
RowSelectionPolicy: Policy for picking a strategy to materialise RowSelection during execution.

ArrowPredicate: A predicate operating on RecordBatch
RowGroups: Interface for reading data pages from the columns of one or more RowGroups.

ParquetRecordBatchReaderBuilder: Creates ParquetRecordBatchReader for reading Parquet files into Arrow RecordBatches