Struct parquet::format::DataPageHeaderV2

pub struct DataPageHeaderV2 {
    pub num_values: i32,
    pub num_nulls: i32,
    pub num_rows: i32,
    pub encoding: Encoding,
    pub definition_levels_byte_length: i32,
    pub repetition_levels_byte_length: i32,
    pub is_compressed: Option<bool>,
    pub statistics: Option<Statistics>,
}

New page format allowing reading levels without decompressing the data Repetition and definition levels are uncompressed The remaining section containing the data is compressed if is_compressed is true

Fields

num_values: i32

Number of values, including NULLs, in this data page. *

num_nulls: i32

Number of NULL values, in this data page. Number of non-null = num_values - num_nulls which is also the number of values in the data section *

num_rows: i32

Number of rows in this data page. Every page must begin at a row boundary (repetition_level = 0): rows must not be split across page boundaries when using V2 data pages.

encoding: Encoding

Encoding used for data in this page *

definition_levels_byte_length: i32

Length of the definition levels

repetition_levels_byte_length: i32

Length of the repetition levels

is_compressed: Option<bool>

Whether the values are compressed. Which means the section of the page between definition_levels_byte_length + repetition_levels_byte_length + 1 and compressed_page_size (included) is compressed with the compression_codec. If missing it is considered compressed

statistics: Option<Statistics>

Optional statistics for the data in this page *

Implementations

impl DataPageHeaderV2

pub fn new<F7, F8>( num_values: i32, num_nulls: i32, num_rows: i32, encoding: Encoding, definition_levels_byte_length: i32, repetition_levels_byte_length: i32, is_compressed: F7, statistics: F8, ) -> DataPageHeaderV2

where F7: Into<Option<bool>>, F8: Into<Option<Statistics>>,

Trait Implementations

impl Clone for DataPageHeaderV2

fn clone(&self) -> DataPageHeaderV2

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for DataPageHeaderV2

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Hash for DataPageHeaderV2

fn hash<__H: Hasher>(&self, state: &mut __H)

Feeds this value into the given Hasher.

fn hash_slice<H>(data: &[Self], state: &mut H)

where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher.

impl Ord for DataPageHeaderV2

fn cmp(&self, other: &DataPageHeaderV2) -> Ordering

This method returns an Ordering between self and other.

fn max(self, other: Self) -> Self

where Self: Sized,

Compares and returns the maximum of two values.

fn min(self, other: Self) -> Self

where Self: Sized,

Compares and returns the minimum of two values.

fn clamp(self, min: Self, max: Self) -> Self

where Self: Sized + PartialOrd,

Restrict a value to a certain interval.

impl PartialEq for DataPageHeaderV2

fn eq(&self, other: &DataPageHeaderV2) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl PartialOrd for DataPageHeaderV2

fn partial_cmp(&self, other: &DataPageHeaderV2) -> Option<Ordering>

This method returns an ordering between self and other values if one exists.

fn lt(&self, other: &Rhs) -> bool

Tests less than (for self and other) and is used by the < operator.

fn le(&self, other: &Rhs) -> bool

Tests less than or equal to (for self and other) and is used by the <= operator.

fn gt(&self, other: &Rhs) -> bool

Tests greater than (for self and other) and is used by the > operator.

fn ge(&self, other: &Rhs) -> bool

Tests greater than or equal to (for self and other) and is used by the >= operator.

impl TSerializable for DataPageHeaderV2

fn read_from_in_protocol<T: TInputProtocol>( i_prot: &mut T, ) -> Result<DataPageHeaderV2>

Reads the struct from the input Thrift protocol

fn write_to_out_protocol<T: TOutputProtocol>( &self, o_prot: &mut T, ) -> Result<()>

Writes the struct to the output Thrift protocol

impl Eq for DataPageHeaderV2

impl StructuralPartialEq for DataPageHeaderV2