Struct mz_compute_types::plan::AvailableCollections
source · pub struct AvailableCollections {
pub raw: bool,
pub arranged: Vec<(Vec<MirScalarExpr>, BTreeMap<usize, usize>, Vec<usize>)>,
pub types: Option<Vec<ColumnType>>,
}
Expand description
The forms in which an operator’s output is available;
it can be considered the plan-time equivalent of
render::context::CollectionBundle
.
These forms are either “raw”, representing an unarranged collection, or “arranged”, representing one that has been arranged by some key.
The raw collection, if it exists, may be consumed directly.
The arranged collections are slightly more complicated:
Each key here is attached to a description of how the corresponding
arrangement is permuted to remove value columns
that are redundant with key columns. Thus, the first element in each
tuple of arranged
is the arrangement key; the second is the map of
logical output columns to columns in the key or value of the deduplicated
representation, and the third is a “thinning expression”,
or list of columns to include in the value
when arranging.
For example, assume a 5-column collection is to be arranged by the key
[Column(2), Column(0) + Column(3), Column(1)]
.
Then Column(1)
and Column(2)
in the value are redundant with the key, and
only columns 0, 3, and 4 need to be stored separately.
The thinning expression will then be [0, 3, 4]
.
The permutation represents how to recover the
original values (logically [Column(0), Column(1), Column(2), Column(3), Column(4)]
)
from the key and value of the arrangement, logically
[Column(2), Column(0) + Column(3), Column(1), Column(0), Column(3), Column(4)]
.
Thus, the permutation in this case should be {0: 3, 1: 2, 2: 0, 3: 4, 4: 5}
.
Note that this description, while true at the time of writing, is merely illustrative;
users of this struct should not rely on the exact strategy used for generating
the permutations. As long as clients apply the thinning expression
when creating arrangements, and permute by the hashmap when reading them,
the contract of the function where they are generated (mz_expr::permutation_for_arrangement
)
ensures that the correct values will be read.
Fields§
§raw: bool
Whether the collection exists in unarranged form.
arranged: Vec<(Vec<MirScalarExpr>, BTreeMap<usize, usize>, Vec<usize>)>
The set of arrangements of the collection, along with a column permutation mapping
types: Option<Vec<ColumnType>>
The types of the columns in the raw form of the collection, if known. We only capture types when necessary to support arrangement specialization, so this only done for specific LIR operators during lowering.
Implementations§
source§impl AvailableCollections
impl AvailableCollections
sourcepub fn new_arranged(
arranged: Vec<(Vec<MirScalarExpr>, BTreeMap<usize, usize>, Vec<usize>)>,
types: Option<Vec<ColumnType>>,
) -> Self
pub fn new_arranged( arranged: Vec<(Vec<MirScalarExpr>, BTreeMap<usize, usize>, Vec<usize>)>, types: Option<Vec<ColumnType>>, ) -> Self
Represent a collection that is arranged in the specified ways, with optionally given types describing the rows that would be in the raw form of the collection.
sourcepub fn arbitrary_arrangement(
&self,
) -> Option<&(Vec<MirScalarExpr>, BTreeMap<usize, usize>, Vec<usize>)>
pub fn arbitrary_arrangement( &self, ) -> Option<&(Vec<MirScalarExpr>, BTreeMap<usize, usize>, Vec<usize>)>
Get some arrangement, if one exists.
Trait Implementations§
source§impl Arbitrary for AvailableCollections
impl Arbitrary for AvailableCollections
§type Parameters = (<bool as Arbitrary>::Parameters, <Option<Vec<ColumnType>> as Arbitrary>::Parameters)
type Parameters = (<bool as Arbitrary>::Parameters, <Option<Vec<ColumnType>> as Arbitrary>::Parameters)
arbitrary_with
accepts for configuration
of the generated Strategy
. Parameters must implement Default
.§type Strategy = Map<(<bool as Arbitrary>::Strategy, BoxedStrategy<Vec<(Vec<MirScalarExpr>, BTreeMap<usize, usize>, Vec<usize>)>>, <Option<Vec<ColumnType>> as Arbitrary>::Strategy), fn(_: (bool, Vec<(Vec<MirScalarExpr>, BTreeMap<usize, usize>, Vec<usize>)>, Option<Vec<ColumnType>>)) -> AvailableCollections>
type Strategy = Map<(<bool as Arbitrary>::Strategy, BoxedStrategy<Vec<(Vec<MirScalarExpr>, BTreeMap<usize, usize>, Vec<usize>)>>, <Option<Vec<ColumnType>> as Arbitrary>::Strategy), fn(_: (bool, Vec<(Vec<MirScalarExpr>, BTreeMap<usize, usize>, Vec<usize>)>, Option<Vec<ColumnType>>)) -> AvailableCollections>
Strategy
used to generate values of type Self
.source§fn arbitrary_with(_top: Self::Parameters) -> Self::Strategy
fn arbitrary_with(_top: Self::Parameters) -> Self::Strategy
source§impl Clone for AvailableCollections
impl Clone for AvailableCollections
source§fn clone(&self) -> AvailableCollections
fn clone(&self) -> AvailableCollections
1.0.0 · source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
source
. Read moresource§impl Debug for AvailableCollections
impl Debug for AvailableCollections
source§impl Default for AvailableCollections
impl Default for AvailableCollections
source§fn default() -> AvailableCollections
fn default() -> AvailableCollections
source§impl<'de> Deserialize<'de> for AvailableCollections
impl<'de> Deserialize<'de> for AvailableCollections
source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
source§impl DisplayText<PlanRenderingContext<'_, Plan>> for AvailableCollections
impl DisplayText<PlanRenderingContext<'_, Plan>> for AvailableCollections
source§impl Ord for AvailableCollections
impl Ord for AvailableCollections
source§fn cmp(&self, other: &AvailableCollections) -> Ordering
fn cmp(&self, other: &AvailableCollections) -> Ordering
1.21.0 · source§fn max(self, other: Self) -> Selfwhere
Self: Sized,
fn max(self, other: Self) -> Selfwhere
Self: Sized,
source§impl PartialEq for AvailableCollections
impl PartialEq for AvailableCollections
source§impl PartialOrd for AvailableCollections
impl PartialOrd for AvailableCollections
source§impl RustType<ProtoAvailableCollections> for AvailableCollections
impl RustType<ProtoAvailableCollections> for AvailableCollections
source§fn into_proto(&self) -> ProtoAvailableCollections
fn into_proto(&self) -> ProtoAvailableCollections
Self
into a Proto
value.source§fn from_proto(x: ProtoAvailableCollections) -> Result<Self, TryFromProtoError>
fn from_proto(x: ProtoAvailableCollections) -> Result<Self, TryFromProtoError>
source§fn into_proto_owned(self) -> Proto
fn into_proto_owned(self) -> Proto
Self::into_proto
that types can
optionally implement, otherwise, the default implementation
delegates to Self::into_proto
.source§impl Serialize for AvailableCollections
impl Serialize for AvailableCollections
impl Eq for AvailableCollections
impl StructuralPartialEq for AvailableCollections
Auto Trait Implementations§
impl Freeze for AvailableCollections
impl RefUnwindSafe for AvailableCollections
impl Send for AvailableCollections
impl Sync for AvailableCollections
impl Unpin for AvailableCollections
impl UnwindSafe for AvailableCollections
Blanket Implementations§
source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
source§default unsafe fn clone_to_uninit(&self, dst: *mut T)
default unsafe fn clone_to_uninit(&self, dst: *mut T)
clone_to_uninit
)source§impl<Q, K> Comparable<K> for Q
impl<Q, K> Comparable<K> for Q
source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
key
and return true
if they are equal.source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
key
and return true
if they are equal.source§impl<T> FmtForward for T
impl<T> FmtForward for T
source§fn fmt_binary(self) -> FmtBinary<Self>where
Self: Binary,
fn fmt_binary(self) -> FmtBinary<Self>where
Self: Binary,
self
to use its Binary
implementation when Debug
-formatted.source§fn fmt_display(self) -> FmtDisplay<Self>where
Self: Display,
fn fmt_display(self) -> FmtDisplay<Self>where
Self: Display,
self
to use its Display
implementation when
Debug
-formatted.source§fn fmt_lower_exp(self) -> FmtLowerExp<Self>where
Self: LowerExp,
fn fmt_lower_exp(self) -> FmtLowerExp<Self>where
Self: LowerExp,
self
to use its LowerExp
implementation when
Debug
-formatted.source§fn fmt_lower_hex(self) -> FmtLowerHex<Self>where
Self: LowerHex,
fn fmt_lower_hex(self) -> FmtLowerHex<Self>where
Self: LowerHex,
self
to use its LowerHex
implementation when
Debug
-formatted.source§fn fmt_octal(self) -> FmtOctal<Self>where
Self: Octal,
fn fmt_octal(self) -> FmtOctal<Self>where
Self: Octal,
self
to use its Octal
implementation when Debug
-formatted.source§fn fmt_pointer(self) -> FmtPointer<Self>where
Self: Pointer,
fn fmt_pointer(self) -> FmtPointer<Self>where
Self: Pointer,
self
to use its Pointer
implementation when
Debug
-formatted.source§fn fmt_upper_exp(self) -> FmtUpperExp<Self>where
Self: UpperExp,
fn fmt_upper_exp(self) -> FmtUpperExp<Self>where
Self: UpperExp,
self
to use its UpperExp
implementation when
Debug
-formatted.source§fn fmt_upper_hex(self) -> FmtUpperHex<Self>where
Self: UpperHex,
fn fmt_upper_hex(self) -> FmtUpperHex<Self>where
Self: UpperHex,
self
to use its UpperHex
implementation when
Debug
-formatted.source§impl<T> FutureExt for T
impl<T> FutureExt for T
source§fn with_context(self, otel_cx: Context) -> WithContext<Self>
fn with_context(self, otel_cx: Context) -> WithContext<Self>
source§fn with_current_context(self) -> WithContext<Self>
fn with_current_context(self) -> WithContext<Self>
source§impl<T> Instrument for T
impl<T> Instrument for T
source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
source§impl<T> IntoRequest<T> for T
impl<T> IntoRequest<T> for T
source§fn into_request(self) -> Request<T>
fn into_request(self) -> Request<T>
T
in a tonic::Request
source§impl<T, U> OverrideFrom<Option<&T>> for Uwhere
U: OverrideFrom<T>,
impl<T, U> OverrideFrom<Option<&T>> for Uwhere
U: OverrideFrom<T>,
source§impl<T> Pipe for Twhere
T: ?Sized,
impl<T> Pipe for Twhere
T: ?Sized,
source§fn pipe<R>(self, func: impl FnOnce(Self) -> R) -> Rwhere
Self: Sized,
fn pipe<R>(self, func: impl FnOnce(Self) -> R) -> Rwhere
Self: Sized,
source§fn pipe_ref<'a, R>(&'a self, func: impl FnOnce(&'a Self) -> R) -> Rwhere
R: 'a,
fn pipe_ref<'a, R>(&'a self, func: impl FnOnce(&'a Self) -> R) -> Rwhere
R: 'a,
self
and passes that borrow into the pipe function. Read moresource§fn pipe_ref_mut<'a, R>(&'a mut self, func: impl FnOnce(&'a mut Self) -> R) -> Rwhere
R: 'a,
fn pipe_ref_mut<'a, R>(&'a mut self, func: impl FnOnce(&'a mut Self) -> R) -> Rwhere
R: 'a,
self
and passes that borrow into the pipe function. Read moresource§fn pipe_borrow<'a, B, R>(&'a self, func: impl FnOnce(&'a B) -> R) -> R
fn pipe_borrow<'a, B, R>(&'a self, func: impl FnOnce(&'a B) -> R) -> R
source§fn pipe_borrow_mut<'a, B, R>(
&'a mut self,
func: impl FnOnce(&'a mut B) -> R,
) -> R
fn pipe_borrow_mut<'a, B, R>( &'a mut self, func: impl FnOnce(&'a mut B) -> R, ) -> R
source§fn pipe_as_ref<'a, U, R>(&'a self, func: impl FnOnce(&'a U) -> R) -> R
fn pipe_as_ref<'a, U, R>(&'a self, func: impl FnOnce(&'a U) -> R) -> R
self
, then passes self.as_ref()
into the pipe function.source§fn pipe_as_mut<'a, U, R>(&'a mut self, func: impl FnOnce(&'a mut U) -> R) -> R
fn pipe_as_mut<'a, U, R>(&'a mut self, func: impl FnOnce(&'a mut U) -> R) -> R
self
, then passes self.as_mut()
into the pipe
function.source§fn pipe_deref<'a, T, R>(&'a self, func: impl FnOnce(&'a T) -> R) -> R
fn pipe_deref<'a, T, R>(&'a self, func: impl FnOnce(&'a T) -> R) -> R
self
, then passes self.deref()
into the pipe function.source§impl<T> Pointable for T
impl<T> Pointable for T
source§impl<T> PreferredContainer for T
impl<T> PreferredContainer for T
source§impl<T> ProgressEventTimestamp for T
impl<T> ProgressEventTimestamp for T
source§impl<P, R> ProtoType<R> for Pwhere
R: RustType<P>,
impl<P, R> ProtoType<R> for Pwhere
R: RustType<P>,
source§fn into_rust(self) -> Result<R, TryFromProtoError>
fn into_rust(self) -> Result<R, TryFromProtoError>
RustType::from_proto
.source§fn from_rust(rust: &R) -> P
fn from_rust(rust: &R) -> P
RustType::into_proto
.source§impl<'a, S, T> Semigroup<&'a S> for Twhere
T: Semigroup<S>,
impl<'a, S, T> Semigroup<&'a S> for Twhere
T: Semigroup<S>,
source§fn plus_equals(&mut self, rhs: &&'a S)
fn plus_equals(&mut self, rhs: &&'a S)
std::ops::AddAssign
, for types that do not implement AddAssign
.source§impl<T> Tap for T
impl<T> Tap for T
source§fn tap_borrow<B>(self, func: impl FnOnce(&B)) -> Self
fn tap_borrow<B>(self, func: impl FnOnce(&B)) -> Self
Borrow<B>
of a value. Read moresource§fn tap_borrow_mut<B>(self, func: impl FnOnce(&mut B)) -> Self
fn tap_borrow_mut<B>(self, func: impl FnOnce(&mut B)) -> Self
BorrowMut<B>
of a value. Read moresource§fn tap_ref<R>(self, func: impl FnOnce(&R)) -> Self
fn tap_ref<R>(self, func: impl FnOnce(&R)) -> Self
AsRef<R>
view of a value. Read moresource§fn tap_ref_mut<R>(self, func: impl FnOnce(&mut R)) -> Self
fn tap_ref_mut<R>(self, func: impl FnOnce(&mut R)) -> Self
AsMut<R>
view of a value. Read moresource§fn tap_deref<T>(self, func: impl FnOnce(&T)) -> Self
fn tap_deref<T>(self, func: impl FnOnce(&T)) -> Self
Deref::Target
of a value. Read moresource§fn tap_deref_mut<T>(self, func: impl FnOnce(&mut T)) -> Self
fn tap_deref_mut<T>(self, func: impl FnOnce(&mut T)) -> Self
Deref::Target
of a value. Read moresource§fn tap_dbg(self, func: impl FnOnce(&Self)) -> Self
fn tap_dbg(self, func: impl FnOnce(&Self)) -> Self
.tap()
only in debug builds, and is erased in release builds.source§fn tap_mut_dbg(self, func: impl FnOnce(&mut Self)) -> Self
fn tap_mut_dbg(self, func: impl FnOnce(&mut Self)) -> Self
.tap_mut()
only in debug builds, and is erased in release
builds.source§fn tap_borrow_dbg<B>(self, func: impl FnOnce(&B)) -> Self
fn tap_borrow_dbg<B>(self, func: impl FnOnce(&B)) -> Self
.tap_borrow()
only in debug builds, and is erased in release
builds.source§fn tap_borrow_mut_dbg<B>(self, func: impl FnOnce(&mut B)) -> Self
fn tap_borrow_mut_dbg<B>(self, func: impl FnOnce(&mut B)) -> Self
.tap_borrow_mut()
only in debug builds, and is erased in release
builds.source§fn tap_ref_dbg<R>(self, func: impl FnOnce(&R)) -> Self
fn tap_ref_dbg<R>(self, func: impl FnOnce(&R)) -> Self
.tap_ref()
only in debug builds, and is erased in release
builds.source§fn tap_ref_mut_dbg<R>(self, func: impl FnOnce(&mut R)) -> Self
fn tap_ref_mut_dbg<R>(self, func: impl FnOnce(&mut R)) -> Self
.tap_ref_mut()
only in debug builds, and is erased in release
builds.source§fn tap_deref_dbg<T>(self, func: impl FnOnce(&T)) -> Self
fn tap_deref_dbg<T>(self, func: impl FnOnce(&T)) -> Self
.tap_deref()
only in debug builds, and is erased in release
builds.