Module compute

Logging dataflows for events generated by clusterd.

Structs

ArrangementHeapAllocations

A change in an arrangement’s heap allocation count.

ArrangementHeapAllocationsContainer

Derived columnar container for a struct.

ArrangementHeapAllocationsReference

Derived columnar reference for a struct.

ArrangementHeapCapacity

A change in an arrangement’s heap capacity.

ArrangementHeapCapacityContainer

Derived columnar container for a struct.

ArrangementHeapCapacityReference

Derived columnar reference for a struct.

ArrangementHeapSize

A change in an arrangement’s heap size.

ArrangementHeapSizeContainer

Derived columnar container for a struct.

ArrangementHeapSizeOperator

Announcing an operator that manages an arrangement.

ArrangementHeapSizeOperatorContainer

Derived columnar container for a struct.

ArrangementHeapSizeOperatorDrop

Drop event for an operator managing an arrangement.

ArrangementHeapSizeOperatorDropContainer

Derived columnar container for a struct.

ArrangementHeapSizeOperatorDropReference

Derived columnar reference for a struct.

ArrangementHeapSizeOperatorReference

Derived columnar reference for a struct.

ArrangementHeapSizeReference

Derived columnar reference for a struct.

ArrangementSizeState 🔒

State for tracking arrangement sizes.

CollectionLogging

Logging state maintained for a compute collection.

ComputeEventContainer

Derived columnar container for an enum.

DataflowGlobal

Announce that a dataflow supports a specific global ID.

DataflowGlobalContainer

Derived columnar container for a struct.

DataflowGlobalReference

Derived columnar reference for a struct.

DataflowShutdown

Dataflow shutdown event.

DataflowShutdownContainer

Derived columnar container for a struct.

DataflowShutdownReference

Derived columnar reference for a struct.

DemuxHandler 🔒

Event handler of the demux operator.

DemuxOutput 🔒

Bundled output sessions used by the demux operator.

DemuxState 🔒

State maintained by the demux operator.

ErrorCount

Error count update event.

ErrorCountContainer

Derived columnar container for a struct.

ErrorCountReference

Derived columnar reference for a struct.

Export

A dataflow exports a global ID.

ExportContainer

Derived columnar container for a struct.

ExportDropped

The export for a global id was dropped.

ExportDroppedContainer

Derived columnar container for a struct.

ExportDroppedReference

Derived columnar reference for a struct.

ExportReference

Derived columnar reference for a struct.

ExportState 🔒

State tracked for each dataflow export.

Frontier

Frontier change event.

FrontierContainer

Derived columnar container for a struct.

FrontierReference

Derived columnar reference for a struct.

Hydration

An export is hydrated.

HydrationContainer

Derived columnar container for a struct.

HydrationReference

Derived columnar reference for a struct.

ImportFrontier

An import frontier change.

ImportFrontierContainer

Derived columnar container for a struct.

ImportFrontierReference

Derived columnar reference for a struct.

LirMapping

Announce a mapping of an LIR operator to a dataflow operator for a global ID.

LirMappingContainer

Derived columnar container for a struct.

LirMappingReference

Derived columnar reference for a struct.

LirMetadata

Metadata for LIR operators.

LirMetadataContainer

Derived columnar container for a struct.

LirMetadataReference

Derived columnar reference for a struct.

OperatorHydration

An operator’s hydration status changed.

OperatorHydrationContainer

Derived columnar container for a struct.

OperatorHydrationReference

Derived columnar reference for a struct.

PeekEvent

A peek event with a PeekType, and an installation status.

PeekEventContainer

Derived columnar container for a struct.

PeekEventReference

Derived columnar reference for a struct.

PeekTypeContainer

Derived columnar container for all-unit enum.

Return 🔒

The return type of the construct function.

Enums

ComputeEvent

A logged compute event.

ComputeEventReference

Reference for an enum.

PeekType

A peek type distinguishing between index and persist peeks.

Traits

LogDataflowErrors 🔒

Extension trait to attach ComputeEvent::DataflowError logging operators to collections and batch streams.

Functions

construct 🔒

Constructs the logging dataflow fragment for compute logs.

make_string_datum 🔒

Format the given value and pack it into a Datum::String.

sum_batch_diffs 🔒

Return the sum of all diffs within the given batch.

Type Aliases

ComputeEventBuilder

Logger

Type alias for a logger of compute events.