Module compute

Source
Expand description

Logging dataflows for events generated by clusterd.

StructsΒ§

ArrangementHeapAllocations
A change in an arrangement’s heap allocation count.
ArrangementHeapAllocationsContainer
Derived columnar container for a struct.
ArrangementHeapAllocationsReference
Derived columnar reference for a struct.
ArrangementHeapCapacity
A change in an arrangement’s heap capacity.
ArrangementHeapCapacityContainer
Derived columnar container for a struct.
ArrangementHeapCapacityReference
Derived columnar reference for a struct.
ArrangementHeapDatum πŸ”’
ArrangementHeapSize
A change in an arrangement’s heap size.
ArrangementHeapSizeContainer
Derived columnar container for a struct.
ArrangementHeapSizeOperator
Announcing an operator that manages an arrangement.
ArrangementHeapSizeOperatorContainer
Derived columnar container for a struct.
ArrangementHeapSizeOperatorDrop
Drop event for an operator managing an arrangement.
ArrangementHeapSizeOperatorDropContainer
Derived columnar container for a struct.
ArrangementHeapSizeOperatorDropReference
Derived columnar reference for a struct.
ArrangementHeapSizeOperatorReference
Derived columnar reference for a struct.
ArrangementHeapSizeReference
Derived columnar reference for a struct.
ArrangementSizeState πŸ”’
State for tracking arrangement sizes.
CollectionLogging
Logging state maintained for a compute collection.
ComputeEventContainer
Derived columnar container for an enum.
DataflowGlobal
Announce that a dataflow supports a specific global ID.
DataflowGlobalContainer
Derived columnar container for a struct.
DataflowGlobalDatum πŸ”’
DataflowGlobalReference
Derived columnar reference for a struct.
DataflowShutdown
Dataflow shutdown event.
DataflowShutdownContainer
Derived columnar container for a struct.
DataflowShutdownReference
Derived columnar reference for a struct.
DemuxHandler πŸ”’
Event handler of the demux operator.
DemuxOutput πŸ”’
Bundled output sessions used by the demux operator.
DemuxState πŸ”’
State maintained by the demux operator.
ErrorCount
Error count update event.
ErrorCountContainer
Derived columnar container for a struct.
ErrorCountDatum πŸ”’
ErrorCountReference
Derived columnar reference for a struct.
Export
A dataflow exports a global ID.
ExportContainer
Derived columnar container for a struct.
ExportDatum πŸ”’
ExportDropped
The export for a global id was dropped.
ExportDroppedContainer
Derived columnar container for a struct.
ExportDroppedReference
Derived columnar reference for a struct.
ExportReference
Derived columnar reference for a struct.
ExportState πŸ”’
State tracked for each dataflow export.
Frontier
Frontier change event.
FrontierContainer
Derived columnar container for a struct.
FrontierDatum πŸ”’
FrontierReference
Derived columnar reference for a struct.
Hydration
An export is hydrated.
HydrationContainer
Derived columnar container for a struct.
HydrationReference
Derived columnar reference for a struct.
HydrationTimeDatum πŸ”’
ImportFrontier
An import frontier change.
ImportFrontierContainer
Derived columnar container for a struct.
ImportFrontierDatum πŸ”’
ImportFrontierReference
Derived columnar reference for a struct.
LirMapping
Announce a mapping of an LIR operator to a dataflow operator for a global ID.
LirMappingContainer
Derived columnar container for a struct.
LirMappingDatum πŸ”’
LirMappingDatumContainer πŸ”’
Derived columnar container for a struct.
LirMappingDatumReference πŸ”’
Derived columnar reference for a struct.
LirMappingReference
Derived columnar reference for a struct.
LirMetadata
Metadata for LIR operators.
LirMetadataContainer
Derived columnar container for a struct.
LirMetadataReference
Derived columnar reference for a struct.
Peek
A logged peek event.
PeekContainer
Derived columnar container for a struct.
PeekDatum πŸ”’
PeekDurationDatum πŸ”’
PeekEvent
A peek event with a Peek, a PeekType, and an installation status.
PeekEventContainer
Derived columnar container for a struct.
PeekEventReference
Derived columnar reference for a struct.
PeekReference
Derived columnar reference for a struct.
PeekTypeContainer
Derived columnar container for all-unit enum.
Return πŸ”’
The return type of the construct function.

EnumsΒ§

ComputeEvent
A logged compute event.
ComputeEventReference
Reference for an enum.
PeekType
A peek type distinguishing between index and persist peeks.

TraitsΒ§

LogDataflowErrors πŸ”’
Extension trait to attach ComputeEvent::DataflowError logging operators to collections and batch streams.

FunctionsΒ§

construct πŸ”’
Constructs the logging dataflow fragment for compute logs.
make_string_datum πŸ”’
Format the given value and pack it into a Datum::String.
sum_batch_diffs πŸ”’
Return the sum of all diffs within the given batch.

Type AliasesΒ§

ComputeEventBuilder
Logger
Type alias for a logger of compute events.