Module compute

Logging dataflows for events generated by clusterd.

Structs

• ArrangementHeapAllocations
  A change in an arrangement’s heap allocation count.
• ArrangementHeapAllocationsContainer
  Derived columnar container for a struct.
• ArrangementHeapAllocationsReference
  Derived columnar reference for a struct.
• ArrangementHeapCapacity
  A change in an arrangement’s heap capacity.
• ArrangementHeapCapacityContainer
  Derived columnar container for a struct.
• ArrangementHeapCapacityReference
  Derived columnar reference for a struct.
• ArrangementHeapDatum 🔒
• ArrangementHeapSize
  A change in an arrangement’s heap size.
• ArrangementHeapSizeContainer
  Derived columnar container for a struct.
• ArrangementHeapSizeOperator
  Announcing an operator that manages an arrangement.
• ArrangementHeapSizeOperatorContainer
  Derived columnar container for a struct.
• ArrangementHeapSizeOperatorDrop
  Drop event for an operator managing an arrangement.
• ArrangementHeapSizeOperatorDropContainer
  Derived columnar container for a struct.
• ArrangementHeapSizeOperatorDropReference
  Derived columnar reference for a struct.
• ArrangementHeapSizeOperatorReference
  Derived columnar reference for a struct.
• ArrangementHeapSizeReference
  Derived columnar reference for a struct.
• ArrangementSizeState 🔒
  State for tracking arrangement sizes.
• CollectionLogging
  Logging state maintained for a compute collection.
• ComputeEventContainer
  Derived columnar container for an enum.
• DataflowGlobal
  Announce that a dataflow supports a specific global ID.
• DataflowGlobalContainer
  Derived columnar container for a struct.
• DataflowGlobalDatum 🔒
• DataflowGlobalReference
  Derived columnar reference for a struct.
• DataflowShutdown
  Dataflow shutdown event.
• DataflowShutdownContainer
  Derived columnar container for a struct.
• DataflowShutdownReference
  Derived columnar reference for a struct.
• DemuxHandler 🔒
  Event handler of the demux operator.
• DemuxOutput 🔒
  Bundled output sessions used by the demux operator.
• DemuxState 🔒
  State maintained by the demux operator.
• ErrorCount
  Error count update event.
• ErrorCountContainer
  Derived columnar container for a struct.
• ErrorCountDatum 🔒
• ErrorCountReference
  Derived columnar reference for a struct.
• Export
  A dataflow exports a global ID.
• ExportContainer
  Derived columnar container for a struct.
• ExportDatum 🔒
• ExportDropped
  The export for a global id was dropped.
• ExportDroppedContainer
  Derived columnar container for a struct.
• ExportDroppedReference
  Derived columnar reference for a struct.
• ExportReference
  Derived columnar reference for a struct.
• ExportState 🔒
  State tracked for each dataflow export.
• Frontier
  Frontier change event.
• FrontierContainer
  Derived columnar container for a struct.
• FrontierDatum 🔒
• FrontierReference
  Derived columnar reference for a struct.
• Hydration
  An export is hydrated.
• HydrationContainer
  Derived columnar container for a struct.
• HydrationReference
  Derived columnar reference for a struct.
• HydrationTimeDatum 🔒
• ImportFrontier
  An import frontier change.
• ImportFrontierContainer
  Derived columnar container for a struct.
• ImportFrontierDatum 🔒
• ImportFrontierReference
  Derived columnar reference for a struct.
• LirMapping
  Announce a mapping of an LIR operator to a dataflow operator for a global ID.
• LirMappingContainer
  Derived columnar container for a struct.
• LirMappingDatum 🔒
• LirMappingDatumContainer 🔒
  Derived columnar container for a struct.
• LirMappingDatumReference 🔒
  Derived columnar reference for a struct.
• LirMappingReference
  Derived columnar reference for a struct.
• LirMetadata
  Metadata for LIR operators.
• LirMetadataContainer
  Derived columnar container for a struct.
• LirMetadataReference
  Derived columnar reference for a struct.
• Peek
  A logged peek event.
• PeekContainer
  Derived columnar container for a struct.
• PeekDatum 🔒
• PeekDurationDatum 🔒
• PeekEvent
  A peek event with a Peek, a PeekType, and an installation status.
• PeekEventContainer
  Derived columnar container for a struct.
• PeekEventReference
  Derived columnar reference for a struct.
• PeekReference
  Derived columnar reference for a struct.
• PeekTypeContainer
  Derived columnar container for all-unit enum.
• Return 🔒
  The return type of the construct function.

Enums

• ComputeEvent
  A logged compute event.
• ComputeEventReference
  Reference for an enum.
• PeekType
  A peek type distinguishing between index and persist peeks.

Traits

• LogDataflowErrors 🔒
  Extension trait to attach ComputeEvent::DataflowError logging operators to collections and batch streams.

Functions

• construct 🔒
  Constructs the logging dataflow fragment for compute logs.
• make_string_datum 🔒
  Format the given value and pack it into a Datum::String.
• sum_batch_diffs 🔒
  Return the sum of all diffs within the given batch.

Type Aliases

• ComputeEventBuilder
• Logger
  Type alias for a logger of compute events.