Struct tower::load::peak_ewma::PeakEwma

pub struct PeakEwma<S, C = CompleteOnResponse> { /* private fields */ }

Measures the load of the underlying service using Peak-EWMA load measurement.

PeakEwma implements Load with the Cost metric that estimates the amount of pending work to an endpoint. Work is calculated by multiplying the exponentially-weighted moving average (EWMA) of response latencies by the number of pending requests. The Peak-EWMA algorithm is designed to be especially sensitive to worst-case latencies. Over time, the peak latency value decays towards the moving average of latencies to the endpoint.

When no latency information has been measured for an endpoint, an arbitrary default RTT of 1 second is used to prevent the endpoint from being overloaded before a meaningful baseline can be established..

Note

This is derived from Finagle, which is distributed under the Apache V2 license. Copyright 2017, Twitter Inc.

Implementations

impl<S, C> PeakEwma<S, C>

pub fn new( service: S, default_rtt: Duration, decay_ns: f64, completion: C, ) -> Self

Wraps an S-typed service so that its load is tracked by the EWMA of its peak latency.

Trait Implementations

impl<S: Debug, C: Debug> Debug for PeakEwma<S, C>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<S, C> Load for PeakEwma<S, C>

type Metric = Cost

A comparable load metric.

fn load(&self) -> Self::Metric

Estimate the service’s current load.

impl<S, C, Request> Service<Request> for PeakEwma<S, C>

where S: Service<Request>, C: TrackCompletion<Handle, S::Response>,

type Response = <C as TrackCompletion<Handle, <S as Service<Request>>::Response>>::Output

Responses given by the service.

type Error = <S as Service<Request>>::Error

Errors produced by the service.

type Future = TrackCompletionFuture<<S as Service<Request>>::Future, C, Handle>

The future response value.

fn poll_ready(&mut self, cx: &mut Context<'_>) -> Poll<Result<(), Self::Error>>

Returns Poll::Ready(Ok(())) when the service is able to process requests.

fn call(&mut self, req: Request) -> Self::Future

Process the request and return the response asynchronously.