Search code examples
openshiftistioenvoyproxyistio-sidecar

Can istio exclude POD from the load balancing by latency?

I have two services (A and B for example) that communicate with each other via GRPC and work in an OpenShift cluster. I want to exclude sick pods from balancing by response time. For example, if the response time of service B is set to more than 250 ms, I want to redirect traffic to other pods of service B.

With the help of DestinationRule, I was able to exclude from balancing the pods that return errors (outlier detection) but that's not exactly what I need. I want to maintain a low latency of responses for the client.

Solution

  • This is currently not possible with Envoy. There's an existing Github issue that tracks the work to support latency outlier detection.