Istio 101 : - Loadbalancing, attempts and retries - DestinationRule, VirtualService - -


Istio provides loadbalancing for kubernetes.

It also supports retries for failing pods and circuit breaking to reject requests for pods with a "degraded" service.
It also provides it with "pool ejection", which stops pods and removes them as a destination for the loadbalancer.

Below is an example of kubernetes without Istio:


The below diagram shows kubernetes with Istio:


Some of the functions of the the proxy sidecar include:
  • packet forwarding.
  • routing.
  • caching.
  • loadbalancing.
Below is a basic "RANDOM" loadbalancing rules for our service:


We could use the VirtualService to implement a timeout for our service in case it fails, so the client application would just sit around waiting for a service that has failed:


We could use the retry feature of Istio to can make more attempts to try to connect to an unresponsive service.
Using a VirtualService, we could specify the "retry" parameter:


The above VirtualService make "5" attempts and has "10" seconds timeout after each "retry". 

Comments

Post a Comment

Popular posts from this blog

Istio 101 : How Istio ServiceEntry relates to Kubernetes Services and Endpoints

Image
Kubernetes "converts" its services and pods/endpoints into a ServiceEntry through Istio .   A service with two pods and two endpoints -  10.244.3.1, 10.244.3.2 -,  will be mapped to a ServiceEntry - host / IP address endpoint -. Endpoints  represent the IP addresses that a service sends its requests to. The "hosts" in the  ServiceEntry   Yaml file are associated with the service. A ServiceEntry adds newly added services to the service registry - database of existing services in Istio -, this allows existing services to be able to access these newly deployed ones. Below is an example of a service its endpoint and the resulting service entry : We have two nginx pods and the service entry that allows access through the host " service1.default.svc.cluster.local " to  the nginx applications.
Read more

Kubernetes 101 : - Scaling a Stateful set -

Image
The below diagram represents the scaling down of a  statefulset named  db1 : Before scaling down our statefulset , we check the pods and we see that there are three replicas: We can tell from the names of our pods that they are managed by a  statefulset is named  db1 . We look for that statefulset in our system using the below: Then we can scale out statefulset down to two pods using the below command: We check to see if the statefulset was successfully scaled down to two pods using the following: Remark: The " --record " parameter created an annotation as we see using the " kubectl describe " command:
Read more

Python 101 : Generators and Lists

Image
A list is a collection of val ues stored in memory. A generator does not build a list, it only tells us how to generate these values with nothing stored in memory. Our examples below use the " range() " iterator and they produce the same results. Below is our list example: And our generator example: The generator expression generate values only when they are needed which saves us system resources, especially with huge amounts of data.
Read more