Create 9 machines on your favorite place. We’ll not details the steps here. We use hetzner cloud. Deploy a debian or ubuntu or your favorite distrib.
Then we need to prepare the Network:
In term of network topology, we’ll use 3 networks, all secured by wireguard:
Management will be used by kubernetes and ceph components.
The ceph backend will be used for data heavy part of ceph.
And the overlay to allow services running on top of kubernetes to discuss together.
In this step, we’ll only install the 2 first one. The overlay will be installed later.
Use kubespray to deploy your components. It is a set of ansible roles to deploy an HA kubernetes cluster.
Or deploy them by hand. We currently use kubespray, but think of not using it for the next iteration.
We personnaly use the following:
Storage with ceph (Or rook if you are bold ;), it is almost production ready)
This term is a reference to 12 factor app, and it is not a coincidence! (If you don’t know it, get there and read it!)
This is our curated list of operators:
UI to let people self serve. The status of this is clearly vaporware, but we hope to release an alpha by begining of 2021 (Except if you have skills and want to work on it already, this would be amazing ;) ).