Installing the nodes with Ceph and K8S
Network 🌐
In this post, I’ll walk through how I install and prepare the host nodes. Each host is set up with both Ceph and Kubernetes (K8s). The full configuration code on what I base this blog post about can be found at https://codeberg.org/mpiscaer/myOpenstackCluster with GIT tag 0.1.1
As described in my previous blog post, 📡 My First Network Connectivity, the network is fully routed.
In most cases environments uses LACP to create a redundant network connection and where multiple hosts are on the same broadcast network. I deliberately chose not to use LACP on the interfaces and instead rely on OSPF and BGP to provide redundancy. In the end I use this setup to evaluate if this a usable setup.
The advantage of using BGP and OSPF over LACP is beter integration of the network and hosts, traffic can flow directly and uses the shortest path. Using a layer 3 only setup eliminates the need for Spanning tree and so all links can stay active.
I have three nodes, all three nodes will and up with the function:
- Ceph MON
- Ceph OSD
- Ceph MGR
- Kubernetes control node
- Openstack control node
- Openstack Compute node