Skip to content

Infrastructure

The cluster runs on a mix of ARM and x86 hardware, managed entirely through Talos Linux -- an immutable, API-driven Kubernetes OS. This section covers the physical and logical layers that make up the cluster.

Overview

graph TD
    subgraph Network
        SW[TP-Link 24-Port PoE Switch]
        RT[NanoPi R5C Router]
        AP1[Ubiquiti U7-Pro AP]
        AP2[Ubiquiti U6-Lite AP]
    end

    subgraph Control Plane
        CP1[worker-01<br/>Lenovo 440p]
        CP2[worker-02<br/>Lenovo 440p]
        CP3[worker-03<br/>Acemagician AM06]
    end

    subgraph Workers
        W4[worker-04<br/>Acemagician AM06]
        W5[worker-05<br/>Acemagician AM06]
        W6[worker-06<br/>Acemagician AM06]
        WP1[worker-pi-01<br/>Raspberry Pi 4]
        WP2[worker-pi-02<br/>Raspberry Pi 4]
        WP3[worker-pi-03<br/>Raspberry Pi 4]
    end

    subgraph Storage
        SYN[Synology 4-Bay NAS<br/>8TB]
        CEPH[(Ceph on NVMe)]
    end

    SW --> CP1 & CP2 & CP3
    SW --> W4 & W5 & W6
    SW --> WP1 & WP2 & WP3
    SW --> SYN
    RT --> SW
    UPS[Eaton 500VA UPS] -.-> SW & RT

Sections

Page Description
Hardware Full hardware inventory -- compute nodes, network gear, and storage
Talos Linux Talos OS configuration, factory images, extensions, and patches
Cluster Bootstrap Step-by-step guide to bootstrapping the cluster from scratch
Node Management Day-2 operations: applying configs, rebooting, resetting, and upgrading nodes

Key Design Decisions

  • Talos Linux was chosen over traditional distributions for its immutability, minimal attack surface, and fully API-driven management (no SSH, no shell).
  • Mixed architecture (ARM + x86) is supported through Talos factory images with per-node schematics and extensions.
  • Control plane nodes also run workloads (allowSchedulingOnControlPlanes: true) to maximize resource utilization.
  • Cilium replaces kube-proxy entirely and serves as the CNI, configured at bootstrap time via kustomize addons.
  • PoE powers the Raspberry Pi nodes directly from the switch, reducing cable clutter.