Introduction
This is the documentation for my home Kubernetes cluster running on Talos Linux, managed with Flux.
These docs are specific to my setup. They may or may not work for you, but hopefully they're useful as a reference.
Overview
This repository is my home Kubernetes cluster in a declarative state. Flux watches the kubernetes folder and will make the changes to the cluster based on the YAML manifests.
Core Components
Core components that form the foundation of the cluster:
- backube/volsync and backube/snapscheduler: Backup and recovery of persistent volume claims.
- cilium/cilium: Kubernetes CNI.
- envoyproxy/envoy: Kubernetes-based application gateway using Kubernetes Gateway API.
- external-secrets/external-secrets: Managed Kubernetes secrets using 1Password Connect.
- jetstack/cert-manager: Creates SSL certificates for services in my Kubernetes cluster.
- kubernetes-sigs/external-dns: Automatically manages DNS records from my cluster in CloudFlare.
- rancher/system-upgrade-controller: Handles Kubernetes and Talos upgrades automatically.
- rook/rook: Distributed block storage for persistent storage.
- siderolabs/talos: The Kubernetes Operating System.
Observability
For observability and monitoring of the cluster the following software is used:
- fluent/fluent-bit: Log processor.
- grafana/grafana: Data visualization platform.
- prometheus/alertmanager: Handles processing and sending alerts.
- pushover: Handles receiving alerts on my devices.
- TwiN/gatus: High level status dashboard.
- VictoriaMetrics/VictoriaLogs: Database for logs.
- prometheus/prometheus: Time series database for metrics.
Automation
- Github Actions for checking code formatting and running periodic jobs
- Renovate keeps the application charts and container images up-to-date
Cloud Dependencies
- 1Password for managing secrets via external-secrets.
- AWS SES for sending emails.
- Cloudflare tunnels for exposing services & creating certificates & managing domains.
- Cloudflare R2 for daily backups.
- Pushover for sending alerts.
Total cloud costs yearly is approximately ~$150/year.
Directories
This Git repository contains the following directories.
📁 bootstrap # Flux installation to bootstrap cluster
📁 docs # Docs
📁 hacks # Contains random scripts
📁 kubernetes # Kubernetes cluster defined as code
├─📁 flux # Main Flux configuration of repository
├─📁 components # Flux components
└─📁 apps # Apps deployed into my cluster grouped by namespace
📁 talos # Contains the configuration for Talos operating system
📁 terraform # Contains Cloudflare terraform
Hardware
Checkout my rack
| Device | Count | OS Disk Size | Data Disk Size | Ram | Operating System | Purpose |
|---|---|---|---|---|---|---|
| UDM-Pro-Max | 1 | - | - | - | UniFi | Router |
| USW-Pro-Aggregation | 1 | - | - | - | UniFi | Switch |
| USW-Pro-Max-24-PoE | 1 | - | - | - | UniFi | Switch |
| UAP-AC-Lite | 1 | - | - | - | UniFi | WiFi AP |
| ER-10X | 1 | - | - | - | EdgeOS | Switch |
| PiKVM V4 Mini | 1 | - | - | - | PiKVM | KVM |
| TESmart HDMI KVM Switch 8 Ports | 1 | - | - | - | - | KVM Switch |
| CyberPower CP1500PFCRM2U | 1 | - | - | - | UPS | |
| USP-PDU-Pro | 1 | - | - | - | UniFi | PDU |
| Synology DS920+ | 1 | - | 2x8TB & 2x16TB | 20GB | DSM | NAS |
| MS-01 i9-13900H | 3 | 1TB | 2TB | 96GB | Talos | Control Plane |
Graditude and Thanks
Thanks to all the people who donate their time to the Kubernetes @Home community.
This repository was built off the onedr0p/template-cluster-k3s repository.
Star History
License
See LICENSE