Home Linux Stuff: Homelab Engineering & Infrastructure Guide

Welcome to Home Linux Stuff: A comprehensive engineering journal and reference architecture for building resilient, hardened Linux infrastructure, declarative container services, and enterprise-grade homelabs.

Every guide in this knowledge base is designed for practical, modern operations: prioritizing immutable configurations, automated GitOps pipelines, zero-trust network ingress, client-side encrypted backups, and long-term maintainability without server sprawl or downtime.


The Production GitOps Workflow

Instead of manually editing configurations or running ad-hoc Docker commands across physical nodes, modern infrastructure treats Git as the single source of truth:

1. Declarative Repositories

Infrastructure is organized into dedicated repositories per environment. Pull requests enforce branch protection and automated linting scripts (docker compose config).

2. Webhook Orchestration

Merges trigger signed webhooks to Komodo Core. The orchestrator diffs the changed Compose files and coordinates zero-downtime rolling updates.

3. Node Periphery Agents

Target hosts run lightweight Komodo Periphery agents over secure internal websockets or WireGuard meshes, eliminating inbound SSH management ports entirely.


Master Runbook Index by Domain

1. GitOps & Declarative Infrastructure Automation

Version-controlled infrastructure-as-code, Komodo orchestration, native Docker secrets, and SSH multiplexing.

2. Security & Edge Networking

Zero-Trust Cloudflare Tunnels, Tailscale mesh networking, Pocket-ID OIDC SSO, CrowdSec intrusion prevention, Caddy reverse proxies, and automated Let’s Encrypt DNS-01 certificates.

3. Storage & OpenZFS Architecture

Enterprise OpenZFS topologies, TrueNAS SCALE performance tuning, ARC cache sizing, dataset recordsize optimization, NVMe wear monitoring, and disk replacement.

4. Backups & Disaster Recovery

Client-side encrypted backups with Restic and Kopia to S3/B2, ZFS snapshot replication with Syncoid/Sanoid, and Proxmox PBS bare-metal recovery.

5. Observability & System Health

Out-of-band Uptime Kuma monitoring with AutoKuma GitOps, Netdata telemetry, Vector structured JSON logging with Grafana Loki, and Network UPS Tools (NUT).

6. Self-Hosted Applications & Homelab Stacks

Immich photo management with ML, Paperless-ngx OCR digital archiving, Home Assistant, Frigate AI NVR, Jellyfin transcoding, Lyrion Music Server, and isolated torrent daemons.

7. Server Maintenance & Operations

Automated CVE security patching with unattended-upgrades and needrestart, S.M.A.R.T. predictive disk failure monitoring with smartd and Scrutiny, container auto-healing, and CLI productivity.


All runbooks are verified against modern Linux kernels (Debian 12 Bookworm, Ubuntu 24.04 LTS, TrueNAS SCALE Dragonfish/Electric Eel) with pure declarative workflows.