Skip to content
Documentation
Operating FACE

Operating FACE

This section is for the platform and SRE teams who deploy, configure, upgrade and troubleshoot a FACE instance. It is also for Runink operators. FACE runs on the Runink platform: CORE’s operators on a k0s cluster. FACE needs nothing outside that cluster to run. It calls no third-party model API and no managed cloud database, so the same procedures work air-gapped.

FACE is application code. CORE provisions the cluster, runs the operators that build FACE’s pods, and serves the model plane FACE reasons with. The pages below say which side owns each setting, so you know whether to change a custom resource or the FACE image.

Deployment model
The custom resources, the pods the operator builds, and what it injects into them.
Prerequisites and ordering
The three secrets and one URL that must exist before the image runs, and the exact boot refusals.
Configuration reference
Every environment variable the code reads, grouped, with defaults.
Model plane
The OpenAI-compatible contract, bringing a plane up, and the embedding dimension check.
Persistence and backup
MetaDB and Litestream, the appfs root, object and record stores, and custody of the key.
Runners
Operating in-cluster fetch runners and self-hosted runners that enrol outbound.
Upgrades and CD
How images are built and rolled, and what each upgrade leaves behind for a rollback.
Local development
core dev up face, the release web build, and the smoke harness.
Health and troubleshooting
Probes, boot refusals, crashloops, empty panels, sign-in failures and embedding mismatch.

The rule behind most incidents

FACE refuses to start when a dependency it cannot work without is missing. It does not fall back to a degraded mode. This applies to the session signing key, the mesh CA, the at-rest key and the inference endpoint. A crashlooping pod with one clear log line is the intended result of a configuration fault. A pod that runs but serves nothing would be harder to diagnose. So read the first ❌ line of the container log before you look anywhere else. Health and troubleshooting lists each one.