configuration

uvacompute stores configuration and data in standardized locations following the filesystem hierarchy standard (fhs).

cli configuration (~/.uvacompute/)

user authentication and local settings. this directory is created when you run uva login.

filedescription
configauth token and version info (json)
node/config.yamllocal node management config
node/install-state.yamlinstallation tracking
node/prepare-state.yamlpre-install state (gpu, iommu checks)

node system configuration (/etc/uvacompute/)

node registration and runtime settings. these files are created during node installation and require root access.

filedescription
node-config.yamlhub connection details (tunnel host, port, k3s url)
node-labels.yamlkubernetes resource labels (cpus, ram, gpu type)
storage-config.yamlvm storage allocation settings
orchestration-secretapi authentication for gpu mode scripts

note: these files contain sensitive information. the orchestration-secret file has mode 600 (owner read/write only).

node data storage (/var/lib/uvacompute/)

persistent vm and job data. this is where vm disk images and working directories are stored.

pathdescription
storage/vm disk images, job working directories

storage allocation: during node installation, you specify how much disk space to allocate. this directory will use up to that amount for vm disks and job data.

ssh keys (~/.ssh/)

ssh keys used for secure communication between nodes and the hub.

filedescription
id_ed25519_uvacomputenode tunnel communication key (private)
id_ed25519_uvacompute.pubnode tunnel communication key (public)

gpu mode management

switch between nvidia (container) and vfio (vm passthrough) gpu modes on nodes with nvidia gpus.

commanddescription
uva node gpu-mode statusshow current gpu mode
uva node gpu-mode nvidiaswitch to nvidia mode (for container workloads)
uva node gpu-mode vfioswitch to vfio mode (for vm gpu passthrough)

example usage

uva node gpu-mode statusuva node gpu-mode nvidiauva node gpu-mode vfio

node services

systemd services installed on gpu nodes during setup.

servicedescription
uvacompute-tunnelssh tunnel to hub for cluster communication
uvacompute-gpu-guardiandetects host gpu usage and blocks job scheduling (nvidia mode only)
uvacompute-gpu-reconcilerestores gpu mode after reboot

directory summary

purposelocationrationale
system config/etc/uvacompute/fhs: host-specific system configuration
variable data/var/lib/uvacompute/fhs: persistent application data
user config~/.uvacompute/xdg: user-level configuration
scripts/usr/local/bin/fhs: locally installed executables