Local AI README: no internal host name, and the port the webmail shares

Drops the internal machine name from the measurement line: this repo is
public. Says that 127.0.0.1:8080 is the mail namespace's own loopback, and
that a model run outside a namespace on a host the installer set up needs
another port, since the container install's webmail already binds the
host's 127.0.0.1:8080.
This commit is contained in:
2026-09-24 07:55:57 -07:00
parent d4351beb78
commit 3cedee4202
+11 -4
View File
@@ -23,7 +23,7 @@ The mail server's model entry (`x:AiModel`) points at
`qwen3-4b-instruct-2507`, which is the service's `--alias`. The address is `qwen3-4b-instruct-2507`, which is the service's `--alias`. The address is
the mail namespace's own loopback, so message text never leaves the machine. the mail namespace's own loopback, so message text never leaves the machine.
Measured on production (host1, CPU only): about 1.2 s per message once warm, Measured on production (CPU only): about 1.2 s per message once warm,
4 s for the first; about 4.3 GB of memory. 4 s for the first; about 4.3 GB of memory.
## The model, built from source ## The model, built from source
@@ -55,10 +55,17 @@ systemctl daemon-reload && systemctl enable --now inbuxa-llm
ip netns exec mail curl -s http://127.0.0.1:8080/health # {"status":"ok"} ip netns exec mail curl -s http://127.0.0.1:8080/health # {"status":"ok"}
``` ```
Port 8080 is the mail namespace's own loopback, not the host's, so it can't
collide with anything outside the namespace. That matters because the
installer's container install binds the webmail to the host's
`127.0.0.1:8080`.
A host without the mail namespace drops `NetworkNamespacePath`, A host without the mail namespace drops `NetworkNamespacePath`,
`After=mail-netns.service` and `Requires=mail-netns.service` from the unit; `After=mail-netns.service` and `Requires=mail-netns.service` from the unit,
the service then listens on the host's loopback, which is where a mail server and the service then listens on the host's loopback. There, pick another port
on that host reaches it. (`--port` in the unit) if the installer has set the host up, since the webmail
already holds 8080, and change the address in inbuxa Admin's Local AI page
(or the model's `url`) to match.
## Undoing it ## Undoing it