packaging/local-ai/ holds what runs the AI spam classifier's model on
production's mail host, for the installer's bare-metal mode to use later
(nothing in the installer uses it yet):
- inbuxa-llm.service: llama.cpp's server with Qwen3 4B Instruct 2507
(Q4_K_M), in the mail network namespace on 127.0.0.1:8080 only, bounded
to 4 cores and 8 GB. Identical to host1's unit apart from the license
header.
- build-model.sh: builds the model from Qwen's official weights, checked
against Hugging Face's checksums, with llama.cpp b11160's converter and
quantizer, and compares the result with production's SHA-256. Qwen
publishes no GGUF of this model, so the file that runs is one we made.
Two builds from the same weights came out byte-identical.
- README.md: what runs and where it came from, a by-hand install, and how
to undo it.
jcoffey-dev
393b9d897f