Evaluate the personal-data catalog: the data inventory and its history #89

Merged

jcoffey-dev merged 1 commits from feature/data-inventory into main

2026-09-28 17:15:10 +00:00

jcoffey-dev commented

2026-09-28 16:59:53 +00:00

Owner

Personal-data catalog §6, Phase 3c.

inbuxa:DataInventory/get: the catalog evaluated against live settings; collected, retention (live value), leaves host, endpoints, candidate processors, summary. Tenant slice inside a tenant. sysComplianceGet.
inbuxa:InventorySnapshot/get: history, recorded when the inventory changes (registry writes it reads, log/audit/AI settings, daily); kept as long as audit records.
New dependency: toml (MIT/Apache).

Tested: unit tests (several configurations), extended compliance system test, system/audit/hold/lock suites, fork checks. Intermittent BlobNotFound on email import seen once each in two system runs (antispam.rs, purge.rs), unrelated to this change; noted separately.

Personal-data catalog §6, Phase 3c. - `inbuxa:DataInventory/get`: the catalog evaluated against live settings; collected, retention (live value), leaves host, endpoints, candidate processors, summary. Tenant slice inside a tenant. `sysComplianceGet`. - `inbuxa:InventorySnapshot/get`: history, recorded when the inventory changes (registry writes it reads, log/audit/AI settings, daily); kept as long as audit records. - New dependency: `toml` (MIT/Apache). Tested: unit tests (several configurations), extended compliance system test, system/audit/hold/lock suites, fork checks. Intermittent BlobNotFound on email import seen once each in two system runs (antispam.rs, purge.rs), unrelated to this change; noted separately.

jcoffey-dev added 1 commit 2026-09-28 16:59:54 +00:00

Evaluate the personal-data catalog: the data inventory and its history

ci / fork-checks (pull_request) Successful in 57s

Details

ci / build (pull_request) Successful in 15m6s

Details

a8fb10458b

Personal-data catalog spec, §6 (Phase 3c).

inbuxa:DataInventory/get evaluates the catalog against the server's
live settings and says what this server holds: for each source and each
object that can hold personal data, its categories and whose data it
is, whether it is collected here at all, what bounds its retention (the
live value of the setting that does, or unbounded), whether it leaves
the host and to which endpoints, and a summary. Every host that
receives something is listed once as a candidate processor with what it
receives. Inside a tenant it answers with the tenant's slice and none
of the server's processors. Read-only, with sysComplianceGet.

inbuxa:InventorySnapshot/get is the history: a dated copy of the
evaluated inventory, recorded when it changes -- after a registry write
to an object the inventory reads, after inbuxa's log, audit or AI
settings change, and on the daily clean-up -- and kept as long as the
audit log's records. ids: null lists every snapshot, newest first; the
full inventory only when asked for.

The catalog is embedded and parsed at start (new dependency: toml,
MIT/Apache); the evaluation is a pure function of it and the live
facts, so each configuration is tested without a server. Loopback
endpoints stay on the host; any other configured endpoint leaves it.

Tested: unit tests for the evaluation (a new install's defaults, an
external blob store, a hosted AI endpoint, telemetry off, a tenant's
slice, hosts from URLs, loopback), snapshots, and the fact gathering's
store and duration rules; the compliance system test, extended (the
officer reads the inventory, a plain user is refused, a tenant's
officer sees its slice and no processors, a webhook to another host
becomes a processor and a snapshot names x:WebHook, a retention change
reads through); the system, audit, legal hold and account lock suites;
fork checks. The system suite failed once of three runs with an email
import's blob not found, in antispam.rs; the same happened once in
purge.rs on the previous branch. Nothing here touches uploads; noted
for a separate look.

jcoffey-dev merged commit 7bbbff0648 into main

2026-09-28 17:15:10 +00:00

jcoffey-dev deleted branch feature/data-inventory

2026-09-28 17:15:10 +00:00

jcoffey-dev referenced this issue from a commit

2026-09-28 19:22:38 +00:00

Release 2026.9.28.4

jcoffey-dev referenced this pull request

2026-09-28 19:22:39 +00:00

Release 2026.9.28.4 #94