jcoffey-dev
86d7ebd982
What administrators and the server itself do to the control plane is now recorded, from inbuxa-drafts/specs/audit-hold-lock.md (AU-1 to AU-12): settings, accounts, domains, roles and every other registry change, with each field's before and after (secrets only as "changed"); the fork's own settings objects; administrator sign-ins (and failed ones to administrator accounts), master-user and recovery-admin sign-ins, once an hour per account, method and address; access to another account's data through impersonation or FetchAnyBlob, once an hour; exports and tamper checks; and registry writes the server makes on its own, named by subsystem (system:AcmeRenewal, system:auto-ban, system:directory-sync, ...), with a spam rules update as one summary record. No change without its record (AU-3): before a set method changes anything, a pending record per requested create, update and destroy is written; if that fails, the method is refused with serverFail. Its outcome follows as a later entry. A change interrupted by a crash stays "unfinished". Records live in the fork's subspace under L, as one SHA-256 hash chain per node. The chain's head is stored, never cached, and every append asserts it, so two writers can't take the same place. Nothing can edit or delete a record; the daily purge removes the oldest past the retention (default 730 days, minimum 90) and records where the chain now starts, so verification still passes. security.audit-recorded (647) copies each record to webhooks, OpenTelemetry and the log; security.audit-write-failed (648) reports a failed write. New JMAP objects under urn:inbuxa:jmap: inbuxa:AuditEvent/get and /query (filters: time, actor, action, target, account, tenant, outcome, address, text), inbuxa:AuditSettings, inbuxa:AuditExport (CSV or JSON Lines built on the server, each line with its chain hash, ending in a manifest; the created object names the blob and its SHA-256) and inbuxa:AuditVerification. New permissions sysAuditGet, sysAuditExport and sysAuditSettingsUpdate: the Administrator role gets all three, the Tenant Administrator role gets read and export, once, on existing installs too. A tenant administrator sees records whose actor or target is in its tenant, including a server administrator's changes there. Sign-in method on the session: access tokens now remember how they signed in (password, app password, API key, OAuth client, directory, master user, recovery admin), including across the HTTP credential cache. New OAuth access tokens carry their client id in the sealed claims; older ones show as client "unknown" until they expire. The schema gains the permissions, the two events and a Management > Compliance > Audit Log link. Stack: the request layer boxes every inner future where it's made. Without that, a debug build overflowed the default 2 MB worker stack on a registry set; measured with the same request, the branch and main now overflow at the same stack size (between 1856 and 1920 KiB, debug), so the layer adds nothing measurable. Tests: unit tests in inbuxa-features and jmap; system::audit::audit_log_tests (run with --ignored) passes on RocksDB, SQLite, PostgreSQL, PostgreSQL with a read replica, MySQL, MySQL with a replica and FoundationDB. The system, JMAP and SCIM suites pass. authorization.rs skipped fork permissions that guard no registry object; the audit suite checks a plain user is refused instead.
245 lines
7.2 KiB
Rust
245 lines
7.2 KiB
Rust
/*
|
|
* SPDX-FileCopyrightText: 2020 Stalwart Labs LLC <[email protected]>
|
|
*
|
|
* SPDX-License-Identifier: AGPL-3.0-only OR LicenseRef-SEL
|
|
*
|
|
* Modified by Coffey Labs in 2026 for INBUXA.
|
|
*/
|
|
|
|
pub mod bootstrap;
|
|
pub mod get;
|
|
pub mod local;
|
|
pub mod query;
|
|
pub mod write;
|
|
|
|
// inbuxa: the audit log's view of registry writes (audit-hold-lock spec,
|
|
// AU-1.10)
|
|
pub mod hook;
|
|
|
|
use crate::{
|
|
Deserialize, SerializeInfallible, U16_LEN, U32_LEN, U64_LEN,
|
|
write::key::{DeserializeBigEndian, KeySerializer},
|
|
};
|
|
use registry::{
|
|
pickle::{Pickle, PickledStream},
|
|
schema::{
|
|
prelude::{Object, ObjectInner, ObjectType, Property},
|
|
structs::{
|
|
ArchivedItem, DmarcInternalReport, Metric, SpamTrainingSample, Task, TlsInternalReport,
|
|
Trace,
|
|
},
|
|
},
|
|
types::{EnumImpl, ObjectImpl, id::ObjectId},
|
|
};
|
|
use types::id::Id;
|
|
|
|
pub struct RegistryObject<T: ObjectImpl> {
|
|
pub id: ObjectId,
|
|
pub object: T,
|
|
pub revision: u64,
|
|
}
|
|
|
|
#[derive(Debug)]
|
|
pub struct RegistryQuery {
|
|
pub(crate) object_type: ObjectType,
|
|
pub filters: Vec<RegistryFilter>,
|
|
pub(crate) start: RegistryQueryStart,
|
|
pub(crate) limit: Option<usize>,
|
|
}
|
|
|
|
#[derive(Debug, Clone, Copy, Default)]
|
|
pub struct RegistryObjectCounter(pub usize);
|
|
|
|
#[derive(Debug, Clone, Copy)]
|
|
pub(crate) enum RegistryQueryStart {
|
|
Index(u64),
|
|
Anchor(u64),
|
|
None,
|
|
}
|
|
|
|
#[derive(Debug)]
|
|
pub struct RegistryFilter {
|
|
pub property: Property,
|
|
pub op: RegistryFilterOp,
|
|
pub value: RegistryFilterValue,
|
|
pub is_pk: bool,
|
|
}
|
|
|
|
#[derive(Debug, PartialEq, Clone, Copy, Eq, Hash)]
|
|
pub struct ObjectIdVersioned {
|
|
pub object_id: ObjectId,
|
|
pub version: u32,
|
|
}
|
|
|
|
#[derive(Debug, Clone, Copy, PartialEq, Eq)]
|
|
pub enum RegistryFilterOp {
|
|
Equal,
|
|
GreaterThan,
|
|
GreaterEqualThan,
|
|
LowerThan,
|
|
LowerEqualThan,
|
|
TextMatch,
|
|
}
|
|
|
|
#[derive(Debug)]
|
|
pub enum RegistryFilterValue {
|
|
String(String),
|
|
Bytes(Vec<u8>),
|
|
U64(u64),
|
|
U16(u16),
|
|
Boolean(bool),
|
|
}
|
|
|
|
impl Deserialize for Object {
|
|
fn deserialize_with_key(key: &[u8], bytes: &[u8]) -> trc::Result<Self> {
|
|
let revision = xxhash_rust::xxh3::xxh3_64(bytes);
|
|
ObjectType::from_id(key.deserialize_be_u16(0)?)
|
|
.and_then(|object_id| ObjectInner::unpickle(object_id, &mut PickledStream::new(bytes)?))
|
|
.map(|inner| Object { revision, inner })
|
|
.ok_or_else(|| {
|
|
trc::EventType::Registry(trc::RegistryEvent::DeserializationError)
|
|
.into_err()
|
|
.caused_by(trc::location!())
|
|
.ctx(trc::Key::Value, bytes)
|
|
})
|
|
}
|
|
|
|
fn deserialize(_: &[u8]) -> trc::Result<Self> {
|
|
unreachable!("Object deserialization requires the object type from the key")
|
|
}
|
|
}
|
|
|
|
impl Deserialize for Task {
|
|
fn deserialize(bytes: &[u8]) -> trc::Result<Self> {
|
|
PickledStream::new(bytes)
|
|
.and_then(|mut stream| Self::unpickle(&mut stream))
|
|
.ok_or_else(|| {
|
|
trc::EventType::Registry(trc::RegistryEvent::DeserializationError)
|
|
.into_err()
|
|
.caused_by(trc::location!())
|
|
.ctx(trc::Key::Value, bytes)
|
|
})
|
|
}
|
|
}
|
|
|
|
impl Deserialize for SpamTrainingSample {
|
|
fn deserialize(bytes: &[u8]) -> trc::Result<Self> {
|
|
PickledStream::new(bytes)
|
|
.and_then(|mut stream| Self::unpickle(&mut stream))
|
|
.ok_or_else(|| {
|
|
trc::EventType::Registry(trc::RegistryEvent::DeserializationError)
|
|
.into_err()
|
|
.caused_by(trc::location!())
|
|
.ctx(trc::Key::Value, bytes)
|
|
})
|
|
}
|
|
}
|
|
|
|
impl Deserialize for ArchivedItem {
|
|
fn deserialize(bytes: &[u8]) -> trc::Result<Self> {
|
|
PickledStream::new(bytes)
|
|
.and_then(|mut stream| Self::unpickle(&mut stream))
|
|
.ok_or_else(|| {
|
|
trc::EventType::Registry(trc::RegistryEvent::DeserializationError)
|
|
.into_err()
|
|
.caused_by(trc::location!())
|
|
.ctx(trc::Key::Value, bytes)
|
|
})
|
|
}
|
|
}
|
|
|
|
impl Deserialize for TlsInternalReport {
|
|
fn deserialize(bytes: &[u8]) -> trc::Result<Self> {
|
|
PickledStream::new(bytes)
|
|
.and_then(|mut stream| Self::unpickle(&mut stream))
|
|
.ok_or_else(|| {
|
|
trc::EventType::Registry(trc::RegistryEvent::DeserializationError)
|
|
.into_err()
|
|
.caused_by(trc::location!())
|
|
.ctx(trc::Key::Value, bytes)
|
|
})
|
|
}
|
|
}
|
|
|
|
impl Deserialize for DmarcInternalReport {
|
|
fn deserialize(bytes: &[u8]) -> trc::Result<Self> {
|
|
PickledStream::new(bytes)
|
|
.and_then(|mut stream| Self::unpickle(&mut stream))
|
|
.ok_or_else(|| {
|
|
trc::EventType::Registry(trc::RegistryEvent::DeserializationError)
|
|
.into_err()
|
|
.caused_by(trc::location!())
|
|
.ctx(trc::Key::Value, bytes)
|
|
})
|
|
}
|
|
}
|
|
|
|
impl SerializeInfallible for ObjectId {
|
|
fn serialize(&self) -> Vec<u8> {
|
|
KeySerializer::new(U16_LEN + U64_LEN)
|
|
.write(self.object().to_id())
|
|
.write(self.id().id())
|
|
.finalize()
|
|
}
|
|
}
|
|
|
|
impl Deserialize for ObjectId {
|
|
fn deserialize(bytes: &[u8]) -> trc::Result<Self> {
|
|
let object_id = bytes.deserialize_be_u16(0)?;
|
|
let item_id = bytes.deserialize_be_u64(U16_LEN)?;
|
|
Ok(ObjectId::new(
|
|
ObjectType::from_id(object_id).ok_or_else(|| {
|
|
trc::EventType::Registry(trc::RegistryEvent::DeserializationError)
|
|
.into_err()
|
|
.caused_by(trc::location!())
|
|
.ctx(trc::Key::Value, bytes)
|
|
})?,
|
|
Id::new(item_id),
|
|
))
|
|
}
|
|
}
|
|
|
|
impl SerializeInfallible for ObjectIdVersioned {
|
|
fn serialize(&self) -> Vec<u8> {
|
|
KeySerializer::new(U16_LEN + U64_LEN + U32_LEN)
|
|
.write(self.object_id.object().to_id())
|
|
.write(self.object_id.id().id())
|
|
.write(self.version)
|
|
.finalize()
|
|
}
|
|
}
|
|
|
|
impl Deserialize for ObjectIdVersioned {
|
|
fn deserialize(bytes: &[u8]) -> trc::Result<Self> {
|
|
let object_id = ObjectId::deserialize(bytes)?;
|
|
let version = bytes.deserialize_be_u32(U16_LEN + U64_LEN)?;
|
|
Ok(Self { object_id, version })
|
|
}
|
|
}
|
|
|
|
impl Deserialize for Trace {
|
|
fn deserialize(bytes: &[u8]) -> trc::Result<Self> {
|
|
PickledStream::new(bytes)
|
|
.and_then(|mut stream| Self::unpickle(&mut stream))
|
|
.ok_or_else(|| {
|
|
trc::EventType::Registry(trc::RegistryEvent::DeserializationError)
|
|
.into_err()
|
|
.caused_by(trc::location!())
|
|
.ctx(trc::Key::Value, bytes)
|
|
})
|
|
}
|
|
}
|
|
|
|
impl Deserialize for Metric {
|
|
fn deserialize(bytes: &[u8]) -> trc::Result<Self> {
|
|
PickledStream::new(bytes)
|
|
.and_then(|mut stream| Self::unpickle(&mut stream))
|
|
.ok_or_else(|| {
|
|
trc::EventType::Registry(trc::RegistryEvent::DeserializationError)
|
|
.into_err()
|
|
.caused_by(trc::location!())
|
|
.ctx(trc::Key::Value, bytes)
|
|
})
|
|
}
|
|
}
|