inbuxa/inbuxa-server
1
0
Fork 0
Code Issues Pull Requests 1 Actions 1 Packages Projects Releases 1 Wiki Activity

Scale-out storage: PostgreSQL and MySQL read replicas (ST-5 to ST-15)

Browse Source 
A data store with readReplicas becomes a replicated store. Writes,
operator-written SQL and everything outside a read scope go to the
primary. JMAP reads before a request's first write, IMAP LIST, STATUS,
SEARCH, SORT and FETCH, POP3 RETR and TOP, DAV GET, PROPFIND and REPORT,
and blob downloads run in a read scope. Only account data (properties,
indexes, change logs, counters, ACLs, blobs, the search index) is read
from a replica; the registry, in-memory values, the task queue and the
rest stay on the primary.

In a scope, the first read picks a replica round-robin among those up
and under the lag limit, and only if it has every change this node has
written or heard of for the scope's accounts: marks come from write
results, the cluster's state-change broadcasts, a sinceState the client
presents, and, with more than one node, Redis. A write inside the scope
sends the rest of it to the primary. A miss on a replica is looked up on
the primary, and a replica error retries the read there and marks the
replica down.

Each node samples lag every second (WAL positions on PostgreSQL; GTID
sets or Seconds_Behind_Source on MySQL), stops reading from a replica
over 5 s and starts again under 2.5 s, and probes a down replica every
10 s. At startup a replica is left out if it's the primary, isn't
read-only, applies out of commit order, or doesn't show a marker written
to the primary within six tries.

replica_tests (postgres, STORE=PostgreSqlReplicated) runs a primary and a
streaming hot standby in containers: tests 9, 10, 12, 13, 14 and 15 pass.
This commit is contained in:
jcoffey-dev
2026-09-19 14:05:59 -07:00
parent a635b490ec
commit 1518c69033
24 changed files with 1722 additions and 45 deletions
Download Patch File Download Diff File Expand all files Collapse all files
crates/pop3/src/client.rs
+28 -6
View File
@@ -113,10 +113,21 @@ impl<T: SessionStream> Session<T> {
Command::List { msg } => {
self.handle_list(msg).await.map(|_| SessionResult::Continue)
}
Command::Retr { msg } => self
.handle_fetch(msg, None)
Command::Retr { msg } => {
// inbuxa: ST-6: may be served by a read replica
let accounts = self
.state
.access_token()
.all_ids()
.map(|account_id| (account_id, 0))
.collect::<Vec<_>>();
store::backend::scaleout::replica::replica_read(
accounts,
self.handle_fetch(msg, None),
)
.await
.map(|_| SessionResult::Continue),
.map(|_| SessionResult::Continue)
}
Command::Dele { msg } => self
.handle_dele(vec![msg])
.await
@@ -125,10 +136,21 @@ impl<T: SessionStream> Session<T> {
.handle_dele(msgs)
.await
.map(|_| SessionResult::Continue),
Command::Top { msg, n } => self
.handle_fetch(msg, n.into())
Command::Top { msg, n } => {
// inbuxa: ST-6: may be served by a read replica
let accounts = self
.state
.access_token()
.all_ids()
.map(|account_id| (account_id, 0))
.collect::<Vec<_>>();
store::backend::scaleout::replica::replica_read(
accounts,
self.handle_fetch(msg, n.into()),
)
.await
.map(|_| SessionResult::Continue),
.map(|_| SessionResult::Continue)
}
Command::Uidl { msg } => {
self.handle_uidl(msg).await.map(|_| SessionResult::Continue)
}