M12.6: add scoped multi-region cellular census queries
Foundation / checks (deploy) (push) Successful in 5s
Foundation / checks (ecs) (push) Successful in 2m22s
Foundation / checks (network) (push) Successful in 20m57s
Foundation / checks (client) (push) Successful in 22m5s
Foundation / checks (tsan) (push) Successful in 24m37s
Foundation / postgres-tools (push) Canceled after 0s
Foundation / server-image (push) Canceled after 0s
Foundation / image (push) Canceled after 0s
Foundation / checks (checks) (push) Canceled after 45m14s
Foundation / checks (postgres) (push) Canceled after 45m8s

This commit is contained in:
dingo
2026-10-18 15:11:51 -04:00
parent a180c41ae7
commit 82568da9cd
20 changed files with 621 additions and 4 deletions
+16
View File
@@ -1,5 +1,21 @@
# Project status and next steps
## M12.6c scoped multi-region census queries - 2026-10-18
The portable census now queries 1..64 explicitly declared regions at an exact
simulation boundary. Missing/stale coverage, conflicting immutable genome records
and duplicate resident organisms fail before totals are exposed. Real settled
migrations count stock once, retain suspended living stock and support mixed
raw/cohort classifications; departed history remains separate record occurrences.
Native Release passes **79/79**; focused GCC and ASan/UBSan contracts, private
PostgreSQL committed raw/cohort history integration, Clang analysis and formatting
pass. [Evidence and limits](engineering/VALIDATION.md) retain durable world/branch
coverage, reconciled migration cuts, client access and target-host query costs.
A caller-declared region set is not a complete world watermark and cannot accept
terminal extinction. Linked ecology, maturation and later integration/soak gates
remain open; no deployment or World0 action.
## M12.6b replayed census history from committed cuts - 2026-10-18
Regional census history now reads exact retained biological commits as canonical
@@ -0,0 +1,60 @@
# ADR-0152: Scoped multi-region cellular census queries
## Status
Accepted for M12.6c, 2026-10-18. Portable detached queries under ADR-0133;
no world-completeness, branch, authority or terminal-extinction acceptance.
## Context and decision
Regional history pages now bind census observations to exact biological commits.
Adding local totals without checking coverage, identity or resident duplication
could still hide a stale region or count a migration source and ghost twice.
Add `CellularCensusSet` to the portable lifecycle library. The caller declares
1..64 distinct, ascending, nonzero required region IDs and an exact world, frame,
tick, owner format, rule and quantum boundary. Require exactly one matching
observation per region. Raw/population classifications may differ because both
describe the same exact individuals. All other boundary fields must agree.
The 64-region bound limits query work; it selects no production world size.
Keep full immutable genome records and permanent resident organism IDs privately
in detached regional projections. Across regions require byte-equivalent genome
values for every shared genome identity, including origin, capabilities and
parents; a short content hash or matching ancestry alone is insufficient.
Reject duplicate resident organism IDs even when life or genome IDs differ.
Retained nonresident records do not participate in resident duplication checks.
Retain sorted detached regional observations, then answer exact or descendant
queries with checked channel/count sums. Each local archive retains complete
ancestry, so a locally unknown anchor contributes no carriers only after exact
declared coverage and shared-genome consistency have been checked. Unknown in
every archive remains an error. Nonresident sums are historical record occurrences,
not a count of unique organisms or evidence of their current remote viability.
Any invalid evidence refuses construction; it cannot become a partial/zero total.
## Alternatives, benefits, costs and risks
Blind summation conceals missing regions and repeated residents. Using only an
archive's known-alive records counts departed migrants again. Trusting a short
digest would permit conflicting immutable identities. Full records add bounded
memory/copy cost to every detached census; the set retains at most 64 observations
with up to 4,096 genomes and 256 residents each. Identity checks sort bounded
genome references/resident IDs; queries traverse each local ancestry graph once.
This is not a measured deployment latency or capacity guarantee.
The required list is caller-declared, not an authoritative durable world catalog.
Observations themselves confer no commit, branch, epoch or ownership authority.
Callers must keep verified commit references and exact selected cuts; same-tick
arbitrary cuts can still miss a transfer and are not a reconciled watermark.
No new persistence/wire format, cache/index, permissions endpoint or client UI.
## Consequences and qualification
Require direct stock oracles, disjoint/shared/unknown ancestry, exact coverage,
all boundary fields, invalid/over-bound requests, immutable genome conflicts,
duplicate permanent organism identities, detachment and real funded migration
before/after. Test raw/cohort committed migration observations together.
Durable branch identity, required owner coverage and atomic migration-cut
reconciliation remain M12.6/12.7 work. No query here accepts global absence or
terminal extinction; linked resources, maturation and product gates remain open.
+2
View File
@@ -1,5 +1,7 @@
# Architecture decision records
- [ADR-0152: Scoped multi-region cellular census queries](0152-scoped-cellular-census-sets.md) - bounded declared coverage, exact boundaries, complete shared-genome equality and disjoint resident identities; no world-completeness or extinction authority.
- [ADR-0151: Committed cellular census history](0151-committed-cellular-census-history.md) - derives bounded, exact-cut census pages from the existing atomic immutable biological journal, with full historical replay; no duplicate census writes or world-extinction authority.
- [ADR-0150: Regional cellular census projection](0150-regional-cellular-census-projection.md) - bounded local resident/representation/presence census and exact/descendant queries; retained nonresident history never counts as owned stock or world extinction.
@@ -1,5 +1,12 @@
# Persistence and region authority
M12.6c's portable [scoped census set](../../schemas/ecology/scoped-cellular-census-set-v1.md)
combines a bounded declared set of regional observations, including replayed
history entries. It verifies exact common boundaries, complete shared genome
records and disjoint resident organism IDs. Callers retain the verified commit
references separately. Declared coverage is not a durable world catalog, and
same-tick cuts are not by themselves a reconciled migration watermark.
M12.6b derives regional census history from the existing immutable biological
commit journal. A commit and its exact payload are the canonical event, already
atomic with the head; no duplicate census-write window or new SQL table is added.
@@ -15,6 +15,13 @@ binds those projections to exact retained biological commits with full replay.
The commit journal supplies atomic durable events without a second census write.
Its fixed regional cut still supplies no complete world or external branch proof.
M12.6c's [scoped census set](../../schemas/ecology/scoped-cellular-census-set-v1.md)
checks exact declared regional coverage/boundaries, shared immutable genomes and
disjoint resident organism identities before summing exact/descendant queries.
It refuses missing/stale/conflicting evidence. The list remains caller-declared;
neither a durable world catalog nor reconciled migration cuts or branch proof
is supplied, so this query cannot accept world absence or terminal extinction.
## Identity and classification
An organism has a permanent identity and terminal death. An immutable genome has
+1 -1
View File
@@ -13,7 +13,7 @@ Commit and push each validated scoped segment separately.
| 12.3 | Exact population profile/trace/store and opt-in host integration implemented (12.3b) | ADR-0142, schema 44; exact publication/recovery, mutation race guards, ambiguous replies and process kills. Executable/network population fault drills and target-host qualification remain open. |
| 12.4 | Owned intervals and durable paired migration/fault qualification implemented in scoped segments through 12.4l | ADR-0143–0149/schema 49; bounded admitted work, source freeze, staged ghost, atomic pair and exact recovery, local TLS and storage faults. Multi-host/orchestrator, linked ecology and integrated stock audits remain open. |
| 12.5 | Blocked on 12.2-12.4 | Finite M6 process fixtures do not qualify coupled persistent cellular/cohort atmosphere/water budgets. |
| 12.6 | Regional census/lineage queries and replayed commit-bound history pages implemented (12.6a/b) | ADR-0150/0151; existing atomic biological commits are the durable events. Fixed regional watermarks and full replay bind observations; world/branch context, cross-region query/index costs and client path remain required. |
| 12.6 | Regional census/lineage queries, replayed commit-bound history pages and scoped multi-region queries implemented (12.6a-c) | ADR-0150–0152; atomic biological commits are the durable events. Fixed regional cuts and full replay bind observations; declared sets reject missing/stale/conflicting identity or duplicate residents. Durable world/branch coverage, reconciled migration cuts, target-host query/index costs and client path remain required. |
| 12.7 | Evidence policy defined; reconciler open | Complete durable world watermark and every viable/in-flight store remain required. |
| 12.8 | Not qualified | Actual multi-day integrated ecology/restart/clone evidence remains required. |
| 12.9 | Not accepted | Returning-player product evidence and expansion review remain required; World0 stays separately blocked. |
+8 -1
View File
@@ -27,7 +27,7 @@ or authorize production enablement.
| 12.3 | Dedicated population profile/trace/store/owning host; exact recovery and private PostgreSQL fault tests | Population-specific executable/network fault drills and target-host publication/capacity qualification. |
| 12.4 | Owned intervals; exact transfer/accounting; durable atomic pair/recovery; independent loopback TLS path loss and owner expiry/replacement/heal; local object sync/read-failure matrix | Multi-host/kernel-network, storage-host and orchestrator drills, linked-boundary contracts and integrated ownership/stock audits at scale. |
| 12.5 | Finite cellular contact feeding/decay and separate M6 producer/consumer resource owner | One jointly owned cellular/environment budget, explicit effective depth and source entitlements, versioned water/atmosphere species mapping and producer coefficients, plus closed/open and nutrient-exhaustion comparisons. |
| 12.6 | Retained archive, bounded regional census/lineage queries and fully replayed census history pages from atomic biological commits (12.6a/b) | World/branch history context and cross-region query/index qualification, client permission/presentation path and deployment-host query costs; no account power or invented precise statistical ancestry. |
| 12.6 | Retained archive, regional census/lineage queries, replayed commit-bound history and bounded scoped multi-region queries (12.6a-c) | Durable world/branch history context and required-region coverage, reconciled migration cuts, target-host query/index qualification and client permission/presentation; no account power or invented precise statistical ancestry. |
| 12.7 | ADR-0133's viability/unknown semantics | Durable region-set/watermark reconciliation covering every owned representation, suspended/viable stock and migration escrow. Missing/stale regions must prevent terminal extinction. |
| 12.8 | Deterministic seed/regime drivers and separate-process exact continuation | Reproducible integrated worlds running for actual days, real restarts/clone comparisons and retained accounting/diversity/cost audits. Accelerated tests cannot supply elapsed days. |
| 12.9 | M11 feedback and current UI review retained | Returning-player samples on the integrated ecology and explicit product/3D readiness decision after soak evidence. No M12 product acceptance or World0 promotion is inferred. |
@@ -107,6 +107,13 @@ is not an external branch identity or complete world watermark. World-level
history context/queries, client presentation and M12.7 reconciliation remain open;
neither primitive accepts terminal extinction.
M12.6c adds [scoped multi-region queries](../../schemas/ecology/scoped-cellular-census-set-v1.md)
over 1..64 explicitly declared regions. Exact coverage and simulation boundaries,
complete shared-genome identity and disjoint resident organism IDs are checked
before querying. Nonresident historical records add no living stock. A required
list supplied by a caller is still not durable world coverage; equal ticks alone
cannot prove a consistent migration cut or branch. This does not close M12.7.
Current expansion readiness: **no-go for M13 integration or World0 promotion**
while these M12 integration/evidence gates remain open. This records the present
engineering evidence, not a substitute for the later maintainer product review.
+11
View File
@@ -1,5 +1,16 @@
# Validation strategy
M12.6c's scoped census-set contract compares declared-region queries with direct
resident count/body/reserve oracles. Require missing/extra/duplicate regions,
every boundary field, unknown/invalid scope, conflicting immutable successor IDs,
repeated permanent resident IDs, detached observations and the 64-region work
bound. Real funded transfers must preserve stock across the combined set while
source-plus-incoming-copy observations fail. Committed raw/cohort histories
must also compose after full recovery. A refused set yields no partial/zero
total. Native Release, Linux Release, relevant ASan/UBSan, private population
history integration and Clang analysis/format qualify this read-only change.
No global coverage or terminal-extinction claim follows from these checks.
M12.6b's private PostgreSQL history tests require exact fixed-watermark pagination
after new no-tick publications, preserved genesis/profile/migration cuts, unchanged
heads/stock and repeated event identity. Invalid limits, false cuts/regions/frames,
+56
View File
@@ -1,5 +1,61 @@
# Validation report
## 2026-10-18 - M12.6c scoped multi-region census queries
[ADR-0152](../adr/0152-scoped-cellular-census-sets.md) adds a portable detached
query over exactly 1..64 declared regions at one exact simulation boundary.
Missing/extra/duplicate regions, mismatched boundaries, conflicting complete
immutable genome records and duplicate permanent resident organism IDs refuse
construction. Queries preserve resident categories and checked count/body/reserve
sums. Unknown anchors remain errors; retained zero-carrier ancestry can report
scoped zero. Nonresident history is counted only as record occurrences.
Executed locally:
- MSVC **19.44.35217.0** Release full CTest **79/79 passed**, **14.56 s**;
final census rebuild/contract passed after the analysis-only test correction.
- GCC 14 Release census/migration contracts **2/2 passed**, **2.48 s**.
- Clang 19 Linux **ASan/UBSan**, same contracts **2/2 passed**, **66.57 s**,
without sanitizer reports.
- Optional GCC persistence/process targets rebuilt; private PostgreSQL population
qualification **exit 0**, **19 s** (15 s population phase). Committed raw/cohort
paired migration histories compose after full recovery and preserve resident
lineage counts across direction changes. The runner used a fresh isolated
temporary cluster and stopped it on exit.
- Explicit clang-tidy 19 covered both census sources and census, migration and
population integration tests. It found a missing defensive default in an integer
test selector; that was fixed and affected tests rechecked without owned warnings.
Repository clang-format 19 and `git diff --check` passed.
Real funded mutation successors exercise conflicting world genome identities;
funded migration checks every resident category's count/body/reserve, excludes
departed history, retains suspended stock and permits mixed raw/cohort observations.
A source plus incoming destination copy fails duplicate ownership checks.
Declared coverage, all boundary fields, unknown/invalid scopes, known absence,
detachment and the 64-region work bound are exercised under NDEBUG.
The first test fixture incorrectly supplied unequal founder allocation IDs;
public birth validation rejected it. Tests now use valid funded births/mutations,
without bypassing biology. The initial sandboxed native run could not create
existing hard-link fixtures; the complete rerun with filesystem access passed.
No golden, biological rule/format, SQL schema, dependency or ownership change.
Limits: the required list is caller-declared, not a durable complete world catalog.
No external branch identity or reconciled cross-region migration watermark is
supplied. Equal-tick source-after/destination-before cuts can omit a migrant;
duplicate detection alone cannot prove completeness. This API accepts neither
world absence nor terminal extinction. Client permissions/presentation and
deployment-host query/index costs remain open. No new TSan, full SQL/backup/DR
matrix, remote CI, multi-host drill or multi-day soak was run for this portable
read-only change; M12.6b retains the preceding full persistence regression.
No deployment, live database or World0 action.
Logs: `build/m126c-final-native.log`, `build/m126c-final-native-census.log`,
`build/m126c-final-gcc.log`, `build/m126c-final-asan.log`,
`build/m126c-postgres-build.log`, `build/m126c-postgres.log`,
`build/m126c-tidy.log`, `build/m126c-final-tidy.log`,
`build/m126c-final-format.log`.
## 2026-10-18 - M12.6b committed regional census history
ADR-0151 uses the retained immutable biological commit journal as canonical