M12.4: retain and settle owned population intervals
Foundation / checks (deploy) (push) Successful in 5s
Foundation / checks (ecs) (push) Successful in 2m28s
Foundation / checks (tsan) (push) Failing after 18m22s
Foundation / checks (network) (push) Successful in 20m38s
Foundation / checks (client) (push) Failing after 21m6s
Foundation / postgres-tools (push) Canceled after 0s
Foundation / server-image (push) Canceled after 0s
Foundation / image (push) Canceled after 0s
Foundation / checks (postgres) (push) Canceled after 46m54s
Foundation / checks (checks) (push) Canceled after 47m3s

This commit is contained in:
dingo
2026-10-17 17:31:05 -04:00
parent 627411983f
commit 0a8962b57e
34 changed files with 1032 additions and 75 deletions
+16
View File
@@ -1,5 +1,21 @@
# Project status and next steps
## M12.4b owned population intervals - 2026-10-17
ADR-0143/schema 45 records one bounded interval before computation and settles it
atomically with its exact checkpoint. Replacement owners retain the same pending
work; zero newly due ticks can finish a recovered interval. Unknown admission
pauses readiness and retries its immutable source/end. A separate durable pending
tick metric complements local debt and checkpoint age.
New entry/work requires fully suspended controlled cells: the existing 200-tick
vulnerable linger and permanent-ending path stays on profile 4. Old traces retain
their meaning, and either profile's recovery reconciles owned corpses. No new
biological version, immunity, dependency or deployment was introduced. See
[scope and evidence](engineering/M12_OWNED_POPULATION_INTERVALS.md). Biological
migration escrow and linked-boundary/resource contracts remain the next M12.4
work; this does not close all of M12 or enable production automatically.
## M12.3b durable exact populations - 2026-10-17
ADR-0142 and schema 44 add dedicated population profile 5, trace 1, immutable
@@ -0,0 +1,71 @@
# ADR-0143: Owned bounded population intervals
## Status
Accepted for M12.4's opt-in engineering path, 2026-10-17. Extends ADR-0133,
0141 and 0142 without changing biology, controller decisions or World0 policy.
M12.4b's interval segment is implemented and validated. Biological migration and
the rest of M12.4 remain separate work; this does not close the entire gate.
## Context
Local confirmed-head pacing preserves debt while an owner runs, but loses its
unpublished interval on process loss. Inferring a replacement interval from elapsed
wall time would violate the accepted outage pause and could change controlled
biology. Profile 5 already supplies exact frozen-player/wildlife replay and bounded
publication. It needs a durable operational admission boundary.
## Decision
Admit one interval per region under its current lease and exact profile-5 head.
Bind the source commit/digest, begin/end ticks, controller version, admitting
holder and epoch. Intervals contain 1..64 unchanged 50 ms biological steps. Keep
admission records immutable. Identical retries return the same interval; different
end boundaries for one source conflict. New admissions require the exact current
head and no unsettled predecessor interval.
Write its immutable settlement with the checkpoint in the same transaction.
Normal profile-5 biological publication must consume precisely its admission;
manual conversion or profile exit waits while any interval is unsettled. Old
committed records remain recoverable and exactly retryable without fabricated
retroactive admission records. Generic publishers cannot bypass these guards.
A replacement fenced owner loads pending admission before selecting fresh work.
It advances from the verified source using the recorded controller version and
frozen controlled intentions, then publishes the exact trace/payload. Unknown
admission replies retain the same request until reconciliation; unknown checkpoint
replies retain their existing prepared bytes. Read-only resolution grants no
authority. A returning player waits for this bounded admitted interval, then the
host materializes before admitting player operations.
New profile entry and interval preparation require every controlled cell to be
fully suspended. Frozen intentions alone are insufficient: during the existing
200-tick linger period a cell is still vulnerable to predation, and its permanent
ending must stay on the existing profile-4 path. That path finishes linger and
records any death before entry; no new immunity or biological timer is introduced.
Earlier profile-5 traces remain verifiable with their original semantics and can
be materialized. Recovery reconciles retained owned corpses for either profile,
so an older post-commit/pre-ending crash cannot leave its account bound forever.
Collect one second of due time for routine unattended admissions, service at most
64 ticks per batch, and preserve debt until the confirmed head consumes it. A
short terminal-u64 remainder is admitted without waiting for 20 ticks. Report
pending admitted ticks separately from local due debt and checkpoint freshness.
Capacity pressure pauses admission; it cannot drop an admitted interval or cull
organisms. Unadmitted wall time remains paused across outage (ADR-0133).
## Alternatives
Keeping only a local deadline loses admitted work on restart. Reconstructing it
from database timestamps adds an unaccepted catch-up policy. A transaction per
tick violates the founding durability requirement. An unbounded queue conceals
resource commitments and makes returning-player latency unbounded.
## Consequences and limits
This adds a bounded operational journal and transaction guards, not a new time
integrator or ecological rule. Require duplicate/conflicting admissions, lost
replies, stale writers, process loss before/after admission and publication,
restart with zero new due time, and exact uninterrupted continuation comparisons.
Migration escrow, delayed boundary coupling, environmental ownership and multi-day
evidence remain separate M12 work. Production enablement stays off by default.
+9
View File
@@ -40,6 +40,15 @@ state, materializes before player operations and never treats read-only commit
resolution as current authority. See [the contract](../../schemas/cellular-population-batch.md)
and [qualification limits](../engineering/M12_DURABLE_POPULATIONS.md).
ADR-0143/schema 45 adds one durable 1..64-tick admission per population head,
with immutable source/digest/ticks/controller evidence and an atomically maintained
pending pointer. Settlement and checkpoint publication share one transaction.
Recovery services that exact pending prefix before fresh work; conversion/profile
exit cannot skip it. Unknown admission retains the same request and pauses
readiness. New work requires fully suspended controlled cells, leaving vulnerable
linger/death on profile 4. Earlier trace semantics remain readable. See the
[interval contract](../../schemas/ecology/population-interval-v1.md).
World/region/frame are nonzero durable IDs. No ID is a Pod name. The host records
its unique holder ID and monotonically increasing nonzero lease epoch. Exhaustion
of IDs, epochs, commit sequences or ticks fails closed; never wrap/reuse them.
+9 -4
View File
@@ -20,7 +20,7 @@ removes stale ownership tags; funded births begin as individuals. Suspension
continues to freeze controlled biology regardless of representation elsewhere.
The model retains exact members and makes no aggregation speedup claim. There is
no regional population approximation, process migration or production selector.
no regional population approximation or biological cross-region migration.
The existing 256-life ceiling remains; target-host service capacity is separate.
M12.3 adds [population envelope 1](../../schemas/cellular-population.md), detached
@@ -34,9 +34,14 @@ biology restore together; loading a checkpoint does not reselect members.
`conversion_candidate` leaves the predecessor intact and returns the complete
exact successor for fenced publication. Successful candidate creation and local
checkpoint file writes are not durable production acknowledgements. A dedicated
PostgreSQL profile/trace/publication adapter is still required; existing raw
cellular profile 4 cannot contain this envelope. The separate-process test
demonstrates identical continuation, not power-loss or database-failover safety.
PostgreSQL adapter now uses dedicated profile 5 (ADR-0142), leaving raw profile 4
unchanged. ADR-0143 adds owned bounded unattended intervals. New entry and interval
publication require fully suspended controlled cells; active/lingering cells stay
on the existing raw path so permanent endings remain correct. Older recorded
traces remain verifiable. The selector is opt-in and off by default; see
[durable populations](../engineering/M12_DURABLE_POPULATIONS.md) and
[owned intervals](../engineering/M12_OWNED_POPULATION_INTERVALS.md) for evidence
and the remaining production qualification.
Run `evo-cellular-cohorts --verify` for the CTest matrix or omit the option for
8192 ticks per case. The executable compares complete canonical state every tick,
+1 -1
View File
@@ -11,7 +11,7 @@ Commit and push each validated scoped segment separately.
| 12.1 | Engineering evidence policy and explicit deferrals documented | ADR-0133, identity/time contract and worked histories; no new game rules or runtime versions. |
| 12.2 | Exact local model selected and paired qualification implemented (12.2d); production cost gate open | ADR-0139, exact canonical equality across 196,608 paired ticks per platform. Regional approximation disabled; no compression claim. Deployment-host capacity and fuller interaction coverage remain open. |
| 12.3 | Exact population profile/trace/store and opt-in host integration implemented (12.3b) | ADR-0142, schema 44; exact publication/recovery, mutation race guards, ambiguous replies and process kills. Executable/network population fault drills and target-host qualification remain open. |
| 12.4 | Current-worker unattended demand and confirmed-head pacing implemented (12.4a) | ADR-0141. Population durable intervals and biological migration escrow remain unimplemented. |
| 12.4 | Unattended demand/pacing plus owned population interval admission/recovery implemented (12.4b) | ADR-0143/schema 45; bounded durable pending work, exact settlement, replacement-owner and uncertainty tests. Biological migration escrow and boundary/stock-in-transit evidence remain open. |
| 12.5 | Blocked on 12.2-12.4 | Finite M6 process fixtures do not qualify coupled persistent cellular/cohort atmosphere/water budgets. |
| 12.6 | Existing local archive retained; integrated population history open | World-level durable event/query/client path remains required. |
| 12.7 | Evidence policy defined; reconciler open | Complete durable world watermark and every viable/in-flight store remain required. |
@@ -61,6 +61,11 @@ services at most 64 fixed steps per batch. The portable input builder matches an
independent per-tick fixture. This removes per-tick SQL publication from the new
population path; it does not yet make local pacing debt a durable admission queue.
M12.4b subsequently adds the [owned interval journal](M12_OWNED_POPULATION_INTERVALS.md).
It restricts new entry/work to fully suspended controlled cells, preserving the
vulnerable linger/death path on profile 4. Earlier traces remain verifiable, and
retained owned corpses are reconciled after either profile's recovery.
Still open: profile-5 executable/network fault drills, deployment-host tail costs,
durable ecological interval admission and biological migration escrow, jointly
owned environmental budgets, world-level history/extinction reconciliation and
@@ -0,0 +1,64 @@
# M12.4b owned unattended population intervals
ADR-0143 and schema 45 add one durable admitted interval per population region.
The source commit/digest and exact begin/end ticks identify it; immutable admission
and settlement journals retain its history. A bounded pending pointer makes work
lookup independent of accumulated history. Publication settles that exact interval
atomically with its checkpoint. An aborting transaction leaves it pending.
The optional worker collects at least 20 due ticks (one second), services at most
64 unchanged 50 ms steps, and consumes debt only from a confirmed head. The final
short u64 remainder cannot wrap or wait forever. A recovered pending interval runs
with zero newly due time; it does not consume or delay fresh wall-time accounting.
Admission uncertainty retains the same source/end request and pauses readiness.
Checkpoint uncertainty retains its complete prepared bytes. Neither a timeout,
duplicate request nor new lease may resample work, skip its prefix or reopen it.
The host reports `evo_region_ecological_pending_ticks` (0..64), separately from
local tick debt and checkpoint age. Fresh unadmitted wall time remains paused
during outage/uncertainty. This does not introduce whole-world catch-up.
## Suspension and retained compatibility
Inspection of ADR-0128 and the cellular kernel found an important restriction:
frozen intentions stop controlled biology, but lingering cells remain vulnerable
for 200 ticks. New population entry and interval preparation therefore require
every controlled cell fully suspended. Linger/death stays on the existing raw
cellular path, which records account endings before population entry. This changes
operational admission, not immunity, movement, funding, biology versions or goldens.
Existing profile-5 envelopes and recorded frozen/lingering traces retain their
meaning. Recovery verifies them and allows reverse materialization; new biological
publication from such an unsafe source is refused. Either profile's recovery now
reconciles retained owned corpses, including a legacy post-commit/pre-ending crash.
The portable general population model and its active-player qualification remain
unchanged; the durable unattended profile has the stricter admission contract.
## Evidence and limits
The private PostgreSQL fixture uses funded reserved founders and descendants. It
publishes the real 201-tick raw suspension prefix before new profile entry. Tests
cover duplicate/conflicting/oversized admissions, partial settlement refusal,
conversion/profile-exit refusal while pending, a replacement epoch retaining the
same interval, exact settlement, old retry without reopening work, and revoked
private publisher access. Publisher SIGKILLs before transaction/after commit/after
pipe ACK also verify whether the interval remains pending or settled.
An actual owning host is drained/recreated with pending work. It restores the
same head, refuses early materialization, services the recorded interval with
zero new due ticks, and then permits player operations. Lease-row contention
causes a real admission timeout; readiness and biology stay paused until the
identical request reconciles, then its exact reference trajectory publishes.
The 65-tick local request is capped at 64; a 19-tick routine window waits.
Fixed-clock tests check recovered-prefix accounting, bounded retry without fresh
debt, overflow/refusal and metrics shape/cardinality. Legacy trace replay and new
active/lingering-source refusal are separate contract checks. Executed compiler,
sanitizer and database results are recorded in [VALIDATION](VALIDATION.md).
This closes the scoped interval-admission/recovery segment. Biological cross-region
escrow, delayed boundary coupling and stock-in-transit audits remain M12.4 work.
No probe inventory stands in for biological stock. Deployment-host costs, mixed
controlled/cohort publication, environmental coupling, integrated history/global
extinction and actual multi-day/product qualification remain open. Production
entry stays disabled by default; no live region or World0 was changed.
+7 -5
View File
@@ -14,8 +14,10 @@ now support exact population membership with entry disabled by default. Private
PostgreSQL tests cover ambiguity, fencing, profile races and publisher process
kills. [Scope and limits](M12_DURABLE_POPULATIONS.md) distinguish those tests from
executable/network fault drills and deployment-host qualification still required.
This resolves the architectural profile conflict and permits the next durable
interval work. It does not close all of M12.3 or authorize production enablement.
This resolves the architectural profile conflict. ADR-0143/schema 45 now adds
bounded durable interval admission and exact settlement/recovery, with fully
suspended controlled cells required for new work. It does not close all of M12.3
or authorize production enablement.
## Dependent ecological integration
@@ -23,7 +25,7 @@ interval work. It does not close all of M12.3 or authorize production enablement
|---|---|---|
| 12.2 | Exact cellular model and paired matrix; local samples through 256 lives | Deployment-host tail costs including publication; larger wildlife cohorts, predation/twins and contention coverage; useful compression remains unimplemented. |
| 12.3 | Dedicated population profile/trace/store/owning host; exact recovery and private PostgreSQL fault tests | Population-specific executable/network fault drills and target-host publication/capacity qualification. |
| 12.4 | Current worker advances unattended wildlife and preserves running scheduling debt | Durable ecological interval admission/backlog recovery; exact biological source/destination escrow, partition/duplicate settlement and stock-in-transit audits. |
| 12.4 | Current-worker demand/debt plus owned bounded population intervals and restart backlog recovery | Exact biological source/destination escrow, partition/duplicate settlement, linked-boundary contracts and stock-in-transit audits. |
| 12.5 | Finite cellular contact feeding/decay and separate M6 producer/consumer resource owner | One jointly owned cellular/environment budget, explicit effective depth and source entitlements, versioned water/atmosphere species mapping and producer coefficients, plus closed/open and nutrient-exhaustion comparisons. |
| 12.6 | Retained genome/organism archive with ancestry and common-ancestor queries | Append-only population census/history events in the same durable commit, bounded world history queries/indexing and client presentation; no account power or invented precise statistical ancestry. |
| 12.7 | ADR-0133's viability/unknown semantics | Durable region-set/watermark reconciliation covering every owned representation, suspended/viable stock and migration escrow. Missing/stale regions must prevent terminal extinction. |
@@ -40,8 +42,8 @@ and photosynthesis steps B/C do not silently become accepted M12 mechanics.
The engineering constitution requires stopping expansion at this architectural
boundary and documenting the resolution. That does not prevent the independent
worker scheduling correction or the dedicated exact population adapter above.
Durable ecological intervals are the next substantive coding segment; none of
the rows above is closed by adding a placeholder service.
Biological migration escrow is the next M12.4 boundary; none of the rows above is
closed by adding a placeholder service or relabeling the non-biological probe.
Current expansion readiness: **no-go for M13 integration or World0 promotion**
while these M12 integration/evidence gates remain open. This records the present
+45
View File
@@ -1,5 +1,50 @@
# Validation report
## 2026-10-17 - M12.4b owned population intervals
ADR-0143/schema 45 affects population admission/settlement journals, the owning
host, confirmed-head pacing and bounded operational metrics. New entry/work waits
for full controlled suspension; legacy trace replay and owned-corpse recovery are
retained. Biology versions, old goldens and the general population kernel remain
unchanged. No live region, World0 operation or new dependency.
Executed:
- MSVC 19.44 Release configure/build and **76/76 CTests** (final 10.39 s), including
active/lingering-source refusal, retained legacy trace replay, recovered-prefix
clock accounting and fixed-cardinality pending-work metrics.
- Analysis-preset clang-tidy 19 and repository format check; direct portable
population/pacing/metrics CTests **3/3 passed** (4.40 s).
- Actual GCC QUIC/PostgreSQL server build; focused private PostgreSQL suite with
the final suspension source **passed, exit 0, 6 s**. Real reserved founders fund
descendants; 201 raw frozen steps finish linger before new profile entry.
- Tests reject conflicting/oversized admissions, shortened settlement, conversion
or profile exit while pending, and the private pre-journal publisher. A new
epoch restores the same admission; committed retries do not reopen it. Real
publisher SIGKILLs verify pending versus settled work at each tested boundary.
- Recreated actual host finishes a pending interval with zero new due ticks.
Lease-row contention causes a real admission timeout; readiness and biology
stay paused until the exact request reconciles, then match uninterrupted
reference continuation. A 65-tick request is capped at 64; a routine 19 waits.
- Actual PostgreSQL host/adapter tests under Clang 19 **ASan/UBSan passed, exit 0,
19 s**, default sanitizer environment, no reports. The earlier 21 s run disabled
leak checking; the final default-environment run above supersedes it.
- Actual optional Clang server build and explicit clang-tidy 19 on the interval
store, population publication store, host, integration tests and worker. The
final repeated-branch cleanup in error classification passes its follow-up
tidy check; no owned warnings remain.
Final frozen-binary `postgres-check.sh --full` **passed, exit 0, 497 s**: complete
C++ suite (422 s), independent reservation connections, backup/restore, host-loss
DR, upgrade, migration-history, permission and checksum-drift checks. Migration
history and rollback drills include schema 45; private old publishers are revoked.
Limits: these remain private-cluster publisher/host tests, not population-specific
network ACK fault qualification or actual multi-day ecology. Biological migration
escrow, delayed linked-boundary coupling and stock-in-transit audits remain open;
the M10 probe is not biological evidence. Details:
[M12_OWNED_POPULATION_INTERVALS](M12_OWNED_POPULATION_INTERVALS.md).
## 2026-10-17 - M12.3b durable exact population publication
ADR-0142 affects portable lifecycle batches/checkpoint manifests, optional