M12.4: retain and settle owned population intervals
Foundation / checks (deploy) (push) Successful in 5s
Foundation / checks (ecs) (push) Successful in 2m28s
Foundation / checks (tsan) (push) Failing after 18m22s
Foundation / checks (network) (push) Successful in 20m38s
Foundation / checks (client) (push) Failing after 21m6s
Foundation / postgres-tools (push) Canceled after 0s
Foundation / server-image (push) Canceled after 0s
Foundation / image (push) Canceled after 0s
Foundation / checks (postgres) (push) Canceled after 46m54s
Foundation / checks (checks) (push) Canceled after 47m3s
Foundation / checks (deploy) (push) Successful in 5s
Foundation / checks (ecs) (push) Successful in 2m28s
Foundation / checks (tsan) (push) Failing after 18m22s
Foundation / checks (network) (push) Successful in 20m38s
Foundation / checks (client) (push) Failing after 21m6s
Foundation / postgres-tools (push) Canceled after 0s
Foundation / server-image (push) Canceled after 0s
Foundation / image (push) Canceled after 0s
Foundation / checks (postgres) (push) Canceled after 46m54s
Foundation / checks (checks) (push) Canceled after 47m3s
This commit is contained in:
@@ -1,5 +1,21 @@
|
||||
# Project status and next steps
|
||||
|
||||
## M12.4b owned population intervals - 2026-10-17
|
||||
|
||||
ADR-0143/schema 45 records one bounded interval before computation and settles it
|
||||
atomically with its exact checkpoint. Replacement owners retain the same pending
|
||||
work; zero newly due ticks can finish a recovered interval. Unknown admission
|
||||
pauses readiness and retries its immutable source/end. A separate durable pending
|
||||
tick metric complements local debt and checkpoint age.
|
||||
|
||||
New entry/work requires fully suspended controlled cells: the existing 200-tick
|
||||
vulnerable linger and permanent-ending path stays on profile 4. Old traces retain
|
||||
their meaning, and either profile's recovery reconciles owned corpses. No new
|
||||
biological version, immunity, dependency or deployment was introduced. See
|
||||
[scope and evidence](engineering/M12_OWNED_POPULATION_INTERVALS.md). Biological
|
||||
migration escrow and linked-boundary/resource contracts remain the next M12.4
|
||||
work; this does not close all of M12 or enable production automatically.
|
||||
|
||||
## M12.3b durable exact populations - 2026-10-17
|
||||
|
||||
ADR-0142 and schema 44 add dedicated population profile 5, trace 1, immutable
|
||||
|
||||
@@ -0,0 +1,71 @@
|
||||
# ADR-0143: Owned bounded population intervals
|
||||
|
||||
## Status
|
||||
|
||||
Accepted for M12.4's opt-in engineering path, 2026-10-17. Extends ADR-0133,
|
||||
0141 and 0142 without changing biology, controller decisions or World0 policy.
|
||||
M12.4b's interval segment is implemented and validated. Biological migration and
|
||||
the rest of M12.4 remain separate work; this does not close the entire gate.
|
||||
|
||||
## Context
|
||||
|
||||
Local confirmed-head pacing preserves debt while an owner runs, but loses its
|
||||
unpublished interval on process loss. Inferring a replacement interval from elapsed
|
||||
wall time would violate the accepted outage pause and could change controlled
|
||||
biology. Profile 5 already supplies exact frozen-player/wildlife replay and bounded
|
||||
publication. It needs a durable operational admission boundary.
|
||||
|
||||
## Decision
|
||||
|
||||
Admit one interval per region under its current lease and exact profile-5 head.
|
||||
Bind the source commit/digest, begin/end ticks, controller version, admitting
|
||||
holder and epoch. Intervals contain 1..64 unchanged 50 ms biological steps. Keep
|
||||
admission records immutable. Identical retries return the same interval; different
|
||||
end boundaries for one source conflict. New admissions require the exact current
|
||||
head and no unsettled predecessor interval.
|
||||
|
||||
Write its immutable settlement with the checkpoint in the same transaction.
|
||||
Normal profile-5 biological publication must consume precisely its admission;
|
||||
manual conversion or profile exit waits while any interval is unsettled. Old
|
||||
committed records remain recoverable and exactly retryable without fabricated
|
||||
retroactive admission records. Generic publishers cannot bypass these guards.
|
||||
|
||||
A replacement fenced owner loads pending admission before selecting fresh work.
|
||||
It advances from the verified source using the recorded controller version and
|
||||
frozen controlled intentions, then publishes the exact trace/payload. Unknown
|
||||
admission replies retain the same request until reconciliation; unknown checkpoint
|
||||
replies retain their existing prepared bytes. Read-only resolution grants no
|
||||
authority. A returning player waits for this bounded admitted interval, then the
|
||||
host materializes before admitting player operations.
|
||||
|
||||
New profile entry and interval preparation require every controlled cell to be
|
||||
fully suspended. Frozen intentions alone are insufficient: during the existing
|
||||
200-tick linger period a cell is still vulnerable to predation, and its permanent
|
||||
ending must stay on the existing profile-4 path. That path finishes linger and
|
||||
records any death before entry; no new immunity or biological timer is introduced.
|
||||
Earlier profile-5 traces remain verifiable with their original semantics and can
|
||||
be materialized. Recovery reconciles retained owned corpses for either profile,
|
||||
so an older post-commit/pre-ending crash cannot leave its account bound forever.
|
||||
|
||||
Collect one second of due time for routine unattended admissions, service at most
|
||||
64 ticks per batch, and preserve debt until the confirmed head consumes it. A
|
||||
short terminal-u64 remainder is admitted without waiting for 20 ticks. Report
|
||||
pending admitted ticks separately from local due debt and checkpoint freshness.
|
||||
Capacity pressure pauses admission; it cannot drop an admitted interval or cull
|
||||
organisms. Unadmitted wall time remains paused across outage (ADR-0133).
|
||||
|
||||
## Alternatives
|
||||
|
||||
Keeping only a local deadline loses admitted work on restart. Reconstructing it
|
||||
from database timestamps adds an unaccepted catch-up policy. A transaction per
|
||||
tick violates the founding durability requirement. An unbounded queue conceals
|
||||
resource commitments and makes returning-player latency unbounded.
|
||||
|
||||
## Consequences and limits
|
||||
|
||||
This adds a bounded operational journal and transaction guards, not a new time
|
||||
integrator or ecological rule. Require duplicate/conflicting admissions, lost
|
||||
replies, stale writers, process loss before/after admission and publication,
|
||||
restart with zero new due time, and exact uninterrupted continuation comparisons.
|
||||
Migration escrow, delayed boundary coupling, environmental ownership and multi-day
|
||||
evidence remain separate M12 work. Production enablement stays off by default.
|
||||
@@ -40,6 +40,15 @@ state, materializes before player operations and never treats read-only commit
|
||||
resolution as current authority. See [the contract](../../schemas/cellular-population-batch.md)
|
||||
and [qualification limits](../engineering/M12_DURABLE_POPULATIONS.md).
|
||||
|
||||
ADR-0143/schema 45 adds one durable 1..64-tick admission per population head,
|
||||
with immutable source/digest/ticks/controller evidence and an atomically maintained
|
||||
pending pointer. Settlement and checkpoint publication share one transaction.
|
||||
Recovery services that exact pending prefix before fresh work; conversion/profile
|
||||
exit cannot skip it. Unknown admission retains the same request and pauses
|
||||
readiness. New work requires fully suspended controlled cells, leaving vulnerable
|
||||
linger/death on profile 4. Earlier trace semantics remain readable. See the
|
||||
[interval contract](../../schemas/ecology/population-interval-v1.md).
|
||||
|
||||
World/region/frame are nonzero durable IDs. No ID is a Pod name. The host records
|
||||
its unique holder ID and monotonically increasing nonzero lease epoch. Exhaustion
|
||||
of IDs, epochs, commit sequences or ticks fails closed; never wrap/reuse them.
|
||||
|
||||
@@ -20,7 +20,7 @@ removes stale ownership tags; funded births begin as individuals. Suspension
|
||||
continues to freeze controlled biology regardless of representation elsewhere.
|
||||
|
||||
The model retains exact members and makes no aggregation speedup claim. There is
|
||||
no regional population approximation, process migration or production selector.
|
||||
no regional population approximation or biological cross-region migration.
|
||||
The existing 256-life ceiling remains; target-host service capacity is separate.
|
||||
|
||||
M12.3 adds [population envelope 1](../../schemas/cellular-population.md), detached
|
||||
@@ -34,9 +34,14 @@ biology restore together; loading a checkpoint does not reselect members.
|
||||
`conversion_candidate` leaves the predecessor intact and returns the complete
|
||||
exact successor for fenced publication. Successful candidate creation and local
|
||||
checkpoint file writes are not durable production acknowledgements. A dedicated
|
||||
PostgreSQL profile/trace/publication adapter is still required; existing raw
|
||||
cellular profile 4 cannot contain this envelope. The separate-process test
|
||||
demonstrates identical continuation, not power-loss or database-failover safety.
|
||||
PostgreSQL adapter now uses dedicated profile 5 (ADR-0142), leaving raw profile 4
|
||||
unchanged. ADR-0143 adds owned bounded unattended intervals. New entry and interval
|
||||
publication require fully suspended controlled cells; active/lingering cells stay
|
||||
on the existing raw path so permanent endings remain correct. Older recorded
|
||||
traces remain verifiable. The selector is opt-in and off by default; see
|
||||
[durable populations](../engineering/M12_DURABLE_POPULATIONS.md) and
|
||||
[owned intervals](../engineering/M12_OWNED_POPULATION_INTERVALS.md) for evidence
|
||||
and the remaining production qualification.
|
||||
|
||||
Run `evo-cellular-cohorts --verify` for the CTest matrix or omit the option for
|
||||
8192 ticks per case. The executable compares complete canonical state every tick,
|
||||
|
||||
@@ -11,7 +11,7 @@ Commit and push each validated scoped segment separately.
|
||||
| 12.1 | Engineering evidence policy and explicit deferrals documented | ADR-0133, identity/time contract and worked histories; no new game rules or runtime versions. |
|
||||
| 12.2 | Exact local model selected and paired qualification implemented (12.2d); production cost gate open | ADR-0139, exact canonical equality across 196,608 paired ticks per platform. Regional approximation disabled; no compression claim. Deployment-host capacity and fuller interaction coverage remain open. |
|
||||
| 12.3 | Exact population profile/trace/store and opt-in host integration implemented (12.3b) | ADR-0142, schema 44; exact publication/recovery, mutation race guards, ambiguous replies and process kills. Executable/network population fault drills and target-host qualification remain open. |
|
||||
| 12.4 | Current-worker unattended demand and confirmed-head pacing implemented (12.4a) | ADR-0141. Population durable intervals and biological migration escrow remain unimplemented. |
|
||||
| 12.4 | Unattended demand/pacing plus owned population interval admission/recovery implemented (12.4b) | ADR-0143/schema 45; bounded durable pending work, exact settlement, replacement-owner and uncertainty tests. Biological migration escrow and boundary/stock-in-transit evidence remain open. |
|
||||
| 12.5 | Blocked on 12.2-12.4 | Finite M6 process fixtures do not qualify coupled persistent cellular/cohort atmosphere/water budgets. |
|
||||
| 12.6 | Existing local archive retained; integrated population history open | World-level durable event/query/client path remains required. |
|
||||
| 12.7 | Evidence policy defined; reconciler open | Complete durable world watermark and every viable/in-flight store remain required. |
|
||||
|
||||
@@ -61,6 +61,11 @@ services at most 64 fixed steps per batch. The portable input builder matches an
|
||||
independent per-tick fixture. This removes per-tick SQL publication from the new
|
||||
population path; it does not yet make local pacing debt a durable admission queue.
|
||||
|
||||
M12.4b subsequently adds the [owned interval journal](M12_OWNED_POPULATION_INTERVALS.md).
|
||||
It restricts new entry/work to fully suspended controlled cells, preserving the
|
||||
vulnerable linger/death path on profile 4. Earlier traces remain verifiable, and
|
||||
retained owned corpses are reconciled after either profile's recovery.
|
||||
|
||||
Still open: profile-5 executable/network fault drills, deployment-host tail costs,
|
||||
durable ecological interval admission and biological migration escrow, jointly
|
||||
owned environmental budgets, world-level history/extinction reconciliation and
|
||||
|
||||
@@ -0,0 +1,64 @@
|
||||
# M12.4b owned unattended population intervals
|
||||
|
||||
ADR-0143 and schema 45 add one durable admitted interval per population region.
|
||||
The source commit/digest and exact begin/end ticks identify it; immutable admission
|
||||
and settlement journals retain its history. A bounded pending pointer makes work
|
||||
lookup independent of accumulated history. Publication settles that exact interval
|
||||
atomically with its checkpoint. An aborting transaction leaves it pending.
|
||||
|
||||
The optional worker collects at least 20 due ticks (one second), services at most
|
||||
64 unchanged 50 ms steps, and consumes debt only from a confirmed head. The final
|
||||
short u64 remainder cannot wrap or wait forever. A recovered pending interval runs
|
||||
with zero newly due time; it does not consume or delay fresh wall-time accounting.
|
||||
Admission uncertainty retains the same source/end request and pauses readiness.
|
||||
Checkpoint uncertainty retains its complete prepared bytes. Neither a timeout,
|
||||
duplicate request nor new lease may resample work, skip its prefix or reopen it.
|
||||
|
||||
The host reports `evo_region_ecological_pending_ticks` (0..64), separately from
|
||||
local tick debt and checkpoint age. Fresh unadmitted wall time remains paused
|
||||
during outage/uncertainty. This does not introduce whole-world catch-up.
|
||||
|
||||
## Suspension and retained compatibility
|
||||
|
||||
Inspection of ADR-0128 and the cellular kernel found an important restriction:
|
||||
frozen intentions stop controlled biology, but lingering cells remain vulnerable
|
||||
for 200 ticks. New population entry and interval preparation therefore require
|
||||
every controlled cell fully suspended. Linger/death stays on the existing raw
|
||||
cellular path, which records account endings before population entry. This changes
|
||||
operational admission, not immunity, movement, funding, biology versions or goldens.
|
||||
|
||||
Existing profile-5 envelopes and recorded frozen/lingering traces retain their
|
||||
meaning. Recovery verifies them and allows reverse materialization; new biological
|
||||
publication from such an unsafe source is refused. Either profile's recovery now
|
||||
reconciles retained owned corpses, including a legacy post-commit/pre-ending crash.
|
||||
The portable general population model and its active-player qualification remain
|
||||
unchanged; the durable unattended profile has the stricter admission contract.
|
||||
|
||||
## Evidence and limits
|
||||
|
||||
The private PostgreSQL fixture uses funded reserved founders and descendants. It
|
||||
publishes the real 201-tick raw suspension prefix before new profile entry. Tests
|
||||
cover duplicate/conflicting/oversized admissions, partial settlement refusal,
|
||||
conversion/profile-exit refusal while pending, a replacement epoch retaining the
|
||||
same interval, exact settlement, old retry without reopening work, and revoked
|
||||
private publisher access. Publisher SIGKILLs before transaction/after commit/after
|
||||
pipe ACK also verify whether the interval remains pending or settled.
|
||||
|
||||
An actual owning host is drained/recreated with pending work. It restores the
|
||||
same head, refuses early materialization, services the recorded interval with
|
||||
zero new due ticks, and then permits player operations. Lease-row contention
|
||||
causes a real admission timeout; readiness and biology stay paused until the
|
||||
identical request reconciles, then its exact reference trajectory publishes.
|
||||
The 65-tick local request is capped at 64; a 19-tick routine window waits.
|
||||
|
||||
Fixed-clock tests check recovered-prefix accounting, bounded retry without fresh
|
||||
debt, overflow/refusal and metrics shape/cardinality. Legacy trace replay and new
|
||||
active/lingering-source refusal are separate contract checks. Executed compiler,
|
||||
sanitizer and database results are recorded in [VALIDATION](VALIDATION.md).
|
||||
|
||||
This closes the scoped interval-admission/recovery segment. Biological cross-region
|
||||
escrow, delayed boundary coupling and stock-in-transit audits remain M12.4 work.
|
||||
No probe inventory stands in for biological stock. Deployment-host costs, mixed
|
||||
controlled/cohort publication, environmental coupling, integrated history/global
|
||||
extinction and actual multi-day/product qualification remain open. Production
|
||||
entry stays disabled by default; no live region or World0 was changed.
|
||||
@@ -14,8 +14,10 @@ now support exact population membership with entry disabled by default. Private
|
||||
PostgreSQL tests cover ambiguity, fencing, profile races and publisher process
|
||||
kills. [Scope and limits](M12_DURABLE_POPULATIONS.md) distinguish those tests from
|
||||
executable/network fault drills and deployment-host qualification still required.
|
||||
This resolves the architectural profile conflict and permits the next durable
|
||||
interval work. It does not close all of M12.3 or authorize production enablement.
|
||||
This resolves the architectural profile conflict. ADR-0143/schema 45 now adds
|
||||
bounded durable interval admission and exact settlement/recovery, with fully
|
||||
suspended controlled cells required for new work. It does not close all of M12.3
|
||||
or authorize production enablement.
|
||||
|
||||
## Dependent ecological integration
|
||||
|
||||
@@ -23,7 +25,7 @@ interval work. It does not close all of M12.3 or authorize production enablement
|
||||
|---|---|---|
|
||||
| 12.2 | Exact cellular model and paired matrix; local samples through 256 lives | Deployment-host tail costs including publication; larger wildlife cohorts, predation/twins and contention coverage; useful compression remains unimplemented. |
|
||||
| 12.3 | Dedicated population profile/trace/store/owning host; exact recovery and private PostgreSQL fault tests | Population-specific executable/network fault drills and target-host publication/capacity qualification. |
|
||||
| 12.4 | Current worker advances unattended wildlife and preserves running scheduling debt | Durable ecological interval admission/backlog recovery; exact biological source/destination escrow, partition/duplicate settlement and stock-in-transit audits. |
|
||||
| 12.4 | Current-worker demand/debt plus owned bounded population intervals and restart backlog recovery | Exact biological source/destination escrow, partition/duplicate settlement, linked-boundary contracts and stock-in-transit audits. |
|
||||
| 12.5 | Finite cellular contact feeding/decay and separate M6 producer/consumer resource owner | One jointly owned cellular/environment budget, explicit effective depth and source entitlements, versioned water/atmosphere species mapping and producer coefficients, plus closed/open and nutrient-exhaustion comparisons. |
|
||||
| 12.6 | Retained genome/organism archive with ancestry and common-ancestor queries | Append-only population census/history events in the same durable commit, bounded world history queries/indexing and client presentation; no account power or invented precise statistical ancestry. |
|
||||
| 12.7 | ADR-0133's viability/unknown semantics | Durable region-set/watermark reconciliation covering every owned representation, suspended/viable stock and migration escrow. Missing/stale regions must prevent terminal extinction. |
|
||||
@@ -40,8 +42,8 @@ and photosynthesis steps B/C do not silently become accepted M12 mechanics.
|
||||
The engineering constitution requires stopping expansion at this architectural
|
||||
boundary and documenting the resolution. That does not prevent the independent
|
||||
worker scheduling correction or the dedicated exact population adapter above.
|
||||
Durable ecological intervals are the next substantive coding segment; none of
|
||||
the rows above is closed by adding a placeholder service.
|
||||
Biological migration escrow is the next M12.4 boundary; none of the rows above is
|
||||
closed by adding a placeholder service or relabeling the non-biological probe.
|
||||
|
||||
Current expansion readiness: **no-go for M13 integration or World0 promotion**
|
||||
while these M12 integration/evidence gates remain open. This records the present
|
||||
|
||||
@@ -1,5 +1,50 @@
|
||||
# Validation report
|
||||
|
||||
## 2026-10-17 - M12.4b owned population intervals
|
||||
|
||||
ADR-0143/schema 45 affects population admission/settlement journals, the owning
|
||||
host, confirmed-head pacing and bounded operational metrics. New entry/work waits
|
||||
for full controlled suspension; legacy trace replay and owned-corpse recovery are
|
||||
retained. Biology versions, old goldens and the general population kernel remain
|
||||
unchanged. No live region, World0 operation or new dependency.
|
||||
|
||||
Executed:
|
||||
|
||||
- MSVC 19.44 Release configure/build and **76/76 CTests** (final 10.39 s), including
|
||||
active/lingering-source refusal, retained legacy trace replay, recovered-prefix
|
||||
clock accounting and fixed-cardinality pending-work metrics.
|
||||
- Analysis-preset clang-tidy 19 and repository format check; direct portable
|
||||
population/pacing/metrics CTests **3/3 passed** (4.40 s).
|
||||
- Actual GCC QUIC/PostgreSQL server build; focused private PostgreSQL suite with
|
||||
the final suspension source **passed, exit 0, 6 s**. Real reserved founders fund
|
||||
descendants; 201 raw frozen steps finish linger before new profile entry.
|
||||
- Tests reject conflicting/oversized admissions, shortened settlement, conversion
|
||||
or profile exit while pending, and the private pre-journal publisher. A new
|
||||
epoch restores the same admission; committed retries do not reopen it. Real
|
||||
publisher SIGKILLs verify pending versus settled work at each tested boundary.
|
||||
- Recreated actual host finishes a pending interval with zero new due ticks.
|
||||
Lease-row contention causes a real admission timeout; readiness and biology
|
||||
stay paused until the exact request reconciles, then match uninterrupted
|
||||
reference continuation. A 65-tick request is capped at 64; a routine 19 waits.
|
||||
- Actual PostgreSQL host/adapter tests under Clang 19 **ASan/UBSan passed, exit 0,
|
||||
19 s**, default sanitizer environment, no reports. The earlier 21 s run disabled
|
||||
leak checking; the final default-environment run above supersedes it.
|
||||
- Actual optional Clang server build and explicit clang-tidy 19 on the interval
|
||||
store, population publication store, host, integration tests and worker. The
|
||||
final repeated-branch cleanup in error classification passes its follow-up
|
||||
tidy check; no owned warnings remain.
|
||||
|
||||
Final frozen-binary `postgres-check.sh --full` **passed, exit 0, 497 s**: complete
|
||||
C++ suite (422 s), independent reservation connections, backup/restore, host-loss
|
||||
DR, upgrade, migration-history, permission and checksum-drift checks. Migration
|
||||
history and rollback drills include schema 45; private old publishers are revoked.
|
||||
|
||||
Limits: these remain private-cluster publisher/host tests, not population-specific
|
||||
network ACK fault qualification or actual multi-day ecology. Biological migration
|
||||
escrow, delayed linked-boundary coupling and stock-in-transit audits remain open;
|
||||
the M10 probe is not biological evidence. Details:
|
||||
[M12_OWNED_POPULATION_INTERVALS](M12_OWNED_POPULATION_INTERVALS.md).
|
||||
|
||||
## 2026-10-17 - M12.3b durable exact population publication
|
||||
|
||||
ADR-0142 affects portable lifecycle batches/checkpoint manifests, optional
|
||||
|
||||
Reference in New Issue
Block a user