Files
aevolution/docs/engineering/TEST_STRATEGY.md
T
dingoandClaude Opus 5 d5b4bd068e Initial commit: architecture docs and headless engineering proof
Aeternalis Evolution, a custom-engine persistent evolutionary MMO.

This first commit establishes the project skeleton:

- Architecture and design docs: project vision, system overview,
  engineering constitution, roadmap, 19 ADRs, and the simulation,
  world, network, persistence and infrastructure architectures.
- Headless engineering proof: deterministic synthetic particles,
  component lifecycle, explicit PRNG streams, canonical snapshots
  and restored execution.
- Build and tooling: CMake 3.28+ / Ninja presets, C++23 feature
  check, clang-format and clang-tidy config, format check script,
  Windows check script, and a Docker build context.
- Tests: unit tests, benchmarks, a snapshot fuzz target and CLI
  integration wiring.

No gameplay, renderer, network service or running deployment yet.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
2026-09-14 15:44:41 -04:00

2.8 KiB

Validation strategy

Tests defend contracts, not directory coverage. All checks remain active in Release builds. Current proof has no actual network, biology or distributed recovery, so those categories below are milestone gates rather than passing test labels attached to empty targets.

Category Foundation evidence Future gate
Unit PRNG reference vectors, entity lifecycle, capacity/error boundaries Genome development and energetic transfer rules
Deterministic regression Frozen canonical fingerprint plus independent reference calculation; uninterrupted vs restored execution Versioned ecosystem baseline ensembles
Property-style Many explicit seeds and tick split points; coordinate and ID invariants Conservation, nonnegative mass/population and phenotype prerequisites
Serialization Exact byte round-trip, malformed lengths/versions/checksum/IDs/coordinates; validate before publication Compatible migrations, verified object archive and replay range
Integration CLI seed/ticks and replay verification; file save/load comparison Durable death/reproduction acknowledgment and worker process kill
Fuzz Optional libFuzzer snapshot decoder with bounded input and sanitizer instrumentation Authenticated protocol/parser and migration fuzzing
Static/sanitizers clang-format/tidy; ASan/UBSan and separate TSan configurations TSan on real scheduler and I/O lifecycle
Benchmark/load Seed/count/tick/time/compiler report for kernel; no noisy portable time threshold 20+ clients, region load, interest bandwidth, recovery backlog
Biological regression Absent until M2; do not call synthetic particles an ecosystem Million-tick balances, predator/prey cycles, starvation, diversity and extinction
Disaster recovery Absent until persistent services exist Off-host verified backup restore; database/object consistency; old owner fencing

Reference fixture, rules/format 1: seed 123456, create 8 particles at (0,0), then 1,000 ticks yields canonical payload FNV-1a d61ad5bf0c928c76. Expected positions by ID: (49,10), (985,993), (39,33), (1008,0), (16,1), (7,3), (1004,1007), (995,15). The initial value was computed independently in JavaScript with explicit wrapping BigInt arithmetic, not copied from the C++ test result. SplitMix64 seed-zero vectors begin e220a8397b1dcdaf, 6e789e6aa1b965f4, 06c45d188009454f, f88bb8a8724c81ec.

Changing a golden requires a stated rule/format change, compatibility decision, independent review and updated documentation. A new compiler or optimization mode must reproduce existing integer fixtures. Floating-point biology later needs error envelopes and ensemble comparisons in addition to exact fixtures.

Unexecuted configurations are not validation. Record exact tools, commands, results and limitations in VALIDATION.md at the end of each foundation change.