Evaluate row storage against pinned EnTT in an isolated deterministic benchmark

This commit is contained in:
dingo
2026-09-19 14:16:45 -04:00
parent 1c6e6e119a
commit bf7d60b7cd
16 changed files with 861 additions and 7 deletions
+124
View File
@@ -0,0 +1,124 @@
# M1.5 ECS evaluation protocol
Scope: synthetic composition storage, not biological rules. Public SimulationWorld,
its golden fingerprint, rules version and snapshot format remain unchanged.
## Workload and controls
Both adapters store a stable u64 ID and counter, with optional Motion and Capture
counter components. These are workload labels, not organism classes or energy.
Seed 123456 selects capabilities independently at 10% and 100% prevalence.
Run 1000 and 10000 entities, 100 update passes, one warmup and seven measured
samples. Alternate adapter order between samples to reduce simple ordering bias.
Both adapters use three ordered system passes per tick. One adds 3 to every
common counter; the next adds Motion.rate then increments that
rate by 1, and adds Capture.rate then increments it by 2. These independent
integer operations have a closed-form reference. No wall clock enters state.
After updates, remove every tenth original entity and create the same number
with new monotonic IDs. Each adapter rejects stale IDs and preserves external
identity despite storage relocation/native handle recycling.
Measure population creation (excluding the empty store constructor), updates,
churn, canonical encoding and fresh restore
separately. Export sorts by external ID and explicitly encodes fields little
endian. Decode checks exact size, bounded count, ID ordering and capability
flags. This in-memory experimental format is not production persistence.
Compare full bytes after every correctness phase and after restore/continuation;
fingerprints in reports are convenient checks, not substitutes for equality.
The row adapter extends the proof's sorted-row strategy with optional fields;
it is not a benchmark of the unmodified production binary. EnTT uses sparse
views and an external-ID-to-handle vector. That map's allocation is counted.
Neither adapter reserves ahead to conceal growth; both start empty. No owning
groups or per-tick sorting is applied because updates do not interact across
entities. A production interaction scheduler must specify stable conflict order.
EnTT receives a small allocator-traits bridge backed by the counting resource.
Direct polymorphic_allocator failed compilation because allocator-aware storage
construction received a second injected allocator. The bridge preserves normal
allocator-traits construction and tracks rebound allocations; it is benchmark
instrumentation, not a new production allocator. Lifetime-balance tests apply
to both adapters. Allocation failures abort the experiment at its host boundary;
these internal fixture adapters do not claim transactional recovery.
External IDs are capped at 200000 in this experiment. The EnTT lookup vector
retains space for retired IDs until store destruction. This is deliberately
measured, not an acceptable unbounded mapping for a persistent region. A
production EnTT adapter would need a separately evaluated bounded/sparse map.
## Memory and evidence
Track allocation calls, live requested bytes and peak requested bytes for store
containers through a dedicated std::pmr resource. Exclude canonical snapshot
scratch/output, stack, allocator metadata and process RSS. Check all tracked
bytes return to zero on adapter destruction. Do not call this total memory.
Report construction/iteration/churn/export/restore timings for every sample,
seed, count, density, compiler and build type; summarize medians and ranges.
Measure cold/warm target build time and executable size separately. Do not
compare wall times between Windows and Linux as if hosts/flags were controlled.
## Acceptance and decision
Correctness gates: hand-checkable arithmetic fixture; density/seed ensembles;
empty/singleton stores; stale/duplicate identities; churn; byte equality;
malformed codec inputs; restore then continued equality; allocator balance.
Timing has no CI threshold. Regression checks remain active under NDEBUG.
Prefer the simpler strategy when it satisfies measured needs. A candidate's
query speed cannot excuse unstable IDs, hidden iteration-order semantics,
unbounded adapter retention or more memory than the region budget supports.
Document the measured recommendation in ADR-0005; any later production adapter
needs a separate contract review and unchanged replay tests.
## Reproduction
After initializing the compiler environment (Windows: run the existing check
helper once in the same shell):
```sh
cmake -P tools/prepare-entt.cmake
cmake --preset release -B build/ecs -DEVO_BUILD_ECS_EXPERIMENT=ON
cmake --build build/ecs --target evo-ecs-experiment --parallel 2
ctest --test-dir build/ecs -R ecs-experiment --output-on-failure
./build/ecs/evo-ecs-experiment --measure
```
Preparation is the only network step. Repeating configure/build uses the verified
local header offline. Use .exe on Windows. Never place EnTT headers in include/evo.
## Windows observations, 2026-09-19
MSVC 19.44.35217.0 (/O2, NDEBUG), CMake 3.31.6, Ninja 1.12.1; Windows
10.0.26200 on Ryzen 7 9800X3D (8 cores / 16 logical processors). Seven samples
after warmup; [raw JSONL](results/ecs-msvc1944.jsonl) includes every sample and
fingerprint. Measurements were recorded after compiler jobs completed. There
is no controlled CPU isolation or portable performance threshold.
10000 entities, median elapsed milliseconds; update column is **100 ticks**,
churn removes/replaces 1000 individuals. Memory is live requested container bytes.
| Store / density | Create ms | Update ms | Churn ms | Export ms | Restore ms | Live bytes |
|---|---:|---:|---:|---:|---:|---:|
| Rows / 10% | 0.3366 | 0.7365 | 1.3883 | 0.3019 | 0.3056 | 485520 |
| EnTT4 / 10% | 0.4178 | 0.9868 | 0.0952 | 0.6435 | 0.5067 | 638608 |
| Rows / 100% | 0.2699 | 0.9237 | 1.3829 | 0.2873 | 0.2561 | 485520 |
| EnTT4 / 100% | 0.5777 | 7.0615 | 0.1399 | 0.6269 | 0.6842 | 866632 |
All paired samples have identical canonical bytes. EnTT wins this individual
churn case by roughly 10–15x; rows win the measured simple updates/export and
use fewer live bytes. EnTT's peak bytes can be lower than the row vector's
temporary reallocation peak: at 10% density, 638608 versus 809200. Do not equate
live bytes, peak requested bytes and process RSS.
The combined comparison executable is 99328 bytes; it contains both adapters
and verification code, so this is not an isolated EnTT binary-size delta.
Clean target build observed 2.7621 seconds, warm no-op 0.0475 seconds
(configuration excluded; OS file cache not flushed).
No claim of allocator-overhead/RSS measurement is made.
Recommendation: keep the current bounded row proof while designing the
deterministic scheduler. Preserve a future adapter boundary. Revisit with real
component sizes, dynamic capabilities, interacting systems, EnTT groups, batched
structural changes and a bounded persistent-ID mapping before production adoption.
Do not extrapolate these synthetic counts into organism/player capacity.
+19
View File
@@ -99,3 +99,22 @@ Registry digest:
The dev manifest pins this digest. This proves build/test/image delivery; Argo
application mapping and Kubernetes Job completion remain unverified locally.
## M1.5 native ECS experiment
Opt-in target evo-ecs-experiment (EnTT4 pinned in ADR-0021), based on 1c6e6e1 plus
this experiment's changes. MSVC Release contract checks passed, including 72
seed/density/count combinations, hand-calculated arithmetic, canonical equality,
restore continuation, retired-ID rejection, malformed snapshot checks and
allocator balance. The final clang-tidy build/test passed after tightening the
process-boundary diagnostic catch. MSVC ASan passed on the final source.
Baseline Release CTest remained 5/5
and format-check included the experiment. No simulation rule/golden changed.
Commands: configure release/analysis/asan with `-B build/ecs[-analysis|-asan]
-DEVO_BUILD_ECS_EXPERIMENT=ON`, build target evo-ecs-experiment, then
`ctest --test-dir <directory> -R ecs-experiment --output-on-failure`.
Seven measured samples plus warmup are retained in results/ecs-msvc1944.jsonl;
protocol, build observations and scope limits are in ECS_EVALUATION.md. The
Linux experiment CI job is pending its first pushed run; no Linux experiment
success is claimed yet.
@@ -0,0 +1,57 @@
{"experiment":"ecs-storage-v1","entt":"4.0.0","compiler":"MSVC 1944","build":"release"}
{"store":"rows","entities":1000,"density_percent":10,"seed":123456,"ticks":100,"sample":0,"create_s":2.81e-05,"tick_s":6.63e-05,"churn_s":1.32e-05,"export_s":4.53e-05,"restore_s":4.25e-05,"live_bytes":42640,"peak_bytes":71080,"allocations":18,"hash":"ae6c58eaaffcbb17"}
{"store":"entt4","entities":1000,"density_percent":10,"seed":123456,"ticks":100,"sample":0,"create_s":7.81e-05,"tick_s":9.88e-05,"churn_s":1.1e-05,"export_s":7.13e-05,"restore_s":9.6e-05,"live_bytes":136420,"peak_bytes":140684,"allocations":127,"hash":"ae6c58eaaffcbb17"}
{"store":"entt4","entities":1000,"density_percent":10,"seed":123456,"ticks":100,"sample":1,"create_s":7.7e-05,"tick_s":9.98e-05,"churn_s":1.01e-05,"export_s":5.91e-05,"restore_s":8.8e-05,"live_bytes":136420,"peak_bytes":140684,"allocations":127,"hash":"ae6c58eaaffcbb17"}
{"store":"rows","entities":1000,"density_percent":10,"seed":123456,"ticks":100,"sample":1,"create_s":2.88e-05,"tick_s":6.55e-05,"churn_s":1.29e-05,"export_s":4.55e-05,"restore_s":4.63e-05,"live_bytes":42640,"peak_bytes":71080,"allocations":18,"hash":"ae6c58eaaffcbb17"}
{"store":"rows","entities":1000,"density_percent":10,"seed":123456,"ticks":100,"sample":2,"create_s":2.77e-05,"tick_s":6.49e-05,"churn_s":1.19e-05,"export_s":4.58e-05,"restore_s":5.06e-05,"live_bytes":42640,"peak_bytes":71080,"allocations":18,"hash":"ae6c58eaaffcbb17"}
{"store":"entt4","entities":1000,"density_percent":10,"seed":123456,"ticks":100,"sample":2,"create_s":9.09e-05,"tick_s":9.79e-05,"churn_s":1.07e-05,"export_s":6.93e-05,"restore_s":8.76e-05,"live_bytes":136420,"peak_bytes":140684,"allocations":127,"hash":"ae6c58eaaffcbb17"}
{"store":"entt4","entities":1000,"density_percent":10,"seed":123456,"ticks":100,"sample":3,"create_s":7.86e-05,"tick_s":9.56e-05,"churn_s":9.9e-06,"export_s":5.7e-05,"restore_s":9.21e-05,"live_bytes":136420,"peak_bytes":140684,"allocations":127,"hash":"ae6c58eaaffcbb17"}
{"store":"rows","entities":1000,"density_percent":10,"seed":123456,"ticks":100,"sample":3,"create_s":5.1e-05,"tick_s":6.47e-05,"churn_s":1.25e-05,"export_s":4.22e-05,"restore_s":5.37e-05,"live_bytes":42640,"peak_bytes":71080,"allocations":18,"hash":"ae6c58eaaffcbb17"}
{"store":"rows","entities":1000,"density_percent":10,"seed":123456,"ticks":100,"sample":4,"create_s":4.27e-05,"tick_s":6.41e-05,"churn_s":1.17e-05,"export_s":3.95e-05,"restore_s":4.42e-05,"live_bytes":42640,"peak_bytes":71080,"allocations":18,"hash":"ae6c58eaaffcbb17"}
{"store":"entt4","entities":1000,"density_percent":10,"seed":123456,"ticks":100,"sample":4,"create_s":8.94e-05,"tick_s":9.84e-05,"churn_s":9.8e-06,"export_s":6.44e-05,"restore_s":8.1e-05,"live_bytes":136420,"peak_bytes":140684,"allocations":127,"hash":"ae6c58eaaffcbb17"}
{"store":"entt4","entities":1000,"density_percent":10,"seed":123456,"ticks":100,"sample":5,"create_s":7.87e-05,"tick_s":9.89e-05,"churn_s":9.7e-06,"export_s":5.17e-05,"restore_s":8.32e-05,"live_bytes":136420,"peak_bytes":140684,"allocations":127,"hash":"ae6c58eaaffcbb17"}
{"store":"rows","entities":1000,"density_percent":10,"seed":123456,"ticks":100,"sample":5,"create_s":3.96e-05,"tick_s":6.39e-05,"churn_s":1.15e-05,"export_s":5.08e-05,"restore_s":4.27e-05,"live_bytes":42640,"peak_bytes":71080,"allocations":18,"hash":"ae6c58eaaffcbb17"}
{"store":"rows","entities":1000,"density_percent":10,"seed":123456,"ticks":100,"sample":6,"create_s":4.27e-05,"tick_s":6.36e-05,"churn_s":1.13e-05,"export_s":3.76e-05,"restore_s":3.52e-05,"live_bytes":42640,"peak_bytes":71080,"allocations":18,"hash":"ae6c58eaaffcbb17"}
{"store":"entt4","entities":1000,"density_percent":10,"seed":123456,"ticks":100,"sample":6,"create_s":7.03e-05,"tick_s":9.59e-05,"churn_s":9.7e-06,"export_s":5.69e-05,"restore_s":8.19e-05,"live_bytes":136420,"peak_bytes":140684,"allocations":127,"hash":"ae6c58eaaffcbb17"}
{"store":"rows","entities":1000,"density_percent":100,"seed":123456,"ticks":100,"sample":0,"create_s":2.94e-05,"tick_s":8.8e-05,"churn_s":1.12e-05,"export_s":3.37e-05,"restore_s":3.32e-05,"live_bytes":42640,"peak_bytes":71080,"allocations":18,"hash":"c18e5db8d060af79"}
{"store":"entt4","entities":1000,"density_percent":100,"seed":123456,"ticks":100,"sample":0,"create_s":8.48e-05,"tick_s":0.0006977,"churn_s":1.57e-05,"export_s":5.87e-05,"restore_s":9.88e-05,"live_bytes":143820,"peak_bytes":148084,"allocations":137,"hash":"c18e5db8d060af79"}
{"store":"entt4","entities":1000,"density_percent":100,"seed":123456,"ticks":100,"sample":1,"create_s":8.11e-05,"tick_s":0.0006962,"churn_s":1.45e-05,"export_s":5.14e-05,"restore_s":8.87e-05,"live_bytes":143820,"peak_bytes":148084,"allocations":137,"hash":"c18e5db8d060af79"}
{"store":"rows","entities":1000,"density_percent":100,"seed":123456,"ticks":100,"sample":1,"create_s":2.91e-05,"tick_s":8.79e-05,"churn_s":1.17e-05,"export_s":3.23e-05,"restore_s":2.73e-05,"live_bytes":42640,"peak_bytes":71080,"allocations":18,"hash":"c18e5db8d060af79"}
{"store":"rows","entities":1000,"density_percent":100,"seed":123456,"ticks":100,"sample":2,"create_s":2.87e-05,"tick_s":8.78e-05,"churn_s":1.13e-05,"export_s":3.32e-05,"restore_s":2.68e-05,"live_bytes":42640,"peak_bytes":71080,"allocations":18,"hash":"c18e5db8d060af79"}
{"store":"entt4","entities":1000,"density_percent":100,"seed":123456,"ticks":100,"sample":2,"create_s":8.22e-05,"tick_s":0.0006988,"churn_s":1.56e-05,"export_s":5.53e-05,"restore_s":8.88e-05,"live_bytes":143820,"peak_bytes":148084,"allocations":137,"hash":"c18e5db8d060af79"}
{"store":"entt4","entities":1000,"density_percent":100,"seed":123456,"ticks":100,"sample":3,"create_s":8.08e-05,"tick_s":0.0006977,"churn_s":1.46e-05,"export_s":4.99e-05,"restore_s":8.7e-05,"live_bytes":143820,"peak_bytes":148084,"allocations":137,"hash":"c18e5db8d060af79"}
{"store":"rows","entities":1000,"density_percent":100,"seed":123456,"ticks":100,"sample":3,"create_s":2.95e-05,"tick_s":8.79e-05,"churn_s":1.14e-05,"export_s":3.07e-05,"restore_s":2.69e-05,"live_bytes":42640,"peak_bytes":71080,"allocations":18,"hash":"c18e5db8d060af79"}
{"store":"rows","entities":1000,"density_percent":100,"seed":123456,"ticks":100,"sample":4,"create_s":2.97e-05,"tick_s":8.8e-05,"churn_s":1.12e-05,"export_s":3.29e-05,"restore_s":2.63e-05,"live_bytes":42640,"peak_bytes":71080,"allocations":18,"hash":"c18e5db8d060af79"}
{"store":"entt4","entities":1000,"density_percent":100,"seed":123456,"ticks":100,"sample":4,"create_s":8.1e-05,"tick_s":0.0007039,"churn_s":1.56e-05,"export_s":5.57e-05,"restore_s":8.82e-05,"live_bytes":143820,"peak_bytes":148084,"allocations":137,"hash":"c18e5db8d060af79"}
{"store":"entt4","entities":1000,"density_percent":100,"seed":123456,"ticks":100,"sample":5,"create_s":7.98e-05,"tick_s":0.0007589,"churn_s":1.52e-05,"export_s":5.54e-05,"restore_s":8.72e-05,"live_bytes":143820,"peak_bytes":148084,"allocations":137,"hash":"c18e5db8d060af79"}
{"store":"rows","entities":1000,"density_percent":100,"seed":123456,"ticks":100,"sample":5,"create_s":2.91e-05,"tick_s":9e-05,"churn_s":1.19e-05,"export_s":3.06e-05,"restore_s":2.75e-05,"live_bytes":42640,"peak_bytes":71080,"allocations":18,"hash":"c18e5db8d060af79"}
{"store":"rows","entities":1000,"density_percent":100,"seed":123456,"ticks":100,"sample":6,"create_s":2.93e-05,"tick_s":8.73e-05,"churn_s":1.12e-05,"export_s":3.34e-05,"restore_s":2.73e-05,"live_bytes":42640,"peak_bytes":71080,"allocations":18,"hash":"c18e5db8d060af79"}
{"store":"entt4","entities":1000,"density_percent":100,"seed":123456,"ticks":100,"sample":6,"create_s":7.99e-05,"tick_s":0.0007663,"churn_s":1.54e-05,"export_s":5.61e-05,"restore_s":8.8e-05,"live_bytes":143820,"peak_bytes":148084,"allocations":137,"hash":"c18e5db8d060af79"}
{"store":"rows","entities":10000,"density_percent":10,"seed":123456,"ticks":100,"sample":0,"create_s":0.0003536,"tick_s":0.0007323,"churn_s":0.0013903,"export_s":0.0003548,"restore_s":0.0003743,"live_bytes":485520,"peak_bytes":809200,"allocations":24,"hash":"1e0aaac006ff1a06"}
{"store":"entt4","entities":10000,"density_percent":10,"seed":123456,"ticks":100,"sample":0,"create_s":0.0004459,"tick_s":0.001013,"churn_s":9.47e-05,"export_s":0.0006435,"restore_s":0.0005379,"live_bytes":638608,"peak_bytes":638608,"allocations":212,"hash":"1e0aaac006ff1a06"}
{"store":"entt4","entities":10000,"density_percent":10,"seed":123456,"ticks":100,"sample":1,"create_s":0.0004167,"tick_s":0.0009827,"churn_s":9.84e-05,"export_s":0.0006469,"restore_s":0.0005008,"live_bytes":638608,"peak_bytes":638608,"allocations":212,"hash":"1e0aaac006ff1a06"}
{"store":"rows","entities":10000,"density_percent":10,"seed":123456,"ticks":100,"sample":1,"create_s":0.0003366,"tick_s":0.0007453,"churn_s":0.001388,"export_s":0.0003228,"restore_s":0.000392,"live_bytes":485520,"peak_bytes":809200,"allocations":24,"hash":"1e0aaac006ff1a06"}
{"store":"rows","entities":10000,"density_percent":10,"seed":123456,"ticks":100,"sample":2,"create_s":0.000375,"tick_s":0.0007312,"churn_s":0.0013888,"export_s":0.0002883,"restore_s":0.000289,"live_bytes":485520,"peak_bytes":809200,"allocations":24,"hash":"1e0aaac006ff1a06"}
{"store":"entt4","entities":10000,"density_percent":10,"seed":123456,"ticks":100,"sample":2,"create_s":0.0004178,"tick_s":0.0009963,"churn_s":9.48e-05,"export_s":0.0006384,"restore_s":0.0004966,"live_bytes":638608,"peak_bytes":638608,"allocations":212,"hash":"1e0aaac006ff1a06"}
{"store":"entt4","entities":10000,"density_percent":10,"seed":123456,"ticks":100,"sample":3,"create_s":0.0004159,"tick_s":0.0010396,"churn_s":9.85e-05,"export_s":0.0006736,"restore_s":0.000545,"live_bytes":638608,"peak_bytes":638608,"allocations":212,"hash":"1e0aaac006ff1a06"}
{"store":"rows","entities":10000,"density_percent":10,"seed":123456,"ticks":100,"sample":3,"create_s":0.0003283,"tick_s":0.0008778,"churn_s":0.0013898,"export_s":0.0003027,"restore_s":0.0002713,"live_bytes":485520,"peak_bytes":809200,"allocations":24,"hash":"1e0aaac006ff1a06"}
{"store":"rows","entities":10000,"density_percent":10,"seed":123456,"ticks":100,"sample":4,"create_s":0.0003473,"tick_s":0.0007322,"churn_s":0.0013875,"export_s":0.0002874,"restore_s":0.0003056,"live_bytes":485520,"peak_bytes":809200,"allocations":24,"hash":"1e0aaac006ff1a06"}
{"store":"entt4","entities":10000,"density_percent":10,"seed":123456,"ticks":100,"sample":4,"create_s":0.0004432,"tick_s":0.0009824,"churn_s":9.52e-05,"export_s":0.0006572,"restore_s":0.0004959,"live_bytes":638608,"peak_bytes":638608,"allocations":212,"hash":"1e0aaac006ff1a06"}
{"store":"entt4","entities":10000,"density_percent":10,"seed":123456,"ticks":100,"sample":5,"create_s":0.0004146,"tick_s":0.0009868,"churn_s":9.52e-05,"export_s":0.0006328,"restore_s":0.000528,"live_bytes":638608,"peak_bytes":638608,"allocations":212,"hash":"1e0aaac006ff1a06"}
{"store":"rows","entities":10000,"density_percent":10,"seed":123456,"ticks":100,"sample":5,"create_s":0.0003105,"tick_s":0.0007455,"churn_s":0.0013883,"export_s":0.0003019,"restore_s":0.0002687,"live_bytes":485520,"peak_bytes":809200,"allocations":24,"hash":"1e0aaac006ff1a06"}
{"store":"rows","entities":10000,"density_percent":10,"seed":123456,"ticks":100,"sample":6,"create_s":0.0002835,"tick_s":0.0007365,"churn_s":0.0013849,"export_s":0.0002923,"restore_s":0.0003155,"live_bytes":485520,"peak_bytes":809200,"allocations":24,"hash":"1e0aaac006ff1a06"}
{"store":"entt4","entities":10000,"density_percent":10,"seed":123456,"ticks":100,"sample":6,"create_s":0.000445,"tick_s":0.0009866,"churn_s":9.48e-05,"export_s":0.0006257,"restore_s":0.0005067,"live_bytes":638608,"peak_bytes":638608,"allocations":212,"hash":"1e0aaac006ff1a06"}
{"store":"rows","entities":10000,"density_percent":100,"seed":123456,"ticks":100,"sample":0,"create_s":0.000264,"tick_s":0.0009358,"churn_s":0.0013822,"export_s":0.0002945,"restore_s":0.000296,"live_bytes":485520,"peak_bytes":809200,"allocations":24,"hash":"56e63b67590e4cf9"}
{"store":"entt4","entities":10000,"density_percent":100,"seed":123456,"ticks":100,"sample":0,"create_s":0.0005764,"tick_s":0.0071502,"churn_s":0.0001714,"export_s":0.0006253,"restore_s":0.0006842,"live_bytes":866632,"peak_bytes":866632,"allocations":252,"hash":"56e63b67590e4cf9"}
{"store":"entt4","entities":10000,"density_percent":100,"seed":123456,"ticks":100,"sample":1,"create_s":0.0005531,"tick_s":0.0070694,"churn_s":0.0001399,"export_s":0.0006572,"restore_s":0.0007577,"live_bytes":866632,"peak_bytes":866632,"allocations":252,"hash":"56e63b67590e4cf9"}
{"store":"rows","entities":10000,"density_percent":100,"seed":123456,"ticks":100,"sample":1,"create_s":0.0002631,"tick_s":0.0009242,"churn_s":0.0013859,"export_s":0.0002801,"restore_s":0.0002415,"live_bytes":485520,"peak_bytes":809200,"allocations":24,"hash":"56e63b67590e4cf9"}
{"store":"rows","entities":10000,"density_percent":100,"seed":123456,"ticks":100,"sample":2,"create_s":0.0003084,"tick_s":0.0009203,"churn_s":0.0013826,"export_s":0.0002853,"restore_s":0.0002531,"live_bytes":485520,"peak_bytes":809200,"allocations":24,"hash":"56e63b67590e4cf9"}
{"store":"entt4","entities":10000,"density_percent":100,"seed":123456,"ticks":100,"sample":2,"create_s":0.0005777,"tick_s":0.0071149,"churn_s":0.0001429,"export_s":0.0006525,"restore_s":0.0007687,"live_bytes":866632,"peak_bytes":866632,"allocations":252,"hash":"56e63b67590e4cf9"}
{"store":"entt4","entities":10000,"density_percent":100,"seed":123456,"ticks":100,"sample":3,"create_s":0.0005635,"tick_s":0.0070522,"churn_s":0.0001399,"export_s":0.0006252,"restore_s":0.0006686,"live_bytes":866632,"peak_bytes":866632,"allocations":252,"hash":"56e63b67590e4cf9"}
{"store":"rows","entities":10000,"density_percent":100,"seed":123456,"ticks":100,"sample":3,"create_s":0.0002591,"tick_s":0.0009237,"churn_s":0.0016731,"export_s":0.0002873,"restore_s":0.0002896,"live_bytes":485520,"peak_bytes":809200,"allocations":24,"hash":"56e63b67590e4cf9"}
{"store":"rows","entities":10000,"density_percent":100,"seed":123456,"ticks":100,"sample":4,"create_s":0.0003584,"tick_s":0.0009218,"churn_s":0.0013859,"export_s":0.0003422,"restore_s":0.0002999,"live_bytes":485520,"peak_bytes":809200,"allocations":24,"hash":"56e63b67590e4cf9"}
{"store":"entt4","entities":10000,"density_percent":100,"seed":123456,"ticks":100,"sample":4,"create_s":0.0005855,"tick_s":0.0070491,"churn_s":0.0001392,"export_s":0.0006269,"restore_s":0.0006574,"live_bytes":866632,"peak_bytes":866632,"allocations":252,"hash":"56e63b67590e4cf9"}
{"store":"entt4","entities":10000,"density_percent":100,"seed":123456,"ticks":100,"sample":5,"create_s":0.0005805,"tick_s":0.0070615,"churn_s":0.0001407,"export_s":0.0006198,"restore_s":0.0006525,"live_bytes":866632,"peak_bytes":866632,"allocations":252,"hash":"56e63b67590e4cf9"}
{"store":"rows","entities":10000,"density_percent":100,"seed":123456,"ticks":100,"sample":5,"create_s":0.0002699,"tick_s":0.0009311,"churn_s":0.0013829,"export_s":0.0002835,"restore_s":0.0002378,"live_bytes":485520,"peak_bytes":809200,"allocations":24,"hash":"56e63b67590e4cf9"}
{"store":"rows","entities":10000,"density_percent":100,"seed":123456,"ticks":100,"sample":6,"create_s":0.0003301,"tick_s":0.0009232,"churn_s":0.0013792,"export_s":0.0003064,"restore_s":0.0002561,"live_bytes":485520,"peak_bytes":809200,"allocations":24,"hash":"56e63b67590e4cf9"}
{"store":"entt4","entities":10000,"density_percent":100,"seed":123456,"ticks":100,"sample":6,"create_s":0.0005805,"tick_s":0.0070573,"churn_s":0.0001395,"export_s":0.0006499,"restore_s":0.000742,"live_bytes":866632,"peak_bytes":866632,"allocations":252,"hash":"56e63b67590e4cf9"}