docs: correct the v0.27.0 backfill claim — prod needs no backfill
The v0.27.0 notes said prod held 4 histograms that would stay empty until a backfill. That was wrong, and asserted without checking. Verified: all four recovered files (K440HJCN.3C0H, K557IF1U.8K0H, T191HVNP.0S0H, T193L0XM.CI0H) are archive-only — none appears in the production store or the events DB. Re-running stride detection over the prod store's 10,215 histogram binaries under both the old and new code shows 0 files whose decode changes. So the partial-final-block fix is forward-looking: it matters for future ingests of sub-minute histograms with a partial final block, not for anything already stored. TOOL_VERSION still moves with the release, so a future backfill run will regenerate the whole store instead of skipping. Harmless — byte-identical output for every stored file — but it costs the full ~2 hours on the NAS, so it should not be started casually. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01HgTe8CamXAHcAmaQ6QNcog
This commit is contained in:
+11
-3
@@ -39,9 +39,17 @@ carried, and it found one real codec bug (below).
|
||||
walk double-counts every binary — 127,035 paths are 63,535 distinct files. The
|
||||
ASCII exports are *not* mirrored, so the 14,340 pair count is already distinct.)
|
||||
|
||||
⚠ Prod stores hold `.h5` files generated before this fix. Those 4 events stay
|
||||
empty until `backfill_sidecars.py` is re-run — not worth a two-hour prod backfill
|
||||
on its own; fold it into the next one.
|
||||
**No prod backfill is required for this.** Verified after the fact: all four
|
||||
recovered files are archive-only — none exists in the production store or the
|
||||
events DB — and re-running stride detection over the production store's
|
||||
**10,215** histogram binaries shows **0 files whose decode changes**. The fix
|
||||
matters for future ingests of sub-minute histograms with a partial final block,
|
||||
not for anything already stored.
|
||||
|
||||
(`TOOL_VERSION` moves with the release, so whenever a backfill *is* next run for
|
||||
some other reason it will regenerate the whole store rather than skipping. That
|
||||
is harmless — the output is byte-identical for every currently-stored file — but
|
||||
it means the run takes its full ~2 hours on the NAS.)
|
||||
|
||||
- **Histogram/waveform twin matching is now interval-based** (`find_twins`). A real
|
||||
trigger is recorded twice — as a triggered waveform (stamped at the trigger instant)
|
||||
|
||||
Reference in New Issue
Block a user