d0b66368d5
Merge pull request 'update to v0.21.1, thor data import successful' (#29) from dev into main
main
serversdown2026-06-01 16:54:23 -04:00
25386cab8b
fix(backfill): regenerate IDFH .h5 + merge binary mic_pspl_psi onto bridge Two gaps in backfill_thor_events.py that left old Thor events showing stale charts after a v0.21.1 backfill pass: 1. IDFH events were skipped from .h5 regeneration (the "have decoded samples" gate was IDFW-only). Histograms kept their pre-v0.21.1 .h5 — written from raw_samples = None, which the renderer turned into a near-empty bar chart, or for older events the dB(L)-as-pseudo- psi mic scale that produced "107.7 psi" peaks (atomic-bomb level instead of footstep level). Fix: synthesise the same 1-sample-per- interval array save_imported_idf v0.21.1 uses (peak ADC count per channel per interval) so the renderer's bar-chart grouping has data to work with. 2. The IDFW h5 path didn't merge binary_peaks.mic_pspl_psi onto the IdfEvent before to_minimateplus_event(). The live save_imported_idf does this merge — without it, IdfEvent.from_report() only sees the .txt's dB(L) value, the bridge falls back to the dBL→psi formula (instead of the binary-accurate 2.14e-6 psi/count value), and the h5 writer's per-count mic factor lands on a less-correct value. Fix: same merge the live ingest does (lift res.event.peaks.mic_pspl_psi onto idf_event.peaks before the bridge call). Verified against UM6047_20250804190047.IDFH (250-interval prod histogram): 250 intervals decode, mic_pspl_psi = 2.78e-5 (was being treated as dB(L)=107.7 in the old h5). Operator: re-run after deploy. docker compose exec sfm python scripts/backfill_thor_events.py is idempotent — the existing version check still skips events already at the new TOOL_VERSION, and review state + captured_at are preserved on the second pass.
dev
serversdown2026-06-01 20:02:54 +00:00
1ed86244d0
fix(thor-events): add parallel field for mic psi. Now shows mic in dbl and psi. (psi for charts)
serversdown2026-06-01 18:27:24 +00:00
b2c565f217
fix(idf_waveforms): _find_waveform_body_offset() — scans every 00 02 00 magic past offset 0x0E00, runs decode_waveform_v2 on each candidate, picks the one that returns the most samples. Validated on 483 prod IDFW files: 0 preamble-only events (was ~50%), 355/483 fully decode, 126/483 partial (BW codec walker-stops-early on loud events — known issue). IDFH now synthesises a 1-sample-per-interval array from the binary intervals and writes an .h5 so the existing renderer works unchanged. Each "sample" is the per-interval peak ADC count → h5_value = count × geo_fs/32768 yields the right bar height.
serversdown2026-05-31 20:51:09 +00:00
460006e5cd
sfm: stored-event browser at /events
serversdown2026-05-23 06:53:48 +00:00
8710b8f327
docs: record three known issues discovered during prod deployment
serversdown2026-05-22 21:02:13 +00:00
db657bcac9
Merge pull request 'fix: bw_report overlay onto event before DB, prevents data loss docs: three-tier architecture model + strategic roadmap' (#27) from feat/wire-histogram-codec into dev
serversdown2026-05-22 15:46:46 -04:00
35842ac50a
backfill: overlay bw_report onto Event before DB upsert
serversdown2026-05-22 18:56:22 +00:00
9ef424d098
Merge pull request 'Histogram body codec — full RE + peak-count fix that resolves the prod inflation incident' (#26) from feat/wire-histogram-codec into dev
serversdown2026-05-22 13:08:03 -04:00
cc821f9ee3
hotfix: fix dockerfile on main to fix import bug on prod
claude2026-05-21 20:42:15 +00:00
c3c7fe559c
docs: histogram body codec RE — starting-point status doc
serversdown2026-05-20 21:13:26 +00:00
fa9d3cdef2
read_blastware_file: leave peak_values=None when samples can't be decoded
serversdown2026-05-20 20:30:53 +00:00
c4648c1959
scripts/backfill_sidecars: skip .h5 write when decoder returned no samples
serversdown2026-05-20 20:16:31 +00:00
0e89125495
docker: fix dockerfile to include scripts and micromate folders
serversdown2026-05-20 19:58:54 +00:00
fffb363b2b
Merge pull request 'minimateplus: wire read_blastware_file to verified body codec' (#24) from feat/wire-codec-to-import-path into dev
serversdown2026-05-20 15:26:15 -04:00
e8682d49ad
scripts/backfill_sidecars: cascade h5 regen when sidecar is stale + bump TOOL_VERSION
serversdown2026-05-20 18:24:06 +00:00
31d691b40b
minimateplus: wire read_blastware_file to verified body codec
serversdown2026-05-20 18:13:24 +00:00
beca5de06e
docs: clean up and verify s3 protocol docs
serversdown2026-05-20 17:55:02 +00:00
d85df4c886
Merge pull request 'merge full s3 codec decoded' (#23) from codec-re into main
serversdown2026-05-20 13:45:32 -04:00
0466bb4f44
codec: crack wide-NN blocks (1X NN / 2X NN); loud events now fully decode
Claude
2026-05-16 03:29:13 +00:00
85f4bcfe86
codec: wire decode_waveform_v2 into production; add MicL dB helper
Claude
2026-05-16 00:27:14 +00:00
2ff2762eec
codec-re: 30 NN block CRACKED — codec fully decoded
Claude
2026-05-12 05:09:42 +00:00
d4cdce77fa
codec-re: 30 NN partial finding — sum matches but per-sample distribution doesn't
Claude
2026-05-12 04:41:59 +00:00
ce5dc640ba
codec-re: quiet bundle decodes FULLY (17k samples, zero errors)
Claude
2026-05-12 04:07:55 +00:00
07675626dc
codec-re: channel rotation CONFIRMED — full multi-channel decoder works
Claude
2026-05-12 03:57:38 +00:00
87675ac2d8
Merge pull request 'docker: add .dockerignore and Dockerfile for containerization.' (#20) from dockerize into main
serversdown2026-05-11 17:40:56 -04:00
83d69b9220
chore(server): update inline version to 0.16.0
serversdown2026-05-11 21:40:18 +00:00
3e247e2182
docker: add .dockerignore and Dockerfile for containerization.
serversdown2026-05-11 21:38:03 +00:00
d2e48c62b5
Merge pull request 'feat(import): v0.16.0 - Fully implemented series 3 BW-ACH pipeline stablized.' (#19) from ach-report-ingestion into main
serversdown2026-05-11 15:55:23 -04:00
3402b4d11a
add additional events for decode-RE
serversdown2026-05-11 14:17:21 -04:00
988d26c03d
docs: capture deferred work in README Roadmap
serversdown2026-05-11 16:08:02 +00:00
197c0630e2
chore(release): v0.16.0 — BW ACH ingestion
serversdown2026-05-11 07:33:48 +00:00
f83993ad1d
fix(import): pair _ASCII.TXT reports on the SFM server side too
serversdown2026-05-11 07:25:04 +00:00