Commit Graph

  • d0b66368d5 Merge pull request 'update to v0.21.1, thor data import successful' (#29) from dev into main main serversdown 2026-06-01 16:54:23 -04:00
  • 25386cab8b fix(backfill): regenerate IDFH .h5 + merge binary mic_pspl_psi onto bridge Two gaps in backfill_thor_events.py that left old Thor events showing stale charts after a v0.21.1 backfill pass: 1. IDFH events were skipped from .h5 regeneration (the "have decoded samples" gate was IDFW-only). Histograms kept their pre-v0.21.1 .h5 — written from raw_samples = None, which the renderer turned into a near-empty bar chart, or for older events the dB(L)-as-pseudo- psi mic scale that produced "107.7 psi" peaks (atomic-bomb level instead of footstep level). Fix: synthesise the same 1-sample-per- interval array save_imported_idf v0.21.1 uses (peak ADC count per channel per interval) so the renderer's bar-chart grouping has data to work with. 2. The IDFW h5 path didn't merge binary_peaks.mic_pspl_psi onto the IdfEvent before to_minimateplus_event(). The live save_imported_idf does this merge — without it, IdfEvent.from_report() only sees the .txt's dB(L) value, the bridge falls back to the dBL→psi formula (instead of the binary-accurate 2.14e-6 psi/count value), and the h5 writer's per-count mic factor lands on a less-correct value. Fix: same merge the live ingest does (lift res.event.peaks.mic_pspl_psi onto idf_event.peaks before the bridge call). Verified against UM6047_20250804190047.IDFH (250-interval prod histogram): 250 intervals decode, mic_pspl_psi = 2.78e-5 (was being treated as dB(L)=107.7 in the old h5). Operator: re-run after deploy. docker compose exec sfm python scripts/backfill_thor_events.py is idempotent — the existing version check still skips events already at the new TOOL_VERSION, and review state + captured_at are preserved on the second pass. dev serversdown 2026-06-01 20:02:54 +00:00
  • 6cb619ecc4 version bump - 0.21.1 serversdown 2026-06-01 19:33:44 +00:00
  • 1ed86244d0 fix(thor-events): add parallel field for mic psi. Now shows mic in dbl and psi. (psi for charts) serversdown 2026-06-01 18:27:24 +00:00
  • b2c565f217 fix(idf_waveforms): _find_waveform_body_offset() — scans every 00 02 00 magic past offset 0x0E00, runs decode_waveform_v2 on each candidate, picks the one that returns the most samples. Validated on 483 prod IDFW files: 0 preamble-only events (was ~50%), 355/483 fully decode, 126/483 partial (BW codec walker-stops-early on loud events — known issue). IDFH now synthesises a 1-sample-per-interval array from the binary intervals and writes an .h5 so the existing renderer works unchanged. Each "sample" is the per-interval peak ADC count → h5_value = count × geo_fs/32768 yields the right bar height. serversdown 2026-05-31 20:51:09 +00:00
  • 43f440812a scripts: add backfill_thor_events.py serversdown 2026-05-30 04:37:43 +00:00
  • 23e83908c2 report_pdf: fix PVS overlapping stats table, drop NA caption serversdown 2026-05-29 22:17:43 +00:00
  • bee118506b fix(idf): decode from in-memory bytes during ingest serversdown 2026-05-29 20:09:54 +00:00
  • defd17d9c2 sfm_webapp: harmonize "Received by server at" → "Time received" serversdown 2026-05-29 19:51:58 +00:00
  • e42956a20b release: v0.21.0 — Thor / Series IV codec + Thor→BW adapter serversdown 2026-05-29 19:25:44 +00:00
  • 9fd52ddabb feat: add thor report generation, pdf generation. serversdown 2026-05-29 19:03:06 +00:00
  • 9b71ead44b series 4 codec work, inital decode success serversdown 2026-05-29 06:33:06 +00:00
  • 2eb1d25028 Merge pull request 'v0.20.0 -- Full s3 event parse and PDF creation.' (#28) from dev into main serversdown 2026-05-28 17:54:31 -04:00
  • 1bccc44b88 release: v0.20.0 — PDF + parser polish serversdown 2026-05-28 21:17:53 +00:00
  • a3cc44d30a feat(backfill): --reparse-txt flag to refresh bw_report from preserved .TXT serversdown 2026-05-28 18:56:23 +00:00
  • 6a73523e4d ui: surface per-channel ZC Freq (and ">100") in event modals serversdown 2026-05-28 18:47:37 +00:00
  • 780b45a371 feat: render ">100" for above-range ZC Freq instead of "—" serversdown 2026-05-28 18:38:49 +00:00
  • f6abe3caa0 fix(report_pdf): histogram geo channels share nice-quantized y-axis serversdown 2026-05-28 18:22:20 +00:00
  • ad2702d4bf fix(report_pdf): add missing histogram_interval_size_s field serversdown 2026-05-28 18:07:41 +00:00
  • 86325b9bab docs: roadmap entry for a SECOND undecoded histogram sub-format (S353) serversdown 2026-05-28 05:42:18 +00:00
  • 6381dcb312 tz: server-wide display timezone via TZ env var (default EST/EDT) serversdown 2026-05-28 05:41:10 +00:00
  • 53c05d93e2 delete: also clean up preserved _ASCII.TXT file serversdown 2026-05-28 05:31:08 +00:00
  • a5888e1b5c report_pdf: PDF histogram aggregation + fix footer/x-axis overlap serversdown 2026-05-28 04:33:53 +00:00
  • b9f8bbb220 viewers: enforce minimum Y-range on histogram channels serversdown 2026-05-28 04:23:01 +00:00
  • b59f886cb7 docs: roadmap entry for sensor-check waveform extraction serversdown 2026-05-28 04:17:50 +00:00
  • 87aec3f4d1 viewers: smoother mic dBL chart + restore binary/TXT download links serversdown 2026-05-27 23:08:21 +00:00
  • ace542cba5 report_pdf: wire histogram peak date/time + PVS-when + Finish field serversdown 2026-05-27 22:47:53 +00:00
  • 8cbda09917 viewers: render timestamps in browser-local time serversdown 2026-05-27 22:30:43 +00:00
  • 3457ed0072 bw_ascii_report: parse OORANGE saturation marker + TimeSum typo serversdown 2026-05-27 20:32:56 +00:00
  • d21e3b5298 histogram aggregation + parser extension for BW interval fields serversdown 2026-05-27 20:23:05 +00:00
  • ad2b553c7b ingest: preserve raw BW ASCII report (.TXT) alongside the binary serversdown 2026-05-27 20:01:12 +00:00
  • dfbc8b8520 report_pdf: split waveform vs histogram layouts (BW PDF iteration) serversdown 2026-05-27 18:22:03 +00:00
  • 411ef8139e sfm: Event Report PDF generation (v0.20.0 stub layout) serversdown 2026-05-27 02:55:58 +00:00
  • ed926de3f4 viewers: default mic to dB(L) + add Mic-unit toggle (dBL ↔ psi) serversdown 2026-05-27 02:30:56 +00:00
  • 5d5441604b viewers: symmetric Y-axis on geo waveforms + clarify timestamp labels serversdown 2026-05-24 20:26:23 +00:00
  • 784f2cca36 viewers: decimal peak labels + bar chart for histograms + clean x-axis ticks serversdown 2026-05-24 19:54:04 +00:00
  • 6abfadae4f viewers: render pre-trigger samples (time_axis is metadata, not an array) serversdown 2026-05-23 21:58:20 +00:00
  • fd0e28657d sfm_webapp: default to Database view + sortable columns + inline waveform plot serversdown 2026-05-23 19:39:18 +00:00
  • c14a8c54db event_browser: Instantel-printout-style polish serversdown 2026-05-23 07:09:12 +00:00
  • 460006e5cd sfm: stored-event browser at /events serversdown 2026-05-23 06:53:48 +00:00
  • 8710b8f327 docs: record three known issues discovered during prod deployment serversdown 2026-05-22 21:02:13 +00:00
  • db657bcac9 Merge pull request 'fix: bw_report overlay onto event before DB, prevents data loss docs: three-tier architecture model + strategic roadmap' (#27) from feat/wire-histogram-codec into dev serversdown 2026-05-22 15:46:46 -04:00
  • 35842ac50a backfill: overlay bw_report onto Event before DB upsert serversdown 2026-05-22 18:56:22 +00:00
  • 49a524d0d4 docs: three-tier architecture model + strategic roadmap serversdown 2026-05-22 18:38:00 +00:00
  • 9ef424d098 Merge pull request 'Histogram body codec — full RE + peak-count fix that resolves the prod inflation incident' (#26) from feat/wire-histogram-codec into dev serversdown 2026-05-22 13:08:03 -04:00
  • cc821f9ee3 hotfix: fix dockerfile on main to fix import bug on prod claude 2026-05-21 20:42:15 +00:00
  • ed6982c512 scripts: bw_report preservation check for backfill safety serversdown 2026-05-21 06:13:52 +00:00
  • d506ebc103 histogram_codec: peak count is uint8 (not uint16 LE) — properly cracks the BE9558 / BE18003 extension-byte case serversdown 2026-05-21 06:05:19 +00:00
  • e949232875 histogram_codec + backfill: tighter peak ceiling, preserve bw_report serversdown 2026-05-21 02:50:10 +00:00
  • bc5a2d3f19 histogram_codec: defensive bounds-check on peak counts serversdown 2026-05-21 02:17:33 +00:00
  • 88549bc659 backfill_sidecars: filter out Thor IDF files serversdown 2026-05-21 01:20:08 +00:00
  • 76bce0b5a3 Merge pull request 'v0.20.0 - prerelease features.' (#25) from feat/wire-histogram-codec into dev serversdown 2026-05-20 21:05:37 -04:00
  • 7183b953e4 minimateplus: histogram body codec — FULLY DECODED serversdown 2026-05-20 23:05:13 +00:00
  • c3c7fe559c docs: histogram body codec RE — starting-point status doc serversdown 2026-05-20 21:13:26 +00:00
  • fa9d3cdef2 read_blastware_file: leave peak_values=None when samples can't be decoded serversdown 2026-05-20 20:30:53 +00:00
  • c4648c1959 scripts/backfill_sidecars: skip .h5 write when decoder returned no samples serversdown 2026-05-20 20:16:31 +00:00
  • 0e89125495 docker: fix dockerfile to include scripts and micromate folders serversdown 2026-05-20 19:58:54 +00:00
  • fffb363b2b Merge pull request 'minimateplus: wire read_blastware_file to verified body codec' (#24) from feat/wire-codec-to-import-path into dev serversdown 2026-05-20 15:26:15 -04:00
  • e8682d49ad scripts/backfill_sidecars: cascade h5 regen when sidecar is stale + bump TOOL_VERSION serversdown 2026-05-20 18:24:06 +00:00
  • 31d691b40b minimateplus: wire read_blastware_file to verified body codec serversdown 2026-05-20 18:13:24 +00:00
  • beca5de06e docs: clean up and verify s3 protocol docs serversdown 2026-05-20 17:55:02 +00:00
  • d85df4c886 Merge pull request 'merge full s3 codec decoded' (#23) from codec-re into main serversdown 2026-05-20 13:45:32 -04:00
  • 0466bb4f44 codec: crack wide-NN blocks (1X NN / 2X NN); loud events now fully decode Claude 2026-05-16 03:29:13 +00:00
  • 85f4bcfe86 codec: wire decode_waveform_v2 into production; add MicL dB helper Claude 2026-05-16 00:27:14 +00:00
  • 2ff2762eec codec-re: 30 NN block CRACKED — codec fully decoded Claude 2026-05-12 05:09:42 +00:00
  • d4cdce77fa codec-re: 30 NN partial finding — sum matches but per-sample distribution doesn't Claude 2026-05-12 04:41:59 +00:00
  • ce5dc640ba codec-re: quiet bundle decodes FULLY (17k samples, zero errors) Claude 2026-05-12 04:07:55 +00:00
  • 07675626dc codec-re: channel rotation CONFIRMED — full multi-channel decoder works Claude 2026-05-12 03:57:38 +00:00
  • ae0e17b5dc codec-re: handoff polish — readmes, skeleton, remove decode-re/ duplicate Claude 2026-05-12 02:53:10 +00:00
  • f68ee9f0f9 docs: clean up waveform-codec doc layers per review Claude 2026-05-12 02:43:25 +00:00
  • 5bf5329369 codec-re: add Waveform body codec section to CLAUDE.md Claude 2026-05-12 02:22:06 +00:00
  • 9ed6f2a8d8 codec-re: add segment 1 block dumper for analysis Claude 2026-05-12 01:18:50 +00:00
  • a0c9a482c7 codec-re: 00 NN is RLE; full Tran segment-0 decode (4 of 5 events) Claude 2026-05-11 22:29:07 +00:00
  • 6ac126e05c codec-re: crack Tran channel codec with high-amplitude May 11 bundle Claude 2026-05-11 18:30:56 +00:00
  • d3f77d1d96 codec-re: solve waveform body block framing; per-byte sample mapping still open Claude 2026-05-08 20:44:37 +00:00
  • 7bd0f8badf Pull in v0.18 - Merge branch 'main' into codec-re serversdown 2026-05-20 16:50:03 +00:00
  • 8316a1bbd8 docs(protocol): accuracy sweep across the protocol reference Claude 2026-05-20 15:41:42 +00:00
  • 8f568b809b Merge pull request 'v0.19.0 - minimate compatability + family separation' (#22) from dev into main serversdown 2026-05-20 11:22:54 -04:00
  • ecc935482b seismo-relay v0.19.0 — device-family separation + micromate/ package serversdown 2026-05-20 15:19:49 +00:00
  • e95ac692ee feat: add device family to separate s3 and s4 events. serversdown 2026-05-20 06:15:50 +00:00
  • 3265ad6fa3 fix: apply psi dbL conversion rule serversdown 2026-05-20 05:43:52 +00:00
  • 350f81f8b5 fix: add thor specific ascii parser. serversdown 2026-05-20 05:22:28 +00:00
  • cd20be2eff feat: add thor/micromate compatibility v0.18.0 serversdown 2026-05-19 04:32:43 +00:00
  • f7c5c9fed3 Merge branch 'main' into codec-re serversdown 2026-05-17 23:30:29 +00:00
  • 512d82c720 merge: update to 0.17.0' (#21) from ach-report-ingestion into main serversdown 2026-05-17 19:13:56 -04:00
  • 57287a2ade chore: update to 0.17.0 serversdown 2026-05-17 23:07:12 +00:00
  • 1fff8179d6 Add runbook for recovering wedged units and new scripts for device management serversdown 2026-05-17 07:58:13 +00:00
  • ae7edac83f chore(doc): bump to 0.16.1 serversdown 2026-05-15 23:35:35 +00:00
  • b6911009ff scripts: backfill record_type on legacy events imported with hardcoded "Waveform" serversdown 2026-05-15 06:38:09 +00:00
  • aac1c8e06d fix(import): derive record_type from filename suffix instead of hardcoding "Waveform" serversdown 2026-05-14 21:09:21 +00:00
  • 84ee68f889 Merge branch 'main' into codec-re serversdown 2026-05-11 22:27:25 -04:00
  • 20519383fe add additional events for decode serversdown 2026-05-11 18:13:24 -04:00
  • 87675ac2d8 Merge pull request 'docker: add .dockerignore and Dockerfile for containerization.' (#20) from dockerize into main serversdown 2026-05-11 17:40:56 -04:00
  • 83d69b9220 chore(server): update inline version to 0.16.0 serversdown 2026-05-11 21:40:18 +00:00
  • 3e247e2182 docker: add .dockerignore and Dockerfile for containerization. serversdown 2026-05-11 21:38:03 +00:00
  • d2e48c62b5 Merge pull request 'feat(import): v0.16.0 - Fully implemented series 3 BW-ACH pipeline stablized.' (#19) from ach-report-ingestion into main serversdown 2026-05-11 15:55:23 -04:00
  • 3402b4d11a add additional events for decode-RE serversdown 2026-05-11 14:17:21 -04:00
  • 988d26c03d docs: capture deferred work in README Roadmap serversdown 2026-05-11 16:08:02 +00:00
  • 197c0630e2 chore(release): v0.16.0 — BW ACH ingestion serversdown 2026-05-11 07:33:48 +00:00
  • f83993ad1d fix(import): pair _ASCII.TXT reports on the SFM server side too serversdown 2026-05-11 07:25:04 +00:00