gabriel / musehub public
perf patch perf/mwp-parallel-all-verbs #1 / 1
gabriel · 71 days ago · Apr 12, 2026 · Diff

perf: eliminate all sequential storage I/O across every MWP verb

wire_push inline objects: was N+1 session.get() + sequential exists() + sequential put() per object. Now: 1. Bulk SELECT IN — 1 DB round-trip 2. CPU-bound checks first (hash verify, polyglot) — fail fast 3. Parallel exists() for self-heal detection 4. Parallel put() for new + re-uploads 5. Bulk INSERT ON CONFLICT DO NOTHING — 1 DB round-trip

Self-healing is preserved: DB-present objects whose bytes are missing from storage are detected (parallel exists) and re-uploaded (parallel put) with their DB row updated. No data integrity compromise.

Every MWP verb is now fully parallel on storage I/O: filter-objects → single SQL IN push/objects → parallel put + bulk INSERT push (inline) → parallel exists + parallel put + bulk INSERT fetch/objects → parallel get (asyncio.gather) presign → parallel presign (asyncio.gather) negotiate → DB only refs → DB only

sha256:b06ff83a67d755950e1d354e2bc68e89fed485e40f7f67793543a5a273b95804 sha
sha256:b0eff14767b3ff232069f1f95e5f64ed72db41ca309d5f6feef4011c3b0ace62 parent
sha256:126d994e587fc4ce50df68d47cbafd0dd2584c3846be3525e04e498d804ecce4 snapshot
← Older Oldest on perf/mwp-parallel-all-verbs
All commits
Newer → Latest on perf/mwp-parallel-all-verbs

0 comments

No comments yet. Be the first to start the discussion.

To add a comment, use the Muse CLI: muse hub commit comment sha256:b06ff83a67d755950e1d354e2bc68e89fed485e40f7f67793543a5a273b95804 --body "your comment"