gabriel / musehub public
perf patch timing task/timing-instrumentation #5 / 5
AI Agent gabriel · 40 days ago · May 10, 2026 · Diff

perf(timing): absurd instrumentation across wire_push_presign, wire_push_confirm, _flush_batch, wire_push_stream phases 3b/4/5/7/8/9/10

Every sub-step now emits [S+Xs] progress frames and logger.info lines with millisecond precision so we can see exactly where time goes without waiting for a full push to complete:

- wire_push_presign: DB IN query time, sequential ghost-check MinIO HEAD time, presign_batch URL generation time, total - wire_push_confirm: parallel exists gather time, chunk INSERT time per chunk, upsert_object_refs time, session.commit time, total - _flush_batch: DB presence check, sequential ghost MinIO HEAD loop (flagged as bottleneck), parallel PUT time with KiB, bulk INSERT, upsert_refs, commit - wire_push_stream phase 3b: known_snap_ids query, manifest scan, external ref query, _check_missing_objects query — all individually timed - phases 4/5/7/8/9/10: yield _tprog at entry+exit of each phase, per-batch timing for snapshot upserts and commit INSERTs, final commit time, TOTAL

sha256:3c7d4bccfd75c58133785eedaf80376da6dc02149518a1c799b2ce21d0dd18af sha
sha256:ae5cf3a960b4f341dd9d280aecf406a3f0de3884fe873b4fa86ebeaf033b4d5b parent
sha256:68c99e17cc2df6d6371b09d69c6eb23d41baf18789b48e8b3180b7936b13a6c7 snapshot
← Older Oldest on task/timing-instrumentation
All commits Newer fix: batch enqueue_push_intel from O(N) to O(1) DB round-trips sha256:34844ccdc278ce0371354d4b298302848ce48f8399946af20d41dd7a1ef5d8cd

0 comments

No comments yet. Be the first to start the discussion.

To add a comment, use the Muse CLI: muse hub commit comment sha256:3c7d4bccfd75c58133785eedaf80376da6dc02149518a1c799b2ce21d0dd18af --body "your comment"