gabriel / musehub public
db-query-runbook.md markdown
159 lines 4.0 KB
Raw
sha256:34035d72cef530c1ab9d6a6f53be18d803dde705fc3157617d70352a96d0747b Merge branch 'fix/wire-push-external-parent-manifest' into dev Human 8 days ago

MuseHub — Database Query Runbook

Run these EXPLAIN ANALYZE checks before each production deployment and after any schema or index change. No sequential scans on tables expected to hold more than ~10 k rows.


How to run

# Connect to the production DB:
psql $DATABASE_URL

# For each query below, prepend EXPLAIN (ANALYZE, BUFFERS, FORMAT TEXT):
EXPLAIN (ANALYZE, BUFFERS, FORMAT TEXT)
SELECT ...

Look for:

  • Seq Scan on large tables — add an index if present
  • Rows Removed by Filter >> Rows — index selectivity is poor
  • actual time= values > 100 ms — investigate or add a covering index

Top-10 highest-traffic queries

Q1 — Repo lookup by URL slug (every page load)

SELECT * FROM musehub_repos
WHERE owner = 'gabriel' AND slug = 'neo-soul'
  AND deleted_at IS NULL;

Expected plan: Index Scan using uq_musehub_repos_owner_slug


Q2 — List repos for a user (dashboard)

SELECT * FROM musehub_repos
WHERE owner = 'gabriel' AND visibility = 'public'
  AND deleted_at IS NULL
ORDER BY pushed_at DESC
LIMIT 20;

Expected plan: Index Scan using ix_musehub_repos_owner_visibility


Q3 — HEAD commit for a branch (every push/fetch)

SELECT * FROM musehub_commits
WHERE repo_id = '<repo_uuid>' AND branch = 'main'
ORDER BY timestamp DESC
LIMIT 1;

Expected plan: Index Scan using ix_musehub_commits_repo_branch


Q4 — Open issue list (issue tracker)

SELECT * FROM musehub_issues
WHERE repo_id = '<repo_uuid>' AND state = 'open'
ORDER BY created_at DESC
LIMIT 25;

Expected plan: Index Scan using ix_musehub_issues_repo_state


Q5 — Issue by number (direct URL)

SELECT * FROM musehub_issues
WHERE repo_id = '<repo_uuid>' AND number = 42;

Expected plan: Index Scan using ix_musehub_issues_repo_number


Q6 — Open proposals (Proposal list)

SELECT * FROM musehub_proposals
WHERE repo_id = '<repo_uuid>' AND state = 'open'
ORDER BY created_at DESC
LIMIT 25;

Expected plan: Index Scan using ix_musehub_proposals_repo_state


Q7 — Intel result lookup (intel endpoints)

SELECT * FROM musehub_intel_results
WHERE repo_id = '<repo_uuid>' AND intel_type = 'code.symbol_history';

Expected plan: Index Scan using ix_musehub_intel_results_repo_type

SLOW QUERY threshold: 100 ms. Alert if actual time exceeds threshold.


Q8 — Per-repo storage quota sum (every push)

SELECT COALESCE(SUM(o.size_bytes), 0)
FROM musehub_objects o
JOIN musehub_object_refs r ON r.object_id = o.object_id
WHERE r.repo_id = '<repo_uuid>' AND o.deleted_at IS NULL;

Expected plan: Index Scan using pk_musehub_object_refs (repo_id prefix) + Index Scan using musehub_objects pkey


Q9 — Recent commit feed (repo home page)

SELECT * FROM musehub_commits
WHERE repo_id = '<repo_uuid>'
ORDER BY timestamp DESC
LIMIT 10;

Expected plan: Index Scan using ix_musehub_commits_repo_timestamp


Q10 — Per-user storage sum (MCP push quota)

SELECT COALESCE(SUM(o.size_bytes), 0)
FROM musehub_objects o
JOIN musehub_object_refs ref ON ref.object_id = o.object_id
JOIN musehub_repos      r   ON r.repo_id = ref.repo_id
WHERE r.owner_user_id = '<user_uuid>'
  AND r.deleted_at IS NULL;

Expected plan: Index Scan using ix_musehub_repos_owner_user_id + Index Scan using pk_musehub_object_refs + Index Scan using musehub_objects pkey


Slow query log

Queries exceeding SLOW_QUERY_THRESHOLD_MS (default 100 ms) are logged at WARNING level by the SQLAlchemy after_cursor_execute listener in musehub/db/database.py.

To monitor in production:

# Tail the app log for SLOW QUERY entries:
journalctl -u musehub -f | grep "SLOW QUERY"

# Or set log_min_duration_statement in Postgres for server-side capture:
ALTER SYSTEM SET log_min_duration_statement = 100;
SELECT pg_reload_conf();

Alerts should be wired to any line matching SLOW QUERY in the application log, or to pg_stat_statements entries with mean_exec_time > 100.

File History 14 commits
sha256:34035d72cef530c1ab9d6a6f53be18d803dde705fc3157617d70352a96d0747b Merge branch 'fix/wire-push-external-parent-manifest' into dev Human 8 days ago
sha256:fc04e4cae9e1774d6a21b65c45daeed0e6787eb581d13aa1b03bfe9384a34226 Merge branch 'fix/two-column-scroll-layout' into dev Human 8 days ago
sha256:408916fc5973ba59c6e4eebaa80ebdcc801c0a63205651e25009d11548f79454 chore: bump version to 0.2.0.dev2 — nightly.2, matching muse Sonnet 4.6 patch 11 days ago
sha256:d035733f21ccff27735fddebfbbe0ed24565a32a22db8de5885402262671ecd2 chore: bump version to 0.2.0rc15 for musehub#113 fix release Sonnet 4.6 patch 14 days ago
sha256:0032d6cfa33bc3c8367436ad768e7dd0e339b4332153160247da8266cb5fa352 Merge branch 'task/version-tags-phase3-server' into dev Human 17 days ago
sha256:4669620efda9ff41c55bdefd1f7bfe1c239d468428744c84ead9957e5a003a53 merge: rescue snapshot-recovery hardening (c00aa21d) into d… Opus 4.8 minor 29 days ago
sha256:a59da49c4611b970fc4b6ae48678ce4943261c213a07ddbd73ce9201df869b4a fix: remove false-positive proposal_comments index drop fro… Sonnet 4.6 patch 33 days ago
sha256:0a240d6dbff234f07d98a28a4a9a68db702f3f9ff9260196f24219bdb1c0b6f3 feat: render markdown mists as HTML with heading anchor links Sonnet 4.6 patch 34 days ago
sha256:24a7d47486ebc4ebd1832830580e177ec6f877b48dced8c000e198cdec4ce9d6 Merge 'task/bump-version-rc12' into 'dev' — proposal: Bump … Human 35 days ago
sha256:b9ff931d147e0114a1f17060f415b89ed551c170a91ff226c70437aa5c85f9ee Merge 'task/bump-version-rc12' into 'dev' — proposal: Bump … Human 35 days ago
sha256:d1122d21e73471879b460037b22c0b50fded7c423444a176f248428f75dac39c Merge 'task/fix-issue-pagination-cursor' into 'dev' — propo… Human 35 days ago
sha256:01e18975e73d2b3cd5b6db7929c895bef9aa6e0d4391dc5b2adfc548b41318dd Merge 'feat/adding-debug-logs-to-staging' into 'dev' — prop… Human 35 days ago
sha256:6b1949fc2797ca4c1936a637a4cbfec828ef56cf52398a2e74ca3c4f494e728f fix: use wire_bytes not mpack_bytes_raw in compute_object_b… Sonnet 4.6 patch 48 days ago
sha256:b99f2455dc346966d040133f5203297e6e3ef5803a93728a2c30568d0a0f7583 rename: delta_add → delta_upsert across wire format, models… Sonnet 4.6 patch 50 days ago