PROPOSAL-EVALUATION-RUBRIC-DEFAULT.md markdown
28 lines 1012 B
Raw
sha256:b5f647cb9c409f563d4671fe3fc05ddea01fabfed9b41fc11cb923588e1c1baf mirror: GitHub Phase A durable MCP OAuth (#270) Human minor ⚠ breaking 10 days ago

Default proposal evaluation rubric

This is the starter checklist shipped with Knowtation Hub. Admins can override it by placing a JSON file at data/hub_proposal_rubric.json (same shape as below). The Hub merges these items with per-item pass/fail when an evaluator submits an evaluation.

Shape

{
  "items": [
    { "id": "accurate", "label": "Short human-readable criterion" }
  ]
}
  • id: Stable key (snake_case). Submitted evaluations reference these ids.
  • label: Shown in the Hub UI and stored on the proposal record.

Default items (summary)

Id Intent
accurate Factual/context fit
no_secrets No keys or credentials
matches_intent Aligns with proposal intent
pii Minimal unnecessary personal data
tone Fits vault style

Customize or add rows for your organization (compliance, legal review, product areas, etc.). See PROPOSAL-LIFECYCLE.md for evaluation states and gating.

File History 4 commits
sha256:b5f647cb9c409f563d4671fe3fc05ddea01fabfed9b41fc11cb923588e1c1baf mirror: GitHub Phase A durable MCP OAuth (#270) Human minor 10 days ago
sha256:d8c648b20a4d53b2673c5c082ee7edfa7b2fc9b11080832da1f38807b6bf940b fix(7C-L1b): route hosted delegation proposals through cani… Human minor 30 days ago
sha256:2827ba9e7632a4b141c50caf1e8f7d77abbc3515be20e7465f2bccb0ac4edf91 fix: repair endpoint now sets has_active_subscription when … Human minor 49 days ago