Reviewer decisions are recorded as audited, reversible corrections in the bitemporal graph and can gate workflow releases.
Quality review console
The Quality review console (/platform/context-graph?view=review) organizes graph, extraction, table, and OCR problems into seven prioritized queues. Reviewers inspect source passages and PDF page previews and record audited, reversible decisions in the bitemporal graph. Nothing in this console calls an AI model.
The seven review queues
| Queue | Signal source | Reviewer actions (Accept / Reject / Edit) |
|---|---|---|
| Entity merges and splits | Entity resolution unsure/low-confidence pairs (< 0.7), low-score model merge links (< 0.8), or conflicting identity numbers | Accept records the merge, split, or reject; Reject leaves entities unchanged; Edit renames the entity |
| Stale documents | Superseded document versions that still have open facts in valid time or incoming cross-document references | Accept retracts the stale document’s open facts as of the decision and queues re-extraction of the newer version; Reject keeps the facts |
| Contradictions | Claim verification contradicts relations between resolved facts | Accept keeps the chosen side and retracts the other side’s facts; Reject retracts the contradiction relation itself |
| Low-confidence facts | Extraction facts below 0.6 confidence that have a graph assertion | Accept confirms the fact; Reject retracts it; Edit replaces the value in the review scope (review:<scope>) |
| Table checks | Table arithmetic reconciliation findings (mismatch or flagged from tables-v3) | Accept confirms the printed number is wrong; Reject marks the number right; Edit replaces the cell’s canonical value and refreshes finance rules |
| OCR quality | Failed pages, pages below 0.6 confidence, or low/empty document extraction | Accept opens a re-index request; Reject marks the page as reading correctly |
| Re-index requests | Explicit requests, incomplete graph builds (coverage_incomplete), or stale summaries (summary_stale) | Accept re-indexes and re-extracts the document; Reject declines the request |
Bitemporal corrections, undo, and dataset promotion
- Every decision requires a reason (up to 2,000 characters) and
graph:reviewpermission (workspace admin or owner). Viewers and editors see the queues and evidence read-only. - Reversible assertions: A decision never overwrites history. In one fenced graph transaction (
POST /api/w/:wsId/graph-review/items/:itemId/decisions), it archives rejected fact versions by closing their system time, inserts corrected versions in a protectedreview:scope with suppressions so later re-extractions do not overwrite them, and triggers targeted downstream refreshes (entity resolution,financerules, answer cache invalidation, and trust analytics). If a background graph build holds the workspace clock, the route waits briefly and otherwise returns503 GRAPH_CLOCK_BUSYwithRetry-After: 30. - Undo: The latest decision on an item can be undone (
POST /api/w/:wsId/graph-review/decisions/:decisionId/undo) with a reason, restoring archived versions and lifting suppressions. - Promote to Eval Studio: Reviewers with both
graph:reviewandeval:createcan promote a standing decision into the latest draft version of an extraction, RAG, or retrieval evaluation dataset (POST /api/w/:wsId/graph-review/decisions/:decisionId/promote).
Queue health and workflow release gate
The Health and release gate tab (GET /api/w/:wsId/graph-review/health and /gate) shows queue backlog by priority, median/p90/oldest item age, and 7-day/30-day decision velocity.
Workspace admins can enable the Release gate (PUT /api/w/:wsId/graph-review/settings) with an age threshold from 1 to 8,760 hours (default 72 hours). While enabled, publishing a workflow release syncs the queues first and fails closed:
409 GRAPH_REVIEW_GATE_FAILEDif any pending critical review item is older than the threshold.503 GRAPH_REVIEW_GATE_UNVERIFIEDif the queue sync cannot complete within 15 seconds.