Skip to content
Version: Current

Search Restoration Runbook

Status as of 2026-11-05: Search is not operational. Restore in order with safety checks.

Phase Status (2026-11-05) Goal
1. Massprox pool Partially present (16 verified, 2026-10-20, as of 2026-11-05) Verify egress and grow pool
2. Federation layer Not deployed (as of 2026-11-05) Add source routing and permissions
3. Fetch and extract Not deployed (as of 2026-11-05) Add fetchers and parsing
4. Rerank Not deployed (as of 2026-11-05) Add RRF and weights
5. Cited synthesis Not deployed (as of 2026-11-05) Add attribution and citations
6. Validate Not started (as of 2026-11-05) Tests, audits, monitoring
  1. Verify egress: sudo -u massprox massprox-ops egress-test must pass.
  2. Check status: cat /home/ubuntu/search/proxies/mass-status.json.
  3. Start mass-proxy-gather.service only after passing egress tests.
  4. Monitor pool growth and failure rates.

Follow the service repos and DB-first rules:

  • Put runtime config in PostgreSQL suite with audits.
  • Use prepared statements and indexes.
  • Run EXPLAIN for new hot queries.
  • Enforce egress law at every layer.
  • Do not add file-based runtime state.
  • Egress guard passes on all hosts.
  • Proxy pool has acceptable size.
  • Federation routes with permissions.
  • Fetch/extract work through proxies.
  • Rerank and synthesis pass tests.
  • All claims are dated.
  • No secrets or customer data in docs.