deckhearth/.convoys/scan-visual-catalog-search/brief-3-identify-knn-route.md
varutasu 8f09ed1ef6
feat(scanner): Layer-0 visual catalog search (Phase 3) (#160)
Add pgvector embeddings on cards, server-side cohere/embed-v4.0 via AI
Gateway, kNN identify route, and L0→L1→L2 client orchestration with
empty-index fast escalate and id-cursor backfill job.

Co-authored-by: Cursor <cursoragent@cursor.com>
2026-08-14 21:46:39 -05:00

778 B

convoy brief_number depends_on recommended_model model_tier files
scan-visual-catalog-search 3
1
composer-2.5-fast fast
lib/card-visual-match.js
pages/api/scan/identify-by-image.js
lib/scanner-card-identify.js
lib/use-scanner-identification.js
test/lib/card-visual-match.test.js

Brief 3: Layer-0 identify route + client orchestration

Goal

kNN visual match before L1/L2; log scan_attempts.layer = 0.

Acceptance criteria

  • POST /api/scan/identify-by-image — auth + checkScanRateLimit + embed + kNN
  • identifyTrackedCardCapture order: L0 → L1 → L2
  • Gallery path runs L0 → L1 → L2
  • Skip auto Gemini refine when disambiguation from L0 (same as L1)
  • Thresholds: match 0.82, disambiguation 0.58