Paid: UPC visual label capture for unenriched products #79

New issue

Open

opened 2026-04-13 12:51:25 -07:00 by pyr0ball · 0 comments

pyr0ball commented

2026-04-13 12:51:25 -07:00

Owner

Context: Barcode scan gaps — products not in USDA FDC or Open Food Facts — leave pantry items unenriched and invisible to recipe matching and dietary filtering. Visual label capture fills the gap.

Scope:

New captured_products migration (barcode-keyed local product cache)
Gap detection in barcode scan flow: if FDC/OFF returns no data, offer capture to paid-tier users
Visual model integration (cf-docuvision fast-path → cloud fallback) for nutrition facts panel extraction
Structured extraction: calories, macros, ingredient_names, allergens, serving_size
User review + confirm screen (amber highlight for confidence < 0.7 fields)
Local cache lookup: prevents re-capture of known products on future scans
Avocet opt-in toggle in settings (off by default, plain-language description)
VRAM scheduling: queue capture if expiry_llm_fallback is running; do not fail
Calm UX throughout: no urgency language, Discard always first-class

Out of scope: Submitting to Open Food Facts, receipt-level multi-item capture, cross-user cache sharing on cloud.

Acceptance criteria: Paid-tier users can capture and confirm a nutrition label for any unrecognized product; confirmed data enriches the pantry item permanently; opt-in Avocet upload queued when enabled.

Related: circuitforge-plans/kiwi/superpowers/specs/2026-04-13-upc-visual-label-capture-design.md · Circuit-Forge/avocet (cross-product training pipeline ticket)

**Context:** Barcode scan gaps — products not in USDA FDC or Open Food Facts — leave pantry items unenriched and invisible to recipe matching and dietary filtering. Visual label capture fills the gap. **Scope:** - [ ] New `captured_products` migration (barcode-keyed local product cache) - [ ] Gap detection in barcode scan flow: if FDC/OFF returns no data, offer capture to paid-tier users - [ ] Visual model integration (cf-docuvision fast-path → cloud fallback) for nutrition facts panel extraction - [ ] Structured extraction: calories, macros, ingredient_names, allergens, serving_size - [ ] User review + confirm screen (amber highlight for confidence < 0.7 fields) - [ ] Local cache lookup: prevents re-capture of known products on future scans - [ ] Avocet opt-in toggle in settings (off by default, plain-language description) - [ ] VRAM scheduling: queue capture if expiry_llm_fallback is running; do not fail - [ ] Calm UX throughout: no urgency language, Discard always first-class **Out of scope:** Submitting to Open Food Facts, receipt-level multi-item capture, cross-user cache sharing on cloud. **Acceptance criteria:** Paid-tier users can capture and confirm a nutrition label for any unrecognized product; confirmed data enriches the pantry item permanently; opt-in Avocet upload queued when enabled. **Related:** `circuitforge-plans/kiwi/superpowers/specs/2026-04-13-upc-visual-label-capture-design.md` · Circuit-Forge/avocet (cross-product training pipeline ticket)