Training UI — Merlin-side gesture recorder and test mode (Avocet handles labeling) #1

New issue

Open

opened 2026-04-26 21:43:00 -07:00 by pyr0ball · 0 comments

pyr0ball commented

2026-04-26 21:43:00 -07:00

Owner

The Merlin training flow is split:

Merlin owns (this issue):

GestureRecorder — live camera feed + landmark overlay, guided recording session (10–20 reps). Signal quality scorer runs inline; certified samples are saved to ~/.merlin/training/<profile>/. No countdown timers. No accuracy framing.
TestMode — live action preview before enabling. User performs gesture, sees which action would fire. No actual OS input until user explicitly enables.
ProfileManager — save/load/switch profiles. Each profile stores: gesture→action mappings + path to trained model.

Avocet owns (see avocet repo):

Review queue UI for low-confidence samples flagged by the signal quality scorer
One-click local trainer (MLP / gradient boost) triggered from Avocet after labeling
Label tool adapted for gesture/landmark vector data type alongside existing email classifier

See avocet issue for the Merlin pipeline adapter.

Accessibility: no urgency, no performance framing. cf-a11y-dev review before ship.

The Merlin training flow is split: **Merlin owns (this issue):** - **GestureRecorder** — live camera feed + landmark overlay, guided recording session (10–20 reps). Signal quality scorer runs inline; certified samples are saved to `~/.merlin/training/<profile>/`. No countdown timers. No accuracy framing. - **TestMode** — live action preview before enabling. User performs gesture, sees which action would fire. No actual OS input until user explicitly enables. - **ProfileManager** — save/load/switch profiles. Each profile stores: gesture→action mappings + path to trained model. **Avocet owns (see avocet repo):** - Review queue UI for low-confidence samples flagged by the signal quality scorer - One-click local trainer (MLP / gradient boost) triggered from Avocet after labeling - Label tool adapted for gesture/landmark vector data type alongside existing email classifier See avocet issue for the Merlin pipeline adapter. Accessibility: no urgency, no performance framing. cf-a11y-dev review before ship.

pyr0ball added this to the Phase A — Camera-Only milestone 2026-04-26 21:43:00 -07:00

pyr0ball changed title from ~~Training UI — Vue 3 SPA (GestureRecorder, TestMode, ProfileManager)~~ to Training UI — Merlin-side gesture recorder and test mode (Avocet handles labeling)

2026-04-26 21:44:11 -07:00

pyr0ball referenced this issue from Circuit-Forge/avocet

2026-04-26 21:45:10 -07:00

Merlin pipeline adapter — gesture/landmark labeled training data #40