[MRLN] Merlin — BCI and alternative input training harness #38

New issue

Open

opened 2026-04-26 21:41:52 -07:00 by pyr0ball · 0 comments

pyr0ball commented

2026-04-26 21:41:52 -07:00

Owner

[MRLN] Merlin

BCI (brain-computer interface) and alternative input — camera gestures, eye gaze, depth skeleton, EEG, EMG → OS keyboard and mouse events. Local-first, no cloud required, no hardware mandated.

Repository

https://git.opensourcesolarpunk.com/Circuit-Forge/merlin

Milestones

https://git.opensourcesolarpunk.com/Circuit-Forge/merlin/milestones

Phases

Phase	Signal Sources	Status
A	Webcam (blink, gaze, head pose, hand gesture)	Active dev
B	Depth cameras, stereo video, monocular depth (PyTorch), SteamVR Lighthouse	Planned
C	EEG (ADS1299 / OpenBCI Cyton), EMG (OpenBCI / Myo)	Planned

Design Pillars

Privacy · Safety · Accessibility — co-equal, non-negotiable.
Neurodivergent and adaptive needs users are the primary audience. Signal drift (common in progressive conditions, fatigue, age) is a first-class concern.

Tier System

Tier	What you get
Free	Camera-only, rule-based defaults, local trained model, all depth hardware sources
Paid	EEG/EMG hardware support, cloud model pre-seeding, cross-session drift detection
Premium	Nightly model retraining (cloud compute), profile sharing

License

Signal quality scorer, rule-based defaults, hardware drivers: MIT. Learned classifiers, Avocet EEG training pipeline: BSL 1.1.

Accessibility commitment

Rule-based defaults and dwell-to-click must never require a tier upgrade. Free tier is a complete, usable product.

Spec

circuitforge-plans/merlin/superpowers/specs/2026-04-26-merlin-bci-design.md

Hardware (Phase C)

Custom ADS1299 PCB — ESP32-WROOM-32E + ADS1299IPAGR, WiFi streaming via brainflow CUSTOM_BOARD.
BOM: hardware/bom/merlin-bci-rev0.csv

Ports

8521: Vue SPA training UI
8522: FastAPI daemon control API

## [MRLN] Merlin > BCI (brain-computer interface) and alternative input — camera gestures, eye gaze, depth skeleton, EEG, EMG → OS keyboard and mouse events. Local-first, no cloud required, no hardware mandated. ### Repository https://git.opensourcesolarpunk.com/Circuit-Forge/merlin ### Milestones https://git.opensourcesolarpunk.com/Circuit-Forge/merlin/milestones ### Phases | Phase | Signal Sources | Status | |-------|---------------|--------| | A | Webcam (blink, gaze, head pose, hand gesture) | Active dev | | B | Depth cameras, stereo video, monocular depth (PyTorch), SteamVR Lighthouse | Planned | | C | EEG (ADS1299 / OpenBCI Cyton), EMG (OpenBCI / Myo) | Planned | ### Design Pillars Privacy · Safety · Accessibility — co-equal, non-negotiable. Neurodivergent and adaptive needs users are the primary audience. Signal drift (common in progressive conditions, fatigue, age) is a first-class concern. ### Tier System | Tier | What you get | |------|--------------| | Free | Camera-only, rule-based defaults, local trained model, all depth hardware sources | | Paid | EEG/EMG hardware support, cloud model pre-seeding, cross-session drift detection | | Premium | Nightly model retraining (cloud compute), profile sharing | ### License Signal quality scorer, rule-based defaults, hardware drivers: MIT. Learned classifiers, Avocet EEG training pipeline: BSL 1.1. ### Accessibility commitment Rule-based defaults and dwell-to-click must never require a tier upgrade. Free tier is a complete, usable product. ### Spec `circuitforge-plans/merlin/superpowers/specs/2026-04-26-merlin-bci-design.md` ### Hardware (Phase C) Custom ADS1299 PCB — ESP32-WROOM-32E + ADS1299IPAGR, WiFi streaming via brainflow CUSTOM_BOARD. BOM: `hardware/bom/merlin-bci-rev0.csv` ### Ports - 8521: Vue SPA training UI - 8522: FastAPI daemon control API