feat: YAMNet acoustic event classifier (queue/environ/speaker type) — Navigation v0.2.x #5

New issue

Closed

opened 2026-04-06 13:05:57 -07:00 by pyr0ball · 1 comment

pyr0ball commented

2026-04-06 13:05:57 -07:00

Owner

Integrate tone classification producing ToneEvent objects for the annotation overlay.

Data flow:

VoiceFrame → YAMNet (acoustic mood) + wav2vec2 (paralinguistic) → ToneEvent

ToneEvent fields: label, confidence, speaker_id, shift_magnitude, timestamp

Design constraints:

Never import YAMNet or wav2vec2 directly in Linnet code — only via cf_voice.context VoiceFrame
shift_magnitude threshold gate: only emit shift annotation if delta exceeds configurable threshold (avoids annotation noise for stable tone)
Confidence score exposed in UI (user can set visibility threshold)

Blocked on: cf_voice.context VoiceFrame being available in circuitforge-core.

Integrate tone classification producing `ToneEvent` objects for the annotation overlay. Data flow: ``` VoiceFrame → YAMNet (acoustic mood) + wav2vec2 (paralinguistic) → ToneEvent ``` ToneEvent fields: `label`, `confidence`, `speaker_id`, `shift_magnitude`, `timestamp` Design constraints: - Never import YAMNet or wav2vec2 directly in Linnet code — only via `cf_voice.context` VoiceFrame - `shift_magnitude` threshold gate: only emit shift annotation if delta exceeds configurable threshold (avoids annotation noise for stable tone) - Confidence score exposed in UI (user can set visibility threshold) Blocked on: cf_voice.context VoiceFrame being available in circuitforge-core.

pyr0ball added this to the Notation — v0.1.x milestone 2026-04-06 13:05:57 -07:00

pyr0ball added the

enhancement

backlog

cf-core-dep

labels 2026-04-06 13:05:57 -07:00

pyr0ball referenced this issue

2026-04-06 13:43:21 -07:00

feat: cf_voice dependency — Circuit-Forge/circuitforge-core#39 #3

pyr0ball changed title from ~~feat: tone classifier pipeline — YAMNet AME + wav2vec2 via cf_voice.context~~ to feat: YAMNet acoustic event classifier (queue/environ/speaker type) — Navigation v0.2.x

2026-04-11 09:50:47 -07:00

pyr0ball commented

2026-04-11 09:50:48 -07:00

Author

Owner

Partial: wav2vec2 tone classifier (cf_voice.classify.ToneClassifier) is done and confirmed working — closes the tone/affect part of this issue.

Remaining: YAMNet acoustic event classification (queue state: hold_music/ringback/busy/dtmf; speaker type: human_single/ivr_synth/transfer; environ: call_center/music/noise). acoustic.py has the AcousticBackend protocol and MockAcousticBackend; YAMNetAcousticBackend raises NotImplementedError and is caught silently in _classify_real_async.

Retitling this issue to track only the YAMNet piece. Tone is done.

Partial: wav2vec2 tone classifier (`cf_voice.classify.ToneClassifier`) is done and confirmed working — closes the tone/affect part of this issue. Remaining: YAMNet acoustic event classification (queue state: hold_music/ringback/busy/dtmf; speaker type: human_single/ivr_synth/transfer; environ: call_center/music/noise). `acoustic.py` has the `AcousticBackend` protocol and `MockAcousticBackend`; `YAMNetAcousticBackend` raises `NotImplementedError` and is caught silently in `_classify_real_async`. Retitling this issue to track only the YAMNet piece. Tone is done.

pyr0ball referenced this issue

2026-04-11 09:58:12 -07:00

feat: acoustic environment fingerprinting + privacy risk scoring #20

pyr0ball referenced this issue

2026-04-12 10:19:26 -07:00

feat: negotiation discourse analysis — affect-text discordance, linguistic evasion, and manipulation pattern detection [INTERNAL] #21

pyr0ball modified the milestone from Notation — v0.1.x to Navigation — v0.2.x

2026-04-12 11:04:25 -07:00

pyr0ball closed this issue

2026-04-17 11:55:52 -07:00