Messaging tab: email/comms hub with Osprey IVR/voice integration for nonverbal users #74

Open
opened 2026-04-06 10:05:44 -07:00 by pyr0ball · 0 comments
Owner

Context

A dedicated messaging tab gives users quick access to all job-search communications in one place — emails, call logs, notes — without leaving Peregrine. Long-term, wiring in Osprey's IVR automation and voice services makes this a critical accessibility feature for nonverbal and low-verbal users.

Why this matters for accessibility

Phone calls are a significant barrier for nonverbal and low-verbal users. This is core to CF's ND/adaptive audience. The messaging tab + Osprey integration means:

  • Osprey navigates IVR menus automatically — user never has to speak on a hold-line call
  • Text-to-speech reads pre-scripted responses when a human picks up
  • Pre-written response templates for common scenarios (schedule interview, request accommodation, follow up)
  • Full call transcript via Osprey's Whisper transcription service
  • User maintains control and approves all outbound communication

This is the privacy-first, human-approved version of speaking on someone's behalf.

Phase 1 — Email/comms hub (no Osprey dependency)

  • Threaded email view per contact / per application
  • Manual log entry (call notes, in-person conversation notes)
  • LLM-drafted reply suggestions (human approval required before send)
  • Message templates: follow-up, thank-you, accommodation request, withdrawal
  • Link messages to contacts and applications

Phase 2 — Osprey IVR integration

  • Trigger an Osprey hold-line call from within Peregrine (e.g. "call HR line for this company")
  • Call status + transcript surface in the messaging tab
  • Bridge notification when a human picks up
  • Post-call summary auto-attached to contact record

Phase 3 — Voice / TTS for nonverbal users

  • Pre-scripted voice responses: Osprey reads approved text aloud via Twilio TTS when human answers
  • Real-time transcription of incoming speech via faster-whisper
  • Full conversation log in messaging tab
  • User composes responses by text; system speaks them

Accessibility notes

  • All voice features opt-in — never assume user wants TTS
  • Transcripts always available regardless of how call was conducted
  • Keyboard-navigable UI throughout (no mouse-only interactions)
  • Screen-reader compatible message list

Acceptance criteria

  • Messaging tab in nav
  • Threaded view per contact
  • Manual log entry
  • LLM reply drafts with human approval gate
  • Message templates (follow-up, thank-you, accommodation, withdrawal)
  • Phase 2/3 tracked as child issues once Osprey IVR is stable
## Context A dedicated messaging tab gives users quick access to all job-search communications in one place — emails, call logs, notes — without leaving Peregrine. Long-term, wiring in Osprey's IVR automation and voice services makes this a critical accessibility feature for nonverbal and low-verbal users. ## Why this matters for accessibility Phone calls are a significant barrier for nonverbal and low-verbal users. This is core to CF's ND/adaptive audience. The messaging tab + Osprey integration means: - Osprey navigates IVR menus automatically — user never has to speak on a hold-line call - Text-to-speech reads pre-scripted responses when a human picks up - Pre-written response templates for common scenarios (schedule interview, request accommodation, follow up) - Full call transcript via Osprey's Whisper transcription service - User maintains control and approves all outbound communication This is the privacy-first, human-approved version of speaking on someone's behalf. ## Phase 1 — Email/comms hub (no Osprey dependency) - Threaded email view per contact / per application - Manual log entry (call notes, in-person conversation notes) - LLM-drafted reply suggestions (human approval required before send) - Message templates: follow-up, thank-you, accommodation request, withdrawal - Link messages to contacts and applications ## Phase 2 — Osprey IVR integration - Trigger an Osprey hold-line call from within Peregrine (e.g. "call HR line for this company") - Call status + transcript surface in the messaging tab - Bridge notification when a human picks up - Post-call summary auto-attached to contact record ## Phase 3 — Voice / TTS for nonverbal users - Pre-scripted voice responses: Osprey reads approved text aloud via Twilio TTS when human answers - Real-time transcription of incoming speech via faster-whisper - Full conversation log in messaging tab - User composes responses by text; system speaks them ## Accessibility notes - All voice features opt-in — never assume user wants TTS - Transcripts always available regardless of how call was conducted - Keyboard-navigable UI throughout (no mouse-only interactions) - Screen-reader compatible message list ## Acceptance criteria - [ ] Messaging tab in nav - [ ] Threaded view per contact - [ ] Manual log entry - [ ] LLM reply drafts with human approval gate - [ ] Message templates (follow-up, thank-you, accommodation, withdrawal) - [ ] Phase 2/3 tracked as child issues once Osprey IVR is stable
pyr0ball added this to the Paid Tier GA milestone 2026-04-06 10:05:58 -07:00
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: Circuit-Forge/peregrine#74
No description provided.