feat: wire cf-text for interview prep, cover letters, and AI suggestions #75

New issue

Closed

opened 2026-04-08 21:56:16 -07:00 by pyr0ball · 0 comments

pyr0ball commented

2026-04-08 21:56:16 -07:00

Owner

Summary

Replace or supplement the current ollama/vllm text generation path with cf-text (circuitforge-core service module) for all AI-generated text in Peregrine.

Scope

Interview prep: question generation, answer coaching, follow-up suggestions
Cover letters: generation, rewrite, tone adjustment
Job match suggestions: fit analysis, keyword gap, tailoring advice
ATS rewriter (issue #72): cf-text is the natural backend here

Why cf-text vs. ollama/vllm

Direct model access — no ollama/vllm process lifecycle overhead for lighter tasks
Shared instance across products — if Kiwi is also running cf-text, Peregrine benefits from a warm model
cf-orch managed — VRAM budgeting, eviction, and multi-node routing apply automatically
Streaming support — cover letter generation can stream directly to the Vue frontend

Dependencies

Circuit-Forge/circuitforge-core cf-text module (file separately)
cf-orch node profiles updated with cf-text service entries

Notes

Existing ollama/vllm path should remain as fallback (tier/config switch)
BYOK users should be able to point cf-text at a remote API endpoint (OpenAI-compatible)

## Summary Replace or supplement the current ollama/vllm text generation path with `cf-text` (circuitforge-core service module) for all AI-generated text in Peregrine. ## Scope - **Interview prep**: question generation, answer coaching, follow-up suggestions - **Cover letters**: generation, rewrite, tone adjustment - **Job match suggestions**: fit analysis, keyword gap, tailoring advice - **ATS rewriter** (issue #72): cf-text is the natural backend here ## Why cf-text vs. ollama/vllm - Direct model access — no ollama/vllm process lifecycle overhead for lighter tasks - Shared instance across products — if Kiwi is also running cf-text, Peregrine benefits from a warm model - cf-orch managed — VRAM budgeting, eviction, and multi-node routing apply automatically - Streaming support — cover letter generation can stream directly to the Vue frontend ## Dependencies - `Circuit-Forge/circuitforge-core` cf-text module (file separately) - cf-orch node profiles updated with `cf-text` service entries ## Notes - Existing ollama/vllm path should remain as fallback (tier/config switch) - BYOK users should be able to point cf-text at a remote API endpoint (OpenAI-compatible)