pyr0ball
b16620385a
When CF_ORCH_URL is set, chat now calls CFOrchClient.task_allocate("pagepiper",
"rag_query") instead of routing through LLMRouter with an explicit model. The
coordinator resolves the assignment (granite-4.1-8b via assignments.yaml) and
returns an allocated URL; pagepiper wraps it in a minimal LLMRouter config for
the Synthesizer. Falls back to LLMRouter on TaskNotFound or allocation failure,
so standalone Ollama installs are unaffected.
Extracts _run_chat() and _build_llm_for_alloc() helpers to keep the endpoint
body readable regardless of which path fires.
|
||
|---|---|---|
| .. | ||
| __init__.py | ||
| chat.py | ||
| feedback.py | ||
| feedback_attach.py | ||
| ingest.py | ||
| library.py | ||
| search.py | ||