pyr0ball
b16620385a
When CF_ORCH_URL is set, chat now calls CFOrchClient.task_allocate("pagepiper",
"rag_query") instead of routing through LLMRouter with an explicit model. The
coordinator resolves the assignment (granite-4.1-8b via assignments.yaml) and
returns an allocated URL; pagepiper wraps it in a minimal LLMRouter config for
the Synthesizer. Falls back to LLMRouter on TaskNotFound or allocation failure,
so standalone Ollama installs are unaffected.
Extracts _run_chat() and _build_llm_for_alloc() helpers to keep the endpoint
body readable regardless of which path fires.
|
||
|---|---|---|
| .. | ||
| api | ||
| services | ||
| __init__.py | ||
| cloud_session.py | ||
| config.py | ||
| deps.py | ||
| main.py | ||
| startup.py | ||