Circuit-Forge/kiwi
3
0
Fork 0
Code Issues 17 Pull requests 3 Projects Releases 2 Packages Wiki Activity Actions 6

docs(bsl): document cf-text/LLMRouter routing chain in llm_timing and llm_planner

Browse source
This commit is contained in:
pyr0ball 2026-04-12 14:07:32 -07:00
parent 4281b0ce19
commit e52c406d0a
2 changed files with 9 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

4
app/services/meal_plan/llm_planner.py
View file

@ -5,6 +5,10 @@
Returns suggestions for human review — never writes to the DB directly. Returns suggestions for human review — never writes to the DB directly.
The API endpoint presents the suggestions and waits for user approval The API endpoint presents the suggestions and waits for user approval
before calling store.upsert_slot(). before calling store.upsert_slot().
Routing: pass a router from get_meal_plan_router() in llm_router.py.
Cloud: cf-text via cf-orch (3B-7B GGUF, ~2GB VRAM).
Local: LLMRouter (ollama / vllm / openai-compat per llm.yaml).
""" """
from __future__ import annotations from __future__ import annotations

6
app/services/meal_plan/llm_timing.py
View file

@ -3,7 +3,11 @@
"""Estimate cook times for recipes missing corpus prep/cook time fields. """Estimate cook times for recipes missing corpus prep/cook time fields.
Used only when tier allows `meal_plan_llm_timing`. Falls back gracefully Used only when tier allows `meal_plan_llm_timing`. Falls back gracefully
when LLMRouter is unavailable. when no LLM backend is available.
Routing: pass a router from get_meal_plan_router() in llm_router.py.
Cloud: cf-text via cf-orch (3B GGUF, ~2GB VRAM).
Local: LLMRouter (ollama / vllm / openai-compat per llm.yaml).
""" """
from __future__ import annotations from __future__ import annotations