Circuit-Forge/avocet
3
0
Fork 0
Code Issues 39 Pull requests 2 Projects Releases 2 Packages Wiki Activity Actions

feat(benchmark): wire EmbeddingKNNAdapter into MODEL_REGISTRY; add embed_model config

Browse source 
- Add embed_model: nomic-embed-text to config/label_tool.yaml (local, gitignored)
- Add # embed_model: commented example to config/label_tool.yaml.example
- Add pyyaml>=6.0 to requirements.txt (explicit dep for _resolve_urls yaml.safe_load)
- Add params assertion to test_embed_knn_nomic_registry_entry
This commit is contained in:
pyr0ball 2026-05-05 14:05:45 -07:00
parent 5df33b0f41
commit cbe8c0f03e
3 changed files with 3 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

1
config/label_tool.yaml.example
View file

@ -46,6 +46,7 @@ cforch:
# license_key: CFG-AVCT-xxxx-xxxx-xxxx # license_key: CFG-AVCT-xxxx-xxxx-xxxx
# ollama_url: http://localhost:11434 # ollama_url: http://localhost:11434
# ollama_model: llama3.2:3b # ollama_model: llama3.2:3b
# embed_model: nomic-embed-text # Ollama embedding model for EmbeddingKNNAdapter
# judge_url: http://10.1.10.158:8008 # Sif cf-text — LLM-as-judge secondary scorer # judge_url: http://10.1.10.158:8008 # Sif cf-text — LLM-as-judge secondary scorer
# judge_url: http://10.1.10.71:8008 # Heimdall cf-text (alternative) # judge_url: http://10.1.10.71:8008 # Heimdall cf-text (alternative)
# Or set CF_JUDGE_URL. Populates the Judge URL field in the LLM Eval UI automatically. # Or set CF_JUDGE_URL. Populates the Judge URL field in the LLM Eval UI automatically.

1
requirements.txt
View file

@ -3,3 +3,4 @@ pydantic>=2.0.0
uvicorn[standard]>=0.20.0 uvicorn[standard]>=0.20.0
httpx>=0.24.0 httpx>=0.24.0
pytest>=7.0.0 pytest>=7.0.0
pyyaml>=6.0

1
tests/test_benchmark_classifier.py
View file

@ -250,5 +250,6 @@ def test_embed_knn_nomic_registry_entry():
entry = MODEL_REGISTRY["embed-knn-nomic"] entry = MODEL_REGISTRY["embed-knn-nomic"]
assert entry["adapter"] is EmbeddingKNNAdapter assert entry["adapter"] is EmbeddingKNNAdapter
assert entry["model_id"] == "nomic-embed-text" assert entry["model_id"] == "nomic-embed-text"
assert entry["params"] == "local-embed"
assert entry["default"] is False assert entry["default"] is False
assert entry.get("kwargs", {}).get("k") == 3 assert entry.get("kwargs", {}).get("k") == 3