pyr0ball
e52bdb5128
Retrieval:
- Add _fetch_adjacent() to retriever: fetches page ± 1 chunks from DB
after ranking so mid-sentence EPUB chunk boundaries don't lose context
- Fix vec DB doc-filter: oversample to top_k*20 before Python filter
instead of post-filtering an already-small global pool (fixes wrong-book
results when searching within a single document)
- top_k default 5 → 10; context per chunk 500 → 1500 chars; citation
snippet 200 → 400 chars
Artifact cleaning:
- Add scripts/text_clean.py: strips ABC Amber LIT Converter watermarks,
processtext.com URLs, bare page numbers, piracy stamps from extracted text
- Wire clean_paragraph() into ingest_pdf.py and new ingest_epub.py
Startup validation:
- _check_vec_schema() at boot: detects embedding dimension mismatch,
deletes stale vec DB, and queues sequential re-embed in background thread
- Sequential _reembed_docs() prevents SQLite lock races on startup re-embed
cf-orch integration:
- Wire CF_ORCH_URL / CF_LICENSE_KEY into LLMRouter backend config so
allocate() fires and keeps the Ollama model warm between requests
Ingestion progress UI:
- GET /api/library/{doc_id}/status now returns vec_count from page_vecs_meta
- DocumentCard.vue polls status every 3 s while processing and shows
two-phase progress: indeterminate animation during extraction,
determinate "Embedding N/M pages" bar once vectors start landing
Other:
- Chat feedback endpoint + thumbs up/down UI (FeedbackButton.vue)
- EPUB ingest script (ingest_epub.py) with heading-based chunking
- migration 002: chat_feedback table
- README.md with setup and feature overview
35 lines
934 B
Vue
35 lines
934 B
Vue
<template>
|
|
<div id="app">
|
|
<nav class="nav">
|
|
<span class="nav-brand">Pagepiper</span>
|
|
<RouterLink to="/" class="nav-link">Library</RouterLink>
|
|
<RouterLink to="/chat" class="nav-link">Chat</RouterLink>
|
|
</nav>
|
|
<RouterView />
|
|
<FeedbackButton />
|
|
</div>
|
|
</template>
|
|
|
|
<script setup lang="ts">
|
|
import { RouterLink, RouterView } from "vue-router"
|
|
import FeedbackButton from "@/components/FeedbackButton.vue"
|
|
</script>
|
|
|
|
<style>
|
|
@import "@/theme.css";
|
|
|
|
.nav {
|
|
display: flex;
|
|
align-items: center;
|
|
gap: 1.5rem;
|
|
padding: 0.75rem 1.5rem;
|
|
background: var(--color-surface);
|
|
border-bottom: 1px solid var(--color-border);
|
|
position: sticky;
|
|
top: 0;
|
|
z-index: 100;
|
|
}
|
|
.nav-brand { font-weight: 700; color: var(--color-accent); }
|
|
.nav-link { color: var(--color-text-muted); text-decoration: none; }
|
|
.nav-link:hover, .nav-link.router-link-active { color: var(--color-text); }
|
|
</style>
|