pyr0ball 7cad503b35 feat(pipeline): Purple Carrot recipe corpus scraper via Wayback Machine ... discover_wayback.py — enumerates recipe slugs from archived menu API (/api/v2/menus/<id>) and product API (/api/v1/products/*) plus recipe-category HTML pages. Writes incremental JSONL manifest to /Library/Assets/kiwi/pipeline/pc_slugs.jsonl. scrape_recipes.py — fetches full recipe data per slug using three-tier fallback: product API JSON (oldest captures first), HTML inline state (__NEXT_DATA__ / __INITIAL_STATE__), and JSON-LD structured data. Outputs recipes_purplecarrot.parquet in food.com columnar format so build_recipe_index.py imports it unchanged. Includes SourceURL column for recipe attribution UI (kiwi#139). Checkpoints every 50 recipes. Initial discovery: 158 slugs from menu 1536 + product_api pass. Re-run discover_wayback.py after archive.org stabilizes to pick up older slugs from recipe-category pages. Backlog: live Playwright scraper for post-Wayback recipes (kiwi#137).		2026-05-17 09:16:35 -07:00
..
pipeline	feat(pipeline): Purple Carrot recipe corpus scraper via Wayback Machine	2026-05-17 09:16:35 -07:00
__init__.py	feat: data pipeline -- USDA FDC ingredient index builder	2026-03-30 22:44:25 -07:00
backfill_keywords.py	chore: commit in-progress work -- tag inferrer, imitate endpoint, hall-of-chaos easter egg, migration files, Dockerfile .env defense	2026-04-14 13:23:15 -07:00
backfill_texture_profiles.py	feat: recipe engine — assembly templates, prep notes, FTS fixes, texture backfill	2026-04-02 22:12:35 -07:00
tag_sensory_profiles.py	feat: sensory profile filter — texture/smell/noise filtering for Browse and Find (kiwi#51)	2026-04-24 09:47:48 -07:00