Circuit-Forge/kiwi
5
0
Fork 0
Code Issues 18 Pull requests Projects Releases 3 Packages Wiki Activity Actions
kiwi/scripts/pipeline/purple_carrot
History
pyr0ball 21a0664961
Some checks are pending
CI / Backend (Python) (push) Waiting to run
Details
CI / Frontend (Vue) (push) Waiting to run
Details
Mirror / mirror (push) Waiting to run
Details
feat(pipeline): weekly Purple Carrot harvest script + cron 
Add weekly_harvest.sh wrapper that:
- Runs discover_current_menu.py to fetch this week's 23 active menu slugs
- Runs scrape_live.py with --resume to scrape only new slugs
- Appends timestamped output to /Library/Assets/kiwi/pipeline/logs/

Cron entry added to system crontab:
  0 23 * * 0 (every Sunday 23:00)
Logs: /Library/Assets/kiwi/pipeline/logs/purple_carrot_harvest.log
2026-05-21 16:22:26 -07:00
..
__init__.py feat(pipeline): Purple Carrot recipe corpus scraper via Wayback Machine 2026-05-17 09:16:35 -07:00
discover_current_menu.py feat(pipeline): purple carrot weekly menu scraper with CF bypass 2026-05-21 16:16:32 -07:00
discover_slugs_categories.py feat(pipeline): purple carrot weekly menu scraper with CF bypass 2026-05-21 16:16:32 -07:00
discover_wayback.py feat(pipeline): Purple Carrot scraper hardening + shared pipeline logging 2026-05-17 13:35:35 -07:00
scrape_live.py feat(pipeline): purple carrot weekly menu scraper with CF bypass 2026-05-21 16:16:32 -07:00
scrape_recipes.py feat(pipeline): Purple Carrot scraper hardening + shared pipeline logging 2026-05-17 13:35:35 -07:00
weekly_harvest.sh feat(pipeline): weekly Purple Carrot harvest script + cron 2026-05-21 16:22:26 -07:00