tracking: unsupported job board scrapers (Monster, CareerBuilder, Dice, RemoteOK, WWR) #89

New issue

Closed

opened 2026-04-11 09:03:58 -07:00 by pyr0ball · 0 comments

pyr0ball commented

2026-04-11 09:03:58 -07:00

Owner

Summary

Track the implementation of job board scrapers that were in the default boards list but are not supported by the current version of JobSpy.

Background

JobSpy v0.x supported Monster, CareerBuilder, Dice, Remote OK, and We Work Remotely. The current installed version only supports: linkedin, indeed, zip_recruiter, glassdoor, google, bayt, naukri, bdjobs.

Users who went through the old wizard had all 10 boards enabled. One unsupported board name in site_name=[...] caused scrape_jobs() to raise a KeyError, aborting the entire batch — resulting in 0 results across all boards for every location.

Fixes shipped (v0.8.5+)

scripts/discover.py now validates boards against the Site enum before each scrape_jobs() call and skips invalid ones with a warning
GET /api/settings/search now returns a supported bool on each board entry
Settings UI shows unsupported boards as disabled with a "coming soon" badge

Backlog

Board	Issue	Category
Monster.com	#84	General
CareerBuilder	#85	General
Dice	#86	Tech-focused
Remote OK	#87	Remote
We Work Remotely	#88	Remote

Once a scraper is implemented and registered in CUSTOM_SCRAPERS, the board will appear as active in the Settings UI automatically.

## Summary Track the implementation of job board scrapers that were in the default boards list but are not supported by the current version of JobSpy. ## Background JobSpy v0.x supported Monster, CareerBuilder, Dice, Remote OK, and We Work Remotely. The current installed version only supports: `linkedin`, `indeed`, `zip_recruiter`, `glassdoor`, `google`, `bayt`, `naukri`, `bdjobs`. Users who went through the old wizard had all 10 boards enabled. One unsupported board name in `site_name=[...]` caused `scrape_jobs()` to raise a `KeyError`, aborting the entire batch — resulting in 0 results across all boards for every location. ## Fixes shipped (v0.8.5+) - `scripts/discover.py` now validates boards against the `Site` enum before each `scrape_jobs()` call and skips invalid ones with a warning - `GET /api/settings/search` now returns a `supported` bool on each board entry - Settings UI shows unsupported boards as disabled with a "coming soon" badge ## Backlog | Board | Issue | Category | |-------|-------|----------| | Monster.com | #84 | General | | CareerBuilder | #85 | General | | Dice | #86 | Tech-focused | | Remote OK | #87 | Remote | | We Work Remotely | #88 | Remote | Once a scraper is implemented and registered in `CUSTOM_SCRAPERS`, the board will appear as active in the Settings UI automatically.