Skip to content

Fixed scrapers#673

Merged
lalalaurentiu merged 2 commits intopeviitor-ro:mainfrom
lalalaurentiu:main
Dec 17, 2025
Merged

Fixed scrapers#673
lalalaurentiu merged 2 commits intopeviitor-ro:mainfrom
lalalaurentiu:main

Conversation

@lalalaurentiu
Copy link
Collaborator

This pull request updates the job scraping logic for two companies: SonnentoR and GoodYear. It introduces a new, more robust scraper for SonnentoR in a new file, removes the old implementation, and significantly refactors the GoodYear scraper to use a modern API endpoint and improve data extraction.

SonnentoR Scraper Updates:

  • Added a new, more reliable scraper in no_Jobs/sonnentor.py that sets custom headers, adds a delay to avoid anti-bot mechanisms, and targets the correct HTML section for job listings.
  • Removed the old, less precise implementation from sites/sonnentor.py.

GoodYear Scraper Refactor:

  • Refactored sites/goodyear.py to use a JSON API endpoint instead of HTML scraping, improving reliability and maintainability.
  • Updated the script to paginate through jobs using the API's offset and limit parameters, and to extract job details directly from the JSON response.
  • Simplified location handling by removing county lookups and adding support for remote job types.

@lalalaurentiu lalalaurentiu merged commit d4c6a65 into peviitor-ro:main Dec 17, 2025
1 check failed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant