Skip to content

Fixed Infineon and primark scrapers#649

Merged
lalalaurentiu merged 2 commits intopeviitor-ro:mainfrom
lalalaurentiu:main
Sep 4, 2025
Merged

Fixed Infineon and primark scrapers#649
lalalaurentiu merged 2 commits intopeviitor-ro:mainfrom
lalalaurentiu:main

Conversation

@lalalaurentiu
Copy link
Collaborator

This pull request updates the job scraping logic for both the Infineon and Primark sites to improve data fetching and parsing. The main changes involve updating request parameters, parsing methods, and URL handling to ensure correct retrieval and processing of job listings.

Infineon site improvements:

  • Standardized the call to scraper.get_from_url by explicitly passing url, setting type="JSON", and disabling SSL verification with verify=False for both the initial and paginated requests. [1] [2]

Primark site improvements:

  • Updated the job search url to a new endpoint that supports more advanced filtering and pagination.
  • Modified the scraper.get_from_url call to specify "JSON" as the type and disabled SSL verification; re-initialized the scraper with the fetched results for HTML parsing.
  • Updated the job link construction to use the new careers domain, ensuring links point to the correct site.

@lalalaurentiu lalalaurentiu merged commit 5ebab5c into peviitor-ro:main Sep 4, 2025
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant