Skip to content

An automatic web scrapper project build on Python using Scrapy which scrapes websites by just giving the XPath of the products

Notifications You must be signed in to change notification settings

aghilkp91/productScrapper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Web-Scrapping

Web Scrapping Project using Scrapy and Microsoft Server to scrap the product details from various websites

To Create DB and Tables : Add username and password into DatabaseDBConfig.py Then run "python3 Database/createDatabase.py"

To Run the Crawler: First run the Url extractor: eg: scrapy crawl ixonUrls

Then run the Main Crawler eg: scrapy crawl ixon

About

An automatic web scrapper project build on Python using Scrapy which scrapes websites by just giving the XPath of the products

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published