Search code examples
pythonweb-scrapingscrapyscreen-scrapingscrapyd

Time Scheduling - Scrapy


In Scarpy is there any way to schedule our spider to run on some time?


Solution

  • Edit your /etc/crontab file and add this line

    00     *     *   *    *        cd /path/to/scrapy/poject;scrapy crawl spider-name