Search code examples
pythonweb-scrapingscrapyscreen-scrapingscrapy-shell

Does scrapy view uses active project settings?


Does scrapy view use active project settings(especially middleware)? I want to use Scrapy Fake User Agent and Scrapy Crawlera on scrapy view.


Solution

  • Scrapy commands should use your project settings if executed at the root of a project, including scrapy view.

    Alternatively, you can use -s to set settings in the command line.