When tried to install Twisted for Python 3.6.3 it keeps on throwing a particular error :
building 'twisted.test.raiser' extension
error: Microsoft Visual C++ 14.0 is required. Get it with "Microsoft Visual C++ Build Tools": http://landinghub.visualstudio.com/visual-cpp-build-tools
Tried install the Visual-Cpp-build tools but its a massive 4 + gigs download so is there any other way to do it .. Also I have all the redistributable.
Installing Scrapy on Windows can be a real struggle. Some strange errors can occur.
That's why the scrapy documentation recommands to use Anaconda for the scrapy installation. I think you should give it a try if you are working on Windows.
First you need to install Anaconda following this tutorial.
Then you just need to run this command conda install -c conda-forge scrapy
and you are good to go.