linux: ubuntu16.04-64bit
python: 3.5.2
-
安裝環(huán)境
sudo apt-get install build-essential sudo apt-get install python3-dev sudo apt-get install libxml2-dev sudo apt-get install libxslt1-dev sudo apt-get install python3-setuptools sudo apt-get install libssl-dev apt-get install -y libffi-dev pip3 install Twisted pip3 install w3lib pip3 install lxm 安裝Scrapy: [scrapy運(yùn)行必備組件需要(OpenSSL, lxml(lxml一般默認(rèn)有安裝肴掷，可以import xml驗(yàn)證是否有安裝))]
sudo python3 -m pip install Scrapy安裝OpenSSL:
sudo python3 -m pip install pyopenssl重新安裝python3版本的這兩個(gè)軟件:
sudo apt-get install python3-dev
sudo apt-get install python3-setuptools
