0.? 安裝順序很重要
我們需要在linux中安裝zlib-devel包揍拆,進(jìn)行支持冶伞。
? 我們需要在linux中安裝openssl包狐史,進(jìn)行支持罢低。
yum install python-devel
yum install openssl-devel
yum install zlib-devel
yum -y install zlib-devel bzip2-devel openssl-devel ncurses-devel sqlite-devel readline-devel tk-devel gdbm-devel db4-devel libpcap-devel xz-devel
1. 安裝setuptools
wget --no-check-certificate? https://pypi.python.org/packages/source/s/setuptools/setuptools-19.6.tar.gz#md5=c607dd118eae682c44ed146367a17e26
tar -zxvf setuptools-19.6.tar.gz
cd setuptools-19.6
python setup.py build
python setup.py install
2. 安裝pip
wget --no-check-certificate? https://pypi.python.org/packages/source/p/pip/pip-8.0.2.tar.gz#md5=3a73c4188f8dbad6a1e6f6d44d117eeb
tar -zxvf pip-8.0.2.tar.gz
cd pip-8.0.2
python setup.py build
python setup.py install
pip install --upgrade pip
3. 安裝python3
cd /root/
wget https://www.python.org/ftp/python/3.6.0/Python-3.6.0.tgz
tar -zxvf Python-3.6.0.tgz
cd Python-3.6.0
./configure
make
make install
修改系統(tǒng)默認(rèn)的Python路徑,因?yàn)樵诮K端中輸入Python命令時(shí)默認(rèn)是指向Python2.6.6
mv /usr/bin/python /usr/bin/python-2
建立新的軟連接媳禁,指向Python-3.6.0:
注:這里的python36是第4步指定的安裝路徑眠副,python3.6是Python包里的可執(zhí)行程序
ln -s /root/Python-3.6.0/python /usr/bin/python
ln -s /home/yy/Python-3.6.0/python /usr/bin/python
mv /usr/bin/python /usr/bin/python2bak
ln -s /usr/bin/python3 /usr/bin/python
4. 安裝scrapy
pip install scrapy
pip install PyMySQL
pip install lxml
pip install bs4
pip install cryptography --force-reinstall
pip install UserAgent
pip install fake-useragent
pip install pywin32 針對(duì)windows的
pip install bloomfilter4py3
5.更改yum配置,因?yàn)槠湟玫絧ython2才能執(zhí)行竣稽,否則會(huì)導(dǎo)致yum不能正常使用
vi /usr/bin/yum
把#! /usr/bin/python修改為#! /usr/bin/python2
vi /usr/libexec/urlgrabber-ext-down
把#! /usr/bin/python 修改為#! /usr/bin/python2