scrapy -h
查看常見的命令
Available commands:
bench Run quick benchmark test
fetch Fetch a URL using the Scrapy downloader
genspider Generate new spider using pre-defined templates
runspider Run a self-contained spider (without creating a project)
settings Get settings values
shell Interactive scraping console
startproject Create new project
version Print Scrapy version
view Open URL in browser, as seen by Scrapy
fetch 命令：不依賴項目直接爬取網(wǎng)頁命令顿锰，顯示爬蟲爬取的過程
image.png
不顯示日志：
fetch -- none log
#用scrapy view命令下載百度網(wǎng)頁虱痕，并用瀏覽器打開這個問題
scrapy view http://www.baidu.com
