scrapy 十几个项的优雅部署方案？后期方便修改爬虫和好维护的

V2EX = way to explore

V2EX 是一个关于分享和探索的地方

For Existing Member Sign In

推荐学习书目

› Learn Python the Hard Way

Python Sites

› PyPI - Python Package Index

› http://diveintopython.org/toc/index.html

› Pocoo

值得关注的项目

› PyPy

› Celery

› Jinja2

› Read the Docs

› gevent

› pyenv

› virtualenv

› Stackless Python

› Beautiful Soup

› 结巴中文分词

› Green Unicorn

› Sentry

› Shovel

› Pyflakes

› pytest

Python 编程

› pep8 Checker

Styles

› PEP 8

› Google Python Style Guide

› Code Style from The Hitchhiker's Guide

This topic created in 2193 days ago, the information mentioned may be changed or developed.

谢谢

Scrapy

和好

修改

优雅

5 replies • 2020-05-06 09:58:16 +08:00

liuxu

May 5, 2020

十几个项？是一个 Item 有十几个项的意思？每个项对应一个 XPATH，就在 spider 里维护就好了吧

phithon

May 5, 2020

scrapyd

yangxin0

May 5, 2020

k8s

Fizzyi

May 6, 2020

crawlab 你值得拥有

tikazyq

May 6, 2020

https://crawlab.cn/