scrapy

Scrapy, a fast high-level web crawling & scraping framework for Python.

Go to file

Pablo Hoffman 1ce84046d8 scheduler: bug fix to use in-memory queues when request can't be serialized by the disk-queues		2011-08-05 12:39:29 -03:00
bin	slightly improved version of scrapyd script	2011-06-20 11:04:38 -03:00
debian	debian/control: added python-setuptools to Recommends, because it's need by 'scrapy deploy' command	2011-05-01 11:00:02 -03:00
docs	added marshal to formats supported by feed exports	2011-08-03 16:16:48 -03:00
extras	added envvar SCRAPY_VERSION_FROM_HG=1 to extras/makedeb.py script	2011-06-18 03:31:47 -03:00
scrapy	scheduler: bug fix to use in-memory queues when request can't be serialized by the disk-queues	2011-08-05 12:39:29 -03:00
scrapyd	moved spider queues to scrapyd	2011-07-19 19:39:27 -03:00
scripts	…
.coveragerc	…
.hgignore	…
.hgtags	…
AUTHORS	added Darian Moody to AUTHORS	2011-06-12 01:42:30 -03:00
INSTALL	…
LICENSE	…
MANIFEST.in	…
Makefile.buildbot	…
README	fixed typo	2011-04-07 02:04:42 -03:00
setup.cfg	…
setup.py	setup.py: only add lxml requirement if libxml2 is not available	2011-07-13 13:04:42 -03:00

This is Scrapy, an opensource screen scraping framework written in Python.

For more info visit the project home page at http://scrapy.org