Scrapy, a fast high-level web crawling & scraping framework for Python.
Go to file
Shane Evans 88dbe2ae87 fix error messages due to fetching pages during shutdown process
This version keeps the faster approach of not processing request callbacks when engine is shutting down
2011-05-20 14:35:37 +01:00
bin fixed bin\runtests.bat windows script 2010-12-14 12:20:38 -02:00
debian debian/control: added python-setuptools to Recommends, because it's need by 'scrapy deploy' command 2011-05-01 11:00:02 -03:00
docs stack trace dump extension: also dump engine status, and support triggering it with SIGQUIT, besides SIGUSR2 2011-05-20 03:25:00 -03:00
extras moved coverage report script to extras/ 2010-12-15 12:08:59 -02:00
profiling/priorityqueue mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
scrapy fix error messages due to fetching pages during shutdown process 2011-05-20 14:35:37 +01:00
scrapyd Add listjobs.json to Scrapyd API 2011-03-09 14:22:10 -02:00
scripts removed python2.5 from rpm-install.sh script 2009-06-16 13:14:40 -03:00
.coveragerc Added rules to Makefile.buildbot for generating coverage reports 2010-12-15 11:13:45 -02:00
.hgignore ignore docs/build 2009-07-25 15:21:22 -03:00
.hgtags Added tag 0.10.3 for changeset 803efdb19e0b 2010-09-29 13:34:56 -03:00
AUTHORS added Jochen Maes to AUTHORS 2011-03-09 14:24:17 -02:00
INSTALL mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
LICENSE mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
MANIFEST.in added missing scrapyd/default_scrapyd.conf file to MANIFEST.in 2011-01-28 16:21:00 -02:00
Makefile.buildbot moved coverage report script to extras/ 2010-12-15 12:08:59 -02:00
README fixed typo 2011-04-07 02:04:42 -03:00
setup.cfg added bitmap for windows installer 2009-09-17 02:01:40 -03:00
setup.py added w3lib to requirements, in installation guide 2011-05-01 11:14:57 -03:00

README

This is Scrapy, an opensource screen scraping framework written in Python.

For more info visit the project home page at http://scrapy.org