Scrapy, a fast high-level web crawling & scraping framework for Python.
Go to file
Pablo Hoffman fa644f7a5e Some simplifications to Scrapyd architecture and internals:
- launcher no longer knows about egg storage
- removed get_spider_list_from_eggifile() file and replaced by simpler
  get_spider_list() which doesn't receive en egg file as argument
- changed "egg runner" name to just "runner" to reflect the fact that it
  doesn't necesarilly run eggs (though it does in the default case)

--HG--
rename : scrapyd/eggrunner.py => scrapyd/runner.py
2010-12-27 16:22:32 -02:00
bin fixed bin\runtests.bat windows script 2010-12-14 12:20:38 -02:00
debian Make scrapy conflict with previous versionsof the debian package 2010-11-17 17:30:22 -02:00
docs Some simplifications to Scrapyd architecture and internals: 2010-12-27 16:22:32 -02:00
examples Splitted settings classes from settings singleton. Closes #244 2010-09-22 15:47:33 -03:00
extras moved coverage report script to extras/ 2010-12-15 12:08:59 -02:00
profiling/priorityqueue mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
scrapy Remove deprecated match common prefix feature from IBL code 2010-12-23 14:40:22 -02:00
scrapyd Some simplifications to Scrapyd architecture and internals: 2010-12-27 16:22:32 -02:00
scripts removed python2.5 from rpm-install.sh script 2009-06-16 13:14:40 -03:00
.coveragerc Added rules to Makefile.buildbot for generating coverage reports 2010-12-15 11:13:45 -02:00
.hgignore ignore docs/build 2009-07-25 15:21:22 -03:00
.hgtags Added tag 0.10.3 for changeset 803efdb19e0b 2010-09-29 13:34:56 -03:00
AUTHORS Added Didier to AUTHORS 2010-11-01 01:25:30 -02:00
INSTALL mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
LICENSE mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
MANIFEST.in Added missing mime.types files to MANIFEST.in 2010-09-11 04:30:08 -03:00
Makefile.buildbot moved coverage report script to extras/ 2010-12-15 12:08:59 -02:00
README added scrapy-sqs.py to deployed scripts 2010-06-13 19:17:17 -03:00
setup.cfg added bitmap for windows installer 2009-09-17 02:01:40 -03:00
setup.py improved mechanism for tagging version with hg revision 2010-12-13 10:21:39 -02:00

README

This is Scrapy, an opensource screen scraping framework written in Python.

For more visit the project home page at http://scrapy.org