Scrapy, a fast high-level web crawling & scraping framework for Python.
Go to file
Pablo Hoffman 5bf733b6f6 Changed default representation of items to pretty-printed dicts. This improves
default logging by making log more readable in the default case, for both Scraped and Dropped lines.

Projects can still customize how items are represented by overriding the item's __str__ method, as usual.
2011-06-03 01:13:01 -03:00
bin fixed bin\runtests.bat windows script 2010-12-14 12:20:38 -02:00
debian debian/control: added python-setuptools to Recommends, because it's need by 'scrapy deploy' command 2011-05-01 11:00:02 -03:00
docs Changed default representation of items to pretty-printed dicts. This improves 2011-06-03 01:13:01 -03:00
extras moved coverage report script to extras/ 2010-12-15 12:08:59 -02:00
profiling/priorityqueue mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
scrapy Changed default representation of items to pretty-printed dicts. This improves 2011-06-03 01:13:01 -03:00
scrapyd Add listjobs.json to Scrapyd API 2011-03-09 14:22:10 -02:00
scripts removed python2.5 from rpm-install.sh script 2009-06-16 13:14:40 -03:00
.coveragerc Added rules to Makefile.buildbot for generating coverage reports 2010-12-15 11:13:45 -02:00
.hgignore ignore docs/build 2009-07-25 15:21:22 -03:00
.hgtags Added tag 0.10.3 for changeset 803efdb19e0b 2010-09-29 13:34:56 -03:00
AUTHORS added Jochen Maes to AUTHORS 2011-03-09 14:24:17 -02:00
INSTALL mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
LICENSE mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
MANIFEST.in added missing scrapyd/default_scrapyd.conf file to MANIFEST.in 2011-01-28 16:21:00 -02:00
Makefile.buildbot moved coverage report script to extras/ 2010-12-15 12:08:59 -02:00
README fixed typo 2011-04-07 02:04:42 -03:00
setup.cfg added bitmap for windows installer 2009-09-17 02:01:40 -03:00
setup.py added w3lib to requirements, in installation guide 2011-05-01 11:14:57 -03:00

README

This is Scrapy, an opensource screen scraping framework written in Python.

For more info visit the project home page at http://scrapy.org