Scrapy, a fast high-level web crawling & scraping framework for Python.
Go to file
Pablo Hoffman c7d9f6e270 Added JSON item exporter with doc and unittests (closes #192), and also:
* put all json exporters in scrapy.contrib.exporters and deprecated
  scrapy.contrib.exporters.jsonlines to reduce module nesting
* use JSON exporter with EXPORT_FORMAT=json in file export pipeline
2010-08-07 15:52:59 -03:00
bin make runtests.sh more virtualenv-friendly 2010-08-05 13:31:19 -03:00
debian minor fix to path name 2010-07-31 16:02:59 -03:00
docs Added JSON item exporter with doc and unittests (closes #192), and also: 2010-08-07 15:52:59 -03:00
examples Replaced default spider manager (TwistedPluginSpiderManger) with a simpler one that doesn't depend on Twisted Plugins infrastructure. 2010-07-30 17:30:32 -03:00
extras moved sign_release.sh code to Makefile 2010-06-14 09:49:07 -03:00
profiling/priorityqueue mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
scrapy Added JSON item exporter with doc and unittests (closes #192), and also: 2010-08-07 15:52:59 -03:00
scripts removed python2.5 from rpm-install.sh script 2009-06-16 13:14:40 -03:00
.hgignore ignore docs/build 2009-07-25 15:21:22 -03:00
.hgtags Added tag 0.9 for changeset 5caf3dc10a92 2010-06-28 00:54:47 -03:00
AUTHORS Added Ping Yin to AUTHORS 2010-06-11 11:33:02 -03:00
INSTALL mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
LICENSE mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
MANIFEST.in added some missing file to MANIFEST.in 2009-09-28 23:55:00 -03:00
README added scrapy-sqs.py to deployed scripts 2010-06-13 19:17:17 -03:00
setup.cfg added bitmap for windows installer 2009-09-17 02:01:40 -03:00
setup.py removed custom Makefile and version based on mercurial revision 2010-07-24 17:02:08 -03:00

README

This is Scrapy, an opensource screen scraping framework written in Python.

For more visit the project home page at http://scrapy.org