Scrapy, a fast high-level web crawling & scraping framework for Python.
Go to file
Pablo Hoffman 67adb2a05f Always use micro versions in Scrapy from now on 2010-11-17 00:09:14 -02:00
bin runtests.sh: switched to 'text' repoter in trial 2010-10-30 16:03:00 -02:00
debian Automated merge with http://hg.scrapy.org/scrapy-0.10 2010-10-27 14:42:47 -02:00
docs Updated documentation to point out that simplejson is now required if using Python 2.5, and to recommended switching to Python 2.6 2010-11-16 03:31:04 -02:00
examples Splitted settings classes from settings singleton. Closes #244 2010-09-22 15:47:33 -03:00
extras Added new 'deploy' command. Closes #261 2010-10-18 22:38:46 -02:00
profiling/priorityqueue mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
scrapy Always use micro versions in Scrapy from now on 2010-11-17 00:09:14 -02:00
scrapyd Simplified get_spider_list_from_eggfile() function now that it doesn't need to chdir to a custom directory (Scrapy now works when it's unable to create the SQLite database) 2010-11-05 11:48:12 -02:00
scripts removed python2.5 from rpm-install.sh script 2009-06-16 13:14:40 -03:00
.hgignore ignore docs/build 2009-07-25 15:21:22 -03:00
.hgtags Added tag 0.10.3 for changeset 803efdb19e0b 2010-09-29 13:34:56 -03:00
AUTHORS Added Didier to AUTHORS 2010-11-01 01:25:30 -02:00
INSTALL mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
LICENSE mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
MANIFEST.in Added missing mime.types files to MANIFEST.in 2010-09-11 04:30:08 -03:00
README added scrapy-sqs.py to deployed scripts 2010-06-13 19:17:17 -03:00
setup.cfg added bitmap for windows installer 2009-09-17 02:01:40 -03:00
setup.py Removed scrapy.xlib.simplejson module. Scrapy now requires simplejson if running on Python 2.5. Closes #289 2010-11-16 03:11:12 -02:00

README

This is Scrapy, an opensource screen scraping framework written in Python.

For more visit the project home page at http://scrapy.org