Scrapy, a fast high-level web crawling & scraping framework for Python.
Go to file
Pablo Hoffman ff9de424c8 Added SpiderQueue tests. SQS spider queue not tested because operations take too long to complete and it's not easy to know when they have. Closes #227 2010-09-06 09:47:45 -03:00
bin Moved scrapy-ws script to extras/ and fixed broken methods due to changes in web service API 2010-08-27 00:33:08 -03:00
debian Added new Scrapy service with support for: 2010-09-03 15:54:42 -03:00
docs Updated 'Scrapy at a glance' document replacing item pipeline example by a simpler usage of feed exports 2010-09-05 23:38:37 -03:00
examples Changed format of scrapy.cfg file to contain a [settings] section and a 'default' key inside it, instead of the other way around 2010-09-02 21:22:17 -03:00
extras Added new Scrapy service with support for: 2010-09-03 15:54:42 -03:00
profiling/priorityqueue mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
scrapy Added SpiderQueue tests. SQS spider queue not tested because operations take too long to complete and it's not easy to know when they have. Closes #227 2010-09-06 09:47:45 -03:00
scrapyd Added new Scrapy service with support for: 2010-09-03 15:54:42 -03:00
scripts removed python2.5 from rpm-install.sh script 2009-06-16 13:14:40 -03:00
.hgignore ignore docs/build 2009-07-25 15:21:22 -03:00
.hgtags Added tag 0.9 for changeset 5caf3dc10a92 2010-06-28 00:54:47 -03:00
AUTHORS Applied documentation patch provided by Lucian Ursu (closes #207) 2010-08-21 01:26:35 -03:00
INSTALL mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
LICENSE mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
MANIFEST.in Added new Scrapy service with support for: 2010-09-03 15:54:42 -03:00
README added scrapy-sqs.py to deployed scripts 2010-06-13 19:17:17 -03:00
setup.cfg added bitmap for windows installer 2009-09-17 02:01:40 -03:00
setup.py Added new Scrapy service with support for: 2010-09-03 15:54:42 -03:00

README

This is Scrapy, an opensource screen scraping framework written in Python.

For more visit the project home page at http://scrapy.org