RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
Scrapy, a fast high-level web crawling & scraping framework for Python.
2,450 Commits 49 Branches 132 Tags 133 MiB
Python 99.8%
HTML 0.1%
Go to file
Pablo Hoffman 0f69e7a191 Some changes to HTTP Cache middleware: 
* made it use the project data storage by default (closes #279)
* added HTTPCACHE_ENABLED setting (False by default) to enable it
* made HTTPCACHE_DIR = 'httpcache' by default (inside the project data storage)
* simplified HTTPCACHE_EXPIRATION_SECS semantics: zero means don't expire,
  dropped support for negative numbers
* other minor doc improvements
 		2010-11-01 02:38:15 -02:00
bin runtests.sh: switched to 'text' repoter in trial 2010-10-30 16:03:00 -02:00
debian Automated merge with http://hg.scrapy.org/scrapy-0.10 2010-10-27 14:42:47 -02:00
docs Some changes to HTTP Cache middleware: 2010-11-01 02:38:15 -02:00
examples Splitted settings classes from settings singleton. Closes #244 2010-09-22 15:47:33 -03:00
extras Added new 'deploy' command. Closes #261 2010-10-18 22:38:46 -02:00
profiling/priorityqueue mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
scrapy Some changes to HTTP Cache middleware: 2010-11-01 02:38:15 -02:00
scrapyd scrapyd: make Environment tests independent of the current OS environment 2010-10-27 06:49:15 -02:00
scripts removed python2.5 from rpm-install.sh script 2009-06-16 13:14:40 -03:00
.hgignore ignore docs/build 2009-07-25 15:21:22 -03:00
.hgtags Added tag 0.10.3 for changeset 803efdb19e0b 2010-09-29 13:34:56 -03:00
AUTHORS Added Didier to AUTHORS 2010-11-01 01:25:30 -02:00
INSTALL mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
LICENSE mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
MANIFEST.in Added missing mime.types files to MANIFEST.in 2010-09-11 04:30:08 -03:00
README added scrapy-sqs.py to deployed scripts 2010-06-13 19:17:17 -03:00
setup.cfg added bitmap for windows installer 2009-09-17 02:01:40 -03:00
setup.py added lxml to setup.py install_requires, if using setuptools. refs #147 2010-10-25 14:57:50 -02:00

README 

This is Scrapy, an opensource screen scraping framework written in Python.

For more visit the project home page at http://scrapy.org