RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
Scrapy, a fast high-level web crawling & scraping framework for Python.
2,375 Commits 49 Branches 132 Tags 134 MiB
Python 99.8%
HTML 0.1%
Go to file
Pablo Hoffman d15a97ff61 Updated Scrapy version in debian/changelog 2010-09-28 16:45:05 -03:00
bin Removed hacky SCRAPY_SETTINGS_DISABLED environment variable 2010-09-22 16:08:18 -03:00
debian Updated Scrapy version in debian/changelog 2010-09-28 16:45:05 -03:00
docs Added missing colon 2010-09-28 16:44:53 -03:00
examples Splitted settings classes from settings singleton. Closes #244 2010-09-22 15:47:33 -03:00
extras Some changes to Scrapyd to support multiple configuration files, to make it easier to deploy Scrapyd applications. Also documented 'egg_runner' and 'application' options 2010-09-07 09:17:25 -03:00
profiling/priorityqueue mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
scrapy added support to CloseSpider extension, for close the spider after N pages have been crawled. Using the CLOSESPIDER_PAGECOUNT setting. closes #253 2010-09-28 16:29:37 -03:00
scrapyd Removed hacky SCRAPY_SETTINGS_DISABLED environment variable 2010-09-22 16:08:18 -03:00
scripts removed python2.5 from rpm-install.sh script 2009-06-16 13:14:40 -03:00
.hgignore ignore docs/build 2009-07-25 15:21:22 -03:00
.hgtags Added tag 0.10.2 for changeset 68d08e757571 2010-09-15 14:48:47 -03:00
AUTHORS Added Shuaib Khan to AUTHORS 2010-09-20 08:34:22 -03:00
INSTALL mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
LICENSE mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
MANIFEST.in Added missing mime.types files to MANIFEST.in 2010-09-11 04:30:08 -03:00
README added scrapy-sqs.py to deployed scripts 2010-06-13 19:17:17 -03:00
setup.cfg added bitmap for windows installer 2009-09-17 02:01:40 -03:00
setup.py setup.py: added support for generating version from hg revision 2010-09-27 08:19:32 -03:00

README 

This is Scrapy, an opensource screen scraping framework written in Python.

For more visit the project home page at http://scrapy.org