RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
Scrapy, a fast high-level web crawling & scraping framework for Python.
1,186 Commits 49 Branches 132 Tags 143 MiB
Python 99.8%
HTML 0.1%
Go to file
Daniel Grana 00b49752ce Multiples changes to core scheduling and duplicates filtering 
* removed starters from engine
* moved schedulermiddleware to scheduler
* raise RuntimeError when trying to open/close a scheduler domain twice
* removed dupesfilter singleton and spidermw dupefilter middleware

--HG--
extra : rebase_source : e4c3ad4b970cbc8f532bc751ba9d8a944ca16be5
 		2009-06-20 18:15:02 -03:00
bin Fixed distutils packaging for all setup.py bdist formats 2009-06-16 17:10:43 +01:00
docs Added domain schedulers (whose functionality was previously mixed with the 2009-06-19 17:55:54 -03:00
examples Some changes to HTTP cache middleware: 2009-05-24 19:13:06 -03:00
extras/sql mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
profiling/priorityqueue mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
scrapy Multiples changes to core scheduling and duplicates filtering 2009-06-20 18:15:02 -03:00
scripts removed python2.5 from rpm-install.sh script 2009-06-16 13:14:40 -03:00
.hgignore adding .svn to hgignore to help with hg2svn autocommits 2009-05-07 17:29:30 -03:00
AUTHORS mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
INSTALL mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
LICENSE mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
MANIFEST.in Fixed distutils packaging for all setup.py bdist formats 2009-06-16 17:10:43 +01:00
README mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
setup.cfg Fixed distutils packaging for all setup.py bdist formats 2009-06-16 17:10:43 +01:00
setup.py Fixed distutils packaging for all setup.py bdist formats 2009-06-16 17:10:43 +01:00

README 

This is Scrapy, an opensource screen scraping framework written in Python.

For more visit the project home page at http://scrapy.org