RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
Scrapy, a fast high-level web crawling & scraping framework for Python.
1,714 Commits 49 Branches 132 Tags 155 MiB
Python 99.8%
HTML 0.1%
Go to file
Pablo Hoffman 921fc4f3bf Big Scrapy core refactoring to pass around spider references instead of domains. 
This is to avoid accessing the scrapy.spider.spiders singleton for "resolving"
spiders, which is considered an "evil" practice because it ties us to the
singleton model for the spider resolver, which is a bad thing.

This change will also work as the foundation for the API cleaning that we'll
perform for 0.8. We decided to introduce this change now to have a more common
basecode between 0.7 and 0.8, which will allow us to better support 0.7 until
0.8 is released.

However, this change doesn't modify the stable/documented API, nor does it
change the core logic. Those changes will land on the 0.8 branch, after 0.7 is
released.

--HG--
rename : scrapy/contrib/domainsch.py => scrapy/contrib/spiderscheduler.py
 		2009-09-12 14:34:18 -03:00
bin removed scrapy-admin.py command, and left only scrapy-ctl as the only scrapy command 2009-08-24 15:43:36 -03:00
docs Big Scrapy core refactoring to pass around spider references instead of domains. 2009-09-12 14:34:18 -03:00
examples/googledir more cleanups to startproject and project templates 2009-08-29 04:29:47 -03:00
extras/sql mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
profiling/priorityqueue mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
scrapy Big Scrapy core refactoring to pass around spider references instead of domains. 2009-09-12 14:34:18 -03:00
scripts removed python2.5 from rpm-install.sh script 2009-06-16 13:14:40 -03:00
.hgignore ignore docs/build 2009-07-25 15:21:22 -03:00
AUTHORS mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
INSTALL mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
LICENSE mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
MANIFEST.in Fixed distutils packaging for all setup.py bdist formats 2009-06-16 17:10:43 +01:00
README mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
setup.cfg Fixed distutils packaging for all setup.py bdist formats 2009-06-16 17:10:43 +01:00
setup.py removed scrapy-admin.py command, and left only scrapy-ctl as the only scrapy command 2009-08-24 15:43:36 -03:00

README 

This is Scrapy, an opensource screen scraping framework written in Python.

For more visit the project home page at http://scrapy.org