RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
Scrapy, a fast high-level web crawling & scraping framework for Python.
1,658 Commits 42 Branches 132 Tags 165 MiB
Python 99.8%
HTML 0.1%
Go to file
Pablo Hoffman a7f5c6f878 Some enhancements to Scrapy core: 
- added graceful shutdown (with one ^C) and forced shutdown (two ^C)
- added optional loglevel to IgnoreRequest exception
- calling Spider Manager close_domain() function from engine to avoid race
  conditions caused by signal dispatch order
- moved twisted reactor controlling logic outside the engine and into the
  scrapy manager
- made log.err function respect the current log level filter
 		2009-09-03 08:27:48 -03:00
bin removed scrapy-admin.py command, and left only scrapy-ctl as the only scrapy command 2009-08-24 15:43:36 -03:00
docs moved CoreStats extension to scrapy.contrib.corestats 2009-09-01 23:00:49 -03:00
examples/googledir more cleanups to startproject and project templates 2009-08-29 04:29:47 -03:00
extras/sql mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
profiling/priorityqueue mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
scrapy Some enhancements to Scrapy core: 2009-09-03 08:27:48 -03:00
scripts removed python2.5 from rpm-install.sh script 2009-06-16 13:14:40 -03:00
.hgignore ignore docs/build 2009-07-25 15:21:22 -03:00
AUTHORS mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
INSTALL mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
LICENSE mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
MANIFEST.in Fixed distutils packaging for all setup.py bdist formats 2009-06-16 17:10:43 +01:00
README mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
setup.cfg Fixed distutils packaging for all setup.py bdist formats 2009-06-16 17:10:43 +01:00
setup.py removed scrapy-admin.py command, and left only scrapy-ctl as the only scrapy command 2009-08-24 15:43:36 -03:00

README 

This is Scrapy, an opensource screen scraping framework written in Python.

For more visit the project home page at http://scrapy.org