| .. |
|
commands
|
Correctly detect when all managed crawlers are done in CrawlerRunner
|
2014-09-09 17:21:39 -03:00 |
|
contracts
|
Fix usage of crawler_process in ScrapyCommands
|
2014-08-12 14:02:56 -03:00 |
|
contrib
|
Merge pull request #1016 from SudShekhar/jsonProcessor
|
2015-03-18 08:11:25 -03:00 |
|
contrib_exp
|
use io.BytesIO and cStringIO instead of six.BytesIO as suggested
|
2014-07-15 20:51:12 +08:00 |
|
core
|
handle TLS SNI if we have twisted>=14.0
|
2015-03-24 10:52:29 +00:00 |
|
http
|
Update form.py
|
2015-02-04 11:38:37 +01:00 |
|
selector
|
Use generator sintax in re_first
|
2015-03-18 21:11:08 -03:00 |
|
settings
|
add gzip compression to filesystem http cache backend
|
2015-01-21 20:18:11 +01:00 |
|
templates
|
add utf8 encoding header to spider templates
|
2014-06-26 00:30:27 +06:00 |
|
utils
|
Add re_first() to SelectorList and iflatten() to utils.python
|
2015-03-18 21:11:08 -03:00 |
|
xlib
|
pydispatch - pep8
|
2015-03-16 21:43:43 +00:00 |
|
VERSION
|
Bump version: 0.25.0 → 0.25.1
|
2014-07-09 03:05:39 -03:00 |
|
__init__.py
|
emphasize web crawling over screen scraping on scrapy description. closes #586
|
2015-03-18 00:24:16 -03:00 |
|
_monkeypatches.py
|
cleanup toplevel namespace
|
2014-04-15 01:09:35 +06:00 |
|
cmdline.py
|
PY3: use six.iterkeys, six.iteritems, and tempfile
|
2014-07-14 18:47:22 +08:00 |
|
command.py
|
Drop support for ScrapyCommand.crawler property
|
2014-08-12 14:02:56 -03:00 |
|
conf.py
|
better backwards compatibility for scrapy.conf.settings
|
2012-10-25 11:41:40 -02:00 |
|
crawler.py
|
Stop logobserver only when set
|
2014-09-10 12:09:07 -03:00 |
|
dupefilter.py
|
rename attribute to match conventions used for XXX_DEBUG settings (in autothrottle and cookies mw)
|
2014-02-20 12:03:06 -02:00 |
|
exceptions.py
|
pylint cleanup: unused imports and old-style exceptions
|
2013-10-18 19:23:45 +06:00 |
|
extension.py
|
Made ExtensionManager a subclass of MiddlewareManager
|
2010-08-22 05:33:08 -03:00 |
|
interfaces.py
|
SpiderManager interface cleanup
|
2014-08-12 14:02:55 -03:00 |
|
item.py
|
items: Use BaseItem.__hash__ and six.add_metaclass decorator
|
2014-07-24 15:37:10 -03:00 |
|
link.py
|
PY3 port scrapy.link
|
2014-08-02 00:16:01 +06:00 |
|
linkextractor.py
|
move restrict_css argument to end of argument list in link extractors for backwards compatibility, use keyword arguments in link extractor super().__init__() calls
|
2014-12-15 09:18:15 -02:00 |
|
log.py
|
Support multiple simultaneous LogObservers listening different crawlers
|
2014-08-12 14:02:56 -03:00 |
|
logformatter.py
|
Log level return from LogFormatter methods
|
2012-12-29 11:43:41 +07:00 |
|
mail.py
|
PY3: use six.BytesIO and six.moves.cStringIO
|
2014-07-15 15:52:10 +08:00 |
|
middleware.py
|
Promote startup info on settings and middleware to INFO level
|
2014-01-09 19:37:06 +01:00 |
|
mime.types
|
moved module scrapy.core.downloader.responsetypes to scrapy.responsetypes
|
2011-08-07 02:49:57 -03:00 |
|
project.py
|
Drop support for scrapy.project.crawler (And scrapy.stats consequently)
|
2014-08-12 14:02:56 -03:00 |
|
resolver.py
|
t.i.b.ThreadedResolver is now a new-style class
|
2014-12-16 19:28:39 +00:00 |
|
responsetypes.py
|
PY3 MimeTypes wants files in text mode.
|
2014-08-01 03:28:05 +06:00 |
|
shell.py
|
Drop support for scrapy.project.crawler (And scrapy.stats consequently)
|
2014-08-12 14:02:56 -03:00 |
|
signalmanager.py
|
remove debugging code
|
2013-02-27 03:52:55 -02:00 |
|
signals.py
|
An attempt to resolve #977, add signal to be sent when request is dropped by the scheduler
|
2014-11-27 15:10:15 +03:00 |
|
spider.py
|
Non mutable default in Spider.custom_settings
|
2014-09-01 21:56:57 -03:00 |
|
spidermanager.py
|
SPIDER_MODULES can be set as a csv string
|
2014-09-10 23:25:57 -03:00 |
|
squeue.py
|
PY3: use six.moves.cPickle
|
2014-07-14 17:15:28 +08:00 |
|
stats.py
|
Drop support for scrapy.project.crawler (And scrapy.stats consequently)
|
2014-08-12 14:02:56 -03:00 |
|
statscol.py
|
minor message update: spider stats -> Scrapy stats
|
2012-10-12 16:53:44 -02:00 |
|
telnet.py
|
telnet client: fix unexisting reference to engine.slots
|
2013-11-19 04:52:24 +01:00 |
aaeb837db4