| .. |
|
commands
|
Merge pull request #2410 from redapple/fetch-transparent-redirect
|
2016-12-21 09:49:15 -02:00 |
|
contracts
|
…
|
|
|
contrib
|
…
|
|
|
contrib_exp
|
…
|
|
|
core
|
Import xlib.tx code from twisted proper
|
2016-12-02 21:21:51 +00:00 |
|
downloadermiddlewares
|
Merge pull request #2411 from redapple/remove-chunked-transfer-mw
|
2016-12-07 22:05:15 +05:00 |
|
extensions
|
Test Slot's heartbeat state before stopping it
|
2016-11-07 16:44:57 +01:00 |
|
http
|
add better messages for when response content isn't text (closes #2264)
|
2016-09-21 10:30:35 -03:00 |
|
linkextractors
|
LinkExtractor PY3 'unicode' type fix
|
2016-11-10 17:50:06 +00:00 |
|
loader
|
Merge pull request #1467 from dacjames/master
|
2015-09-16 22:03:19 -03:00 |
|
pipelines
|
[image & file pipeline] loading setting for user classes
|
2016-09-15 09:39:16 +02:00 |
|
selector
|
Selector should not receive both response and text
|
2016-07-30 10:35:16 +03:00 |
|
settings
|
LOG_SHORT_NAMES option
|
2016-12-09 00:04:04 +05:00 |
|
spidermiddlewares
|
Raise log level for HttpErrorMiddleware to INFO (from DEBUG)
|
2016-09-20 13:44:21 +02:00 |
|
spiders
|
handle relative sitemap urls in robots.txt
|
2016-12-01 09:53:40 -03:00 |
|
templates
|
use crawler only to register signals in from_crawler()
|
2016-10-19 14:09:01 -02:00 |
|
utils
|
Merge pull request #2410 from redapple/fetch-transparent-redirect
|
2016-12-21 09:49:15 -02:00 |
|
xlib
|
Wipe scrapy.xlib.tx
|
2016-12-02 21:22:35 +00:00 |
|
VERSION
|
Bump version: 1.2.2 → 1.3.0
|
2016-12-21 16:28:44 +01:00 |
|
__init__.py
|
drop deprecated "optional_features" set
|
2015-09-15 09:00:08 +00:00 |
|
_monkeypatches.py
|
BF: robustify _monkeypatches check for twisted - str() name first (Closes: #1634)
|
2015-12-18 16:16:05 -05:00 |
|
cmdline.py
|
Remove --lsprof command-line option. Fixes GH-1531
|
2016-01-19 00:00:31 +05:00 |
|
command.py
|
…
|
|
|
conf.py
|
…
|
|
|
crawler.py
|
Remove unneeded `raise` (thanks @lopuhin).
|
2016-02-19 18:31:49 +05:00 |
|
dupefilter.py
|
…
|
|
|
dupefilters.py
|
fixed RFPDupeFilter persistence
|
2015-07-28 14:32:14 +05:00 |
|
exceptions.py
|
…
|
|
|
exporters.py
|
added FEED_EXPORT_ENCODING setting to allow encoding specification
|
2016-07-12 16:20:17 +02:00 |
|
extension.py
|
Replace BaseSettings._getcomposite() with public .getwithbase() method
|
2015-11-11 17:39:57 +01:00 |
|
interfaces.py
|
…
|
|
|
item.py
|
…
|
|
|
link.py
|
PY3 raise an exception if bytes are passed as url to Link constructor
|
2015-08-28 23:04:02 +05:00 |
|
linkextractor.py
|
…
|
|
|
log.py
|
…
|
|
|
logformatter.py
|
fix Referer logging
|
2015-08-26 02:19:33 +05:00 |
|
mail.py
|
fixes import for py35 env.
|
2016-10-18 12:24:11 -03:00 |
|
middleware.py
|
Use long classes names for enabled middlewares in startup logs
|
2016-01-26 16:41:16 +01:00 |
|
mime.types
|
…
|
|
|
project.py
|
…
|
|
|
resolver.py
|
…
|
|
|
responsetypes.py
|
Merge pull request #1503 from demelziraptor/amazon-json-response
|
2016-09-12 13:21:16 -03:00 |
|
shell.py
|
Use built-in range()
|
2016-12-12 22:40:48 +01:00 |
|
signalmanager.py
|
PY3 port signals
|
2015-07-25 18:04:55 +02:00 |
|
signals.py
|
…
|
|
|
spider.py
|
…
|
|
|
spiderloader.py
|
Add stacktrace in warning message
|
2016-12-09 16:56:26 +01:00 |
|
spidermanager.py
|
…
|
|
|
squeue.py
|
…
|
|
|
squeues.py
|
Test for AttributeError when pickling objects (Python>=3.5)
|
2016-01-18 18:14:33 +01:00 |
|
stats.py
|
…
|
|
|
statscol.py
|
…
|
|
|
statscollectors.py
|
enable test_stats and test_utils_log tests in Python 3
|
2015-08-26 01:58:59 +05:00 |
|
telnet.py
|
Relocate telnetconsole to extensions/
|
2015-10-05 21:16:04 +03:00 |