scrapy/scrapy
Konstantin Lopuhin b5c552d17f
Merge pull request #2061 from elacuesta/process_spider_exception_generator
[MRG+1] process_spider_exception on generators
2019-04-01 10:43:19 +03:00
..
commands Add documentation to `scrapy shell` command. 2018-11-16 22:15:03 +01:00
contracts Merge pull request #3381 from StasDeep/fix/issue-3380 2018-09-06 11:41:02 -03:00
core Merge pull request #2061 from elacuesta/process_spider_exception_generator 2019-04-01 10:43:19 +03:00
downloadermiddlewares [MRG+1] redirect_reasons in Request.meta (#3687) 2019-03-27 00:15:53 +05:00
extensions Merge branch 'master' into feed-storage-s3-acl 2019-03-15 13:26:45 -03:00
http enabled sort keys only if not provided 2019-01-25 21:26:28 +05:30
linkextractors New constructor arg *restrict_text* for FilteringLinkExtractor. 2019-02-28 17:21:17 +01:00
loader [backwards incompatible] switch ItemLoader from .extract to .getall. 2018-09-12 17:57:27 +05:00
pipelines Switch from ` to `` where inline code formatting is desired 2019-03-01 16:56:58 +01:00
selector DOC use autodocs for selectors; document more methods and attributes; suggest get/getall 2018-09-12 18:36:25 +05:00
settings using blank string instead of None as default value as proposed by @kmike 2019-02-12 12:26:57 -02:00
spidermiddlewares PEP8 ofsite middleware 2018-08-24 15:18:16 -04:00
spiders Rule.process_request: move deprecation warnings and compiling code, update tests 2019-03-22 19:46:17 -03:00
templates Be consistent with domain used for links to documentation website 2019-01-31 01:28:53 -03:00
utils Merge pull request #2061 from elacuesta/process_spider_exception_generator 2019-04-01 10:43:19 +03:00
xlib Wipe scrapy.xlib.tx 2016-12-02 21:22:35 +00:00
VERSION Bump version: 1.5.0 → 1.6.0 2019-01-30 18:00:40 -03:00
__init__.py drop deprecated "optional_features" set 2015-09-15 09:00:08 +00:00
__main__.py Add support for executing scrapy using -m option of python 2017-05-15 22:52:23 -03:00
_monkeypatches.py Use https links wherever possible 2017-10-28 16:24:40 +05:30
cmdline.py backwards → backward (adj.) 2019-03-01 16:10:23 +01:00
conf.py backwards → backward (adj.) 2019-03-01 16:10:23 +01:00
crawler.py Merge pull request #3610 from Gallaecio/spidercls-check 2019-03-15 08:25:16 +01:00
dupefilters.py Logging the request referer when DUPEFILTER_DEBUG is active 2019-01-18 11:38:59 -02:00
exceptions.py Undocument _InvalidOutput exception 2017-03-10 15:41:57 -03:00
exporters.py Fix for CSV export unnecessary blank lines problem on Windows (#3039) 2018-07-03 18:22:24 -03:00
extension.py Replace BaseSettings._getcomposite() with public .getwithbase() method 2015-11-11 17:39:57 +01:00
interfaces.py SpiderManager shim is removed 2018-07-06 03:28:01 +05:00
item.py Implement Item.deepcopy() 2019-03-22 17:07:10 +01:00
link.py PY3 raise an exception if bytes are passed as url to Link constructor 2015-08-28 23:04:02 +05:00
log.py backwards → backward (adj.) 2019-03-01 16:10:23 +01:00
logformatter.py Switch from ` to `` where inline code formatting is desired 2019-03-01 16:56:58 +01:00
mail.py Use a helper for to_bytes() and None input 2017-10-05 10:16:42 +02:00
middleware.py Use collections.deque instead of list to store methods 2018-10-29 12:40:20 -03:00
mime.types moved module scrapy.core.downloader.responsetypes to scrapy.responsetypes 2011-08-07 02:49:57 -03:00
resolver.py Do not cache DNS responses when cache size is 0 2017-07-04 23:18:15 +02:00
responsetypes.py Merge pull request #1503 from demelziraptor/amazon-json-response 2016-09-12 13:21:16 -03:00
shell.py Populate spider variable when using shell.inspect_response 2017-07-03 11:28:04 -03:00
signalmanager.py Use https links wherever possible 2017-10-28 16:24:40 +05:30
signals.py backwards → backward (adj.) 2019-03-01 16:10:23 +01:00
spiderloader.py Add SPIDER_LOADER_WARN_ONLY to toggle between spiderloader failure and warning 2017-03-07 17:40:40 +01:00
squeues.py Clarify comment about Pyhton versions 2018-02-08 15:47:20 -03:00
statscollectors.py enable test_stats and test_utils_log tests in Python 3 2015-08-26 01:58:59 +05:00
telnet.py Relocate telnetconsole to extensions/ 2015-10-05 21:16:04 +03:00