scrapy/scrapy
gunblues 034e2c31c7
Use a non-zero exit code when a pipeline's open_spider method throws an exception (#4207)
* fix issue 4175 - Scrapy does not use a non-zero exit code when pipeline's open_spider throws the exception

* remove extra blank lines

* remove redundant code

* remove blank line at end of file

* more suitable naming for response and make if-condition shorter

* avoid error - AttributeError: 'Deferred' object has no attribute 'result'

* use getattr to make code concisely

* add test

* remove useless file

* modify test class name

* remove unneccessary files

* Fix Flake8-reported issue

* fix these items which are suggested by Gallaecio
・Sort those imports at tests/test_cmdline_crawl_with_pipeline/__init__.py
・Remove the unused setUp method.
・Remove comments generated by Scrapy’s project generation tool.
・Remove the [deploy] section from the scrapy.cfg file (I don’t think it’s needed here)
・Remove BOT_NAME and NEWSPIDER_MODULE from settings.py (I think there are not needed either, although I’m less sure about NEWSPIDER_MODULE)

* have to reserve BOT_NAME, SPIDER_MODULES in settings.py

* Remove unneeded empty lines

* Empty __init__.py file with unneeded comments

* Remove an unneeded empty line at the end

* Remove unneeed empty line from __init__.py file

* Update __init__.py

* Update __init__.py

* Update exception.py

* Update normal.py

* Update __init__.py

* Update __init__.py

* fix W391 blank line at end of file

Co-authored-by: Adrián Chaves <adrian@chaves.io>
2020-02-26 00:46:05 +05:00
..
commands Use a non-zero exit code when a pipeline's open_spider method throws an exception (#4207) 2020-02-26 00:46:05 +05:00
contracts Fix E502: backslash is redundant between brackets (#4238) 2019-12-17 13:53:15 +01:00
core Expose certificate for HTTPS responses (#4054) 2020-02-22 17:20:31 +05:00
downloadermiddlewares fix E22X flake8 2020-02-21 08:39:14 +01:00
extensions Fix Flake8 errors 2020-01-24 15:51:48 +02:00
http Expose certificate for HTTPS responses (#4054) 2020-02-22 17:20:31 +05:00
linkextractors fix E22X flake8 2020-02-21 08:39:14 +01:00
loader Item loaders: allow single-argument processors (unbound methods) 2019-11-22 20:47:22 -03:00
pipelines Fix Flake8 errors 2020-01-24 15:58:52 +02:00
selector Remove unused imports 2019-11-21 14:21:17 +01:00
settings fix E22X flake8 2020-02-21 08:39:14 +01:00
spidermiddlewares Replace to_native_str calls with to_unicode. 2019-11-14 13:45:39 +05:00
spiders Add errback parameter to scrapy.spiders.crawl.Rule (#4000) 2019-12-18 20:05:33 +05:00
templates fix typo (Response -> Request) 2019-04-05 14:31:15 -03:00
utils fix E701 and E271 flake8 2020-02-22 12:32:38 +01:00
VERSION Bump version: 1.7.0 → 1.8.0 2019-10-29 12:57:02 +01:00
__init__.py Convert the relative imports to absolute imports 2019-12-05 11:25:19 +11:00
__main__.py Add support for executing scrapy using -m option of python 2017-05-15 22:52:23 -03:00
_monkeypatches.py Remove six.PY2 and six.PY3 conditionals. 2019-11-14 13:45:37 +05:00
cmdline.py Fix E502: backslash is redundant between brackets (#4238) 2019-12-17 13:53:15 +01:00
crawler.py Specify Twisted reactor (TWISTED_REACTOR setting) (#4294) 2020-02-06 22:42:34 +05:00
dupefilters.py Update RFPDupeFilter line separator for correct universal newlines mode usage (#4283) 2020-02-06 22:14:40 +01:00
exceptions.py Add missing blank lines between functions and classes 2019-11-18 17:16:09 +01:00
exporters.py Make BaseItemExporter’s dont_fail parameter keyword-only 2020-02-24 13:28:15 +01:00
extension.py Add missing blank lines between functions and classes 2019-11-18 17:16:09 +01:00
interfaces.py Add missing blank lines between functions and classes 2019-11-18 17:16:09 +01:00
item.py Remove six.PY2 and six.PY3 conditionals. 2019-11-14 13:45:37 +05:00
link.py Fix flake8-detected errors. 2019-11-14 15:24:37 +05:00
logformatter.py Merge pull request #4188 from elacuesta/logformatter-error-formatting 2020-02-19 19:05:08 +05:00
mail.py Fix mail attachs tcmime *** (#4229) 2019-12-17 09:47:01 +08:00
middleware.py Fix E502: backslash is redundant between brackets (#4238) 2019-12-17 13:53:15 +01:00
mime.types moved module scrapy.core.downloader.responsetypes to scrapy.responsetypes 2011-08-07 02:49:57 -03:00
pqueues.py Remove specifics of downstream request queues from scheduler (#3884) 2020-02-22 17:02:57 +05:00
resolver.py Remove unnecessary comma (#4369) 2020-02-24 12:02:00 +01:00
responsetypes.py fix E30X flake8 (#4355) 2020-02-21 06:05:31 +01:00
robotstxt.py Add missing blank lines between functions and classes 2019-11-18 17:16:09 +01:00
shell.py Merge pull request #4347 from noviluni/deprecate_sel_shortcut 2020-02-20 02:56:34 +05:00
signalmanager.py Merge remote-tracking branch 'upstream/master' into remove-six-code 2019-11-20 12:41:38 -03:00
signals.py new signal 2020-02-05 11:31:27 +00:00
spiderloader.py fix E22X flake8 2020-02-21 08:39:14 +01:00
squeues.py Remove specifics of downstream request queues from scheduler (#3884) 2020-02-22 17:02:57 +05:00
statscollectors.py Fix W391 Blank line at end of file (#4137) 2019-11-07 17:47:35 +01:00