RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
scrapy/tests
History
gunblues 034e2c31c7
Use a non-zero exit code when a pipeline's open_spider method throws an exception (#4207) 
* fix issue 4175 - Scrapy does not use a non-zero exit code when pipeline's open_spider throws the exception

* remove extra blank lines

* remove redundant code

* remove blank line at end of file

* more suitable naming for response and make if-condition shorter

* avoid error - AttributeError: 'Deferred' object has no attribute 'result'

* use getattr to make code concisely

* add test

* remove useless file

* modify test class name

* remove unneccessary files

* Fix Flake8-reported issue

* fix these items which are suggested by Gallaecio
・Sort those imports at tests/test_cmdline_crawl_with_pipeline/__init__.py
・Remove the unused setUp method.
・Remove comments generated by Scrapy’s project generation tool.
・Remove the [deploy] section from the scrapy.cfg file (I don’t think it’s needed here)
・Remove BOT_NAME and NEWSPIDER_MODULE from settings.py (I think there are not needed either, although I’m less sure about NEWSPIDER_MODULE)

* have to reserve BOT_NAME, SPIDER_MODULES in settings.py

* Remove unneeded empty lines

* Empty __init__.py file with unneeded comments

* Remove an unneeded empty line at the end

* Remove unneeed empty line from __init__.py file

* Update __init__.py

* Update __init__.py

* Update exception.py

* Update normal.py

* Update __init__.py

* Update __init__.py

* fix W391 blank line at end of file

Co-authored-by: Adrián Chaves <adrian@chaves.io>
 		2020-02-26 00:46:05 +05:00
..
CrawlerProcess Specify Twisted reactor (TWISTED_REACTOR setting) (#4294) 2020-02-06 22:42:34 +05:00
keys revert wrong changes 2018-03-13 13:05:37 +08:00
mocks Add missing blank lines between functions and classes 2019-11-18 17:16:09 +01:00
py36 Also test non-default async callbacks. 2020-02-11 01:00:16 +05:00
sample_data [Test] Rename outdated sample files 2019-11-20 09:38:54 -03:00
test_cmdline Fix E502: backslash is redundant between brackets (#4238) 2019-12-17 13:53:15 +01:00
test_cmdline_crawl_with_pipeline Use a non-zero exit code when a pipeline's open_spider method throws an exception (#4207) 2020-02-26 00:46:05 +05:00
test_settings Simplify some more imports. 2019-11-14 13:45:39 +05:00
test_spiderloader Add missing blank lines between functions and classes 2019-11-18 17:16:09 +01:00
test_utils_misc Scan callbacks/errbacks for return statements with values different than None 2019-12-16 11:30:40 -03:00
__init__.py Simplify some more imports. 2019-11-14 13:45:39 +05:00
constraints.txt Added constrain on lxml version based on Python version 2019-07-30 23:24:41 -03:00
ignores.txt Rename tests/py3-ignores.txt to tests/ignores.txt. 2019-11-19 13:52:49 +05:00
mockserver.py Remove a stray newline. 2019-12-20 19:37:50 +05:00
pipelines.py fix E22X flake8 2020-02-21 08:39:14 +01:00
requirements-py3.txt Merge remote-tracking branch 'origin/master' into asyncio-base 2019-12-13 18:07:23 +05:00
spiders.py Add a test for an async callbacks that returns requests. 2020-02-07 17:14:52 +05:00
test_closespider.py [MRG+1] Show elapsed time in statscollector (#3638) 2019-04-07 00:03:40 +05:00
test_command_fetch.py Keep 2 spaces between code and inline comments (#4195) 2019-12-13 14:20:48 +01:00
test_command_parse.py fix E22X flake8 2020-02-21 08:39:14 +01:00
test_command_shell.py Switch from ` to `` where inline code formatting is desired 2019-03-01 16:56:58 +01:00
test_command_version.py Fix test 2017-09-25 12:49:27 +02:00
test_commands.py Specify Twisted reactor (TWISTED_REACTOR setting) (#4294) 2020-02-06 22:42:34 +05:00
test_contracts.py fix W291, W292, W293 (whitespaces) 2019-12-18 16:33:46 +01:00
test_crawl.py Expose certificate for HTTPS responses (#4054) 2020-02-22 17:20:31 +05:00
test_crawler.py fix E30X flake8 (#4355) 2020-02-21 06:05:31 +01:00
test_dependencies.py fix E30X flake8 (#4355) 2020-02-21 06:05:31 +01:00
test_downloader_handlers.py fix E22X flake8 2020-02-21 08:39:14 +01:00
test_downloadermiddleware.py Add a test function that uses asyncio.Queue(). 2019-12-31 17:54:41 +05:00
test_downloadermiddleware_ajaxcrawlable.py Add missing blank lines between functions and classes 2019-11-18 17:16:09 +01:00
test_downloadermiddleware_cookies.py fix E30X flake8 (#4355) 2020-02-21 06:05:31 +01:00
test_downloadermiddleware_decompression.py PY3 fix test downloadermiddleware decompression 2015-07-29 13:51:01 +00:00
test_downloadermiddleware_defaultheaders.py Update deprecated test aliases 2017-08-09 12:52:10 +02:00
test_downloadermiddleware_downloadtimeout.py Update deprecated test aliases 2017-08-09 12:52:10 +02:00
test_downloadermiddleware_httpauth.py Update deprecated test aliases 2017-08-09 12:52:10 +02:00
test_downloadermiddleware_httpcache.py fix E30X flake8 (#4355) 2020-02-21 06:05:31 +01:00
test_downloadermiddleware_httpcompression.py fix E251 2020-02-22 12:32:38 +01:00
test_downloadermiddleware_httpproxy.py Remove unused imports 2019-11-21 14:21:17 +01:00
test_downloadermiddleware_redirect.py fix E30X flake8 (#4355) 2020-02-21 06:05:31 +01:00
test_downloadermiddleware_retry.py fix W291, W292, W293 (whitespaces) 2019-12-18 16:33:46 +01:00
test_downloadermiddleware_robotstxt.py Simplify some more imports. 2019-11-14 13:45:39 +05:00
test_downloadermiddleware_stats.py PY3 fix DownloaderStats middleware tests 2015-09-01 04:09:15 +05:00
test_downloadermiddleware_useragent.py Update deprecated test aliases 2017-08-09 12:52:10 +02:00
test_dupefilters.py fix E22X flake8 2020-02-21 08:39:14 +01:00
test_engine.py Split a long test in test_engine.py into three. 2019-12-18 19:41:16 +05:00
test_exporters.py fix E30X flake8 (#4355) 2020-02-21 06:05:31 +01:00
test_extension_telnet.py Remove unused imports 2019-11-21 14:21:17 +01:00
test_feedexport.py Merge remote-tracking branch 'upstream/master' into remove-six-code 2019-11-22 12:12:29 -03:00
test_http_cookies.py Remove six.moves occurrences from tests 2019-11-03 00:01:09 -03:00
test_http_headers.py Merge remote-tracking branch 'upstream/master' into remove-six-code 2019-11-20 12:41:38 -03:00
test_http_request.py Merge pull request #4008 from elacuesta/docs_request_errback 2020-01-23 23:12:44 +05:00
test_http_response.py fix E30X flake8 (#4355) 2020-02-21 06:05:31 +01:00
test_item.py fix E701 and E271 flake8 2020-02-22 12:32:38 +01:00
test_link.py Rename test_non_str_url_py2 to test_bytes_url. 2019-11-14 22:53:28 +05:00
test_linkextractors.py Update tests to account for link extractors escaping spaces 2020-02-12 19:00:04 +01:00
test_loader.py Merge branch 'master' into remove-six-code 2019-11-25 10:34:21 +01:00
test_logformatter.py Merge pull request #4188 from elacuesta/logformatter-error-formatting 2020-02-19 19:05:08 +05:00
test_mail.py fix E30X flake8 (#4355) 2020-02-21 06:05:31 +01:00
test_middleware.py Add missing blank lines between functions and classes 2019-11-18 17:16:09 +01:00
test_pipeline_crawl.py fix E131 2020-02-22 12:32:38 +01:00
test_pipeline_files.py fix E701 and E271 flake8 2020-02-22 12:32:38 +01:00
test_pipeline_images.py fix E30X flake8 (#4355) 2020-02-21 06:05:31 +01:00
test_pipeline_media.py fix E30X flake8 (#4355) 2020-02-21 06:05:31 +01:00
test_pipelines.py Use get_from_asyncio_queue in the pipeline test. 2020-01-09 14:49:16 +05:00
test_proxy_connect.py Merge pull request #4198 from wRAR/deprecate-noconnect 2019-12-18 16:11:24 +05:00
test_request_cb_kwargs.py Remove six.PY2 and six.PY3 conditionals. 2019-11-14 13:45:37 +05:00
test_request_left.py name signla catcher in accord with signal name 2020-02-06 13:46:23 +00:00
test_responsetypes.py fix E30X flake8 (#4355) 2020-02-21 06:05:31 +01:00
test_robotstxt_interface.py fix W291, W292, W293 (whitespaces) 2019-12-18 16:33:46 +01:00
test_scheduler.py improve tests and fix some lint warnings (#6) 2019-03-25 16:08:40 +03:00
test_selector.py Remove unused imports 2019-11-21 14:21:17 +01:00
test_signals.py Improve async signal tests. 2020-02-11 01:05:45 +05:00
test_spider.py Merge pull request #4170 from mabelvj/4133-handle-start_url 2019-12-05 17:47:03 +05:00
test_spidermiddleware.py fix E22X flake8 2020-02-21 08:39:14 +01:00
test_spidermiddleware_depth.py Fix W391 Blank line at end of file (#4137) 2019-11-07 17:47:35 +01:00
test_spidermiddleware_httperror.py [MRG+1] Automatic port selection for servicies in unit tests (#3210) 2018-05-23 21:25:50 +03:00
test_spidermiddleware_offsite.py fix W291, W292, W293 (whitespaces) 2019-12-18 16:33:46 +01:00
test_spidermiddleware_output_chain.py fix E22X flake8 2020-02-21 08:39:14 +01:00
test_spidermiddleware_referer.py Keep 2 spaces between code and inline comments (#4195) 2019-12-13 14:20:48 +01:00
test_spidermiddleware_urllength.py Fix W391 Blank line at end of file (#4137) 2019-11-07 17:47:35 +01:00
test_spiderstate.py TST remove temporary files and folders 2017-02-16 17:50:38 +05:00
test_squeues.py Merge pull request #4365 from noviluni/fix_flake8_E701_E271 2020-02-23 15:52:52 +05:00
test_stats.py Simplify some more imports. 2019-11-14 13:45:39 +05:00
test_toplevel.py Remove more six imports 2019-11-03 01:11:28 -03:00
test_urlparse_monkeypatches.py Remove six.moves occurrences from tests 2019-11-03 00:01:09 -03:00
test_utils_asyncio.py Specify Twisted reactor (TWISTED_REACTOR setting) (#4294) 2020-02-06 22:42:34 +05:00
test_utils_conf.py fix E30X flake8 (#4355) 2020-02-21 06:05:31 +01:00
test_utils_console.py Add missing blank lines between functions and classes 2019-11-18 17:16:09 +01:00
test_utils_curl.py Remove elluding six occurrences 2019-11-03 12:26:38 -03:00
test_utils_datatypes.py Scan callbacks/errbacks for return statements with values different than None 2019-12-16 11:30:40 -03:00
test_utils_defer.py fix E22X flake8 2020-02-21 08:39:14 +01:00
test_utils_deprecate.py fix E30X flake8 (#4355) 2020-02-21 06:05:31 +01:00
test_utils_gz.py Modifying existing gzip read failure recovery mechanism to patch read for broken archives 2016-08-11 18:21:42 +05:30
test_utils_http.py Fix E502: backslash is redundant between brackets (#4238) 2019-12-17 13:53:15 +01:00
test_utils_httpobj.py Add missing blank lines between functions and classes 2019-11-18 17:16:09 +01:00
test_utils_iterators.py fix E30X flake8 (#4355) 2020-02-21 06:05:31 +01:00
test_utils_log.py fix E22X flake8 2020-02-21 08:39:14 +01:00
test_utils_project.py Fix test_utils_project under Windows 2018-08-15 01:53:20 -03:00
test_utils_python.py fix E701 and E271 flake8 2020-02-22 12:32:38 +01:00
test_utils_reqser.py Remove unused imports 2019-11-21 14:21:17 +01:00
test_utils_request.py fix E30X flake8 (#4355) 2020-02-21 06:05:31 +01:00
test_utils_response.py Remove six.moves occurrences from tests 2019-11-03 00:01:09 -03:00
test_utils_serialize.py Add set serialization to ScrapyJSONEncoder 2016-07-22 17:20:03 -04:00
test_utils_signal.py fix E22X flake8 2020-02-21 08:39:14 +01:00
test_utils_sitemap.py Add missing blank lines between functions and classes 2019-11-18 17:16:09 +01:00
test_utils_spider.py Keep 2 spaces between code and inline comments (#4195) 2019-12-13 14:20:48 +01:00
test_utils_template.py fix E30X flake8 (#4355) 2020-02-21 06:05:31 +01:00
test_utils_trackref.py Simplify some more imports. 2019-11-14 13:45:39 +05:00
test_utils_url.py fix flake E211 2020-02-22 12:32:38 +01:00
test_webclient.py fix E22X flake8 2020-02-21 08:39:14 +01:00