scrapy/tests
Omer Schleifer ff3e299eb0 [MRG+2] add flags to request (#2082)
* add flags to request

* fxi test - add flags to request

* fix test(2) - add flags to request

* fix test(2) - add flags to request

* Updated test to reqser with flags field of request

* Updated documntation with flags field of request

* fix test identation

* fix test failed

* make the change backward comptaible

* remove  unrequired  spaces, fix documentation request flags

* remove  unrequired  space

* fx assert equal

* flags default is empty list

* Add flags to request

* add flags to request

* fxi test - add flags to request

* fix test(2) - add flags to request

* fix test(2) - add flags to request

* Updated test to reqser with flags field of request

* Updated documntation with flags field of request

* fix test identation

* fix test failed

* make the change backward comptaible

* remove  unrequired  spaces, fix documentation request flags

* remove  unrequired  space

* fx assert equal

* flags default is empty list

* add flags to request squashed commits
2017-02-20 20:42:29 +06:00
..
keys Add HTTPS tests with non-hostname-maching server certificate 2016-04-20 14:42:03 +02:00
mocks move tests under root dir 2014-07-30 19:45:08 -03:00
sample_data Merge pull request #2547 from scrapy/linkextractor-strip-whitespaces 2017-02-20 11:08:32 -03:00
test_cmdline Amend "settings" command to output JSON for dict settings 2016-01-29 21:12:03 +01:00
test_settings Support 'True' and 'False' strings as boolean settings values 2017-01-30 16:33:08 +01:00
test_spiderloader Warn user instead of failing for wrong SPIDER_MODULES setting 2016-12-08 12:50:26 +01:00
test_utils_misc move tests under root dir 2014-07-30 19:45:08 -03:00
__init__.py handle whitespace in response.follow; add tests 2017-02-15 04:17:41 +05:00
mockserver.py Remove code required to support ancient twisted versions. See GH-1887. 2017-02-07 22:30:58 +05:00
pipelines.py Update docstring 2016-11-08 13:30:51 +01:00
py3-ignores.txt py3: reviewed s3 downloader handlers 2016-02-15 19:59:48 +03:00
requirements-py3.txt [httpcompression] minor style edits 2017-02-07 10:22:42 +01:00
requirements.txt [httpcompression] minor style edits 2017-02-07 10:22:42 +01:00
spiders.py deprecate Spider.make_requests_from_url. Fixes #1495. 2017-02-16 03:39:34 +05:00
test_closespider.py Use LogCapture in testfixtures package for tests 2015-04-22 17:24:40 -03:00
test_command_fetch.py Let framework handle only HTTP redirects by default for fetch and shell commands 2016-12-07 17:56:13 +01:00
test_command_parse.py Moved parse command tests to its own file. Added some checks to check for logged errors. 2016-09-19 05:33:05 +02:00
test_command_shell.py Add test for fetch(url) within shell with and without redirect 2016-12-07 19:07:32 +01:00
test_command_version.py Print more dependencies versions in "scrapy version" verbose output 2016-11-22 14:48:33 +01:00
test_commands.py TST tests for LOG_SHORT_NAMES 2016-12-09 02:19:51 +05:00
test_contracts.py Move scrapy/spider.py to scrapy/spiders/__init__.py 2015-05-09 04:20:09 -03:00
test_crawl.py Add trailing dot 2017-02-02 22:28:37 +01:00
test_crawler.py make "settings" argument optional for Crawler, CrawlerRunner and CrawlerProcess 2015-06-06 03:23:13 +05:00
test_dependencies.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_downloader_handlers.py TST remove temporary files and folders 2017-02-16 17:50:38 +05:00
test_downloadermiddleware.py py3: body to bytes in tests, unskip test file 2016-01-15 11:26:01 +03:00
test_downloadermiddleware_ajaxcrawlable.py PY3 fix AjacCrawlable middleware tests 2015-09-01 03:49:52 +05:00
test_downloadermiddleware_cookies.py Do not propagate cookie log messages in tests so TopLevelFormatter does not rewrite them 2015-08-03 17:18:08 -03:00
test_downloadermiddleware_decompression.py PY3 fix test downloadermiddleware decompression 2015-07-29 13:51:01 +00:00
test_downloadermiddleware_defaultheaders.py PY3 fix DefaultHeadersMiddleware tests 2015-09-01 03:57:05 +05:00
test_downloadermiddleware_downloadtimeout.py Move scrapy/spider.py to scrapy/spiders/__init__.py 2015-05-09 04:20:09 -03:00
test_downloadermiddleware_httpauth.py PY3 fix HttpAuthMiddleware tests 2015-09-01 04:00:26 +05:00
test_downloadermiddleware_httpcache.py fix error reporting in test: we can fail in process_request too, so result should always be defined 2016-01-15 15:16:12 +03:00
test_downloadermiddleware_httpcompression.py [httpcompression] skip test if no brotli 2017-02-06 13:49:41 +01:00
test_downloadermiddleware_httpproxy.py Add HTTPPROXY_ENABLED setting (default True) 2017-02-14 11:33:01 -03:00
test_downloadermiddleware_redirect.py Do not interpret non-ASCII bytes in "Location" and percent-encode them (#2322) 2016-10-19 23:26:12 -03:00
test_downloadermiddleware_retry.py Remove code required to support ancient twisted versions. See GH-1887. 2017-02-07 22:30:58 +05:00
test_downloadermiddleware_robotstxt.py Pass user-agent as native str when checking URLs against robots.txt 2016-11-15 17:38:32 +01:00
test_downloadermiddleware_stats.py PY3 fix DownloaderStats middleware tests 2015-09-01 04:09:15 +05:00
test_downloadermiddleware_useragent.py PY3 fix UserAgentMiddleware tests 2015-09-01 04:11:33 +05:00
test_dupefilters.py Merge pull request #1388 from scrapy/dupefilter-persist 2015-08-11 14:16:34 -03:00
test_engine.py deprecate Spider.make_requests_from_url. Fixes #1495. 2017-02-16 03:39:34 +05:00
test_exporters.py Fixed bug on XMLItemExporter with non-string fields in items 2016-01-30 10:00:06 -02:00
test_feedexport.py TST remove temporary files and folders 2017-02-16 17:50:38 +05:00
test_http_cookies.py PY3: Implement some attributes of WrappedRequest required in Python 3 2016-02-07 14:19:27 +09:00
test_http_headers.py normalize header values to bytes 2014-08-01 00:02:50 -03:00
test_http_request.py FormRequest: handle whitespaces in action attribute properly 2017-02-16 02:13:39 +05:00
test_http_response.py TST more response.follow tests 2017-02-16 02:02:50 +05:00
test_item.py BUG: Fix __classcell__ propagation. 2017-02-08 02:12:52 -04:00
test_link.py PY3 raise an exception if bytes are passed as url to Link constructor 2015-08-28 23:04:02 +05:00
test_linkextractors.py Strip leading/trailing whitespaces in link extractors. Fixes GH-838. 2017-02-16 02:22:17 +05:00
test_linkextractors_deprecated.py Strip leading/trailing whitespaces in link extractors. Fixes GH-838. 2017-02-16 02:22:17 +05:00
test_loader.py split nested_loader into seperate methods 2015-09-04 13:15:48 -07:00
test_logformatter.py [MRG+2] add flags to request (#2082) 2017-02-20 20:42:29 +06:00
test_mail.py (fixes #2272) using arg_to_iter() to wrap single values and list() to avoid consuming from generators. 2016-10-18 11:06:55 -03:00
test_middleware.py PY3 fix test middleware 2015-07-29 13:51:01 +00:00
test_pipeline_files.py TST: Randomize FILES_EXPIRES above 90 days 2016-12-21 17:03:11 +01:00
test_pipeline_images.py TST: Randomize IMAGES_EXPIRES above 90 days 2016-12-06 18:49:53 +01:00
test_pipeline_media.py PY3 fix test pipeline media 2015-07-29 13:51:01 +00:00
test_proxy_connect.py Use LogCapture in testfixtures package for tests 2015-04-22 17:24:40 -03:00
test_pydispatch_deprecated.py add deprecation for pydispatch (thanks for the help @redapple) 2016-02-11 16:15:28 -02:00
test_responsetypes.py Merge pull request #1503 from demelziraptor/amazon-json-response 2016-09-12 13:21:16 -03:00
test_selector.py Selector should not receive both response and text 2016-07-30 10:35:16 +03:00
test_selector_csstranslator.py cleanup tests for selectors and translators 2015-08-11 14:09:34 -03:00
test_spider.py fix make_requests_from_url deprcation implementation, add tests 2017-02-17 00:18:29 +05:00
test_spidermiddleware_depth.py Move scrapy/spider.py to scrapy/spiders/__init__.py 2015-05-09 04:20:09 -03:00
test_spidermiddleware_httperror.py Raise log level for HttpErrorMiddleware to INFO (from DEBUG) 2016-09-20 13:44:21 +02:00
test_spidermiddleware_offsite.py tests+doc for subdomains in offsite middleware 2016-01-26 12:49:43 +02:00
test_spidermiddleware_referer.py PY3 depth, offsite and referer spider middlewares; Crawler 2015-08-28 04:11:30 +05:00
test_spidermiddleware_urllength.py Move scrapy/spider.py to scrapy/spiders/__init__.py 2015-05-09 04:20:09 -03:00
test_spiderstate.py TST remove temporary files and folders 2017-02-16 17:50:38 +05:00
test_squeues.py fix scrapy squeue tests after recent changes to queuelib 2015-09-09 15:55:55 -03:00
test_stats.py enable test_stats and test_utils_log tests in Python 3 2015-08-26 01:58:59 +05:00
test_toplevel.py drop deprecated "optional_features" set 2015-09-15 09:00:08 +00:00
test_urlparse_monkeypatches.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_utils_conf.py Validate values for components order 2017-02-07 09:13:57 -03:00
test_utils_console.py Add support for bpython console. 2015-08-21 01:12:58 +01:00
test_utils_datatypes.py Add tests for SequenceExclude container 2016-12-12 22:37:53 +01:00
test_utils_defer.py Improve python3 support for test_utils_defer. 2015-07-25 12:58:39 +02:00
test_utils_deprecate.py Ignore ScrapyDeprecationWarning warnings properly. 2015-06-09 18:22:03 +03:00
test_utils_gz.py Modifying existing gzip read failure recovery mechanism to patch read for broken archives 2016-08-11 18:21:42 +05:30
test_utils_http.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_utils_httpobj.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_utils_iterators.py Refactored test code 2016-01-13 12:32:28 +01:00
test_utils_log.py Replace FailureFormatter with direct exc_info conversions in log calls 2015-05-15 05:46:14 -03:00
test_utils_project.py TST fixed ProjectUtilsTest on OS X 2017-02-16 16:32:23 +05:00
test_utils_python.py Rename isbinarytext function to binary_is_text for clarity 2016-03-30 15:44:15 +00:00
test_utils_reqser.py [MRG+2] add flags to request (#2082) 2017-02-20 20:42:29 +06:00
test_utils_request.py Do not fail representing non-http requests 2015-08-10 14:10:58 -03:00
test_utils_response.py response_status_message should not fail on non-standard HTTP codes 2016-03-12 14:16:40 +01:00
test_utils_serialize.py Add set serialization to ScrapyJSONEncoder 2016-07-22 17:20:03 -04:00
test_utils_signal.py PY3 port signals 2015-07-25 18:04:55 +02:00
test_utils_sitemap.py handle relative sitemap urls in robots.txt 2016-12-01 09:53:40 -03:00
test_utils_spider.py Move scrapy/contrib/spiders to scrapy/spiders 2015-04-29 21:27:19 -03:00
test_utils_template.py Test utils.template.render_templatefile() 2015-08-26 20:44:33 +03:00
test_utils_trackref.py PY3: port scrapy.utils.trackref 2015-08-10 15:13:29 -03:00
test_utils_url.py Use w3lib.url.canonicalize_url() from w3lib 1.15.0 2016-08-16 17:42:16 +05:30
test_webclient.py TST fix a weird OS X testing issue 2017-02-16 18:22:04 +05:00