RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
9,578 Commits 49 Branches 132 Tags 143 MiB
Commit Graph

1967 Commits

Author SHA1 Message Date
Adrián Chaves 7bb5289ced Cover additional behavior changes in tests 2023-01-10 21:11:57 +01:00
Adrián Chaves 86baef02a0 Test Content-Encoding against Content-Disposition, URL and body 2023-01-10 20:51:43 +01:00
Adrián Chaves deab93b243 Remove duplicate test 2023-01-10 19:04:52 +01:00
Adrián Chaves fc2833d6bd Fix _get_encoding_or_mime_type_from_headers handling on comma-separated Content-Encoding values 2023-01-10 18:32:27 +01:00
Adrián Chaves ee6f5c56b2 Support multi-encoding Content-Encoding headers 2023-01-10 17:55:35 +01:00
Adrián Chaves 68fccc9f04 Test that Content-Disposition takes precedence over body 2023-01-10 16:45:33 +01:00
Adrián Chaves f538252d3b crazy_case → odd_capitalize 2023-01-10 16:40:21 +01:00
Adrián Chaves 14464388e8 Address flake8 issues 2023-01-10 16:38:42 +01:00
Adrián Chaves dd4f4f094e Test handling of feeds mislabeled as HTML 2023-01-10 16:33:54 +01:00
Adrián Chaves 2178521a79 Make sure that supplied “unknown” MIME types from Content-Type are ignored 2023-01-10 13:41:36 +01:00
Adrián Chaves 8908151608 Test that MIME parameters do not break response class choice 2023-01-10 13:01:25 +01:00
Adrián Chaves 45b95c63d7 Address issues reported by pylint 2023-01-10 11:30:06 +01:00
Adrián Chaves e7e201d0b9 Extend tests covering body-based response class choice 2023-01-10 11:15:56 +01:00
Adrián Chaves eef1f127de test_response_class_choosing_request: update after recent changes 2023-01-10 07:43:14 +01:00
Adrián Chaves fcc9e90553 Wrap XHTML with XmlResponse 2023-01-10 07:30:40 +01:00
Adrián Chaves 827de3d288 Finish cleaning up POST_XTRACTMIME_SCENARIOS 2023-01-08 17:22:12 +01:00
Adrián Chaves 711a6093e1 Finish cleaning up PRE_XTRACTMIME_SCENARIOS 2023-01-08 17:02:56 +01:00
Adrián Chaves b2f2788bd4 Add tests for binary-vs-text body 2023-01-08 16:36:35 +01:00
Adrián Chaves f9f9d61457 Always prefer Content-Type over Content-Disposition 2023-01-08 15:46:32 +01:00
Adrián Chaves e7d36a305d Ignore file path extensions in HTTP responses 2023-01-08 14:24:54 +01:00
Adrián Chaves fa3ba512d9 Uncomment test scenarios 2023-01-08 13:21:36 +01:00
Adrián Chaves f029be3aa7 Fix Apache bug handling 2023-01-08 12:55:17 +01:00
Adrián Chaves 160096b7cf pytest-cov: 3.0.0 → 4.0.0 
Removes 2 warnings when running tests
 2023-01-08 11:43:52 +01:00
Adrián Chaves e96b07bd4b flake8: ignore failing file for the time being 2023-01-08 11:38:46 +01:00
Adrián Chaves c6d416c69f Merge remote-tracking branch 'upstream/master' into integrate-mime 2023-01-08 11:25:00 +01:00
Adrián Chaves 724b033287
Fix CI issues related to asyncio (#5782) 2023-01-06 19:51:07 +01:00
Adrián Chaves fd6742e811
Fix tests for pygments 2.14 (#5783) 2023-01-02 19:13:31 +01:00
Adrián Chaves b336980bd1 Merge remote-tracking branch 'upstream/master' into integrate-mime 2023-01-02 13:14:39 +01:00
Alex 93ace91ace
Merge branch 'scrapy:master' into fix_shell_fetch_alt 2022-12-13 21:50:28 -08:00
Alex c2de9372a2 added unittest for scrapy shell command and fixed flake8 error 2022-12-13 21:37:17 -08:00
Laerte Pereira e099572cec
change xfail condition 2022-12-12 09:56:50 -03:00
Laerte Pereira 0dbd1d9b81
use xfail, switch to packaging to parse version 2022-12-12 08:58:40 -03:00
Laerte Pereira 6757973b61
fix test_follow_whitespace_* tests 2022-12-11 09:11:55 -03:00
Mark Mayo f9a29f03d9
Address some issues reported by Pylint (#5677) 
Co-authored-by: Felipe Boff Nunes <51033921+felipeboffnunes@users.noreply.github.com>
Co-authored-by: Andrey Rahmatullin <wrar@wrar.name>
 2022-11-27 11:00:13 +01:00
Andrey Rahmatullin d19a216e10
Merge branch 'master' into pathlib 2022-11-25 18:20:25 +05:00
Andrey Rakhmatullin f85c3f3d68 Add a comment about `tmpname + '^'`. 2022-11-25 18:46:14 +06:00
Laerte Pereira e769532644
Remove `noconnect` deprecate code 2022-11-23 08:30:11 -03:00
Laerte Pereira 1506479672
Remove deprecated test 2022-11-22 10:07:32 -03:00
Laerte Pereira 8e0025f53d
Remove support for override settings with `SCRAPY_` environment variables 2022-11-22 09:38:54 -03:00
Laerte Pereira 1a6408c3fa
Remove `FilteringLinkExtractor` 2022-11-21 07:30:20 -03:00
Laerte Pereira d5b6c236a9
Remove deprecated code (#5719) 2022-11-21 09:32:26 +01:00
Andrey Rahmatullin bbe24d79a5
Fix test issues 2022-11-07 17:08:54 +05:00
Andrey Rahmatullin 6c0890ff54
Simplify the changes after the merge 2022-11-07 16:36:54 +05:00
Andrey Rahmatullin b03d84e9fb
Merge branch 'master' into 3689-update 2022-11-07 16:33:21 +05:00
Andrey Rahmatullin 77cd511a5e
Merge pull request #5489 from PluT00/deprecate-NoimagesDrop 
Deprecate scrapy.pipelines.images.NoimagesDrop
 2022-11-05 14:18:19 +05:00
Andrey Rahmatullin 8004075823
Merge pull request #5699 from elacuesta/crawlspider-callback-keyword-arguments 
CrawlSpider: pass cb_kwargs from process_request
 2022-11-02 17:35:03 +05:00
Andrey Rahmatullin a95a338eea
Merge pull request #5599 from tonal/patch-1 
Partial in is_generator_with_return_value
 2022-10-31 20:08:16 +05:00
Eugenio Lacuesta b18560315b
Add tests 2022-10-30 18:28:16 -03:00
Andrey Rakhmatullin b71d0292d5 Add a test for processing partial callbacks. 2022-10-27 18:13:47 +06:00
Godson 3a34fa8399
Get the event loop from event_loop_policy to avoid a deprecation warning (#5689) 2022-10-27 14:02:12 +02:00