RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
7,420 Commits 49 Branches 132 Tags 162 MiB
Commit Graph

7420 Commits

Author SHA1 Message Date
Adrián Chaves 4d91ef2645 Bump version: 1.8.3 → 1.8.4 2024-02-14 18:19:27 +01:00
Adrián Chaves 505f525c66 Set the release date of version 1.8.4 2024-02-14 18:18:35 +01:00
Adrián Chaves 38cdbdcc69 Revert arbitrary regexp limits 2024-02-14 14:45:21 +01:00
Adrián Chaves ee7bd9d217 Merge remote-tracking branch 'cw9j-q3vf-hrrv/1.8.4-authorization' into 1.8 2024-02-14 14:35:26 +01:00
Adrián Chaves 71b8741e36 Merge remote-tracking branch '7j7m-v7m3-jqm7/1.8-compression-bomb' into 1.8 2024-02-14 14:33:49 +01:00
Adrián Chaves 73e7c0ed01 Backport the latest 2.11 implementation 2024-02-14 14:25:03 +01:00
Adrián Chaves 978407c938 Warn against using scrapy.downloadermiddlewares.decompression 2023-12-13 13:42:37 +01:00
Adrián Chaves 5460482319 spider → mw 2023-12-11 17:41:29 +01:00
Adrián Chaves 684d4effd4 Set an arbitrary upper limit on ReDoS-vulnerable regexps 2023-11-29 12:39:41 +01:00
Adrián Chaves 06c9692769 Backport improvements 2023-11-24 14:10:59 +01:00
Adrián Chaves 1c3d289798 Protect against compression bombs 2023-11-23 16:24:22 +01:00
Adrián Chaves ca832a4360 Drop the Authorization header on cross-domain redirect 2023-11-17 14:08:10 +01:00
Adrián Chaves a72ccf9f1f Freeze Pillow on tests 2023-11-17 14:07:38 +01:00
Adrián Chaves 2023a6bdcb
Fix the CI (#6149) 2023-11-17 10:12:29 +01:00
Adrián Chaves f9e2387112 tox: set a complete envlist 2023-11-15 16:39:45 +01:00
Adrián Chaves f9b1494148 Fix the ReadTheDocs configuration 2023-11-15 16:36:24 +01:00
Adrián Chaves c0a6ec084a Fix the tox configuration for end-of-life Python support 2023-11-15 16:19:14 +01:00
Adrián Chaves e3273732c2 Bump version: 1.8.2 → 1.8.3 2022-07-25 13:34:10 +02:00
Adrián Chaves ced7e4649a
Merge pull request from GHSA-9x8m-2xpf-crp3 
* Backport the 2.6.2 security fix

* Force the same Python version for docs as CI in Tox configuration

* Re-enable TLS 1.2 in cipher tests.

* tox.ini: ensure pypy runs pypy2

* Set the release date of Scrapy 1.8.3

Co-authored-by: Andrey Rakhmatullin <wrar@wrar.name>
 2022-07-25 13:15:17 +02:00
Adrián Chaves ae41acb502 Bump version: 1.8.1 → 1.8.2 2022-03-01 16:04:17 +01:00
Adrián Chaves d2589c74c5 test_unbounded_response: to_unicode → custom six code 2022-03-01 15:50:19 +01:00
Adrián Chaves efd72b08f9 tests: unicode → to_unicode 2022-03-01 15:14:59 +01:00
Adrián Chaves c5c2e2c7e9 tests: fix cast (str → unicode) 2022-03-01 15:03:36 +01:00
Adrián Chaves ed2348de76 CI: Install mock in Python 3.5 with pinned dependencies 2022-03-01 14:49:59 +01:00
Adrián Chaves 919f52fb8f CI: Install mock in Python 3.5 2022-03-01 14:44:14 +01:00
Adrián Chaves 610ce9b96d Fix typo 2022-03-01 14:18:19 +01:00
Adrián Chaves 6c55f76318 Stop mixing keyword arguments and ** in function calls 2022-03-01 13:43:56 +01:00
Adrián Chaves c4b22a5817 Remove further Python 3 syntax 2022-03-01 13:38:00 +01:00
Adrián Chaves c0e745e3fd Remove Python 3 syntax 2022-03-01 13:30:49 +01:00
Adrián Chaves f541d61593 Remove use of keyword-only arguments 2022-03-01 13:14:02 +01:00
Adrián Chaves bdd022d931 Fix redirect handling regression 2022-03-01 13:10:45 +01:00
Adrián Chaves 91706f58b7
Merge pull request from GHSA-mfjm-vh54-3f96 2022-03-01 12:38:19 +01:00
Adrián Chaves 290e2a2726
Merge pull request from GHSA-cjvr-mfj7-j4j8 
* Do not carry over cookies to a different domain on redirect

* Cover the cookie-domain redirect fix in the release notes

* Restore accidentally-removed release notes content

* Fix redirect Cookie handling when the cookie middleware is disabled

* Update the 1.8.2 release date
 2022-03-01 12:26:05 +01:00
nsirletti 47c4a3282a Suppress Sphinx warnings about MIME types other than .rst 2021-10-06 12:22:13 +02:00
Adrián Chaves 283e90e466 Bump version: 1.8.0 → 1.8.1 2021-10-05 21:37:54 +02:00
Adrián Chaves 99ac4dbd6b Cover 1.8.1 in the release notes 2021-10-05 21:10:49 +02:00
Andrey Rakhmatullin 16351344a6 Small documentation fixes. 2021-10-05 21:07:52 +02:00
Andrey Rakhmatullin b01d69a1bf Add http_auth_domain to HttpAuthMiddleware. 2021-10-05 21:07:45 +02:00
Adrián Chaves 4183925b4b Travis CI → GitHub Actions 2021-10-05 21:04:36 +02:00
Adrián Chaves be2e910dd0 Bump version: 1.7.0 → 1.8.0 2019-10-29 12:57:02 +01:00
Adrián Chaves 94f060fcc8
Cover Scrapy 1.8.0 in the release notes (#3952) 2019-10-29 12:53:46 +01:00
Andrey Rahmatullin 18b808b2e9
Merge pull request #4092 from further-reading/master 
Add Python 3.8 official support
 2019-10-29 16:30:58 +05:00
Roy 93e3dc1b82 [test_downloadermiddleware_httpcache.py] Cleaning text 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-28 16:12:03 +00:00
Roy b73d217de5 [test_downloadermiddleware_httpcache.py] Fixing pytest mark behaviour 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-28 12:55:54 +00:00
Roy 74909030a5 [tox.ini] Removing obsolete py37 extra deps enviornment 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-28 12:52:36 +00:00
Roy c51fb959e2 [test_downloadermiddleware_httpcache] Fixing pytest skip behaviour 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-28 12:36:54 +00:00
Roy 4432136fff [test_downloadermiddleware_httpcache] Fixing pytest skip behaviour 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-28 12:22:21 +00:00
Roy 9b47dc6a70 [travis, setup] Adding official python 3.8 support 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-28 11:24:52 +00:00
Roy 16bb3ac20d [test_downloadermiddleware_httpcache] Using skipif approach 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-28 11:24:09 +00:00
Roy Healy 3af2abb75b
Merge pull request #1 from Gallaecio/py38 
Mark the LevelDB storage backend as deprecated
 2019-10-28 10:35:04 +00:00