RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
7,390 Commits 42 Branches 132 Tags 161 MiB
Commit Graph

7390 Commits

Author SHA1 Message Date
Adrián Chaves bdd022d931 Fix redirect handling regression 2022-03-01 13:10:45 +01:00
Adrián Chaves 91706f58b7
Merge pull request from GHSA-mfjm-vh54-3f96 2022-03-01 12:38:19 +01:00
Adrián Chaves 290e2a2726
Merge pull request from GHSA-cjvr-mfj7-j4j8 
* Do not carry over cookies to a different domain on redirect

* Cover the cookie-domain redirect fix in the release notes

* Restore accidentally-removed release notes content

* Fix redirect Cookie handling when the cookie middleware is disabled

* Update the 1.8.2 release date
 2022-03-01 12:26:05 +01:00
nsirletti 47c4a3282a Suppress Sphinx warnings about MIME types other than .rst 2021-10-06 12:22:13 +02:00
Adrián Chaves 283e90e466 Bump version: 1.8.0 → 1.8.1 2021-10-05 21:37:54 +02:00
Adrián Chaves 99ac4dbd6b Cover 1.8.1 in the release notes 2021-10-05 21:10:49 +02:00
Andrey Rakhmatullin 16351344a6 Small documentation fixes. 2021-10-05 21:07:52 +02:00
Andrey Rakhmatullin b01d69a1bf Add http_auth_domain to HttpAuthMiddleware. 2021-10-05 21:07:45 +02:00
Adrián Chaves 4183925b4b Travis CI → GitHub Actions 2021-10-05 21:04:36 +02:00
Adrián Chaves be2e910dd0 Bump version: 1.7.0 → 1.8.0 2019-10-29 12:57:02 +01:00
Adrián Chaves 94f060fcc8
Cover Scrapy 1.8.0 in the release notes (#3952) 2019-10-29 12:53:46 +01:00
Andrey Rahmatullin 18b808b2e9
Merge pull request #4092 from further-reading/master 
Add Python 3.8 official support
 2019-10-29 16:30:58 +05:00
Roy 93e3dc1b82 [test_downloadermiddleware_httpcache.py] Cleaning text 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-28 16:12:03 +00:00
Roy b73d217de5 [test_downloadermiddleware_httpcache.py] Fixing pytest mark behaviour 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-28 12:55:54 +00:00
Roy 74909030a5 [tox.ini] Removing obsolete py37 extra deps enviornment 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-28 12:52:36 +00:00
Roy c51fb959e2 [test_downloadermiddleware_httpcache] Fixing pytest skip behaviour 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-28 12:36:54 +00:00
Roy 4432136fff [test_downloadermiddleware_httpcache] Fixing pytest skip behaviour 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-28 12:22:21 +00:00
Roy 9b47dc6a70 [travis, setup] Adding official python 3.8 support 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-28 11:24:52 +00:00
Roy 16bb3ac20d [test_downloadermiddleware_httpcache] Using skipif approach 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-28 11:24:09 +00:00
Roy Healy 3af2abb75b
Merge pull request #1 from Gallaecio/py38 
Mark the LevelDB storage backend as deprecated
 2019-10-28 10:35:04 +00:00
Adrián Chaves 3d0df419c4 Mark the LevelDB storage backend as deprecated 2019-10-28 11:24:47 +01:00
Roy Healy b5a00262ec
Update .travis.yml 
Reverting change to 3.8 extra dependency environment.
 2019-10-28 09:59:33 +00:00
elacuesta 7731814cc2 ItemLoader: improve handling of initial item (#4036) 2019-10-28 10:53:53 +01:00
Adrián Chaves bb91f9c78c Cover Scrapy 1.7.4 in the release notes 2019-10-28 09:58:13 +01:00
Roy 20ea912513 [test_downloadermiddleware_httpcache] Making xfails more informative 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-27 18:52:01 +00:00
Roy 70b2854590 [test_downloadermiddleware_httpcache] Making xfails more informative 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-27 18:51:26 +00:00
Roy b3df0a8415 [test_downloadermiddleware_httpcache] Adding xfails to impacted tests following hack fix 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-27 18:28:47 +00:00
Roy 11942c436c [test_downloadermiddleware_httpcache] Trying hack to handle systemerror whjen importing leveldb 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-27 18:02:13 +00:00
Roy deacd34c8d [test_downloadermiddleware_httpcache] Attempting to add xfail for leveldb related tests 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-27 17:39:47 +00:00
Roy Healy 4068797558
Update test_downloadermiddleware_httpcache.py 
Adding xfail denoting that leveldb is not supported in 3.8
 2019-10-27 17:02:17 +00:00
Roy Healy 179dc916ff
Update setup.py 
Updating setup.py to remove python 3.8 support for now
 2019-10-27 16:48:20 +00:00
Adrián Chaves 1d5c270ce8
Fix dangling file descriptor in FeedExporter when FEED_STORE_EMPTY is False (#4023) 2019-10-22 15:12:52 +02:00
WinterComes 5d75ed4cba Remove an old note about contracts (#4093) 2019-10-22 12:19:07 +02:00
illgitthat 07822935ec Updating link for miniconda (#4089) 2019-10-22 12:05:34 +02:00
Roy Healy 85ac5c5c57
Update .travis.yml 
Co-Authored-By: Mikhail Korobov <kmike84@gmail.com>
 2019-10-21 19:06:43 +01:00
Roy c12a075164 [.travis.yml] Added python 3.8 fields 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-21 18:34:15 +01:00
Roy 4e939ca75d [setup.py] Added python 3.8 fields 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-21 18:33:18 +01:00
Roy 3d4317bfe4 [tox.ini] Added python 3.8 fields 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-21 18:32:30 +01:00
Mikhail Korobov 8cb53441b0
Merge pull request #4056 from Gallaecio/documentation-build 
Fix internal links in the tutorial and release notes
 2019-10-19 00:00:02 +02:00
Mikhail Korobov 6674f47dbf
Merge pull request #4069 from seregaxvm/master 
update zsh completion
 2019-10-16 22:59:15 +02:00
Andrey Rahmatullin 4894437826
Merge pull request #4081 from bulatbulat48/documentation-botname 
Fixed BOT_NAME documentation
 2019-10-16 17:03:38 +05:00
Bulat 84be6a941e Refactor sentence. 2019-10-16 14:04:07 +03:00
Bulat c9614a5bdd Fixed BOT_NAME documentation 2019-10-16 12:07:19 +03:00
Adrián Chaves d72ed46fe0 Improve how extra Item API members are introduced in the documentation 2019-10-15 16:04:26 +02:00
Baron Hou 7b1e69dec4 reponse → response (#4079) 2019-10-15 14:51:15 +02:00
Matsievskiy S.V f0db1b4b66 update zsh completion 2019-10-11 00:55:18 +03:00
Mikhail Korobov fa56460d6a
Merge pull request #4061 from jbampton/fix-case-of-github 
Fix case of GitHub.
 2019-10-07 22:27:42 +02:00
John Bampton 39c9a3cc1c Fix case of GitHub. 2019-10-05 10:09:14 +10:00
Adrián Chaves a4aa5b8926 Fix internal links in the tutorial and release notes 2019-10-02 14:51:06 +02:00
elacuesta 6ad5a89cb0 [Doc] Use autoclass in topics/request-response.rst (#4055) 2019-10-02 12:18:36 +02:00