RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
9,276 Commits 49 Branches 132 Tags 136 MiB
Commit Graph

9276 Commits

Author SHA1 Message Date
Mikhail Korobov 4dde2f2c36 Merge branch 'master' into asyncio-parse-fixes 2022-07-27 09:32:54 +05:00
Adrián Chaves 5862f6b8e1
Update frozen CI packages (#5574) 2022-07-25 17:25:10 +02:00
Adrián Chaves 737f39613c
Merge pull request #5573 from Gallaecio/2.6-into-master 
Merge 2.6 into the main branch
 2022-07-25 14:52:39 +02:00
Adrián Chaves 00ccb02f1f Merge remote-tracking branch 'upstream/2.6' 2022-07-25 14:13:22 +02:00
Adrián Chaves aecbccbaa5 Bump version: 2.6.1 → 2.6.2 2022-07-25 13:33:23 +02:00
Adrián Chaves af7dd16d8d
Merge pull request from GHSA-9x8m-2xpf-crp3 
* Enforce matching proxy request meta and Proxy-Authorization header

* Cover proxy credential security fix in the release notes

* Remove extra empty line

* Reword the security issue description

* Address scenario where Proxy-Authorization is unexpectedly removed by a prior middleware

* Set the release date of Scrapy 2.6.2 and 1.8.3
 2022-07-25 13:15:17 +02:00
Andrey Rakhmatullin b21c16099e Fix flake8 issues. 2022-07-22 19:18:33 +05:00
Andrey Rahmatullin a0681fb811
Merge branch 'master' into asyncio-parse-asyncgen-proper-rebased 2022-07-22 18:30:38 +05:00
Andrey Rahmatullin dc67100a8f
Merge pull request #1 from Gallaecio/asyncio-parse-asyncgen-proper-rebased 
Refactor the asynchronous process_spider_output documentation
 2022-07-22 18:28:56 +05:00
Mikhail Korobov 4205609051 Fixed intersphinx references 2022-07-21 18:02:56 +02:00
Mikhail Korobov f60c7ae768
Fixed heading levels in downloader middleware docs (#5567) 2022-07-20 11:01:22 +02:00
Mikhail Korobov d78f505f3d
Merge pull request #5450 from kinoute/master 
fixed detection of extensions like ".tar.gz" in URL
 2022-07-20 01:06:11 +05:00
Mikhail Korobov b103664bf4
Address 2/3 of warnings from tests (#5561) 2022-07-19 17:39:26 +02:00
Andrey Rahmatullin 44580851ff
Merge pull request #5560 from scrapy/non-existing-resolvable 
make Scrapy testing suite more robust in environments where non-existing hosts are resolvable
 2022-07-19 11:28:38 +05:00
Andrey Rahmatullin bb61b03b49
Merge pull request #5563 from scrapy/dataclasses-ftw 
remove compatibility code from tests for the case dataclasses module is not available
 2022-07-19 10:37:20 +05:00
Mikhail Korobov 1054689593 remove unused imports 
thanks flake8!
 2022-07-18 23:53:30 +05:00
Mikhail Korobov e248360e6e remove compatibility code from tests for the case dataclasses module is not available 
It was Python 3.6 compat code, and Python 3.6 support is dropped.
 2022-07-18 23:49:08 +05:00
Andrey Rahmatullin 3ef432156c
Merge pull request #5559 from scrapy/fix-intersphinx 
Fixed intersphinx references
 2022-07-17 22:15:10 +05:00
Mikhail Korobov 26c70318cb make Scrapy testing suite more robust in environments where non-existing hosts are resolvable 2022-07-17 16:47:20 +05:00
Mikhail Korobov 9b33b82a8b Fixed intersphinx references 2022-07-17 15:50:40 +05:00
Andrey Rahmatullin ebc6f9c4eb
Merge pull request #5558 from eltociear/patch-1 
Fix typo in sep-014.rst
 2022-07-17 01:12:16 +05:00
Mikhail Korobov 77a3b02523
Merge pull request #5553 from Rotzbua/fix-doc-typo 
Fix doc: `scrapy.exporter` to `scrapy.exporters`
 2022-07-17 00:21:50 +05:00
Mikhail Korobov 94a0324570
Merge pull request #5554 from Rotzbua/doc-remove-outdated 
[doc] Remove incompatible web service project
 2022-07-17 00:20:32 +05:00
Ikko Ashimine 2f13f23d92
Fix typo in sep-014.rst 
requets -> requests
 2022-07-15 18:16:23 +09:00
Rotzbua 1c7ed4f2e5
[doc] Remove incompatible web service project 
* Abandoned since 2017
* Not compatible with Python3
 2022-07-12 13:09:20 +02:00
Rotzbua 09c3a4ad08
Fix doc: `scrapy.exporter` to `scrapy.exporters` 2022-07-12 12:45:15 +02:00
Mikhail Korobov 49942026d8
Merge pull request #5547 from Laerte/master 
Deprecate the `scrapy.downloadermiddlewares.decompression` module
 2022-07-05 12:44:25 +05:00
Laerte Pereira fe08a119d9
chore: import only used function 2022-06-30 10:46:00 -03:00
Laerte Pereira c4c816624f
chore: Deprecate the `scrapy.downloadermiddlewares.decompression` module 2022-06-30 10:42:01 -03:00
Mikhail Korobov b51b52ff37
Merge pull request #5526 from mtabbasi/headers-multiple-values 
Merge values of multiple headers with same name
 2022-06-27 23:03:01 +05:00
Mikhail Korobov 500dae82e2
Merge pull request #3696 from Gallaecio/allow-customizing-export-column-names 
Allow customizing export column names
 2022-06-27 00:26:05 +05:00
Mikhail Korobov 7120c3df33
Merge pull request #5542 from cyai/cyai-patch-2 
MAINT: Updated f-string format
 2022-06-26 23:46:26 +05:00
Vardhaman 387326fad4
MAINT: Updated f-string format 
Updated the code with the f-string method for better and cleaner understanding.
 2022-06-23 14:40:49 +05:30
Emanuele d8223adfac
Typo: cleanup (verb) → clean up (#5538) 2022-06-20 11:54:05 +02:00
Adrián Chaves e3e69d1209
Pin documentation requirements (#5536) 2022-06-20 11:46:13 +02:00
Adrián Chaves 54bfb9649b
Cover #5525 in the 2.6.2 release notes (#5535) 2022-06-17 11:51:02 +02:00
Adrián Chaves 4ef71829b2
If TWISTED_REACTOR is None, reuse any pre-installed reactor (#5528) 2022-06-17 10:37:27 +02:00
Adrián Chaves ec5cf3e9ce test_feedexport: solve ordered comparison issues 2022-06-17 09:10:18 +02:00
Adrián Chaves bc285f393c Revert "Revert "test_feedexport: remove ordered=False"" 
This reverts commit 516e2d6ec0.
 2022-06-17 09:00:39 +02:00
Adrián Chaves 516e2d6ec0 Revert "test_feedexport: remove ordered=False" 
This reverts commit 24f382fa45.
 2022-06-17 08:55:45 +02:00
Michel Ace 6e878490e8
Support and prefer the .jsonl file extension (#4848) 2022-06-17 08:37:14 +02:00
Adrián Chaves 3729c6d266 Remove unused import and redundant import 2022-06-17 08:33:34 +02:00
Adrián Chaves 24f382fa45 test_feedexport: remove ordered=False 2022-06-17 08:31:45 +02:00
Adrián Chaves 1b9ed22bec Remove Python < 3.7 leftover 2022-06-17 08:27:17 +02:00
Adrián Chaves 3e994bda45 Update for Python 3.7+ 2022-06-16 20:53:14 +02:00
Kromitvs 9e265a2c1f
Mind body to choose response class in cache, FTP and HTTP/1.0 (#4873) 2022-06-16 20:52:19 +02:00
Adrián Chaves e8503217fb Merge remote-tracking branch 'upstream/master' into allow-customizing-export-column-names 2022-06-16 20:19:52 +02:00
Mohammadtaher Abbasi 892c2a4655 delete unnecessary test 2022-06-13 23:46:42 +04:30
Mohammadtaher Abbasi a135d6caf0
Move Mapping import line up 
Co-authored-by: Adrián Chaves <adrian@chaves.io>
 2022-06-13 15:24:30 +04:30
Mikhail Korobov de0e2ccd7b
Merge pull request #5451 from FJMonteroInformatica/master 
make test files follow HTML conventions
 2022-06-12 00:46:45 +05:00