RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
9,196 Commits 50 Branches 132 Tags 142 MiB
Commit Graph

9196 Commits

Author SHA1 Message Date
Adrián Chaves d599fff2b9 Test the life cycle of a storage file 2022-07-29 19:12:20 +02:00
felipeboffnunes 5735e93541 fix_post_processing_feed_export 2022-07-28 18:37:21 -03:00
Mikhail Korobov f60c7ae768
Fixed heading levels in downloader middleware docs (#5567) 2022-07-20 11:01:22 +02:00
Mikhail Korobov d78f505f3d
Merge pull request #5450 from kinoute/master 
fixed detection of extensions like ".tar.gz" in URL
 2022-07-20 01:06:11 +05:00
Mikhail Korobov b103664bf4
Address 2/3 of warnings from tests (#5561) 2022-07-19 17:39:26 +02:00
Andrey Rahmatullin 44580851ff
Merge pull request #5560 from scrapy/non-existing-resolvable 
make Scrapy testing suite more robust in environments where non-existing hosts are resolvable
 2022-07-19 11:28:38 +05:00
Andrey Rahmatullin bb61b03b49
Merge pull request #5563 from scrapy/dataclasses-ftw 
remove compatibility code from tests for the case dataclasses module is not available
 2022-07-19 10:37:20 +05:00
Mikhail Korobov 1054689593 remove unused imports 
thanks flake8!
 2022-07-18 23:53:30 +05:00
Mikhail Korobov e248360e6e remove compatibility code from tests for the case dataclasses module is not available 
It was Python 3.6 compat code, and Python 3.6 support is dropped.
 2022-07-18 23:49:08 +05:00
Andrey Rahmatullin 3ef432156c
Merge pull request #5559 from scrapy/fix-intersphinx 
Fixed intersphinx references
 2022-07-17 22:15:10 +05:00
Mikhail Korobov 26c70318cb make Scrapy testing suite more robust in environments where non-existing hosts are resolvable 2022-07-17 16:47:20 +05:00
Mikhail Korobov 9b33b82a8b Fixed intersphinx references 2022-07-17 15:50:40 +05:00
Andrey Rahmatullin ebc6f9c4eb
Merge pull request #5558 from eltociear/patch-1 
Fix typo in sep-014.rst
 2022-07-17 01:12:16 +05:00
Mikhail Korobov 77a3b02523
Merge pull request #5553 from Rotzbua/fix-doc-typo 
Fix doc: `scrapy.exporter` to `scrapy.exporters`
 2022-07-17 00:21:50 +05:00
Mikhail Korobov 94a0324570
Merge pull request #5554 from Rotzbua/doc-remove-outdated 
[doc] Remove incompatible web service project
 2022-07-17 00:20:32 +05:00
Ikko Ashimine 2f13f23d92
Fix typo in sep-014.rst 
requets -> requests
 2022-07-15 18:16:23 +09:00
Rotzbua 1c7ed4f2e5
[doc] Remove incompatible web service project 
* Abandoned since 2017
* Not compatible with Python3
 2022-07-12 13:09:20 +02:00
Rotzbua 09c3a4ad08
Fix doc: `scrapy.exporter` to `scrapy.exporters` 2022-07-12 12:45:15 +02:00
Mikhail Korobov 49942026d8
Merge pull request #5547 from Laerte/master 
Deprecate the `scrapy.downloadermiddlewares.decompression` module
 2022-07-05 12:44:25 +05:00
Laerte Pereira fe08a119d9
chore: import only used function 2022-06-30 10:46:00 -03:00
Laerte Pereira c4c816624f
chore: Deprecate the `scrapy.downloadermiddlewares.decompression` module 2022-06-30 10:42:01 -03:00
Mikhail Korobov b51b52ff37
Merge pull request #5526 from mtabbasi/headers-multiple-values 
Merge values of multiple headers with same name
 2022-06-27 23:03:01 +05:00
Mikhail Korobov 500dae82e2
Merge pull request #3696 from Gallaecio/allow-customizing-export-column-names 
Allow customizing export column names
 2022-06-27 00:26:05 +05:00
Mikhail Korobov 7120c3df33
Merge pull request #5542 from cyai/cyai-patch-2 
MAINT: Updated f-string format
 2022-06-26 23:46:26 +05:00
Vardhaman 387326fad4
MAINT: Updated f-string format 
Updated the code with the f-string method for better and cleaner understanding.
 2022-06-23 14:40:49 +05:30
Emanuele d8223adfac
Typo: cleanup (verb) → clean up (#5538) 2022-06-20 11:54:05 +02:00
Adrián Chaves ec5cf3e9ce test_feedexport: solve ordered comparison issues 2022-06-17 09:10:18 +02:00
Adrián Chaves bc285f393c Revert "Revert "test_feedexport: remove ordered=False"" 
This reverts commit 516e2d6ec0.
 2022-06-17 09:00:39 +02:00
Adrián Chaves 516e2d6ec0 Revert "test_feedexport: remove ordered=False" 
This reverts commit 24f382fa45.
 2022-06-17 08:55:45 +02:00
Michel Ace 6e878490e8
Support and prefer the .jsonl file extension (#4848) 2022-06-17 08:37:14 +02:00
Adrián Chaves 3729c6d266 Remove unused import and redundant import 2022-06-17 08:33:34 +02:00
Adrián Chaves 24f382fa45 test_feedexport: remove ordered=False 2022-06-17 08:31:45 +02:00
Adrián Chaves 1b9ed22bec Remove Python < 3.7 leftover 2022-06-17 08:27:17 +02:00
Adrián Chaves 3e994bda45 Update for Python 3.7+ 2022-06-16 20:53:14 +02:00
Kromitvs 9e265a2c1f
Mind body to choose response class in cache, FTP and HTTP/1.0 (#4873) 2022-06-16 20:52:19 +02:00
Adrián Chaves e8503217fb Merge remote-tracking branch 'upstream/master' into allow-customizing-export-column-names 2022-06-16 20:19:52 +02:00
Mohammadtaher Abbasi 892c2a4655 delete unnecessary test 2022-06-13 23:46:42 +04:30
Mohammadtaher Abbasi a135d6caf0
Move Mapping import line up 
Co-authored-by: Adrián Chaves <adrian@chaves.io>
 2022-06-13 15:24:30 +04:30
Mikhail Korobov de0e2ccd7b
Merge pull request #5451 from FJMonteroInformatica/master 
make test files follow HTML conventions
 2022-06-12 00:46:45 +05:00
Mohammadtaher Abbasi 6a0bcf97cc Merge values of multiple headers with same name (#5515) 2022-06-11 23:52:21 +04:30
Mohammadtaher Abbasi ddfd192b70 add tests for multiple headers with same name 2022-06-11 23:51:34 +04:30
Mikhail Korobov e2769cfe48
Merge pull request #5524 from Laerte/master 
Remove minimal versions that Scrapy is tested against, cleanup
 2022-06-09 22:07:46 +05:00
Laerte Pereira 197aca2c94
docs: Remove leftover 2022-06-09 10:11:49 -03:00
Laerte Pereira c4c5c9f258
docs: Remove minimal versions paragraphs 2022-06-09 10:00:44 -03:00
Laerte Pereira 6770d1ec62
chore(tests): Remove validations for unsupported modules versions 2022-06-09 09:08:09 -03:00
Laerte Pereira 2e6721fd86
docs: Update minimal versions that Scrapy is tested against 2022-06-09 08:37:01 -03:00
Laerte Pereira 407562b38b
Drop Python 3.6 support (#5514) 
* chore: Drop Python 3.6 support

* Attend PR comments

* Tweak versions

* Update dependencies version

* fix: Ubuntu workflow

* fix windows workflow

* chore: Remove comment

* update `install_requires` dependencies versions

* move lxml to main pinned requirements

* Attend code-review comments

* remove non-pinned 3.7 from windows workflow

* simplify condition

* lint

* remove paragraph

* refactor

* remove leftover
 2022-06-09 00:25:03 -03:00
Adrián Chaves c5627af15b
Centralize request fingerprints (#4524) 
Co-authored-by: Mikhail Korobov <kmike84@gmail.com>
 2022-06-07 18:44:54 +02:00
Mikhail Korobov 517cbc8d71
Merge pull request #5508 from mtabbasi/thumb_path-access-item 
pass on item to thumb_path function as additional argument
 2022-06-05 03:42:45 +05:00
Mikhail Korobov bafe874ecc
Merge pull request #5358 from burakcank/signal_coroutine 
Document coroutines for signals.
 2022-05-28 13:38:05 +05:00