RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
9,655 Commits 49 Branches 132 Tags 162 MiB
Commit Graph

9655 Commits

Author SHA1 Message Date
kenshi kikuchi c8ed793257 Fix test_export_no_items_multiple_feeds 2023-03-16 17:16:14 +09:00
kenshi kikuchi d311779887 Fix FeedExporter 
+ Fix FeedExporter not to export empty file
+ Change default value of FEED_STORE_EMPTY
 2023-03-08 16:24:09 +09:00
Andrey Rakhmatullin 8fbebfa943
Merge pull request #5805 from scrapy/mypy-imports 
Handle typing issues hidden by follow_imports=skip
 2023-02-24 14:57:59 +05:00
Andrey Rakhmatullin 2970b35cff Merge remote-tracking branch 'origin/master' into mypy-imports 2023-02-24 02:35:09 +04:00
Andrey Rakhmatullin 3dd9d71c32 Correctly wrap connection errors into ResponseFailed. 2023-02-24 01:13:48 +04:00
Andrey Rakhmatullin d20f278882 Add a link to the w3lib typing fix. 2023-02-24 00:28:24 +04:00
Andrey Rakhmatullin d7bf39ee78 Fix a merge problem. 2023-02-24 00:28:06 +04:00
Andrey Rakhmatullin 3a40c06ed9 Bump mypy and types-*. 2023-02-24 00:16:49 +04:00
Andrey Rakhmatullin 733309affa Don't assume formnumber can be None. 2023-02-24 00:05:59 +04:00
Andrey Rakhmatullin c8547b0370
Merge pull request #5820 from alexpdev/coveragerc_disable_warnings 
added disable_warnings instruction to .coveragerc
 2023-02-15 03:28:35 +05:00
Alex d366782187
Merge branch 'scrapy:master' into coveragerc_disable_warnings 2023-02-14 05:17:10 -08:00
Mark Brooks 874a879768
artwork/README.rst: add missing articles (#5827) 2023-02-14 09:42:43 +01:00
Andrey Rakhmatullin 76eba9977b
Skip or fix failing code block tests (#5826) 2023-02-14 09:40:38 +01:00
Andrey Rakhmatullin a1717aa48c Fix most of FormRequest typing issues. 2023-02-12 00:42:39 +04:00
Andrey Rakhmatullin b7daa2624d Remove a workaround for old lxml. 2023-02-11 23:46:33 +04:00
Andrey Rakhmatullin fa9897282f Add a cast to deferred_from_coro, that code path has different typing. 2023-02-11 22:12:16 +04:00
Andrey Rakhmatullin 824641e349 Merge remote-tracking branch 'origin/master' into mypy-imports 2023-02-11 22:02:19 +04:00
Andrey Rakhmatullin b1f33a68ac Bump mypy and types-*. 2023-02-11 21:39:27 +04:00
Alex 95c5ebbf38
Merge branch 'scrapy:master' into coveragerc_disable_warnings 2023-02-10 00:58:31 -08:00
Andrey Rakhmatullin b9f52feaa7
Merge pull request #5816 from pankaj1707k/blacken-docs 
Add pre-commit hook for 'blacken-docs'
 2023-02-03 14:33:22 +05:00
pankaj1707k 03f32c018f
Update black version and fix minor typos and punctuations 2023-02-03 11:52:20 +05:30
Pankaj Kumar 280cd6ce71
Merge branch 'scrapy:master' into blacken-docs 2023-02-03 11:38:26 +05:30
Mikhail Korobov a08d722ae8
Merge pull request #5802 from Laerte/chore/deprecate-set-output 
Simplify Publish workflow
 2023-02-02 19:59:57 +05:00
Mikhail Korobov 1e01f29ac0
Merge pull request #5823 from Gallaecio/upgrade-ci 
Upgrade CI tools
 2023-02-02 19:37:33 +05:00
Laerte Pereira 4a424adfff
fix: action version 2023-02-02 09:21:53 -03:00
Laerte Pereira 12559ed21e
refactor: Publish workflow 2023-02-02 08:59:35 -03:00
pankaj1707k 7fdbbd3ccb
Fix for python 3.11 (docs) check on pull request 2023-02-02 15:52:22 +05:30
Adrián Chaves 32a01e32f3 Update pylint exceptions, and run pylint by default with tox 2023-02-02 06:52:01 +01:00
Adrián Chaves b07d3f85a3 Upgrade CI tools 2023-02-02 06:37:40 +01:00
Adrián Chaves c34ca4aef5 Bump version: 2.7.1 → 2.8.0 2023-02-02 04:55:31 +01:00
Adrián Chaves 068af85722
Add release notes for Scrapy 2.8 (#5799) 2023-02-02 04:54:02 +01:00
Alex 8c8894f4be
Apply black formatting to templates (#5814) 2023-02-02 04:42:47 +01:00
pankaj1707k cc9eb3fa79
Format python console blocks using blacken-docs 
Prepend '.. code-block:: pycon' to make python console blocks detectable by blacken-docs
 2023-02-01 20:37:39 +05:30
pankaj1707k c1bbb299d7
Add and run pre-commit hook 'blacken-docs' 
Change python code snippets to begin with '.. code-block:: python' to be recognized by the hook for formatting. All snippets under '::' (rst literal blocks) are ignored.
 2023-02-01 16:30:57 +05:30
Alex 349fc33cc7 added disable_warnings instruction to .coveragerc 2023-01-31 14:28:08 -08:00
Mikhail Korobov b337c986ca
Merge pull request #5798 from Gallaecio/no-callback 
Implement a NO_CALLBACK value for Request.callback
 2023-01-31 01:06:49 +05:00
Adrián Chaves 78eaf0671b Remove typing-extensions from tox.ini 2023-01-30 14:33:11 +01:00
Adrián Chaves 4239f7e12b Merge remote-tracking branch 'Gallaecio/no-callback' into no-callback 2023-01-30 12:39:56 +01:00
Adrián Chaves 389fd99e79 get_media_requests: support and encourage callback=NO_CALLBACK 2023-01-30 12:37:34 +01:00
Adrián Chaves e1699479f6
Fix typo: download middleware → downloader middleware 
Co-authored-by: Andrey Rakhmatullin <wrar@wrar.name>
 2023-01-30 11:54:31 +01:00
Andrey Rakhmatullin ccd1385e11
Merge branch 'master' into no-callback 2023-01-30 15:43:05 +05:00
Andrey Rakhmatullin da15d93d39
Merge pull request #5806 from jxlil/master 
Use isort
 2023-01-30 15:40:44 +05:00
Adrián Chaves 17354a61b1 Avoid duplicities in CI; remove pylint from pre-commit 2023-01-30 10:04:27 +01:00
Jalil SA 5dcf8b9015 fix isort version 2023-01-29 00:22:56 -06:00
Andrey Rakhmatullin 80453d53b1 Type DeferredLists as Deferreds. 2023-01-28 01:29:09 +04:00
Jalil SA 4bd48d2613 added pre-commit action 2023-01-27 15:06:54 -06:00
Jalil SA ef794251f6 fix scrapy/__init__.py 2023-01-27 15:00:19 -06:00
Jalil SA e9ee9454f9 fix .isort.cfg 2023-01-27 14:59:08 -06:00
Andrey Rakhmatullin 5fa0f64db5 Ru typing on 3.8 as types-lxml isn't available for 3.7. 2023-01-27 23:29:23 +04:00
Andrey Rakhmatullin c0efb271a2 Ignore typing for twisted.internet.reactor globally. 2023-01-27 23:19:44 +04:00