RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
9,621 Commits 49 Branches 132 Tags 129 MiB
Commit Graph

9621 Commits

Author SHA1 Message Date
pankaj1707k 03f32c018f
Update black version and fix minor typos and punctuations 2023-02-03 11:52:20 +05:30
Pankaj Kumar 280cd6ce71
Merge branch 'scrapy:master' into blacken-docs 2023-02-03 11:38:26 +05:30
Mikhail Korobov a08d722ae8
Merge pull request #5802 from Laerte/chore/deprecate-set-output 
Simplify Publish workflow
 2023-02-02 19:59:57 +05:00
Mikhail Korobov 1e01f29ac0
Merge pull request #5823 from Gallaecio/upgrade-ci 
Upgrade CI tools
 2023-02-02 19:37:33 +05:00
Laerte Pereira 4a424adfff
fix: action version 2023-02-02 09:21:53 -03:00
Laerte Pereira 12559ed21e
refactor: Publish workflow 2023-02-02 08:59:35 -03:00
pankaj1707k 7fdbbd3ccb
Fix for python 3.11 (docs) check on pull request 2023-02-02 15:52:22 +05:30
Adrián Chaves 32a01e32f3 Update pylint exceptions, and run pylint by default with tox 2023-02-02 06:52:01 +01:00
Adrián Chaves b07d3f85a3 Upgrade CI tools 2023-02-02 06:37:40 +01:00
Adrián Chaves c34ca4aef5 Bump version: 2.7.1 → 2.8.0 2023-02-02 04:55:31 +01:00
Adrián Chaves 068af85722
Add release notes for Scrapy 2.8 (#5799) 2023-02-02 04:54:02 +01:00
Alex 8c8894f4be
Apply black formatting to templates (#5814) 2023-02-02 04:42:47 +01:00
pankaj1707k cc9eb3fa79
Format python console blocks using blacken-docs 
Prepend '.. code-block:: pycon' to make python console blocks detectable by blacken-docs
 2023-02-01 20:37:39 +05:30
pankaj1707k c1bbb299d7
Add and run pre-commit hook 'blacken-docs' 
Change python code snippets to begin with '.. code-block:: python' to be recognized by the hook for formatting. All snippets under '::' (rst literal blocks) are ignored.
 2023-02-01 16:30:57 +05:30
Mikhail Korobov b337c986ca
Merge pull request #5798 from Gallaecio/no-callback 
Implement a NO_CALLBACK value for Request.callback
 2023-01-31 01:06:49 +05:00
Adrián Chaves 78eaf0671b Remove typing-extensions from tox.ini 2023-01-30 14:33:11 +01:00
Adrián Chaves 4239f7e12b Merge remote-tracking branch 'Gallaecio/no-callback' into no-callback 2023-01-30 12:39:56 +01:00
Adrián Chaves 389fd99e79 get_media_requests: support and encourage callback=NO_CALLBACK 2023-01-30 12:37:34 +01:00
Adrián Chaves e1699479f6
Fix typo: download middleware → downloader middleware 
Co-authored-by: Andrey Rakhmatullin <wrar@wrar.name>
 2023-01-30 11:54:31 +01:00
Andrey Rakhmatullin ccd1385e11
Merge branch 'master' into no-callback 2023-01-30 15:43:05 +05:00
Andrey Rakhmatullin da15d93d39
Merge pull request #5806 from jxlil/master 
Use isort
 2023-01-30 15:40:44 +05:00
Adrián Chaves 17354a61b1 Avoid duplicities in CI; remove pylint from pre-commit 2023-01-30 10:04:27 +01:00
Jalil SA 5dcf8b9015 fix isort version 2023-01-29 00:22:56 -06:00
Jalil SA 4bd48d2613 added pre-commit action 2023-01-27 15:06:54 -06:00
Jalil SA ef794251f6 fix scrapy/__init__.py 2023-01-27 15:00:19 -06:00
Jalil SA e9ee9454f9 fix .isort.cfg 2023-01-27 14:59:08 -06:00
Andrey Rakhmatullin 30c0dc7ac5
Merge pull request #5807 from Cj-Malone/patch-1 
Don't check robots.txt for local files
 2023-01-28 00:03:15 +05:00
Adrián Chaves f03b47db05 Make NO_CALLBACK a callable 2023-01-27 17:35:32 +01:00
Cj Malone 33b85a9e2a
Test local files aren't processed 2023-01-26 19:51:20 +00:00
Cj Malone 3054235dc0
Don't check robotstxt for local files 2023-01-26 16:10:57 +00:00
Jalil SA 7f01e1f0ce added isort to pre-commit-config 2023-01-25 14:43:25 -06:00
Jalil SA a5c1ef8276 sort imports with isort 2023-01-25 14:25:15 -06:00
Jalil SA 6d0f9df8c1 added isort.cfg 2023-01-25 14:22:42 -06:00
Adrián Chaves 1f3e42897a _NoCallback → NoCallbackType 2023-01-25 18:30:29 +01:00
Adrián Chaves 9d07be61b4 Merge remote-tracking branch 'Gallaecio/no-callback' into no-callback 2023-01-25 17:49:36 +01:00
Adrián Chaves c883a13006 Make the _set_xback condition more readable 2023-01-25 17:43:10 +01:00
Adrián Chaves 9272c4af0c Merge remote-tracking branch 'scrapy/master' into no-callback 2023-01-25 17:41:41 +01:00
Adrián Chaves e71eab6932
Use black (#5734) 2023-01-25 12:03:46 +01:00
Emmanuel Rondan 72a853c751 fixing contributing page with suggestions 2023-01-23 14:56:48 -03:00
Laerte Pereira 0cfe81d1d3
`set-output` command is deprecated 2023-01-21 16:57:31 -03:00
Emmanuel Rondan f2c22aaabb Merge remote-tracking branch 'upstream/master' into add-black-formatter 2023-01-20 17:08:07 -03:00
Emmanuel Rondan 8ee4817471 reaplying black, fixing conflicts and ignoring bandit checks on test directory 2023-01-20 10:55:46 -03:00
Andrey Rakhmatullin 9cb757d239
Merge pull request #5800 from Laerte/chore/feed-export-encoding 
Set `FEED_EXPORT_ENCODING='utf-8'` in the default template
 2023-01-20 17:47:43 +05:00
Adrián Chaves 818d69fa00
Fix typo: it → is 
Co-authored-by: Andrey Rakhmatullin <wrar@wrar.name>
 2023-01-20 12:38:07 +01:00
Laerte Pereira b611848029
fix(docs): Change `versionchanged` value 2023-01-20 08:35:17 -03:00
Laerte Pereira 973f0cf567
fix: line break 2023-01-20 08:23:05 -03:00
Laerte Pereira 8270df754d
Set `FEED_EXPORT_ENCODING='utf-8'` in the default template 2023-01-20 07:55:16 -03:00
Adrián Chaves 4242ae405d Restore Python 3.7 support 2023-01-19 20:37:24 +01:00
Adrián Chaves 5c1559f60e Address typing issues 2023-01-19 20:30:22 +01:00
Adrián Chaves a493464942 Update the screenshot pipeline code example 2023-01-19 19:53:53 +01:00