RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
9,648 Commits 49 Branches 132 Tags 138 MiB
Commit Graph

9648 Commits

Author SHA1 Message Date
Georgiy Zatserklianyi 218829b1db per slot settings: typo fixed 2023-03-06 16:25:49 +02:00
Georgiy Zatserklianyi be52fe4f67 Revert "periodic log stats: typo in docs fixed" 
This reverts commit 68ba25cb69.
 2023-03-06 16:24:28 +02:00
Georgiy Zatserklianyi 68ba25cb69 periodic log stats: typo in docs fixed 2023-03-04 22:15:06 +02:00
Georgiy Zatserklianyi 864eee66c7 per_slot_settings(docs): code style fix 3 (from previous pre-commit check) 2023-02-16 18:19:36 +02:00
Georgiy Zatserklianyi dd5524eb98 per_slot_settings(docs): code style fix 2 (from previous pre-commit check) 2023-02-16 17:59:36 +02:00
Georgiy Zatserklianyi 045092e8d7 per_slot_settings(docs): code style fix (from previous pre-commit check) 2023-02-16 17:55:59 +02:00
Georgiy Zatserklianyi 07e1429877 per_slot_settings(docs): docs `:setting` bindings added 2023-02-16 15:14:01 +02:00
Georgiy Zatserklianyi 98a5958687 per_slot_settings(docs): per slot settings - the highest priority 2023-02-16 14:52:31 +02:00
Georgiy Zatserklianyi 474087be6f per_slot_settings(docs): settings 3 2023-02-09 14:52:28 +02:00
Georgiy Zatserklianyi 5208d436ae per_slot_settings(docs): settings 2 2023-02-09 00:33:21 +02:00
Georgiy Zatserklianyi c3033a54b1 per_slot_settings(docs): settings 1 2023-02-08 23:55:07 +02:00
Georgiy Zatserklianyi 80a86de507 per_slot_settings: test delays increased 2023-02-08 22:40:22 +02:00
Georgiy Zatserklianyi 13d1f69c78 Merge remote-tracking branch 'upstream/master' into per_slot_settings 
# Conflicts:
#	scrapy/core/downloader/__init__.py
 2023-02-08 22:23:13 +02:00
Andrey Rakhmatullin b9f52feaa7
Merge pull request #5816 from pankaj1707k/blacken-docs 
Add pre-commit hook for 'blacken-docs'
 2023-02-03 14:33:22 +05:00
pankaj1707k 03f32c018f
Update black version and fix minor typos and punctuations 2023-02-03 11:52:20 +05:30
Pankaj Kumar 280cd6ce71
Merge branch 'scrapy:master' into blacken-docs 2023-02-03 11:38:26 +05:30
Mikhail Korobov a08d722ae8
Merge pull request #5802 from Laerte/chore/deprecate-set-output 
Simplify Publish workflow
 2023-02-02 19:59:57 +05:00
Mikhail Korobov 1e01f29ac0
Merge pull request #5823 from Gallaecio/upgrade-ci 
Upgrade CI tools
 2023-02-02 19:37:33 +05:00
Laerte Pereira 4a424adfff
fix: action version 2023-02-02 09:21:53 -03:00
Laerte Pereira 12559ed21e
refactor: Publish workflow 2023-02-02 08:59:35 -03:00
pankaj1707k 7fdbbd3ccb
Fix for python 3.11 (docs) check on pull request 2023-02-02 15:52:22 +05:30
Adrián Chaves 32a01e32f3 Update pylint exceptions, and run pylint by default with tox 2023-02-02 06:52:01 +01:00
Adrián Chaves b07d3f85a3 Upgrade CI tools 2023-02-02 06:37:40 +01:00
Adrián Chaves c34ca4aef5 Bump version: 2.7.1 → 2.8.0 2023-02-02 04:55:31 +01:00
Adrián Chaves 068af85722
Add release notes for Scrapy 2.8 (#5799) 2023-02-02 04:54:02 +01:00
Alex 8c8894f4be
Apply black formatting to templates (#5814) 2023-02-02 04:42:47 +01:00
pankaj1707k cc9eb3fa79
Format python console blocks using blacken-docs 
Prepend '.. code-block:: pycon' to make python console blocks detectable by blacken-docs
 2023-02-01 20:37:39 +05:30
pankaj1707k c1bbb299d7
Add and run pre-commit hook 'blacken-docs' 
Change python code snippets to begin with '.. code-block:: python' to be recognized by the hook for formatting. All snippets under '::' (rst literal blocks) are ignored.
 2023-02-01 16:30:57 +05:30
Mikhail Korobov b337c986ca
Merge pull request #5798 from Gallaecio/no-callback 
Implement a NO_CALLBACK value for Request.callback
 2023-01-31 01:06:49 +05:00
Adrián Chaves 78eaf0671b Remove typing-extensions from tox.ini 2023-01-30 14:33:11 +01:00
Adrián Chaves 4239f7e12b Merge remote-tracking branch 'Gallaecio/no-callback' into no-callback 2023-01-30 12:39:56 +01:00
Adrián Chaves 389fd99e79 get_media_requests: support and encourage callback=NO_CALLBACK 2023-01-30 12:37:34 +01:00
Adrián Chaves e1699479f6
Fix typo: download middleware → downloader middleware 
Co-authored-by: Andrey Rakhmatullin <wrar@wrar.name>
 2023-01-30 11:54:31 +01:00
Andrey Rakhmatullin ccd1385e11
Merge branch 'master' into no-callback 2023-01-30 15:43:05 +05:00
Andrey Rakhmatullin da15d93d39
Merge pull request #5806 from jxlil/master 
Use isort
 2023-01-30 15:40:44 +05:00
Adrián Chaves 17354a61b1 Avoid duplicities in CI; remove pylint from pre-commit 2023-01-30 10:04:27 +01:00
Jalil SA 5dcf8b9015 fix isort version 2023-01-29 00:22:56 -06:00
Jalil SA 4bd48d2613 added pre-commit action 2023-01-27 15:06:54 -06:00
Jalil SA ef794251f6 fix scrapy/__init__.py 2023-01-27 15:00:19 -06:00
Jalil SA e9ee9454f9 fix .isort.cfg 2023-01-27 14:59:08 -06:00
Andrey Rakhmatullin 30c0dc7ac5
Merge pull request #5807 from Cj-Malone/patch-1 
Don't check robots.txt for local files
 2023-01-28 00:03:15 +05:00
Adrián Chaves f03b47db05 Make NO_CALLBACK a callable 2023-01-27 17:35:32 +01:00
Cj Malone 33b85a9e2a
Test local files aren't processed 2023-01-26 19:51:20 +00:00
Cj Malone 3054235dc0
Don't check robotstxt for local files 2023-01-26 16:10:57 +00:00
Jalil SA 7f01e1f0ce added isort to pre-commit-config 2023-01-25 14:43:25 -06:00
Jalil SA a5c1ef8276 sort imports with isort 2023-01-25 14:25:15 -06:00
Jalil SA 6d0f9df8c1 added isort.cfg 2023-01-25 14:22:42 -06:00
Adrián Chaves 1f3e42897a _NoCallback → NoCallbackType 2023-01-25 18:30:29 +01:00
Adrián Chaves 9d07be61b4 Merge remote-tracking branch 'Gallaecio/no-callback' into no-callback 2023-01-25 17:49:36 +01:00
Adrián Chaves c883a13006 Make the _set_xback condition more readable 2023-01-25 17:43:10 +01:00