RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
10,534 Commits 49 Branches 132 Tags 138 MiB
Commit Graph

10534 Commits

Author SHA1 Message Date
Laerte Pereira 3c2a9fa262 update docs 2024-08-27 07:16:01 -03:00
Laerte Pereira b85e5a66ed Add support for meta in Spider Contracts 2024-08-26 23:21:09 -03:00
Georgiy Zatserklianyi 6ce0342beb
Allow yielding items from start_requests (#6417) 
Co-authored-by: Georgiy Zatserklianyi <george.zatseklyany@gmail.com>
Co-authored-by: Adrián Chaves <adrian@chaves.io>
Co-authored-by: Andrey Rakhmatullin <wrar@wrar.name>
 2024-08-26 20:53:06 +02:00
Andrey Rakhmatullin 5794071f96
Typing fixes and updates. (#6460) 2024-08-23 12:48:01 +02:00
mlmsmith af15bd1dad
minor changes to items section of docs (#6462) 2024-08-19 13:55:09 +02:00
mlmsmith b9ef1326a5
Proofread the commands documentation (#6449) 2024-08-01 09:29:11 +02:00
Adrián Chaves 03a15ced4f
Do not suggest logging dropped items twice (#6448) 
Co-authored-by: Kevin Lloyd Bernal <kevinoxy@gmail.com>
 2024-07-31 11:37:19 +02:00
mlmsmith e376c0b31a
Tutorial edits (#6440) 2024-07-24 06:40:01 +02:00
Andrey Rakhmatullin 06f9c289d1
Merge pull request #6434 from guillermo-bondonno/feature/closespider_pagecount_no_item 
Feature/closespider pagecount no item
 2024-07-12 16:31:05 +05:00
guillermo-bondonno 026d606528
clean closespider_pagecount_no_item docs section 
Co-authored-by: Andrey Rakhmatullin <wrar@wrar.name>
 2024-07-12 08:09:03 -03:00
guillermo-bondonno 9cdbcb4f63 add test_closespider_pagecount_no_item_with_pagecount 2024-07-11 14:02:24 -03:00
guillermo-bondonno 5f0fad16f5 improve test_closespider_pagecount_no_item and corresponding test spider 2024-07-11 13:26:22 -03:00
guillermo-bondonno a40d5281cf improve test_closespider_pagecount_no_item and MaxItemsSpider 2024-07-11 11:14:30 -03:00
Adrián Chaves 7a0a34b136
Merge pull request #6435 from wRAR/update-tools 
Update tool versions
 2024-07-11 10:26:04 +02:00
Andrey Rakhmatullin 3c9c1a31bc Bump pylint. 2024-07-11 12:30:12 +05:00
Andrey Rakhmatullin 435686830c Bump the Python version for RTD. 2024-07-11 12:25:13 +05:00
Andrey Rakhmatullin 129dbfa0bf Bump tool versions. 2024-07-11 12:23:43 +05:00
guillermo-bondonno 8646d2ec7b fix docs detail 2024-07-10 11:44:44 -03:00
guillermo-bondonno 59782d7308 update docs 2024-07-10 11:08:22 -03:00
guillermo-bondonno d6352f9f66 refactor changes on closespider.py and improve test 2024-07-10 11:03:01 -03:00
guillermo-bondonno a44818afea restore mitmproxy-dhparam 2024-07-09 16:07:55 -03:00
guillermo-bondonno 0b8604bb5d add CLOSESPIDER_PAGECOUNT_NO_ITEM to CloseSpider extension 2024-07-09 15:52:49 -03:00
Andrey Rakhmatullin ceedb026f8
Remove top-level imports that install the reactor from scrapy.extensions.telnet. (#6432) 2024-07-09 08:34:58 +02:00
mlmsmith d8ecd28c55
Documentation improvements (#6429) 2024-07-04 12:16:26 +02:00
Andrey Rakhmatullin 558b1d11d2
Use CallbackT for Request.callback. (#6422) 2024-07-01 09:30:49 +02:00
Andrey Rakhmatullin 41e15e93e7
Remove an obsolete import. (#6415) 2024-06-26 14:44:12 +02:00
Andrey Rakhmatullin 96d6519b25
Bump twine in twinecheck. (#6416) 2024-06-26 14:43:59 +02:00
Andrey Rakhmatullin e47110f9a5
Add parameteres to most Deferred instances. (#6414) 2024-06-26 10:01:43 +02:00
Andrey Rakhmatullin d08f559600
Add flake8-type-checking. (#6413) 2024-06-25 10:20:59 +02:00
mlmsmith 326e323e11
Apply grammar fixes (#6411) 2024-06-21 12:24:10 +02:00
Andrey Rakhmatullin 0e78ac609d
Merge pull request #6406 from wRAR/more-flake8 
Add some flake8 plugins
 2024-06-20 14:34:25 +05:00
Andrey Rakhmatullin 13d3b1af47 Split ignores into blocks. 2024-06-20 00:42:43 +05:00
Andrey Rakhmatullin 3d8dbd5648 flake8-bugbear 2024-06-20 00:27:38 +05:00
Andrey Rakhmatullin 1ef9c337ca flake8-docstrings 2024-06-19 23:57:40 +05:00
Andrey Rakhmatullin 1c70d3e605 flake8-comprehensions 2024-06-19 23:36:36 +05:00
Andrey Rakhmatullin a617e04d2e flake8-string-format 2024-06-19 23:28:58 +05:00
Andrey Rakhmatullin d132190625 flake8-debugger 2024-06-19 23:26:25 +05:00
Andrey Rakhmatullin a364560fad
Unpin markupsafe in extra-deps. (#6403) 2024-06-17 11:38:10 +02:00
Andrey Rakhmatullin 365c9e62ad
Removing empty example reference (#6402) 
Co-authored-by: Michael Duane Mooring <mikeumus@gmail.com>
 2024-06-17 11:37:11 +02:00
Andrey Rakhmatullin 1282ddf8f7
Add parameters to most Deferred in scrapy/core. (#6395) 2024-06-10 10:27:50 +02:00
Andrey Rakhmatullin ddc98fe91b
Deprecate scrapy.utils.defer.process_chain_both(). (#6397) 2024-06-10 10:16:26 +02:00
Andrey Rakhmatullin 163e7d925e
Merge pull request #6392 from wRAR/pyupgrade 
Add pyupgrade.
 2024-06-07 11:16:46 +04:00
Andrey Rakhmatullin 5850b8f3e6 Merge branch 'master' into pyupgrade 2024-06-07 11:20:31 +05:00
Andrey Rakhmatullin ed3a7acaf3 Remove the Python version check from scrapy/__init__.py. 2024-06-07 11:19:37 +05:00
Andrey Rakhmatullin a4778d2bdf
Merge pull request #6143 from wRAR/typing-request-response-cls 
Improve type hints for copy() and replace() in Request and Response.
 2024-06-06 22:58:14 +04:00
Andrey Rakhmatullin 1268b23304 Merge branch 'master' into typing-request-response-cls 2024-06-06 21:57:53 +05:00
Andrey Rakhmatullin b24ecca4d0
Merge pull request #6391 from wRAR/typing-generics-iterables 
Add parameters to iterable generics, replace generators with iterables.
 2024-06-06 20:54:16 +04:00
Andrey Rakhmatullin 23b1214e90 Add a comment about pyupgrade and scrapy/__init__.py. 2024-06-06 21:44:07 +05:00
Andrey Rakhmatullin d9d7bd170b
Merge pull request #6394 from Laerte/master 
Document missing parts of response.json method
 2024-06-06 09:55:56 +04:00
Laerte Pereira 144ff6c756 Document missing parts of response.json method 2024-06-05 21:09:10 -03:00