RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
10,620 Commits 49 Branches 132 Tags 130 MiB
Commit Graph

10620 Commits

Author SHA1 Message Date
Julian Ste c8e87ab21a
Fixed typos (#6497) 2024-10-17 17:03:16 +02:00
Andrey Rakhmatullin f65e64a724
Misc typing improvements. (#6494) 2024-10-16 18:38:43 +02:00
Andrey Rakhmatullin 9bd5e5bcdb Revert uvloop restrictions. 2024-10-16 14:50:57 +05:00
Andrey Rakhmatullin 845b1ffd44 Merge remote-tracking branch 'origin/master' into py313 2024-10-16 14:50:12 +05:00
Vsevolod Breus 5391663072
Drop Python 3.8 Support (#6472) 2024-10-16 10:03:16 +02:00
Andrey Rakhmatullin 9736e49b52
Merge pull request #6489 from rettinghaus/pypa_action 
update gh-action-pypi-publish
 2024-10-11 00:24:31 +05:00
Klaus Rettinghaus 5ef5474172
update gh-action-pypi-publish 2024-10-09 20:38:50 +02:00
Andrey Rakhmatullin 7ec6b7e65b
Merge pull request #6487 from wRAR/drop-setuptools-dep 
Remove the installation dependency on setuptools.
 2024-10-08 16:34:11 +05:00
Andrey Rakhmatullin 87651fdf47 Don't use types-setuptools. 2024-10-08 16:04:26 +05:00
Andrey Rakhmatullin 29bb869284 Remove the beta block. 2024-10-08 15:43:17 +05:00
Andrey Rakhmatullin df6c51af0f Use the 3.13 release. 2024-10-08 15:37:49 +05:00
Andrey Rakhmatullin 8c133fcf7e Remove the installation dependency on setuptools. 2024-10-07 23:04:48 +05:00
mmoriniere 46cddc6ecf
Ignore SyntaxError as well when SPIDER_LOADER_WARN_ONLY is set to True (#6484) 2024-10-02 10:04:03 +02:00
Andrey Rakhmatullin e139d22db9 Fix expectations for get_func_args() on 3.13. 2024-09-20 19:28:28 +05:00
Andrey Rakhmatullin ee9ee2d12d Revert bpython restrictions. 2024-09-12 14:32:32 +05:00
Andrey Rakhmatullin b3f562d6a5 Revert "Revert uvloop restrictions." 
This reverts commit c21c4a1850.
 2024-09-12 14:31:50 +05:00
Andrey Rakhmatullin ae967d1c06
Merge pull request #6475 from LucasSD/remove-debug-log-message 
Remove log pollution from core.engine signal handler (#6433)
 2024-09-10 12:01:37 +05:00
LucasSD f260f819e0 Remove debug log message from _schedule_request method 2024-09-09 20:26:02 +01:00
Daniel O'Connor 67ab8d4650
Refactor genspider slightly so template variables can be overridden (#6470) 2024-08-28 21:07:49 +02:00
Andrey Rakhmatullin c9d85faaf2
Merge pull request #6469 from Laerte/master 
Add support for meta in Spider Contracts
 2024-08-28 14:53:39 +05:00
Laerte Pereira ddbdfeb699
Update scrapy/contracts/default.py 2024-08-27 07:24:57 -03:00
Laerte Pereira 4f9b2343c0 Merge branch 'master' of github.com:Laerte/scrapy 2024-08-27 07:16:10 -03:00
Laerte Pereira 3c2a9fa262 update docs 2024-08-27 07:16:01 -03:00
Laerte Pereira f68f29dd13
Update docs/topics/contracts.rst 2024-08-26 23:37:57 -03:00
Laerte Pereira b85e5a66ed Add support for meta in Spider Contracts 2024-08-26 23:21:09 -03:00
Georgiy Zatserklianyi 6ce0342beb
Allow yielding items from start_requests (#6417) 
Co-authored-by: Georgiy Zatserklianyi <george.zatseklyany@gmail.com>
Co-authored-by: Adrián Chaves <adrian@chaves.io>
Co-authored-by: Andrey Rakhmatullin <wrar@wrar.name>
 2024-08-26 20:53:06 +02:00
Andrey Rakhmatullin 5794071f96
Typing fixes and updates. (#6460) 2024-08-23 12:48:01 +02:00
Andrey Rakhmatullin c21c4a1850 Revert uvloop restrictions. 2024-08-21 01:06:05 +05:00
mlmsmith af15bd1dad
minor changes to items section of docs (#6462) 2024-08-19 13:55:09 +02:00
Andrey Rakhmatullin 70756fd57c Revert cffi and Pillow restrictions. 2024-08-11 13:57:13 +05:00
Andrey Rakhmatullin 1e68d3c0bf Merge branch 'master' into py313 2024-08-11 13:46:51 +05:00
mlmsmith b9ef1326a5
Proofread the commands documentation (#6449) 2024-08-01 09:29:11 +02:00
Adrián Chaves 03a15ced4f
Do not suggest logging dropped items twice (#6448) 
Co-authored-by: Kevin Lloyd Bernal <kevinoxy@gmail.com>
 2024-07-31 11:37:19 +02:00
mlmsmith e376c0b31a
Tutorial edits (#6440) 2024-07-24 06:40:01 +02:00
Andrey Rakhmatullin 06f9c289d1
Merge pull request #6434 from guillermo-bondonno/feature/closespider_pagecount_no_item 
Feature/closespider pagecount no item
 2024-07-12 16:31:05 +05:00
guillermo-bondonno 026d606528
clean closespider_pagecount_no_item docs section 
Co-authored-by: Andrey Rakhmatullin <wrar@wrar.name>
 2024-07-12 08:09:03 -03:00
guillermo-bondonno 9cdbcb4f63 add test_closespider_pagecount_no_item_with_pagecount 2024-07-11 14:02:24 -03:00
guillermo-bondonno 5f0fad16f5 improve test_closespider_pagecount_no_item and corresponding test spider 2024-07-11 13:26:22 -03:00
guillermo-bondonno a40d5281cf improve test_closespider_pagecount_no_item and MaxItemsSpider 2024-07-11 11:14:30 -03:00
Adrián Chaves 7a0a34b136
Merge pull request #6435 from wRAR/update-tools 
Update tool versions
 2024-07-11 10:26:04 +02:00
Andrey Rakhmatullin 3c9c1a31bc Bump pylint. 2024-07-11 12:30:12 +05:00
Andrey Rakhmatullin 435686830c Bump the Python version for RTD. 2024-07-11 12:25:13 +05:00
Andrey Rakhmatullin 129dbfa0bf Bump tool versions. 2024-07-11 12:23:43 +05:00
guillermo-bondonno 8646d2ec7b fix docs detail 2024-07-10 11:44:44 -03:00
guillermo-bondonno 59782d7308 update docs 2024-07-10 11:08:22 -03:00
guillermo-bondonno d6352f9f66 refactor changes on closespider.py and improve test 2024-07-10 11:03:01 -03:00
guillermo-bondonno a44818afea restore mitmproxy-dhparam 2024-07-09 16:07:55 -03:00
guillermo-bondonno 0b8604bb5d add CLOSESPIDER_PAGECOUNT_NO_ITEM to CloseSpider extension 2024-07-09 15:52:49 -03:00
Andrey Rakhmatullin ceedb026f8
Remove top-level imports that install the reactor from scrapy.extensions.telnet. (#6432) 2024-07-09 08:34:58 +02:00
mlmsmith d8ecd28c55
Documentation improvements (#6429) 2024-07-04 12:16:26 +02:00