RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
10,206 Commits 49 Branches 132 Tags 138 MiB
Commit Graph

1836 Commits

Author SHA1 Message Date
Adrián Chaves 5ad9433dd5 Merge remote-tracking branch 'scrapy/2.11' into 2.11 2024-05-13 16:27:40 +02:00
nihilisticneuralnet 1d6d2a8751 [Solved] JOBDIR= None for when Scheduler initializes disk queue even if JOBDIR is empty string (#6124) 
Co-authored-by: John Doe <johndoe@email.com>
 2024-05-13 16:23:10 +02:00
Adrián Chaves 82981fb8a2 Do not close the underlying file from compression plugins (#6239) 2024-05-13 16:10:19 +02:00
Adrián Chaves f149ea4b80
Fix the offsite middleware missing some requests (#6358) 2024-05-13 15:32:53 +02:00
aisha-partha 3562618f67 Set METAREFRESH_IGNORE_TAGS to ['noscript'] by default (#6347) 2024-05-13 14:23:15 +02:00
Adrián Chaves 070f13e7c7
Update practices.rst 2024-04-11 12:18:56 +02:00
Adrián Chaves 479619b340 Merge branch '2.11-redos' into 2.11 2024-02-14 17:18:26 +01:00
Adrián Chaves 809bfac489 Merge branch '2.11-compression-bomb' into 2.11 2024-02-14 17:16:25 +01:00
Adrián Chaves 48a9a58ff2 Link to Zyte’s export guides 2023-12-20 21:43:21 +04:00
Adrián Chaves 369712ee50 SPM → Zyte API (#6163) 2023-12-20 21:43:13 +04:00
Adrián Chaves b095dd218f Extend Request.meta documentation (#5565) 2023-12-20 21:43:03 +04:00
Adrián Chaves cd6846b763 Merge remote-tracking branch 'scrapy/2.11' into 2.11-redos 2023-12-15 11:52:35 +01:00
Adrián Chaves eb8b2c5197 Mention open_in_browser in the release notes 2023-11-29 12:13:04 +01:00
Adrián Chaves 1087bb7b2e Update the docs 2023-11-23 09:11:14 +01:00
Andrey Rakhmatullin ffbf943e9d Merge pull request #6077 from 11-aryan/11-aryan 2023-11-16 19:13:02 +04:00
Andrey Rakhmatullin 75e99c75b3 Improve the docs about Crawler attributes and settings initialization. 2023-11-16 12:36:57 +04:00
Andrey Rakhmatullin 2fa768399a Replace the VERSION vars. 2023-09-15 19:19:42 +04:00
Andrey Rakhmatullin 14c27d2215 Merge branch 'master' into relnotes-2.11 2023-09-14 16:38:15 +04:00
Andrey Rakhmatullin 8dd48a08e4 Move PeriodicLog docs from Debugging to General purpose. 2023-09-13 20:46:32 +04:00
Andrey Rakhmatullin ac201d310b Small improvements, 2023-09-13 16:17:52 +04:00
Andrey Rakhmatullin 61ef37a594 Docs improvements. 2023-09-13 15:47:41 +04:00
Andrey Rakhmatullin 61e6bfc023 Docs improvements. 2023-09-13 12:35:15 +04:00
Andrey Rakhmatullin a3f22046ef Document changing settings in Spider.from_crawler(). 2023-09-12 20:41:36 +04:00
Andrey Rakhmatullin d3b5c9be97 Deprecate running Crawler.crawl() twice. 2023-09-06 19:29:44 +04:00
Georgiy Zatserklianyi fe02642980 Merge remote-tracking branch 'origin/periodic_log_2' into periodic_log_2 2023-08-21 17:15:42 +03:00
Georgiy Zatserklianyi 1f03cb1419 Merge remote-tracking branch 'upstream/master' into periodic_log_2 2023-08-21 17:07:18 +03:00
Georgiy Zatserklianyi ac1694a9ad
Update docs/topics/extensions.rst 
Co-authored-by: Adrián Chaves <adrian@chaves.io>
 2023-08-11 18:49:09 +03:00
Georgiy Zatserklianyi d67be20b2d
Update docs/topics/extensions.rst 
Co-authored-by: Adrián Chaves <adrian@chaves.io>
 2023-08-11 18:48:58 +03:00
Georgiy Zatserklianyi 3a4a949f9d
Update docs/topics/extensions.rst 
Co-authored-by: Adrián Chaves <adrian@chaves.io>
 2023-08-11 18:48:48 +03:00
Georgiy Zatserklianyi e6bd9829bd
Update docs/topics/extensions.rst 
Co-authored-by: Adrián Chaves <adrian@chaves.io>
 2023-08-11 18:48:31 +03:00
Georgiy Zatserklianyi 2f094a7a5c
Update docs/topics/extensions.rst 
Co-authored-by: Adrián Chaves <adrian@chaves.io>
 2023-08-11 18:48:14 +03:00
Laerte Pereira 9e74748fca
Remove extra spider parameter in item pipeline docs (#6009) 2023-08-10 13:48:43 +02:00
Georgiy Zatserklianyi 8b6a50a935 periodic_log: docs added 2023-08-04 11:12:07 +03:00
Adrián Chaves 72de48be6d asyncio: cover accidental bad reactor installation, sort sections, reword the Windows section 2023-08-04 09:56:30 +02:00
Andrey Rakhmatullin 7c6aaedda2
Merge pull request #5846 from jxlil/docs/spiders 
Added documentation for Spider.update_settings
 2023-08-02 21:09:44 +04:00
Andrey Rakhmatullin af1be835e4
Apply suggestions from code review 
Co-authored-by: Adrián Chaves <adrian@chaves.io>
 2023-08-02 19:46:16 +04:00
Andrey Rakhmatullin 72462a53e2 Add more docs for update_settings(). 2023-08-02 12:32:53 +04:00
Andrey Rakhmatullin 06ebdee35d
Merge pull request #5950 from wRAR/addons 
Add-ons
 2023-08-01 22:18:57 +04:00
Andrey Rakhmatullin cf55eb05f5 Fix a typo. 2023-08-01 13:30:56 +04:00
Andrey Rakhmatullin 41a4a163e3 Handle NotConfigured in add-ons. 2023-07-31 21:09:18 +04:00
Andrey Rakhmatullin b67a81b81d Use the MyHandler class directly. 2023-07-31 20:25:56 +04:00
Andrey Rakhmatullin d8c5b41559 Add more addon tests. 2023-07-31 19:09:21 +04:00
Andrey Rakhmatullin bddbbc522a
Merge pull request #5979 from BurnzZ/closespider-timeout-no-item 2023-07-28 12:56:44 +04:00
Andrey Rakhmatullin 3ba2dc4d68 Fixes for addon docs. 2023-07-24 17:49:04 +04:00
Kevin Lloyd Bernal 9a1bf40c2f expose AWS_REGION_NAME in S3FeedStorage 2023-07-24 16:37:52 +08:00
Mikhail Korobov af2aa4b421
Merge pull request #5847 from namelessGonbai/feat/FixFeedExport 
Fix FeedExporter not to export empty file
 2023-07-22 23:18:36 +05:00
Andrey Rakhmatullin 005c8cc5f0 Unify the "add-on" spelling. 2023-07-19 13:15:35 +04:00
Andrey Rakhmatullin 0a25a300cf Fix docs. 2023-07-18 20:29:42 +04:00
Andrey Rakhmatullin 90dae3ee60 Doc fixes. 2023-07-18 19:55:46 +04:00
Kevin Lloyd Bernal 3f5bbe3a8f introduce CLOSESPIDER_TIMEOUT_NO_ITEM in CloseSpider 2023-07-18 18:30:21 +08:00