RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
11,225 Commits 42 Branches 132 Tags 168 MiB
Commit Graph

11225 Commits

Author SHA1 Message Date
jazzthief cb67bc17b7
Remove `botocore` from docs 2023-03-16 17:25:05 +01:00
jazzthief 4ebc08ef10
Switch from `is_boto3_available()` to `IS_BOTO3_AVAILABLE` var 2023-03-16 17:24:11 +01:00
jazzthief a17d996da2
Change `boto3` version to 1.20.0 for `extra-deps-pinned` env 2023-03-16 17:20:22 +01:00
felipeboffnunes 7bcbfabdbc forgot header bind 2023-03-16 10:28:12 -03:00
felipeboffnunes a81fb5002b adjustments, lean approach 2023-03-16 10:23:06 -03:00
felipeboffnunes 3e59b0805e #5109 extend contributing.rst 2023-03-16 10:02:30 -03:00
namelessGonbai 6ab49e954f
Update docs/topics/feed-exports.rst 
Co-authored-by: Adrián Chaves <adrian@chaves.io>
 2023-03-16 18:03:06 +09:00
kenshi kikuchi 50801c7207 Fix Docs 2023-03-16 17:17:20 +09:00
kenshi kikuchi c8ed793257 Fix test_export_no_items_multiple_feeds 2023-03-16 17:16:14 +09:00
Yegor Statkevich ffef837a1f
Merge pull request #1 from Gallaecio/issue_960_s3_feed_export 
Adapt tests for a switch to boto3 with botocore support for backward compatibility
 2023-03-15 18:51:37 +03:00
Adrián Chaves 7e7b41c6b3 Fix test expectations for boto3 2023-03-15 16:38:13 +01:00
Adrián Chaves 590955fac8 Provide separate test environments for botocore and boto3 extras; add extra-deps-pinned and remote extras from pinned 2023-03-15 16:03:44 +01:00
Adrián Chaves 39dbfa1d82 Minimize test reliance on S3; do not install botocore on the default test environments 2023-03-15 15:31:39 +01:00
Adrián Chaves dfbb63a2f1 Merge remote-tracking branch 'scrapy/master' into issue_960_s3_feed_export 2023-03-15 14:07:54 +01:00
auxsvr d60b4edd11
Prevent an edge case that creates an extra event loop (#5832) 2023-03-14 09:31:13 +01:00
Alex 101a0c32d7
Support genspider with HTTPS (#5808) 2023-03-14 08:13:44 +01:00
Hugo van Kemenade 9411cf4e70
Replace deprecated BadZipfile with BadZipFile (#5849) 2023-03-13 19:03:41 +01:00
Mohammadtaher Abbasi afafc2781a
Fix parse command issues with asyncio (#5824) 2023-03-10 16:20:15 +01:00
Andrey Rakhmatullin 3659a8c8d9
Merge pull request #5328 from GeorgeA92/per_slot_settings 
Per slot settings
 2023-03-09 22:31:24 +05:00
Jalil SA 96d51c3afa docs: update 2023-03-08 04:21:21 -06:00
Jalil SA 1d862d0831 fix: remove line breaks 2023-03-08 03:26:38 -06:00
Jalil SA 05893e1796 docs: Spider.update_settings 2023-03-08 02:59:47 -06:00
kenshi kikuchi d311779887 Fix FeedExporter 
+ Fix FeedExporter not to export empty file
+ Change default value of FEED_STORE_EMPTY
 2023-03-08 16:24:09 +09:00
Jalil SA 8aca47e25d
Add setdefault to BaseSettings (#5821) 2023-03-07 10:26:59 +01:00
Georgiy Zatserklianyi 218829b1db per slot settings: typo fixed 2023-03-06 16:25:49 +02:00
Georgiy Zatserklianyi be52fe4f67 Revert "periodic log stats: typo in docs fixed" 
This reverts commit 68ba25cb69.
 2023-03-06 16:24:28 +02:00
Georgiy Zatserklianyi 68ba25cb69 periodic log stats: typo in docs fixed 2023-03-04 22:15:06 +02:00
Andrey Rakhmatullin 88eec7a417
Merge pull request #5801 from alexpdev/path_object_error_#5739 
Support Path Objects Issue #5739
 2023-03-04 22:01:24 +05:00
Alex 59f5250e59
Merge branch 'scrapy:master' into path_object_error_#5739 2023-03-03 16:47:08 -08:00
Oleg 2b3a8f0d69
Fix a typo in the LOG_FORMAT description (#5839) 2023-03-02 10:19:41 +01:00
Alex 78269f9a4f
Merge branch 'scrapy:master' into path_object_error_#5739 2023-02-25 20:49:04 -08:00
Andrey Rakhmatullin 8fbebfa943
Merge pull request #5805 from scrapy/mypy-imports 
Handle typing issues hidden by follow_imports=skip
 2023-02-24 14:57:59 +05:00
Andrey Rakhmatullin 2970b35cff Merge remote-tracking branch 'origin/master' into mypy-imports 2023-02-24 02:35:09 +04:00
Andrey Rakhmatullin 3dd9d71c32 Correctly wrap connection errors into ResponseFailed. 2023-02-24 01:13:48 +04:00
Andrey Rakhmatullin d20f278882 Add a link to the w3lib typing fix. 2023-02-24 00:28:24 +04:00
Andrey Rakhmatullin d7bf39ee78 Fix a merge problem. 2023-02-24 00:28:06 +04:00
Andrey Rakhmatullin 3a40c06ed9 Bump mypy and types-*. 2023-02-24 00:16:49 +04:00
Andrey Rakhmatullin 733309affa Don't assume formnumber can be None. 2023-02-24 00:05:59 +04:00
jazzthief 45b9dbae40
Fix a typo 2023-02-22 13:28:34 +01:00
Alex 7764184f4b
Merge branch 'scrapy:master' into path_object_error_#5739 2023-02-20 00:15:34 -08:00
Georgiy Zatserklianyi 864eee66c7 per_slot_settings(docs): code style fix 3 (from previous pre-commit check) 2023-02-16 18:19:36 +02:00
Georgiy Zatserklianyi dd5524eb98 per_slot_settings(docs): code style fix 2 (from previous pre-commit check) 2023-02-16 17:59:36 +02:00
Georgiy Zatserklianyi 045092e8d7 per_slot_settings(docs): code style fix (from previous pre-commit check) 2023-02-16 17:55:59 +02:00
jazzthief eb0cca471d
Apply pre-commit changes 2023-02-16 16:53:49 +01:00
Georgiy Zatserklianyi 07e1429877 per_slot_settings(docs): docs `:setting` bindings added 2023-02-16 15:14:01 +02:00
Georgiy Zatserklianyi 98a5958687 per_slot_settings(docs): per slot settings - the highest priority 2023-02-16 14:52:31 +02:00
Yegor f45a7d3f3c
Remove `stacklevel` from warning 2023-02-15 17:07:55 +01:00
Yegor 29c2477f0a
Document the need to install boto3 2023-02-15 16:40:05 +01:00
Yegor 59ba3c4e4c
Use boto3's `upload_fileobj` 2023-02-15 16:29:06 +01:00
Yegor c1a8baa1fa
Add forgotten import 2023-02-15 12:20:01 +01:00