RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
8,556 Commits 49 Branches 132 Tags 138 MiB
Commit Graph

8556 Commits

Author SHA1 Message Date
Eugenio Lacuesta 6b3e1c34f9
Update CI 2020-12-11 16:01:03 -03:00
Eugenio Lacuesta 1aba857f66
Update CI 2020-12-11 15:58:06 -03:00
Eugenio Lacuesta 9530784a40
Update CI 2020-12-11 15:50:40 -03:00
Eugenio Lacuesta e8851d1ea3
Update CI 2020-12-11 15:38:56 -03:00
Eugenio Lacuesta ccd78a710b
Update CI 2020-12-11 15:26:20 -03:00
Eugenio Lacuesta b7337e9143
CI: Pin python version 2020-12-11 15:16:56 -03:00
Eugenio Lacuesta 2f740b2967
Run most CI processes on GH actions 2020-12-11 15:13:57 -03:00
Mikhail Korobov 212163e199
Merge pull request #4912 from elacuesta/remove_deprecated_pickled_settings_to_override 
Remove deprecated SCRAPY_PICKLED_SETTINGS_TO_OVERRIDE
 2020-12-04 01:36:47 +05:00
gunadhya db10aaf9eb
Update links in installation guide (#4899) 2020-12-03 10:56:36 +01:00
Eugenio Lacuesta 6091f3cc03
Remove unused pickle import 2020-12-01 10:26:21 -03:00
Eugenio Lacuesta a80bafe5cd
Remove deprecated SCRAPY_PICKLED_SETTINGS_TO_OVERRIDE 2020-11-30 19:03:13 -03:00
Kader DJEHAF 7fec9f991f
[Cleaned] PEP 8: E251 unexpected spaces around keyword / parameter equals (#4911) 
[Cleaned] PEP 8: E251 unexpected spaces around keyword / parameter equals
 2020-11-30 17:47:28 -03:00
Adrián Chaves 487e19528b
Merge pull request #4901 from elacuesta/remove_deprecated_stuff 
Remove deprecated stuff
 2020-11-30 14:41:40 +01:00
Mikhail Korobov aed1707f24
Merge pull request #4909 from etimoz/exporters-doc-super-fix 
Removed wrong super argument in overriding serialize_fields code example
 2020-11-29 23:09:20 +05:00
etimoz 95d39d5cb4 removed wrong super argument in overriding serialize_fields code example 2020-11-29 13:24:04 +01:00
Andrey Rahmatullin 440e45d172
Merge pull request #4900 from elacuesta/deprecate_utils_py36 
Deprecate scrapy.utils.py36 module
 2020-11-24 23:59:00 +05:00
Eugenio Lacuesta fe8bb6bd90
Fix import 2020-11-23 16:51:04 -03:00
Eugenio Lacuesta 18b05af877
Remove tests/test_utils_http.py 2020-11-23 16:18:58 -03:00
Eugenio Lacuesta 0a93df9efd
Move collect_asyncgen to utils.asyncgen 2020-11-23 16:16:18 -03:00
Eugenio Lacuesta 462014bc57
Scheduler: remove support for deprecated queuelib.PriorityQueue 2020-11-23 15:51:59 -03:00
Eugenio Lacuesta 51ca4d0138
Remove deprecated scrapy.utils.gz.is_gzipped function 2020-11-23 15:47:08 -03:00
Eugenio Lacuesta 4075e1eadd
Remove deprecated modules (utils.http/markup/multipart) 2020-11-23 15:07:56 -03:00
Eugenio Lacuesta 075ab156b0
Deprecate scrapy.utils.py36 module 2020-11-23 11:59:59 -03:00
Adrián Chaves e17c890be1
Merge pull request #4898 from scrapy/2.4 
Scrapy 2.4.1
 2020-11-19 20:31:57 +01:00
Adrián Chaves 63becd1bc8
Update news.rst 2020-11-17 21:58:08 +01:00
Adrián Chaves 26836c4e1a Bump version: 2.4.0 → 2.4.1 2020-11-17 09:17:39 +01:00
Adrián Chaves 15d301e968
Cover Scrapy 2.4.1 in the release notes (#4884) 
Co-authored-by: Mikhail Korobov <kmike84@gmail.com>
 2020-11-17 09:16:08 +01:00
joaquin garmendia 85604e1078
Add failed and success count stats to feedstorage backends (#4850) 2020-11-11 21:16:01 +01:00
Eugenio Lacuesta c20b34269f
Remove unnecessary pytest-azurepipelines package (#4876) 2020-11-10 15:35:09 -03:00
Mikhail Korobov 91a8451c98
Merge pull request #4874 from stummjr/fix-missing-fstring-prefix-genspider 
Fix incorrect output on the genspider command
 2020-11-10 17:23:28 +05:00
Mikhail Korobov 27b07c692c
Merge pull request #4872 from elacuesta/asyncio_get_event_loop 
Call asyncio.get_event_loop when installing the asyncio reactor
 2020-11-10 17:22:20 +05:00
Eugenio Lacuesta b20cfef1e5
Remove unnecessary line from test 2020-11-09 13:58:52 -03:00
Eugenio Lacuesta 7e98a76ac4
Use deferred_from_coro in asyncio test 2020-11-09 12:17:15 -03:00
Valdir Stumm Junior a2c4a7f920 Add missing f-string prefix to genspider output 2020-11-08 20:14:59 -03:00
Eugenio Lacuesta 114229eb4a
Docs: add a note about asyncio.set_event_loop 2020-11-06 13:29:14 -03:00
Eugenio Lacuesta 3095d39740
Test: disable asyncio reactor on Windows for Py>=3.8 2020-11-06 12:16:18 -03:00
Eugenio Lacuesta 5b5478ae9d
Call asyncio.get_event_loop when installing the asyncio reactor 2020-11-05 14:01:34 -03:00
Eugenio Lacuesta c292957cb1
Run Windows tests on GitHub actions (#4869) 2020-11-05 15:15:58 +01:00
Georgiy Zatserklianyi a5872a0fad
Fix output file overwrite with -O (FeedExporter updated) (#4859) 2020-10-30 19:36:39 +01:00
Andrey Rahmatullin 75f35f558f
Merge pull request #4803 from elacuesta/instantiate-resolution-receiver 
CachingHostnameResolver
 2020-10-20 13:55:07 +05:00
Eugenio Lacuesta 585e4a8aee
Replace local server address 2020-10-15 09:07:34 -03:00
Adrián Chaves c340e72988 Bump version: 2.3.0 → 2.4.0 2020-10-11 22:12:45 +02:00
Adrián Chaves 47eac83740 Set a release date for Scrapy 2.4.0 2020-10-11 22:11:14 +02:00
Adrián Chaves 015c82b974
Scrapy 2.4 release notes (#4808) 2020-10-11 22:09:45 +02:00
Eugenio Lacuesta 868826b346
CachingHostnameResolver tests 2020-10-09 10:38:07 -03:00
Eugenio Lacuesta 8fe5876597
HostResolution implementation 2020-10-09 10:38:07 -03:00
Eugenio Lacuesta b55c911ddc
Fix CachingHostnameResolver 2020-10-09 10:38:03 -03:00
Andrey Rahmatullin da426fb3cf
Merge pull request #4839 from elacuesta/pytest_xfail_strict 
Add xfail_strict=true to pytest.ini
 2020-10-09 00:39:05 +05:00
Eugenio Lacuesta 13ae17aecc
Add xfail_strict=true to pytest.ini 2020-10-08 14:04:52 -03:00
Andrey Rahmatullin 9f8c3938cc
Merge pull request #4823 from elacuesta/cookies-revert-header 
Do not process cookies from headers
 2020-10-08 20:20:32 +05:00