RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
7,396 Commits 49 Branches 132 Tags 134 MiB
Commit Graph

7396 Commits

Author SHA1 Message Date
Adrián Chaves 79d2f99995 Make tutorial doctests pass 2019-11-12 08:08:50 +01:00
Andrey Rahmatullin d267e183b4
Merge pull request #4139 from Gallaecio/jobdir-pickle-documentation 
Improve the details about request serialization requirements for JOBDIR
 2019-11-08 22:49:33 +05:00
Andrey Rahmatullin ea41117229
Merge pull request #4142 from Gallaecio/doctest 
Set the bases for testing code examples from the documentation
 2019-11-08 22:44:52 +05:00
Adrián Chaves 1df5755699 Set the bases for testing code examples from the documentation 2019-11-08 16:00:10 +01:00
Adrián Chaves aef98188fa Improve the details about request serialization requirements for JOBDIR 2019-11-07 18:06:55 +01:00
Andrey Rahmatullin d874c4d90b Remove the old Python 2 PyPy installation code from .travis.yml (#4138) 2019-11-07 18:02:17 +01:00
Marc Hernández c377c14e32 Fix W391 Blank line at end of file (#4137) 2019-11-07 17:47:35 +01:00
Marc Hernández e8b1e46e85 Add pytest-flake8 (#3945) 2019-11-07 14:05:01 +01:00
Adrián Chaves 98caf055b5
Fix a typo: specifiy → specify (#4128) 2019-11-06 11:53:46 +01:00
seregaxvm 698aa704b9 Fix zsh completion file extension (#4122) 2019-11-05 16:30:01 +01:00
Adrián Chaves f02c3d1dcf
Use communicate() instead of wait() after killing the mock server (#4095) 2019-10-31 13:31:33 +01:00
Adrián Chaves 15c55d0c1d
Remove LevelDB support (#4112) 2019-10-31 10:47:29 +01:00
Andrey Rahmatullin 229e722a03 Initial Python 2 removal (#4091) 2019-10-31 10:46:02 +01:00
Benjamin Ooghe-Tabanou 6d6da78eda Add a keep_fragments parameter to the request_fingerprint function (#4104) 2019-10-30 09:13:36 +01:00
Amardeep Bhowmick 66cbceeb0a Fix redirection error when the Location header value starts with 3 slashes (#4042) 2019-10-30 09:09:12 +01:00
Adrián Chaves be2e910dd0 Bump version: 1.7.0 → 1.8.0 2019-10-29 12:57:02 +01:00
Adrián Chaves 94f060fcc8
Cover Scrapy 1.8.0 in the release notes (#3952) 2019-10-29 12:53:46 +01:00
Andrey Rahmatullin 18b808b2e9
Merge pull request #4092 from further-reading/master 
Add Python 3.8 official support
 2019-10-29 16:30:58 +05:00
Roy 93e3dc1b82 [test_downloadermiddleware_httpcache.py] Cleaning text 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-28 16:12:03 +00:00
Roy b73d217de5 [test_downloadermiddleware_httpcache.py] Fixing pytest mark behaviour 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-28 12:55:54 +00:00
Roy 74909030a5 [tox.ini] Removing obsolete py37 extra deps enviornment 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-28 12:52:36 +00:00
Roy c51fb959e2 [test_downloadermiddleware_httpcache] Fixing pytest skip behaviour 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-28 12:36:54 +00:00
Roy 4432136fff [test_downloadermiddleware_httpcache] Fixing pytest skip behaviour 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-28 12:22:21 +00:00
Roy 9b47dc6a70 [travis, setup] Adding official python 3.8 support 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-28 11:24:52 +00:00
Roy 16bb3ac20d [test_downloadermiddleware_httpcache] Using skipif approach 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-28 11:24:09 +00:00
Roy Healy 3af2abb75b
Merge pull request #1 from Gallaecio/py38 
Mark the LevelDB storage backend as deprecated
 2019-10-28 10:35:04 +00:00
Adrián Chaves 3d0df419c4 Mark the LevelDB storage backend as deprecated 2019-10-28 11:24:47 +01:00
Roy Healy b5a00262ec
Update .travis.yml 
Reverting change to 3.8 extra dependency environment.
 2019-10-28 09:59:33 +00:00
elacuesta 7731814cc2 ItemLoader: improve handling of initial item (#4036) 2019-10-28 10:53:53 +01:00
Adrián Chaves bb91f9c78c Cover Scrapy 1.7.4 in the release notes 2019-10-28 09:58:13 +01:00
Roy 20ea912513 [test_downloadermiddleware_httpcache] Making xfails more informative 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-27 18:52:01 +00:00
Roy 70b2854590 [test_downloadermiddleware_httpcache] Making xfails more informative 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-27 18:51:26 +00:00
Roy b3df0a8415 [test_downloadermiddleware_httpcache] Adding xfails to impacted tests following hack fix 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-27 18:28:47 +00:00
Roy 11942c436c [test_downloadermiddleware_httpcache] Trying hack to handle systemerror whjen importing leveldb 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-27 18:02:13 +00:00
Roy deacd34c8d [test_downloadermiddleware_httpcache] Attempting to add xfail for leveldb related tests 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-27 17:39:47 +00:00
Roy Healy 4068797558
Update test_downloadermiddleware_httpcache.py 
Adding xfail denoting that leveldb is not supported in 3.8
 2019-10-27 17:02:17 +00:00
Roy Healy 179dc916ff
Update setup.py 
Updating setup.py to remove python 3.8 support for now
 2019-10-27 16:48:20 +00:00
Adrián Chaves 1d5c270ce8
Fix dangling file descriptor in FeedExporter when FEED_STORE_EMPTY is False (#4023) 2019-10-22 15:12:52 +02:00
WinterComes 5d75ed4cba Remove an old note about contracts (#4093) 2019-10-22 12:19:07 +02:00
illgitthat 07822935ec Updating link for miniconda (#4089) 2019-10-22 12:05:34 +02:00
Roy Healy 85ac5c5c57
Update .travis.yml 
Co-Authored-By: Mikhail Korobov <kmike84@gmail.com>
 2019-10-21 19:06:43 +01:00
Roy c12a075164 [.travis.yml] Added python 3.8 fields 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-21 18:34:15 +01:00
Roy 4e939ca75d [setup.py] Added python 3.8 fields 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-21 18:33:18 +01:00
Roy 3d4317bfe4 [tox.ini] Added python 3.8 fields 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-21 18:32:30 +01:00
Mikhail Korobov 8cb53441b0
Merge pull request #4056 from Gallaecio/documentation-build 
Fix internal links in the tutorial and release notes
 2019-10-19 00:00:02 +02:00
Mikhail Korobov 6674f47dbf
Merge pull request #4069 from seregaxvm/master 
update zsh completion
 2019-10-16 22:59:15 +02:00
Andrey Rahmatullin 4894437826
Merge pull request #4081 from bulatbulat48/documentation-botname 
Fixed BOT_NAME documentation
 2019-10-16 17:03:38 +05:00
Bulat 84be6a941e Refactor sentence. 2019-10-16 14:04:07 +03:00
Bulat c9614a5bdd Fixed BOT_NAME documentation 2019-10-16 12:07:19 +03:00
Adrián Chaves d72ed46fe0 Improve how extra Item API members are introduced in the documentation 2019-10-15 16:04:26 +02:00