RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
7,361 Commits 49 Branches 132 Tags 138 MiB
Commit Graph

7361 Commits

Author SHA1 Message Date
Roy b3df0a8415 [test_downloadermiddleware_httpcache] Adding xfails to impacted tests following hack fix 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-27 18:28:47 +00:00
Roy 11942c436c [test_downloadermiddleware_httpcache] Trying hack to handle systemerror whjen importing leveldb 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-27 18:02:13 +00:00
Roy deacd34c8d [test_downloadermiddleware_httpcache] Attempting to add xfail for leveldb related tests 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-27 17:39:47 +00:00
Roy Healy 4068797558
Update test_downloadermiddleware_httpcache.py 
Adding xfail denoting that leveldb is not supported in 3.8
 2019-10-27 17:02:17 +00:00
Roy Healy 179dc916ff
Update setup.py 
Updating setup.py to remove python 3.8 support for now
 2019-10-27 16:48:20 +00:00
Roy Healy 85ac5c5c57
Update .travis.yml 
Co-Authored-By: Mikhail Korobov <kmike84@gmail.com>
 2019-10-21 19:06:43 +01:00
Roy c12a075164 [.travis.yml] Added python 3.8 fields 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-21 18:34:15 +01:00
Roy 4e939ca75d [setup.py] Added python 3.8 fields 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-21 18:33:18 +01:00
Roy 3d4317bfe4 [tox.ini] Added python 3.8 fields 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-21 18:32:30 +01:00
Mikhail Korobov 8cb53441b0
Merge pull request #4056 from Gallaecio/documentation-build 
Fix internal links in the tutorial and release notes
 2019-10-19 00:00:02 +02:00
Mikhail Korobov 6674f47dbf
Merge pull request #4069 from seregaxvm/master 
update zsh completion
 2019-10-16 22:59:15 +02:00
Andrey Rahmatullin 4894437826
Merge pull request #4081 from bulatbulat48/documentation-botname 
Fixed BOT_NAME documentation
 2019-10-16 17:03:38 +05:00
Bulat 84be6a941e Refactor sentence. 2019-10-16 14:04:07 +03:00
Bulat c9614a5bdd Fixed BOT_NAME documentation 2019-10-16 12:07:19 +03:00
Adrián Chaves d72ed46fe0 Improve how extra Item API members are introduced in the documentation 2019-10-15 16:04:26 +02:00
Baron Hou 7b1e69dec4 reponse → response (#4079) 2019-10-15 14:51:15 +02:00
Matsievskiy S.V f0db1b4b66 update zsh completion 2019-10-11 00:55:18 +03:00
Mikhail Korobov fa56460d6a
Merge pull request #4061 from jbampton/fix-case-of-github 
Fix case of GitHub.
 2019-10-07 22:27:42 +02:00
John Bampton 39c9a3cc1c Fix case of GitHub. 2019-10-05 10:09:14 +10:00
Adrián Chaves a4aa5b8926 Fix internal links in the tutorial and release notes 2019-10-02 14:51:06 +02:00
elacuesta 6ad5a89cb0 [Doc] Use autoclass in topics/request-response.rst (#4055) 2019-10-02 12:18:36 +02:00
Mikhail Korobov 1650812060
Merge pull request #4052 from elacuesta/dummy_stats_collector_fix_elapsed_time 
Fix TypeError when using DummyStatsCollector
 2019-10-02 12:06:22 +05:00
Eugenio Lacuesta e0fabab5cc
Fix TypeError when using DummyStatsCollector 2019-10-01 18:03:22 -03:00
Mikhail Korobov 74b4a5c77c
Merge pull request #4006 from whalebot-helmsman/protego-default 
Use protego as a default robots.txt parser
 2019-10-02 00:03:50 +05:00
Mikhail Korobov 62995e27ef
Merge pull request #4050 from KristobalJunta/fix_topics_spiders_typo 
fix typo in docs/topics/spiders
 2019-10-01 23:34:28 +05:00
Kristobal Junta c232bbdc42 fix typo in docs/topics/spiders 2019-10-01 17:41:38 +03:00
Eugen 7632e375c2 fix typo in ScrapyCommand.help docstring (#4046) 2019-10-01 16:29:48 +02:00
s-sanjay 2c14692e60 remove .keys() to avoid creating a tmp list/keyview obj (#4031) 
Also add --verbose and --nolinks for code coverage
 2019-09-27 09:56:43 +02:00
Mikhail Korobov 31c631f9ee
Merge pull request #3999 from Gallaecio/documentation-coverage 
Provide complete API documentation coverage of scrapy.item
 2019-09-25 16:13:13 +01:00
Adrián Chaves 1236e9e81e Provide complete API documentation coverage of scrapy.item 2019-09-25 13:24:56 +02:00
Adrián Chaves 447b3d9d81
Fix documentation typo: accesible → accessible (#4033) 2019-09-25 11:13:37 +02:00
Mikhail Korobov 1364e92007
Merge pull request #4015 from elacuesta/remove_deprecated_xlib 
Remove deprecated xlib module
 2019-09-20 15:28:07 +01:00
Mikhail Korobov 17c0d72d04
Merge pull request #4016 from elacuesta/rule_default_link_extractor 
Crawling rules: make link extractors optional
 2019-09-20 15:27:17 +01:00
Mikhail Korobov 874b005738
Merge pull request #4028 from Gallaecio/fix-dont-merge-cookies-docs 
Clarify the effects of dont_merge_cookies
 2019-09-20 14:51:37 +01:00
Adrián Chaves c26a9015ad Clarify the effects of dont_merge_cookies 2019-09-19 11:08:06 +02:00
Adrián Chaves 9b65f9aa5b
Fix the item exporter example (#4022) 2019-09-19 09:17:23 +02:00
Vostretsov Nikita 2438ac529a
Update docs/topics/downloader-middleware.rst 
Co-Authored-By: Adrián Chaves <adrian@chaves.io>
 2019-09-17 12:27:22 +05:00
Vostretsov Nikita d1d0bf8491
Update docs/topics/downloader-middleware.rst 
Co-Authored-By: Adrián Chaves <adrian@chaves.io>
 2019-09-17 12:27:12 +05:00
Vostretsov Nikita 57e6f4c750 add link to performance comparison 2019-09-17 07:18:37 +00:00
Vostretsov Nikita d39ef77e6b add link to google description of lenght-based rule 2019-09-17 06:34:33 +00:00
Vostretsov Nikita b792dba528 remove periods 2019-09-17 06:28:33 +00:00
Vostretsov Nikita 50c85e3114 Merge branch 'protego-default' of github.com:whalebot-helmsman/scrapy into protego-default 2019-09-16 14:24:31 +00:00
Vostretsov Nikita 5197b39e01 fix capitalization, remove commas 2019-09-16 14:24:25 +00:00
watsta 0b52fa6ca9 LogFormatter: Add the ability to skip log messages (#3987) 2019-09-16 14:12:04 +02:00
OmarFarrag 13735bcf34 Disallow media extensions unregistered with IANA (#3954) 
Co-Authored-By: s-sanjay <sanjay537@gmail.com>
 2019-09-16 14:04:06 +02:00
Eugenio Lacuesta 21ad8e20b9
Crawling rules: make link extractors optional 2019-09-13 17:32:42 -03:00
Eugenio Lacuesta c5612f387b
Remove deprecated xlib module 2019-09-13 14:32:05 -03:00
Vostretsov Nikita 66145b4eaf
Update docs/topics/downloader-middleware.rst 
Co-Authored-By: Mikhail Korobov <kmike84@gmail.com>
 2019-09-12 18:51:00 +03:00
Vostretsov Nikita 171fa1cd10 documentation rework 2019-09-10 09:59:36 +00:00
Vostretsov Nikita c7f2bdfdbe add protego to install_requires 2019-09-10 08:58:52 +00:00