RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
6,396 Commits 49 Branches 132 Tags 145 MiB
Commit Graph

6396 Commits

Author SHA1 Message Date
yandongxu 4966dd7a7f Fix doc: open file with "wb" mode will get an error in python 3 2017-05-08 18:50:30 +08:00
Liu Siyuan 6c1cacb5d5 [MRG+1] doc: fix documentation error in link-extractor.rst (#2676) 
* fix doc error in link-extractor.rst

* remove the import clause

* update based on suggestion
 2017-05-06 02:47:06 +05:00
Daniel Graña 362d6f2d20 Merge pull request #2622 from rolando-contrib/download-maxsize-abort 
[MRG+1] Abort connection earlier and avoid to buffer data when max size limit is reached
 2017-05-04 11:44:51 -03:00
Mikhail Korobov 7fc11c1348 Merge pull request #2720 from redapple/update-test-server-cert 
Change "localhost" test server certificate
 2017-04-28 02:58:46 +05:00
Paul Tremberth 6d14e392f1 Remove old test certificate+key 2017-04-27 23:35:01 +02:00
Paul Tremberth e6ab8bc9a5 Change "localhost" test server certificate 2017-04-27 23:22:25 +02:00
Rolando Espinoza 2b34c6edff Abort connection earlier and avoid to buffer data 
A symptom of this issue was having the log message "Received (X) bytes
larger than download max size (Y)" several times printed, with increased
X values.
 2017-04-27 13:28:16 -03:00
Daniel Graña 2d66c58e01 Merge pull request #2678 from redapple/double-content-length-0-post 
Set bodyproducer with empty content for POST
 2017-04-26 16:10:21 -03:00
Martín Gaitán 4bc0c6b0f4 Update practices.rst 
fix a typo
 2017-04-26 14:12:57 +05:00
Paul Tremberth c3d0f9b6c1 Add test for non-duplicated `Content-Length: 0` for bodyless POST 2017-04-25 17:03:41 +02:00
Paul Tremberth a63d9f502f Restore comments on why POST needs `Content-Length: 0` 2017-04-25 17:03:29 +02:00
Paul Tremberth b1a0a6e258 Make mockserver runnable outside of tox 
Add POST support for Echo resource
 2017-04-25 17:01:54 +02:00
Paul Tremberth 97fc68fa16 Refactor conditions on body producer 2017-04-24 22:08:39 +02:00
Paul Tremberth aa59cf4241 Merge pull request #2668 from harshasrinivas/docs-sphinx-rtd-theme 
[MRG+1] Add sphinx_rtd_theme to docs setup readme
 2017-04-24 12:35:40 +02:00
Paul Tremberth 1e12187e44 Merge pull request #2714 from tbcardoso/docs_disable_dupefilter 
[MRG+1] Mention how to disable request filtering in documentation of DUPEFILTER_CLASS setting
 2017-04-24 12:28:50 +02:00
Tiago Cardoso 00ee9eaeaf Mention how to disable request filtering in documentation of DUPEFILTER_CLASS setting 2017-04-22 14:36:44 +01:00
Paul Tremberth 3dee913d44 Merge pull request #2713 from JulienPalard/master 
[PEDANTIC] FIX trailing whitespaces in LICENSE.
 2017-04-22 01:00:51 +02:00
Julien Palard 30eec55910 [PEDANTIC] FIX trailing whitespaces in LICENSE. 2017-04-22 00:24:18 +02:00
Paul Tremberth 2d7f11ecd5 Merge pull request #2710 from redapple/travis-pypy-portable 
Travis CI: use portable pypy for Linux
 2017-04-18 16:21:56 +02:00
Mikhail Korobov 9731077a54 Merge pull request #2683 from harshasrinivas/docs-SelectorList 
[MRG+1] Remove __nonzero__ from SelectorList docs
 2017-04-12 21:25:00 +05:00
Mikhail Korobov 9e04e77542 Merge pull request #2705 from redapple/docs-selectors-sections 
DOC Rearrange selector sections
 2017-04-12 21:24:25 +05:00
Paul Tremberth f3f7a41861 Travis CI: use portable pypy for Linux 2017-04-12 16:32:21 +02:00
Paul Tremberth 422b38f65c DOC Rearrange selector sections 2017-04-11 16:55:43 +02:00
Paul Tremberth 252819151e Merge pull request #2695 from LMKight/command-list-fix 
[MRG+1] command-list-fix
 2017-04-05 16:21:57 +02:00
LMKight 05ce1296c6 changed code according to request 2017-04-03 19:47:01 +02:00
LMKight 6352c2e9b2 fixed command list 2017-04-02 15:11:13 +02:00
Mikhail Korobov 8753b458fb Merge pull request #2690 from redapple/faq-py3-windows 
FAQ Rewrite note on Python 3 support on Windows
 2017-03-29 15:43:48 +05:00
Paul Tremberth 163618c9b7 FAQ Rewrite note on Python 3 support on Windows 2017-03-29 12:02:44 +02:00
harshasrinivas 2ff6b05723 Remove __nonzero__ from SelectorList docs 2017-03-24 20:43:28 +05:30
Mikhail Korobov 34f4434b17 Merge pull request #2682 from harshasrinivas/compile-docs-open-webbrowser 
[MRG+1] Update Makefile to open webbrowser in MacOS (#2661)
 2017-03-24 19:31:52 +05:00
harshasrinivas 0298bcbe79 Update Makefile to open webbrowser in MacOS (#2661) 2017-03-24 18:13:08 +05:30
harshasrinivas 38e6857c95 Improvise the clarity of test cases 2017-03-23 19:45:04 +05:30
Paul Tremberth 99e3c0d653 Set bodyproducer with empty content for POST 2017-03-23 14:39:56 +01:00
Simon Diviani Gartz 21d794d35a Fixes conversion of transparent PNG with palette images to jpg #2452 2017-03-22 13:29:15 +01:00
Paul Tremberth 776129a951 Merge pull request #2649 from pawelmhm/logformatter-2647 
[MRG+2] [logformatter] 'flags' format spec backward compatibility
 2017-03-21 10:51:31 +01:00
Qiwei Huang 8ecc307e8f Update spiders.rst 
Added note to allowed_domain attribute with an example explaining what goes in the list
 2017-03-20 19:37:07 -07:00
Qiwei Huang c5f74f7d1a Update spiders.rst 
Added a note to allowed_domains attribute, reminding users not to add urls into the list.
 2017-03-20 18:52:33 -07:00
harshasrinivas 83aa0c5e1a Clarify docs readme 2017-03-20 22:36:09 +05:30
harshasrinivas 4ec07ae764 Create docs/requirements.txt 2017-03-20 22:21:08 +05:30
harshasrinivas a57e49d55b Add sphinx_rtd_theme to docs setup readme 2017-03-20 19:49:31 +05:30
harshasrinivas 10741aca72 Update docs - improve clarity 2017-03-19 06:17:28 +05:30
harshasrinivas 0d9ebd6e1e Update tests for max_retry_times 2017-03-19 06:15:46 +05:30
harshasrinivas 49c5afc5ff Fix bug involving OR condition 2017-03-19 06:08:35 +05:30
Pawel Miech 4345eaf1b6 [logformatter] backward compat comments 2017-03-17 08:11:20 +01:00
Mikhail Korobov ec55799d5e Merge pull request #2616 from redapple/mediapipeline-redirect-fix-continued 
[MRG] Allow redirections in media files downloads
 2017-03-16 15:31:28 +05:00
Paul Tremberth 1c0da1749d Merge pull request #2646 from woxcab/master 
[MRG+1] Allowed passing objects of Mapping class or its subclass to the CaselessDict initializer
 2017-03-15 13:11:58 +01:00
woxcab a84652e775 Init tests are split by initializer' input 2017-03-15 12:39:48 +03:00
harshasrinivas 9d97d788c0 Update docs for meta key 2017-03-15 04:13:47 +05:30
harshasrinivas e321ac9931 Update unittests for max_retry_times 2017-03-15 04:12:32 +05:30
harshasrinivas 966bd49c42 Update unittest for meta['max_retry_times'] 2017-03-14 16:23:47 +05:30