RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
9,291 Commits 49 Branches 132 Tags 158 MiB
Commit Graph

9291 Commits

Author SHA1 Message Date
Paul Tremberth 3dee913d44 Merge pull request #2713 from JulienPalard/master 
[PEDANTIC] FIX trailing whitespaces in LICENSE.
 2017-04-22 01:00:51 +02:00
Julien Palard 30eec55910 [PEDANTIC] FIX trailing whitespaces in LICENSE. 2017-04-22 00:24:18 +02:00
Paul Tremberth 2d7f11ecd5 Merge pull request #2710 from redapple/travis-pypy-portable 
Travis CI: use portable pypy for Linux
 2017-04-18 16:21:56 +02:00
Mikhail Korobov 9731077a54 Merge pull request #2683 from harshasrinivas/docs-SelectorList 
[MRG+1] Remove __nonzero__ from SelectorList docs
 2017-04-12 21:25:00 +05:00
Mikhail Korobov 9e04e77542 Merge pull request #2705 from redapple/docs-selectors-sections 
DOC Rearrange selector sections
 2017-04-12 21:24:25 +05:00
Paul Tremberth f3f7a41861 Travis CI: use portable pypy for Linux 2017-04-12 16:32:21 +02:00
Paul Tremberth 422b38f65c DOC Rearrange selector sections 2017-04-11 16:55:43 +02:00
Paul Tremberth 252819151e Merge pull request #2695 from LMKight/command-list-fix 
[MRG+1] command-list-fix
 2017-04-05 16:21:57 +02:00
LMKight 05ce1296c6 changed code according to request 2017-04-03 19:47:01 +02:00
LMKight 6352c2e9b2 fixed command list 2017-04-02 15:11:13 +02:00
Mikhail Korobov 8753b458fb Merge pull request #2690 from redapple/faq-py3-windows 
FAQ Rewrite note on Python 3 support on Windows
 2017-03-29 15:43:48 +05:00
Paul Tremberth 163618c9b7 FAQ Rewrite note on Python 3 support on Windows 2017-03-29 12:02:44 +02:00
harshasrinivas 2ff6b05723 Remove __nonzero__ from SelectorList docs 2017-03-24 20:43:28 +05:30
Mikhail Korobov 34f4434b17 Merge pull request #2682 from harshasrinivas/compile-docs-open-webbrowser 
[MRG+1] Update Makefile to open webbrowser in MacOS (#2661)
 2017-03-24 19:31:52 +05:00
harshasrinivas 0298bcbe79 Update Makefile to open webbrowser in MacOS (#2661) 2017-03-24 18:13:08 +05:30
harshasrinivas 38e6857c95 Improvise the clarity of test cases 2017-03-23 19:45:04 +05:30
Paul Tremberth 99e3c0d653 Set bodyproducer with empty content for POST 2017-03-23 14:39:56 +01:00
Simon Diviani Gartz 21d794d35a Fixes conversion of transparent PNG with palette images to jpg #2452 2017-03-22 13:29:15 +01:00
Mikhail Korobov b040df5ac0 TST cleanup spider middleware tests 2017-03-21 15:56:18 +05:00
Paul Tremberth 776129a951 Merge pull request #2649 from pawelmhm/logformatter-2647 
[MRG+2] [logformatter] 'flags' format spec backward compatibility
 2017-03-21 10:51:31 +01:00
Qiwei Huang 8ecc307e8f Update spiders.rst 
Added note to allowed_domain attribute with an example explaining what goes in the list
 2017-03-20 19:37:07 -07:00
Qiwei Huang c5f74f7d1a Update spiders.rst 
Added a note to allowed_domains attribute, reminding users not to add urls into the list.
 2017-03-20 18:52:33 -07:00
harshasrinivas 83aa0c5e1a Clarify docs readme 2017-03-20 22:36:09 +05:30
harshasrinivas 4ec07ae764 Create docs/requirements.txt 2017-03-20 22:21:08 +05:30
harshasrinivas a57e49d55b Add sphinx_rtd_theme to docs setup readme 2017-03-20 19:49:31 +05:30
Oto Brglez 11cf6ad425 Comments for AWS_ENDPOINT_URL setting. 2017-03-19 12:48:06 +01:00
Oto Brglez 605691792f Updating media-pipeline docs for S3-like storage. 2017-03-19 12:35:39 +01:00
harshasrinivas 10741aca72 Update docs - improve clarity 2017-03-19 06:17:28 +05:30
harshasrinivas 0d9ebd6e1e Update tests for max_retry_times 2017-03-19 06:15:46 +05:30
harshasrinivas 49c5afc5ff Fix bug involving OR condition 2017-03-19 06:08:35 +05:30
Pawel Miech 4345eaf1b6 [logformatter] backward compat comments 2017-03-17 08:11:20 +01:00
Mikhail Korobov ec55799d5e Merge pull request #2616 from redapple/mediapipeline-redirect-fix-continued 
[MRG] Allow redirections in media files downloads
 2017-03-16 15:31:28 +05:00
Paul Tremberth 1c0da1749d Merge pull request #2646 from woxcab/master 
[MRG+1] Allowed passing objects of Mapping class or its subclass to the CaselessDict initializer
 2017-03-15 13:11:58 +01:00
woxcab a84652e775 Init tests are split by initializer' input 2017-03-15 12:39:48 +03:00
Bernardas 7ba4b0a21b add support for embeded ptpython shell 2017-03-15 08:07:47 +00:00
harshasrinivas 9d97d788c0 Update docs for meta key 2017-03-15 04:13:47 +05:30
harshasrinivas e321ac9931 Update unittests for max_retry_times 2017-03-15 04:12:32 +05:30
harshasrinivas 966bd49c42 Update unittest for meta['max_retry_times'] 2017-03-14 16:23:47 +05:30
harshasrinivas 694c6d3d74 Simplify retry_times assignment statement 2017-03-14 16:14:40 +05:30
Mikhail Korobov 4e4395f16f Merge pull request #2644 from delftswa2017/fsfilestore_fixme_fix 
[MRG+1] Fixed the FIXME in FSFilesStore
 2017-03-14 15:11:28 +05:00
Pawel Miech 0f2a5cdb8e [logformatter] 'flags' format spec backward compatibility 
pass 'flags' kwarg to logger so that it is compatible with old
format of CRAWLEDMSG.
 2017-03-13 15:16:38 +01:00
woxcab fbb411a805 Allowed passing objects of Mapping class or its subclass to the CaselessDict initializer 2017-03-13 14:16:39 +03:00
jorenham 3cd9185aa1 Fixed the FIXME; more specific exception catching 2017-03-12 23:02:07 +01:00
harshasrinivas 0d57b5cd43 Prevent max_retry_times override 2017-03-13 02:10:23 +05:30
Paul Tremberth 871134ee22 Refactor to also test FilesPipeline 2017-03-12 17:30:24 +01:00
harshasrinivas 810658bcc5 Add feature to set RETRY_TIMES per request (#2642) 2017-03-12 05:06:12 +05:30
Paul Tremberth 708f1b009b Add integration tests for MEDIA_ALLOW_REDIRECTS 2017-03-10 21:36:33 +01:00
Paul Tremberth 7dcc86e61a Add file listing resource + redirecting resource to MockServer 2017-03-10 21:35:25 +01:00
Eugenio Lacuesta 4cfbe82044 Downloader middleware: raise _InvalidOutput 
Instead of AssertionError, to make it consistent with spider middleware
 2017-03-10 15:47:50 -03:00
Eugenio Lacuesta 9c256cf693 Undocument _InvalidOutput exception 2017-03-10 15:41:57 -03:00