RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
5,133 Commits 49 Branches 132 Tags 138 MiB
Commit Graph

5133 Commits

Author SHA1 Message Date
Jakob de Maeyer bb6dee611c Move Settings documentation to docstrings 2015-10-27 12:43:33 +01:00
Jakob de Maeyer 26586ef5a6 Deprecate _BASE settings, unify _BASE backwards-compatibility 2015-10-27 12:43:23 +01:00
Jakob de Maeyer a769a1ef78 Introduce BaseSettings with full dictionary interface 2015-10-27 12:38:52 +01:00
Mikhail Korobov 4a9f76ebd3 Merge pull request #1555 from stummjr/patch-1 
fix typo in the documentation
 2015-10-26 12:30:46 +05:00
Valdir Stumm Jr d577c4702d fixed a typo in the documentation. 2015-10-26 00:00:20 -02:00
Pablo Hoffman 8dc400c66d Merge pull request #1541 from chripede/patch-1 
[MRG+1] Version 1 now exists
 2015-10-14 10:58:54 -03:00
Christian Pedersen cc76fb3dff Version 1 now exists 2015-10-14 14:07:34 +02:00
Pablo Hoffman 451318ef7a Merge pull request #1530 from scrapy/retry-400 
[MRG+1] DOC fix docs after GH-1289.
 2015-10-13 16:09:07 -03:00
Daniel Graña 411174cf38 Merge pull request #1535 from scrapy/py3-commands 
PY3 port bench, startproject, genspider, list and runspider commands
 2015-10-12 20:43:21 -03:00
Daniel Graña 65f4ba349c Merge pull request #1537 from scrapy/no-coveralls 
drop coveralls support
 2015-10-12 20:36:12 -03:00
Mikhail Korobov 09fc9b48b6 drop coveralls support 2015-10-12 18:12:56 +05:00
Mikhail Korobov 215905bdb6 PY3 port bench, startproject, genspider, list and runspider commands 2015-10-12 17:59:49 +05:00
Julia Medina 0117c811c9 Merge pull request #1533 from Digenis/xml_iter-nodename_with_dot 
[MRG+1] xmliter nodename with dot
 2015-10-12 09:33:27 -03:00
Mikhail Korobov 1b6d60c251 DOC fix docs after GH-1289. 2015-10-09 01:26:09 +05:00
Mikhail Korobov 9676cf8e53 Merge pull request #1527 from scrapy/no-pillow-300 
TST don't use broken Pillow version in tests
 2015-10-09 01:20:45 +05:00
Νικόλαος-Διγενής Καραγιάννης f56062d045 escape nodename in xmliter regex 2015-10-07 14:58:47 +03:00
Νικόλαος-Διγενής Καραγιάννης d66efb13ba test xml nodename with dots 2015-10-07 14:43:47 +03:00
Mikhail Korobov 4e9a43c228 Merge pull request #1532 from hoatle/docs-fixes 
Docs fixes
 2015-10-07 15:34:21 +05:00
hoatle 2869cf8dde fix another invalid xpath error 2015-10-07 16:03:43 +07:00
Hoat Le 4e66955411 fix ValueError: Invalid XPath: //div/[id="not-exists"]/text() on selectors.rst 
>>> response.xpath('//div/[id="not-exists"]/text()').extract_first() is None
Traceback (most recent call last):
  File "<console>", line 1, in <module>
  File "/home/vagrant/.virtualenvs/scrapy/lib/python2.7/site-packages/scrapy/http/response/text.py", line 109, in xpath
    return self.selector.xpath(query)
  File "/home/vagrant/.virtualenvs/scrapy/lib/python2.7/site-packages/scrapy/selector/unified.py", line 100, in xpath
    raise ValueError(msg if six.PY3 else msg.encode("unicode_escape"))
ValueError: Invalid XPath: //div/[id="not-exists"]/text()
 2015-10-07 15:43:02 +07:00
Mikhail Korobov 669be0a2b0 TST don't use broken Pillow version in tests 2015-10-06 17:24:52 +05:00
Mikhail Korobov 91cbf97415 Merge pull request #1522 from smirecki/fix-typos-in-docs-topics 
DOC Typos corrections
 2015-10-03 13:23:38 +05:00
smirecki 8379bea7ed Typos corrections 
I've made a few small corrections, some spelling changes and typo fixes.
I've tried to respect regional spelling differences and avoided proposing hyphenating compound words.

 Please enter the commit message for your changes. Lines starting
 2015-10-02 23:48:27 -04:00
Daniel Graña fe15f93e53 Merge pull request #1498 from Preetwinder/scrapy-add_scheme 
[MRG+1] #1487 add_scheme_if_missing for `scrapy shell` command
 2015-09-30 21:38:58 -03:00
Marius Gedminas 0620e76433 Fix list formatting 2015-09-29 03:33:30 +05:00
Marius Gedminas eaad10facf Typo 2015-09-28 14:44:15 +05:00
Pablo Hoffman 75cd056223 disable log on version command. closes #1426 2015-09-25 16:39:21 -03:00
preetwinder 47c8e2ba78 Restructure tests for add_http_if_no_scheme function 2015-09-24 17:57:25 +00:00
preetwinder 9d96e767a1 Minor changes to add_http_if_no_scheme 2015-09-24 17:31:30 +00:00
preetwinder 8c629eee3e adds docstring, tests and correction 2015-09-24 17:28:44 +00:00
preetwinder c517951a48 add_scheme_if_missing for scrapy shell command 2015-09-24 17:28:44 +00:00
Daniel Graña 69398fa148 Merge pull request #1505 from scrapy/fix-test-suite 
TST pin pytest to 2.7.3
 2015-09-21 18:19:59 -03:00
Mikhail Korobov 916141a08f TST pin pytest to 2.7.3 2015-09-21 21:12:52 +05:00
Mikhail Korobov 181f8d27d7 Merge pull request #1501 from scrapy/disable-log-on-startproject 
disable log on startproject command
 2015-09-20 02:47:41 +05:00
Daniel Graña 51b1249033 Revert "test suite requires recent queuelib to pass because it depends on queuelib test suite" 
This reverts commit a3390afc66.
 2015-09-18 02:27:07 -03:00
Daniel Graña a3390afc66 test suite requires recent queuelib to pass because it depends on queuelib test suite 2015-09-17 19:42:29 -03:00
Daniel Graña a57efdb008 Add PyPI download stats badge 2015-09-17 14:07:57 -03:00
Pablo Hoffman 22327ef47b disable log on startproject command 2015-09-17 01:05:52 -03:00
Daniel Graña 3c596dcf46 Merge pull request #1467 from dacjames/master 
add support for a nested loaders
 2015-09-16 22:03:19 -03:00
Mikhail Korobov 09f388c328 Merge pull request #1497 from haiiiiiyun/fix_typo_middlware 
fix typo middlware
 2015-09-16 15:39:24 +05:00
hy 14f7f22555 fix typos in downloader-middleware.rst and exceptions.rst, middlware -> middleware 2015-09-16 16:59:23 +08:00
Daniel Collins 036109e7de updte nested loader documentation 2015-09-15 23:49:35 -07:00
Daniel Graña 5279da9916 Merge pull request #1496 from scrapy/default-template 
[MRG+1] style fixes for settings.py created by `scrapy startproject`
 2015-09-14 17:14:15 -03:00
Mikhail Korobov 3e13740a57 Merge pull request #1481 from mlyundin/develop 
cleanup
 2015-09-15 00:36:50 +05:00
Daniel Graña 4d1c5c3d32 Merge pull request #1488 from scrapy/py3-redirect-downloader-mware 
[MRG+1] PY3 redirect downloader mware
 2015-09-14 02:20:13 -03:00
Mikhail Korobov 5a13022713 style fixes for settings.py created by scrapy startproject 2015-09-13 21:46:20 +05:00
Elias Dorneles 430e90f4b2 minor refactor on metarefresh redirect mware test 2015-09-13 12:29:41 -03:00
Elias Dorneles b06d0706e6 refactoring redirect logic 2015-09-13 11:49:59 -03:00
Elias Dorneles 81950f773d made encoding conversion more explicit, added test for header with utf-8 encoding replicating what browsers do 2015-09-11 18:51:48 -03:00
Elias Dorneles 179c4588ca adding test for latin1 location 2015-09-10 19:36:47 -03:00