RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
4,214 Commits 49 Branches 132 Tags 136 MiB
Commit Graph

4214 Commits

Author SHA1 Message Date
Daniel Graña 4fcd220f53 Add 0.24.3 release notes 2014-08-09 00:30:52 -03:00
Daniel Graña e0ed22a7e7 Bump version: 0.24.2 → 0.24.3 2014-08-09 00:29:05 -03:00
Daniel Graña 8e080c1e07 no need to waste travis-ci time on py3 for 0.24 2014-08-08 19:10:19 -03:00
Daniel Graña 1d0c096a3f Update installation docs 2014-08-08 19:08:58 -03:00
Daniel Graña 4c701d72dd There is a trove classifier for Scrapy framework! 
Added by https://bitbucket.org/pypa/pypi/issue/179
 2014-08-08 19:08:51 -03:00
Daniel Graña d109c138a6 update other places where w3lib version is mentioned 
Conflicts:
	tox.ini
 2014-08-08 19:08:27 -03:00
Paul Tremberth 39d2ce5e14 Update w3lib requirement to 1.8.0 2014-08-08 19:07:27 -03:00
Paul Tremberth 180d3add0c Use w3lib.html.replace_entities() (remove_entities() is deprecated) 
Conflicts:
	scrapy/utils/misc.py
 2014-08-08 19:06:49 -03:00
Daniel Graña a51ee8b9e1 set zip_safe=False 2014-08-08 19:05:27 -03:00
Daniel Graña ee3b371e56 do not ship tests package 2014-08-08 19:05:22 -03:00
Daniel Graña c3861cf749 scrapy.bat is not needed anymore 2014-08-08 19:03:10 -03:00
Daniel Graña 362e322cbb Modernize setup.py 2014-08-08 19:03:03 -03:00
Daniel Graña 94a5c65764 headers can not handle non-string values 2014-08-08 19:01:27 -03:00
Daniel Graña a274a7f7f7 fix ftp test cases 2014-08-08 19:00:27 -03:00
Daniel Graña ae1e2ccfcf The sum up of travis-ci builds are taking like 50min to complete 2014-08-08 18:59:30 -03:00
Lisimia e49c96ae26 Update shell.rst typo 
There was a typo.
"start" was mistyped as "star"
 2014-08-08 18:58:24 -03:00
Elias Dorneles 1ca489de92 removes weird indentation in the shell results 2014-08-08 18:57:43 -03:00
Elias Dorneles 65c8f05d76 improved explanations, clarified blog post as source, added link for XPath string functions in the spec 2014-08-08 18:57:29 -03:00
nramirezuy 037f6abe8d renamed UserTimeoutError and ServerTimeouterror #583 2014-08-08 18:57:15 -03:00
Elias Dorneles 2d103e08e3 adding some xpath tips to selectors docs 2014-08-08 18:52:10 -03:00
Mikhail Korobov f8d366a209 fix tests to account for https://github.com/scrapy/w3lib/pull/23 2014-08-08 18:51:41 -03:00
nramirezuy 81344ea78b get_func_args maximum recursion fix #728 2014-08-08 18:51:15 -03:00
Rolando Espinoza f7c4ea81aa Updated input/ouput processor example according to #560. 2014-08-08 18:50:20 -03:00
Zbigniew Siciarz db59ed9cea Fixed Python syntax in tutorial. 2014-08-08 18:45:24 -03:00
ivannotes f090260d10 Add test case for tunneling proxy 
Conflicts:
	scrapy/tests/test_proxy_connect.py
 2014-08-08 18:42:03 -03:00
ivannotes d8793afccf Bugfix for leaking Proxy-Authorization header to remote host when using 
tunneling
 2014-08-08 18:42:03 -03:00
Paul Tremberth ed1f376d2b Extract links from XHTML documents with MIME-Type "application/xml" 
"application/xhtml+xml" is already interpreted as HTML
and link extractor is fine with it to extract links.

Only for XML documents can the namespaces in tags be an issue.

Fixes #780

Do both tag and attribute tests in _iter_links() method
 2014-07-11 17:15:16 -03:00
Pablo Hoffman 91a110622b Merge pull request #793 from roysc/patch-1 
Fix typo in commands.rst
 2014-07-10 13:27:10 -03:00
Roy Crihfield 743e1e2034 Fix typo in commands.rst 2014-07-10 11:04:48 -05:00
Daniel Graña e22daaf411 better testcase for settings.overrides.setdefault 2014-07-09 01:42:10 -03:00
ivan 5ec430baa7 Using CRLF as line marker according to http 1.1 definition 2014-07-09 01:42:04 -03:00
Daniel Graña 2cba7b5dee Add 0.24.2 release notes 2014-07-08 05:53:08 -03:00
Daniel Graña 37af19296e Bump version: 0.24.1 → 0.24.2 2014-07-08 05:51:21 -03:00
Daniel Graña e5e81335e7 Use a mutable mapping to proxy deprecated settings.overrides and settings.defaults attribute 2014-07-08 05:45:23 -03:00
Daniel Graña 3cd6146e19 there is not support for python3 yet 2014-07-01 17:12:11 +00:00
Daniel Graña fa5d76b2df Update python compatible version set to debian packages 2014-07-01 13:50:46 -03:00
Mikhail Korobov c6a9e20473 DOC fix formatting in release notes 2014-06-28 13:29:56 +06:00
Daniel Graña 620f712e20 Add 0.24.1 release notes 2014-06-27 12:02:41 -03:00
Daniel Graña 55e6d06c8d Bump version: 0.24.0 → 0.24.1 2014-06-27 12:00:10 -03:00
Daniel Graña 8e3f20a4a9 Fix deprecated CrawlerSettings and increase backwards compatibility with .defaults attribute 2014-06-27 11:58:56 -03:00
Daniel Graña af23770573 set 0.24.0 release date 2014-06-26 11:45:40 -03:00
Daniel Graña f0facb9793 Bump version: 0.23.0 → 0.24.0 2014-06-26 10:30:37 -03:00
Daniel Graña ee33efac39 Add 0.24.0 release notes 2014-06-26 10:29:47 -03:00
Daniel Graña eb97d257f0 Merge pull request #764 from dangra/763-bugfix 
no need to keep links as instance attribute
 2014-06-25 16:29:15 -03:00
Daniel Graña 53057728fb No need to keep extracted links as instance attribute. fixes #763 2014-06-25 16:11:35 -03:00
Daniel Graña ccec728c3a Merge pull request #762 from kmike/688-spider-templates 
add utf8 encoding header to spider templates
 2014-06-25 15:56:33 -03:00
Mikhail Korobov 6fb7093154 add utf8 encoding header to spider templates 2014-06-26 00:30:27 +06:00
Mikhail Korobov df4ba41c82 Merge pull request #688 from stillzhl/master 
add encoding utf-8 to the first line
 2014-06-26 00:26:12 +06:00
Daniel Graña 436c1c8980 address latest comments 2014-06-25 15:12:58 -03:00
Daniel Graña 2ad8db6ae6 Merge pull request #761 from dangra/lxmlextractor 
Promote LxmlLinkExtractor as LxmlExtractor
 2014-06-25 15:07:02 -03:00