RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
5,014 Commits 49 Branches 132 Tags 132 MiB
Commit Graph

5014 Commits

Author SHA1 Message Date
Daniel Graña 71bd79e70f Merge pull request #1212 from Digenis/test-fix-render_template_file 
fix utils.template.render_templatefile() bug +test
 2015-08-26 14:46:42 -03:00
Νικόλαος-Διγενής Καραγιάννης 56b3cf07ff fix string manipulation in render_templatefile() 2015-08-26 20:45:41 +03:00
Νικόλαος-Διγενής Καραγιάννης f5c54072ec Test utils.template.render_templatefile() 2015-08-26 20:44:33 +03:00
Daniel Graña 026a1caffb Merge pull request #1456 from scrapy/py3-fixes 
Small Python 3 fixes
 2015-08-26 11:46:00 -03:00
Mikhail Korobov 68a47ade46 PY3 port test_logformatter 2015-08-26 02:34:21 +05:00
Mikhail Korobov 642af00bb7 fix Referer logging 2015-08-26 02:19:33 +05:00
Mikhail Korobov 7da769feb2 enable test_stats and test_utils_log tests in Python 3 2015-08-26 01:58:59 +05:00
Mikhail Korobov 787b5af30e add coverage files to gitignore 2015-08-26 01:58:33 +05:00
Mikhail Korobov cfae62f9cc Merge pull request #1441 from aivarsk/fix-common-practices 
Make common practices sample code match the comments
 2015-08-23 17:36:09 +05:00
Daniel Graña 489c76b83e Merge pull request #1447 from jdemaeyer/fix/redirectmiddleware-respect-meta-attributes 
[MRG +1] Fix RedirectMiddleware not honouring handle_httpstatus meta keys
 2015-08-22 09:46:27 -03:00
Jakob de Maeyer d164398a27 Fix RedirectMiddleware not honouring meta handle_httpstatus keys 2015-08-21 13:22:42 +02:00
Aivars Kalvāns b8b1e8e544 Make common practices sample code match the comments 2015-08-19 16:54:10 +03:00
Daniel Graña 280eab2416 Merge pull request #1352 from nyov/le-bogus-links 
[MRG+1] [LinkExtractors] Ignore bogus links (#907)
 2015-08-16 00:42:55 -03:00
Andrew Scorpil de15fcdf33 [LinkExtractors] Ignore bogus links 
(rebased the code for scrapy 1.0 and made a few code improvements --nyov)
 2015-08-15 00:16:39 +00:00
Mikhail Korobov 9adb5c31c0 Merge pull request #1433 from scrapy/codecov 
Coverage and reports at codecov.io and coveralls.io
 2015-08-14 05:21:10 +05:00
Daniel Graña 27077d2b6c Forward coverage envvars needed to cover subprocess 2015-08-13 21:07:45 -03:00
Daniel Graña 43fc2f23b8 Increase coverage of version command 2015-08-13 19:30:06 -03:00
Daniel Graña 54f9837804 Document how to get coverage report 2015-08-13 19:02:51 -03:00
Daniel Graña cb9577a6d4 Do not be verbose with coverage report by default 2015-08-13 19:02:36 -03:00
Daniel Graña 108c3e63a5 Add coverage report trough codecov.io 2015-08-13 13:56:24 -03:00
Daniel Graña 12bebb6172 Merge pull request #1431 from dangra/moved-to-parsel 
Replace usage of deprecated class by its parsel\'s counterpart
 2015-08-12 14:29:34 -03:00
Daniel Graña 6c2c9a4baf Merge pull request #1430 from dangra/openssl-version 
Add openssl version to version command
 2015-08-12 14:24:43 -03:00
Daniel Graña 7f634598b6 Add openssl version to version command 2015-08-12 14:24:24 -03:00
Daniel Graña 4ce0f53f7e Replace usage of deprecated class by its parsel\'s counterpart 2015-08-12 14:21:55 -03:00
Daniel Graña 68d2311298 Merge pull request #1427 from scrapy/python3-porting-status 
add Python 3 porting status badge to README
 2015-08-12 11:15:33 -03:00
Mikhail Korobov 1ed6a01c4b Add Python 3 porting status badge to the README 2015-08-12 19:13:54 +05:00
Daniel Graña 15c1300d35 Merge pull request #1409 from eliasdorneles/migrate-parsel 
[MRG+1] Migrating selectors to use parsel
 2015-08-11 16:22:58 -03:00
Elias Dorneles a5abd19e84 make Parsel's Selector more private, remove direct dependency of ParselSelectorList 2015-08-11 15:58:29 -03:00
Elias Dorneles 766c255152 upgrade parsel and add shim for deprecated selectorlist methods 2015-08-11 15:20:33 -03:00
Daniel Graña 457b97c13c Merge pull request #1388 from scrapy/dupefilter-persist 
Dupefilter persistence
 2015-08-11 14:16:34 -03:00
Daniel Graña e2f31f3018 explicit close file on file:// scheme handler 2015-08-11 14:09:49 -03:00
Elias Dorneles e50610bd3a set base_url in kwargs to be fully backward compatible 2015-08-11 14:09:34 -03:00
Elias Dorneles 8ef5aa2ffc using bytes for response body in tests 2015-08-11 14:09:34 -03:00
Elias Dorneles 3a03ef7c08 cleanup tests for selectors and translators 2015-08-11 14:09:34 -03:00
Elias Dorneles 12579b9afa warning when ambiguous root arguments and minor cleanups 2015-08-11 14:09:34 -03:00
Elias Dorneles 26ebccd37a upgrade parsel and use its function to instantiate root for finding form 2015-08-11 14:09:34 -03:00
Elias Dorneles 2fe6d128f5 upgrade parsel and using promoted root attribute 2015-08-11 14:09:16 -03:00
Elias Dorneles 67c98b185b avoid harcoded check for selector type 2015-08-11 14:09:00 -03:00
Elias Dorneles 94c3a345b7 remove deprecated module lxmldocument 2015-08-11 14:09:00 -03:00
Elias Dorneles 6287fc3109 remove lxmldocument dependency from http.request.form 2015-08-11 14:09:00 -03:00
Elias Dorneles 35c1dcdbc2 use response.selector in link extractors instead of instantiating new Selector 2015-08-11 14:09:00 -03:00
Elias Dorneles 17d7347a36 update minimal parsel version, add deprecated classes for csstranslator modules, fix test 2015-08-11 14:09:00 -03:00
Elias Dorneles 01d948f0fd remove selector support for LxmlDocument DOM cache and add deprecation warning for _root argument 2015-08-11 14:08:43 -03:00
Elias Dorneles 3a572e2f3b cleanup csstranslator module, keeping only imports 2015-08-11 14:08:43 -03:00
Elias Dorneles c7b29d118d fix support to legacy _root argument 2015-08-11 14:08:43 -03:00
Elias Dorneles ce21884a97 migrating scrapy Selector to use Parsel 2015-08-11 14:08:43 -03:00
Daniel Graña f67a808d9e Add 1.0.3 release notes 2015-08-11 13:49:49 -03:00
Daniel Graña 342c29af5d Merge pull request #1425 from scrapy/service-identity 
add service_identity to scrapy install_requires. Fix GH-1418 and GH-850.
 2015-08-11 13:34:36 -03:00
Mikhail Korobov 75d3d03382 add service_identity to scrapy install_requires 2015-08-11 20:14:22 +05:00
Mikhail Korobov fa123b335b Merge pull request #1421 from dangra/nyov/lazyload-downloadhandlers 
lazy-load downloadhandlers (continuation of #1357)
 2015-08-11 18:59:47 +05:00