RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
4,963 Commits 49 Branches 132 Tags 170 MiB
Commit Graph

4963 Commits

Author SHA1 Message Date
Mikhail Korobov fa123b335b Merge pull request #1421 from dangra/nyov/lazyload-downloadhandlers 
lazy-load downloadhandlers (continuation of #1357)
 2015-08-11 18:59:47 +05:00
Daniel Graña 7717501ab2 Use log formatting and pass crawler reference 2015-08-11 10:38:31 -03:00
Mikhail Korobov fa3d84b050 Merge pull request #1420 from scrapy/py3-trackrefs 
PY3: port scrapy.utils.trackref
 2015-08-11 18:21:34 +05:00
Daniel Graña 8738521d0a Add docstrings 2015-08-10 19:35:57 -03:00
Daniel Graña eb44152a58 lints 2015-08-10 18:25:11 -03:00
Daniel Graña 15ccf79cad Log errors importing or initializing download handlers 2015-08-10 18:18:13 -03:00
Daniel Graña d3804b3439 log errors importing or instanciating handlers 2015-08-10 16:52:44 -03:00
nyov 8c7997083f lazy-loading for DownloadHandlers 2015-08-10 16:52:44 -03:00
Daniel Graña 666ebfa1d9 py3: port dictionary itervalues call 2015-08-10 16:45:27 -03:00
Mikhail Korobov bdcc78b4dd Merge pull request #1419 from scrapy/httprepr-on-file-scheme 
Do not fail representing non-http requests
 2015-08-11 00:37:00 +05:00
Daniel Graña accd28cc71 PY3: port scrapy.utils.trackref 2015-08-10 15:13:29 -03:00
Daniel Graña 8d45b3c481 Do not fail representing non-http requests 2015-08-10 14:10:58 -03:00
Daniel Graña 5c4666a3d4 Workaround for travis#253 2015-08-10 11:17:20 -03:00
Daniel Graña 1b9b211192 Merge pull request #1415 from scrapy/nyov-py3 
nyov's PY3 changes
 2015-08-08 12:23:44 -03:00
Mikhail Korobov 93accb7fb3 PY3 nicer log messages in FilesPipeline 2015-08-08 05:20:48 +05:00
Mikhail Korobov 56be610e6e TST a test for --profile option 2015-08-08 04:54:47 +05:00
nyov 17b5e9fb86 PY3 response bodies as bytes 2015-08-08 04:23:32 +05:00
nyov 45d441d444 PY3 fix test loader 2015-08-08 04:23:16 +05:00
nyov 34eced0ee8 PY3 fix tests pipelines images 2015-08-08 04:23:06 +05:00
nyov 991197003b PY3 fix tests pipelines files 2015-08-08 04:22:58 +05:00
nyov 6e762ce25c PY3 renames (six types) 2015-08-08 04:21:58 +05:00
nyov 3e6d6c43ac PY3 fix test cmdline 2015-08-08 04:19:55 +05:00
nyov 4d41cc0dc4 PY3 split requirements into files 2015-08-08 04:19:37 +05:00
Daniel Graña 57fafc702d Add 1.0.2 release notes 2015-08-06 18:02:12 -03:00
Mikhail Korobov ad99a552a7 Merge pull request #1414 from scrapy/twisted-bug-7989-2 
Twisted 15.3.0 does not raises expected exception serializing lambdas
 2015-08-07 01:22:17 +05:00
Daniel Graña c5ffa1a59f Twisted 15.3.0 does not raises expected exception serializing lambda functions 2015-08-06 16:40:21 -03:00
Mikhail Korobov 2bca27ef2c Merge pull request #1412 from mlyundin/master 
Minor method name fix
 2015-08-06 00:54:42 +05:00
Mikhail Lyundin ea4199f8e1 Minor method name fix 2015-08-05 22:42:53 +03:00
Daniel Graña 311293ffdc Merge pull request #1408 from scrapy/py3-utils-reqser 
PY3 port scrapy.utils.reqser
 2015-08-03 20:09:14 -03:00
Mikhail Korobov 91991e0bdc PY port scrapy.utils.reqser 2015-08-04 02:17:46 +05:00
Mikhail Korobov 95e6bd2f8d Merge pull request #1398 from scrapy/py3-cookies 
PY3 port http cookies handling
 2015-08-04 01:23:37 +05:00
Daniel Graña f4fc05c2a1 Do not propagate cookie log messages in tests so TopLevelFormatter does not rewrite them 2015-08-03 17:18:08 -03:00
Daniel Graña c6adf648dc PY3 port COOKIES_DEBUG and add tests 2015-08-03 16:28:29 -03:00
Daniel Graña dba7e39f61 Do not break cookie parsing on non-utf8 headers 2015-08-03 10:53:40 -03:00
Daniel Graña cbfb24dbeb Merge pull request #1353 from nyov/test-no-proxies 
[MRG+1] Unset environment proxies for tests
 2015-08-03 09:49:50 -03:00
Daniel Graña 5e6c492967 Merge pull request #1364 from jdemaeyer/enhancement/spider-handles-redirects 
[MRG+1] Make RedirectMiddleware respect Spider.handle_httpstatus_list
 2015-08-02 23:00:00 -03:00
Daniel Graña b6afd1cffe Merge pull request #1390 from nyov/nyov/lazyload-s3-boto 
[MRG+1] lazy-load s3 boto
 2015-08-02 22:58:19 -03:00
Daniel Graña 5f02ef82e8 PY3 port http cookies handling 2015-08-02 22:28:45 -03:00
nyov b2fd9bdb63 lazy-load s3 boto 2015-08-01 03:43:03 +00:00
Mikhail Korobov e8d527c9eb Merge pull request #1399 from tagatac/master 
DOC scrapy.Spider grammar and clarity
 2015-08-01 02:07:42 +05:00
David Tagatac 08123207c5 minor: scrapy.Spider grammar and clarity 2015-07-31 17:01:59 -04:00
Daniel Graña 71c6bd920e Merge pull request #1396 from scrapy/py3-utils-response 
PY3 port scrapy.utils.response
 2015-07-31 17:53:53 -03:00
Daniel Graña a7261d2c46 Merge pull request #1397 from scrapy/testsite-is-not-a-test 
remove scrapy.utils.testsite from PY3 ignores
 2015-07-31 17:51:32 -03:00
Daniel Graña 805a491647 Merge branch 'travis-containers' 2015-07-31 16:46:40 -03:00
Daniel Graña 49fd77d693 indent travis yaml 2015-07-31 16:45:43 -03:00
Mikhail Korobov 9316b2317b remove scrapy.utils.testsite from PY3 ignores 2015-08-01 00:43:13 +05:00
Daniel Graña 5d4cdb59a9 cache pip cache 2015-07-31 16:39:12 -03:00
Mikhail Korobov b01292df02 fix request_httprepr docstring 2015-08-01 00:36:16 +05:00
Mikhail Korobov 7f927f68e1 PY3 port scrapy.utils.response 2015-08-01 00:35:43 +05:00
Daniel Graña 5ae94ae42d Use new travis-ci container based builds 2015-07-31 16:33:37 -03:00