RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
3,482 Commits 49 Branches 132 Tags 138 MiB
Commit Graph

3482 Commits

Author SHA1 Message Date
Mikhail Korobov 35fbec2e63 allow passing arguments to tox 
e.g. "tox -- scrapy.tests.test_contrib_loader" runs test_contrib_loader for Python 2.6 and 2.7
 2013-07-08 22:51:03 +06:00
Daniel Graña 6db259c075 Merge pull request #338 from kmike/patch-3 
DownloaderMiddleware docs fix
 2013-07-08 07:12:42 -07:00
Mikhail Korobov ac2fadf3ab DownloaderMiddleware.process_response docs fix 
"returns an exception" -> "raises an exception"
 2013-07-08 19:41:58 +06:00
Pablo Hoffman 9a13a0fe74 Merge pull request #337 from kmike/patch-2 
improve docs for DownloaderMiddleware.process_response
 2013-07-08 06:21:49 -07:00
Mikhail Korobov 39e5da5f66 improve docs for DownloaderMiddleware.process_response 2013-07-08 19:17:29 +06:00
Pablo Hoffman 163592ee40 Merge pull request #334 from nramirezuy/feedexport-remove_multispider 
feedexport removed multispider support
 2013-07-03 14:26:49 -07:00
nramirezuy 1fc2bc3489 feedexport removed multispider support 2013-07-03 18:24:18 -03:00
Pablo Hoffman 42da57c448 Merge pull request #333 from nramirezuy/mediapipe-remove_multispider 
pipeline media removed multispider support
 2013-07-03 14:20:41 -07:00
Pablo Hoffman 6533115bbb Merge pull request #332 from nramirezuy/offsite-remove_multispider 
offsite multispider support removed
 2013-07-03 14:20:06 -07:00
nramirezuy 2abb9d08cb pipeline media removed multispider support 2013-07-03 18:08:15 -03:00
nramirezuy 07969a9f3b offsite multispider support removed 2013-07-03 17:55:20 -03:00
Daniel Graña 06b9702984 increase delay in test to avoid small time differences 2013-06-27 17:10:27 -03:00
Pablo Hoffman 0f4b70f582 remove no deprecated request_scheduled signal 
It will be replaced by more accurate scheduler signals (proposal will
come soon)
 2013-06-27 11:23:24 -03:00
Pablo Hoffman a2ddfab43b Merge pull request #328 from nramirezuy/signals-request_scheduled 
removed request_received and added request_scheduled
 2013-06-27 07:21:48 -07:00
nramirezuy bef8ade956 removed request_received and added request_scheduled 2013-06-26 16:45:46 -03:00
Pablo Hoffman 819b2776dd Merge pull request #326 from berendiwema/master 
Include example of how to stop the reactor from script
 2013-06-25 13:30:07 -07:00
nramirezuy 83b2774354 remove wrong default httpcache 2013-06-25 17:01:29 -03:00
Daniel Graña e06836ff48 fix import of deprecated http handler for S3 handler 2013-06-25 14:34:43 -03:00
Daniel Graña 22da89b748 callLater must happens before timeout callback is added to avoid AttributeError 2013-06-25 12:45:48 -03:00
Berend Iwema aec314db09 added a bit more documentation on how to close the reactor when running scrapy from a script 2013-06-25 16:08:22 +02:00
Pablo Hoffman bbde1d0e0b Merge pull request #275 from stav/doc 
doc: Response.replace() cannot take meta argument
 2013-06-24 11:09:28 -07:00
Daniel Graña 7af94be3a9 fix helpers used to sign S3 requests with boto connections 2013-06-20 10:56:48 -03:00
Daniel Graña 7a4c012db4 show a meaningful skip message for image tests 2013-06-20 10:51:59 -03:00
Daniel Graña de57e27d81 do not skip image tests and set a fixed pyOpenSSL version 2013-06-20 10:44:20 -03:00
Daniel Graña 26809d2254 fix download_timeout for servers that returns response headers but hangs sending its body 2013-06-20 10:15:23 -03:00
Daniel Graña 133091af3a rename http11 handler methods and split latency and timeout check 2013-06-19 16:23:51 -03:00
Daniel Graña 1e1b161671 Merge pull request #321 from barraponto/document_crawlspider_parse_start_urls 
Document CrawlSpider.parse_start_urls method
 2013-06-10 06:20:16 -07:00
Capi Etheriel 50fa46d183 Document CrawlSpider.parse_start_urls method 2013-06-09 04:03:20 -03:00
Pablo Hoffman 5a097cc192 log optional features available on startup 2013-06-04 19:25:26 -03:00
Daniel Graña 8ea041528f Merge pull request #318 from scrapy/http11 
Add HTTP 1.1 download handler
 2013-06-04 14:34:54 -07:00
Daniel Graña e7acc2171d show deprecation warning for HttpDownloadHandler 2013-06-04 17:28:43 -03:00
Daniel Graña cf10474b8b improve twisted version tests and enable HTTP11 handler by default if supported 2013-06-04 16:59:35 -03:00
Daniel Graña bb806fa0f8 restore http10 as default handler and skip tests if http1.1 is not supported 2013-06-04 16:36:21 -03:00
Daniel Graña 8b0c9466d6 add required files to support twisted 11.1 (precise) 2013-06-04 15:35:31 -03:00
Daniel Graña 7729f939e9 implement download timeouts based on deferred cancellation 2013-06-03 19:18:45 -03:00
Pablo Hoffman 4ac0eea55d Merge pull request #316 from nramirezuy/closespider/errorcount 
standarizes close_spider to use signals
 2013-05-31 12:20:58 -07:00
nramirezuy b61a4e719c standarizes close_spider to use signals 2013-05-31 15:54:17 -03:00
Daniel Graña b4fca90bba merge 0.16.5 release notes 2013-05-30 18:49:00 -03:00
Daniel Graña 58dc16f48d obey request method when scrapy deploy is redirected to a new endpoint 2013-05-30 18:34:59 -03:00
Pablo Hoffman 0effe139e5 Merge pull request #311 from nramirezuy/logstats-6017 
removed multispider support from logstats
 2013-05-30 08:47:33 -07:00
nramirezuy 14e382ae48 test_closespider fixed for python 2.6 2013-05-30 10:57:06 -03:00
Pablo Hoffman 461eace4af Merge pull request #313 from nramirezuy/closespider-6017 
drop multi-spider support from CloseSpider extension
 2013-05-30 06:34:52 -07:00
nramirezuy 971ef5c78e removed multispider support, test added 2013-05-28 17:39:37 -03:00
Pablo Hoffman 2bb2ba66f6 simplify scrapy.tests.mockserver 2013-05-28 15:12:38 -03:00
Pablo Hoffman f35266e6a5 use os.pathsep 2013-05-28 15:10:05 -03:00
nramirezuy 96b8fb69be removed multispider support from logstats 2013-05-28 14:45:02 -03:00
Pablo Hoffman 98aa3efea7 Merge pull request #312 from nramirezuy/cmd/bech/test 
added test for bench command
 2013-05-28 08:46:31 -07:00
nramirezuy 1ed5643eb2 added test for bench command 2013-05-28 12:42:50 -03:00
Pablo Hoffman a4b5bfbb5e Merge pull request #309 from amferraz/patch-1 
Add FAQ entry referencing Request.meta usage
 2013-05-27 09:07:48 -07:00
cacovsky 8007762890 Add FAQ entry referencing Request.meta usage 2013-05-27 13:02:17 -03:00