RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
4,026 Commits 49 Branches 132 Tags 138 MiB
Commit Graph

4026 Commits

Author SHA1 Message Date
Claudio Salazar d034df36e8 Added test against XXE attacks for Sitemap 2014-04-05 00:22:36 +08:00
Claudio Salazar c2a424daae Fixed XML selector against XXE attacks 2014-04-05 00:13:27 +08:00
Claudio Salazar 43217fd698 Fixed XXE flaw in sitemap reader 2014-04-01 23:54:04 +08:00
Daniel Graña ade7662f23 Merge pull request #661 from ananana/sgml-attrs-tuple 
Fixed default value of attrs argument in SgmlLinkExtractor to be tuple
 2014-03-27 09:06:43 -07:00
Ana Sabina Uban 73109bf950 Fixed SgmlLinkExtractor constructor to properly handle both string and list parameters (attrs, tags, deny_extensions) 2014-03-27 16:12:00 +02:00
Daniel Graña f687455046 Merge pull request #660 from rubenvereecken/issue193 
Added content-type check as per issue #193
 2014-03-24 06:10:23 -07:00
Ruben Vereecken 54434095fc Redefined test for #193 2014-03-21 14:41:07 +01:00
Ruben Vereecken 92780b70da Added content-type check as per issue #193 2014-03-20 20:41:08 +01:00
Daniel Graña 3df6946256 Merge pull request #656 from kmike/httperror-logging 
[MRG] Fix for #612 + small tests cleanup
 2014-03-18 19:46:59 -07:00
Mikhail Korobov 60f9dc7a54 TST fix file descriptor leak and a bad variable name in get_testlog 2014-03-19 04:18:04 +06:00
Mikhail Korobov 75060d1424 Fix for #612 + integration-style tests for HttpErrorMiddleware 2014-03-19 04:04:24 +06:00
Mikhail Korobov 364790eb07 scrapy.utils.test.docrawl function 2014-03-19 03:30:58 +06:00
Mikhail Korobov 15454e7845 reduce code duplication in test_spidermiddleware_httperror 2014-03-19 01:50:09 +06:00
Mikhail Korobov 9edbb68b39 Merge pull request #612 from deed02392/patch-1 
Update httperror.py
 2014-03-18 22:30:07 +05:00
Mikhail Korobov ff41d5451e Merge pull request #654 from tpeng/patch-2 
add message when raise IngoreReques; fix item_scraped document
 2014-03-18 21:33:05 +05:00
tpeng fd7b40e892 add message when raise IngoreReques; fix item_scraped document 2014-03-18 15:23:25 +08:00
Daniel Graña b8ecbb7632 Merge pull request #650 from Curita/dlhandler-disable 
Allow to disable a downloader handler just like any other component
 2014-03-17 19:39:46 -07:00
Daniel Graña f921d2aff1 Merge pull request #645 from Curita/formrequest-clickdata-doc 
Documentation for FormRequest.from_response clickdata parameter
 2014-03-13 12:18:26 -07:00
Daniel Graña c2fd1f8a7c Merge pull request #646 from Curita/formrequest-clickdata-nr-index-tests 
Tests for clickdata's nr index in FormRequest
 2014-03-13 12:17:55 -07:00
Julia Medina 2177d4feec Minor fixes in LoadTestCase in test_downloader_handlers 
* same __init__ parameters in both download handlers's mocks
 * additional assertion in test_disabled_handler
 2014-03-13 01:29:10 -03:00
Julia Medina b9e2aad874 Doc for disabling download handler 2014-03-12 23:21:33 -03:00
Julia Medina 6573459481 Fix minor typo in DownloaderHandlers comment 2014-03-12 22:33:42 -03:00
Julia Medina efb86f966d Tests for loading download handlers 2014-03-12 22:32:48 -03:00
Rolando Espinoza La fuente a1df15b9ce Alow to disable a downloader handler just like any other component. 2014-03-12 20:25:51 -03:00
Julia Medina ae4eb90cbf More appropriate assert in FormRequest test 2014-03-12 13:11:41 -03:00
Julia Medina ca1c1a82b5 FormRequest doc improvements 
Clickdata doc enhancements:
 * Fix xml attributes mention
 * nr is 0-indexed reference
 2014-03-12 12:34:50 -03:00
Julia Medina a63b7e1c3e New tests: clickdata's nr in Formrequest.from_response 2014-03-12 07:26:52 -03:00
Julia Medina e29ab4d112 New doc: clickdata in Formrequest.from_response 
Documentation about:
 * clickdata parameter in Formrequest.from_response
 * nr attribute in clickdata dict
 * default behaviour when clickdata is None
 2014-03-12 06:43:50 -03:00
Pablo Hoffman 5bbc20f5dd Merge pull request #643 from Digenis/master 
ItemLoader doc: missing args in replace_value()
 2014-03-09 08:06:37 -07:00
Nikolaos-Digenis Karagiannis 8ac9d40665 ItemLoader doc: missing args in replace_value() 2014-03-09 15:16:57 +02:00
Pablo Hoffman a762834dcd Merge pull request #642 from aspidites/sep-014.rst 
sep 14 for #629
 2014-03-07 19:25:25 -08:00
Edwin O Marshall 38ea9373a5 sep 14 for #629 2014-03-07 18:05:21 -05:00
Pablo Hoffman 0bc2cbaf09 Merge pull request #613 from breno/master 
Update scrapy command line doc with additional scrapy parse options
 2014-03-07 10:35:58 -08:00
Pablo Hoffman 753893229a Merge pull request #641 from aspidites/remaining_seps 
Converted remaining SEPs...
 2014-03-07 10:32:33 -08:00
Pablo Hoffman 690fbdb93c Merge pull request #633 from aspidites/sep-004.rst 
sep 4 for #629
 2014-03-07 10:32:07 -08:00
Edwin O Marshall 138e534bc2 converted sep017 2014-03-07 11:52:12 -05:00
Edwin O Marshall 770e24ae51 converted sep 9 2014-03-07 11:44:41 -05:00
Edwin O Marshall f1e0faacff - convertd sep 8 2014-03-07 11:28:37 -05:00
Edwin O Marshall f43c99f360 converted sep 5 2014-03-07 11:18:08 -05:00
Edwin O Marshall 5312146ff7 converted sep 13 2014-03-07 11:07:57 -05:00
Edwin O Marshall 05ac4112cd converted sep 16 2014-03-07 10:48:50 -05:00
Edwin O Marshall c68798b3d5 - converted sep 18 2014-03-07 10:48:50 -05:00
Pablo Hoffman c9c4343226 Merge pull request #631 from aspidites/sep-002.rst 
converted sep 002 to rst
 2014-03-07 07:07:40 -08:00
Pablo Hoffman 61b81b1c9f Merge pull request #637 from aspidites/sep-010.rst 
sep 10 for #629
 2014-03-07 07:06:20 -08:00
Pablo Hoffman c1d31bd14b Merge pull request #639 from aspidites/sep-007.rst 
converted sep 7 for #629
 2014-03-07 07:05:52 -08:00
Pablo Hoffman 9323b001b7 Merge pull request #634 from aspidites/sep-011.rst 
sep 11 for #629
 2014-03-07 07:05:34 -08:00
Pablo Hoffman 8cf9a97cf7 Merge pull request #635 from aspidites/sep-015.rst 
- sep 15 for #629
 2014-03-07 07:05:11 -08:00
Pablo Hoffman 326d9fb573 Merge pull request #640 from aspidites/sep-012.rst 
sep 12 for #629
 2014-03-07 07:03:46 -08:00
Pablo Hoffman 51966f5946 Merge pull request #636 from aspidites/sep-006.rst 
sep 6 for #629
 2014-03-07 07:01:29 -08:00
Pablo Hoffman cf4d91be69 Merge pull request #632 from aspidites/sep-003.rst 
converted sep 3 for #629
 2014-03-07 07:00:54 -08:00