RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
4,264 Commits 49 Branches 132 Tags 130 MiB
Commit Graph

4264 Commits

Author SHA1 Message Date
Daniel Graña 0845a2567f Merge pull request #1311 from jgors/0.24 
fixed the size to match the above xpath selector text for getting size
 2015-06-23 19:51:12 -03:00
Jason Gors c909596186 fixed the size to match the above xpath selector text for getting size 2015-06-18 15:06:13 -04:00
Daniel Graña cd0c2aaafc Merge pull request #1275 from ramiro/patch-2 
Use call to `inspect_reponse()` that works on 0.24.x
 2015-06-10 16:31:20 -03:00
Ramiro Morales 66ba61c72f Use call to `inspect_reponse()` that works on 0.24.x 
Otherwise, when the spider is ejecuted from a standalone script as described in http://doc.scrapy.org/en/stable/topics/practices.html#run-scrapy-from-a-script it triggers an exception like this:
```
.../site-packages/scrapy/shell.py", line 131, in inspect_response
...
from scrapy.project import crawler
...
exceptions.ImportError: cannot import name crawler
```
 2015-06-02 18:49:25 -03:00
Mikhail Korobov 13fab6e801 Merge pull request #1271 from allyjweir/patch-1 
Tiny spelling correction
 2015-06-01 20:45:07 +05:00
Ally Weir f197700bd3 Spelling correction 
incorrect use of "too" instead of "to"
 2015-06-01 16:42:51 +01:00
Mikhail Korobov aef05cdd8f Merge pull request #1260 from mikeumus/patch-2 
Second PIL link no longer in use.
 2015-05-27 22:54:21 +05:00
Michael Duane Mooring 893f082aa3 Second PIL link no longer in use. 
Leads to this page in the /latest docs: http://doc.scrapy.org/en/latest/topics/PythonImagingLibrary
 2015-05-27 09:26:55 -04:00
Daniel Graña c8f338e2b4 Merge pull request #1085 from Curita/match-default-in-log-start 
[MRG+1] Match default values in log.start
 2015-05-14 23:35:31 -03:00
Mikhail Korobov 7864742374 Merge pull request #1208 from vice/patch-1 
Correct login request example
 2015-05-05 16:46:19 +05:00
Vicente Jimenez Aguilar 178440a39a Correct login request example 
In the example log is not imported
and not found in the global name space
 2015-05-05 10:36:02 +02:00
Daniel Graña 40fbeb30e7 Add 0.24.6 release notes 2015-04-20 01:39:52 -03:00
Daniel Graña c3affcbad6 Bump version: 0.24.5 → 0.24.6 2015-04-20 01:38:10 -03:00
Nikolaos-Digenis Karagiannis 07cb3e526d encode invalid xpath with unicode_escape under PY2 
The exception quotes an xpath string
which may be unicode.
 2015-04-20 01:32:48 -03:00
Elias Dorneles 2c8e573a06 fix IPython shell scope issue and load IPython user config 2015-04-20 01:29:38 -03:00
Mikhail Korobov c84c3769fc Merge pull request #1170 from josericardo/patch-1 
Fix small typo in the docs
 2015-04-17 23:35:51 +05:00
José Ricardo d694019a77 Fix small typo in the docs 2015-04-17 14:27:11 -04:00
Mikhail Korobov 778c33e7ad Merge pull request #1167 from josericardo/patch-1 
Fix small typo
 2015-04-16 20:48:14 +05:00
José Ricardo f92fa83a71 Fix small typo 2015-04-16 11:45:47 -04:00
Peter Bronez c2c6d15d96 Converted sel.xpath() calls to response.xpath() in Extracting the data 2015-03-27 00:53:27 +05:00
Julia Medina 87202546e3 Match default values in log.start 
This will avoid unexpected outputs when calling log.start explicitly.

Main change is setting `logstdout` to False, since it's currently
broken and generates issues like #451.
 2015-03-25 23:40:25 -03:00
Daniel Graña 19bb4d36ff fix truncated 0.24.5 release notes. closes #1084 2015-03-18 20:47:01 -03:00
Daniel Graña 2b5d8ddf8e Add 0.24.5 release notes 2015-02-25 18:03:53 -02:00
Daniel Graña 69ecd6ded7 Bump version: 0.24.4 → 0.24.5 2015-02-25 18:02:03 -02:00
Julia Medina 540b9bcde0 Support new _getEndpoint Agent signatures on Twisted 15.0.0 2015-02-25 17:49:42 -02:00
Mikhail Korobov b4c454b56d DOC a couple more references are fixed 2015-02-25 17:46:58 -02:00
Mikhail Korobov e3c1260671 DOC fix a reference 2015-02-25 17:46:51 -02:00
nyov 9e13f42ecf t.i.b.ThreadedResolver is now a new-style class 
since 2009 / twisted-9.0.0
663d669dce
 2015-02-25 17:44:52 -02:00
immerrr cdb9a0b2c0 S3DownloadHandler: fix auth for requests with quoted paths/query params 2015-02-25 17:28:51 -02:00
Stefan bb3a848c12 fixed the variable types in mailsender documentation 2015-02-25 17:28:24 -02:00
Sudhanshu Shekhar edb07a452c Reset items_scraped instead of item_count 
items_scraped is the counter that needs to be reset each time we have scraped a specific number of items in the code instead of item_count (which represents the specific number of items needed before a message is logged). Updating the source code to reflect this.
Removed some irrelevant words from the log message.
Signed-off-by: Sudhanshu Shekhar <sudshekhar02@gmail.com>
 2015-02-25 17:24:59 -02:00
Daniel Graña 7ee6f7af97 Tentative attention message about what document to read for contributions 2015-02-25 17:24:59 -02:00
Daniel Graña 874fcdde68 mitmproxy 0.10.1 needs netlib 0.10.1 too 2015-01-20 15:38:33 -02:00
Daniel Graña c6b21f07c2 pin mitmproxy 0.10.1 as >0.11 does not work with tests 2015-01-20 15:35:55 -02:00
Julia Medina c3a6628138 Test the parse command locally instead of against an external url 2015-01-20 13:56:35 -02:00
Julia Medina d0bf957069 Patches Twisted issue while closing the connection pool on HTTPDownloadHandler 2015-01-20 13:56:16 -02:00
Capi Etheriel eeb589a4da Updates documentation on dynamic item classes. 
Fixes #398
 2015-01-20 13:10:58 -02:00
Pablo Hoffman 5fdab02735 Merge pull request #943 from Lazar-T/patch-3 
typo
 2014-11-09 12:33:08 -02:00
Lazar-T b0ae19993b typo 2014-11-09 00:04:22 +01:00
Daniel Graña 5cb0cfb0cb pywin32 is required by Twisted. closes #937 
see:
* http://twistedmatrix.com/trac/ticket/6032
* https://tahoe-lafs.org/trac/tahoe-lafs/ticket/2028
 2014-11-05 23:06:30 -02:00
Daniel Graña 781286bc07 Update install.rst 
fixes #937
 2014-11-05 22:49:40 -02:00
Mikhail Korobov b415d04996 Merge pull request #928 from Lazar-T/patch-1 
comma instead of fullstop
 2014-10-25 09:18:47 +06:00
Lazar-T 627b9ba915 comma instead of fullstop 2014-10-25 00:21:16 +02:00
Mikhail Korobov de909ad7e6 Merge pull request #885 from jsma/patch-1 
Update request-response.rst
 2014-09-14 22:05:31 +06:00
John-Scott Atlakson 3f3263dd83 Update request-response.rst 
Fixed minor typo
 2014-09-14 10:54:43 -04:00
yakxxx 49b40f01ad SgmlLinkExtractor - fix for parsing <area> tag with Unicode present 2014-09-02 20:53:15 -03:00
Daniel Graña 4677eedb06 Add 0.24.4 release notes 2014-08-09 17:19:39 -03:00
Daniel Graña 9dba272e57 Bump version: 0.24.3 → 0.24.4 2014-08-09 17:18:49 -03:00
Daniel Graña 5eddc68b63 pem file is used by mockserver and required by scrapy bench 2014-08-09 17:18:14 -03:00
Daniel Graña d6cb9999d4 scrapy bench needs scrapy.tests* 2014-08-09 17:10:43 -03:00