RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
4,894 Commits 49 Branches 132 Tags 137 MiB
Commit Graph

759 Commits

Author SHA1 Message Date
Paul Tremberth 38b09085eb Add support for Sphinx 1.4 
See http://www.sphinx-doc.org/en/stable/changes.html#release-1-4-released-mar-28-2016

sphinx_rtd_theme has become optional, needs to be added to reqs

https://github.com/sphinx-doc/sphinx/pull/2320 changes node entries tuples
to 5 values instead of 4

`sh` syntax highlighting added very locally in selectors.rst
because of this warning/error with Sphinx 1.4:

```
Warning, treated as error:
/home/paul/src/scrapy/docs/topics/selectors.rst:743:
WARNING: Could not lex literal_block as "python". Highlighting skipped.
```
 2016-03-30 17:55:20 +02:00
Lele 6d193e4dab Changed sel. to response. for clarity 
Changed sel. to response. to comply with the rest of the examples in the same section, to avoid confusion.
 2016-03-18 03:30:31 +01:00
Mikhail Korobov a4b103f0d2 Merge pull request #1643 from orangain/doc-downloader-middleware-base-1.0 
DOC: Add AjaxCrawlMiddleware to DOWNLOADER_MIDDLEWARES_BASE
 2016-01-13 12:57:02 +05:00
David Chen 7f4ddd5d8d Fixed minor grammar issues. 2015-12-30 14:34:47 -03:00
Valdir Stumm Jr b71f6775c1 fixed a typo in the documentation. 2015-12-30 14:34:15 -03:00
hoatle 0a1366ed8d fix another invalid xpath error 2015-12-30 14:33:19 -03:00
Hoat Le ca8d60f267 fix ValueError: Invalid XPath: //div/[id="not-exists"]/text() on selectors.rst 
>>> response.xpath('//div/[id="not-exists"]/text()').extract_first() is None
Traceback (most recent call last):
  File "<console>", line 1, in <module>
  File "/home/vagrant/.virtualenvs/scrapy/lib/python2.7/site-packages/scrapy/http/response/text.py", line 109, in xpath
    return self.selector.xpath(query)
  File "/home/vagrant/.virtualenvs/scrapy/lib/python2.7/site-packages/scrapy/selector/unified.py", line 100, in xpath
    raise ValueError(msg if six.PY3 else msg.encode("unicode_escape"))
ValueError: Invalid XPath: //div/[id="not-exists"]/text()
 2015-12-30 14:33:13 -03:00
smirecki 7067117a7b Typos corrections 
I've made a few small corrections, some spelling changes and typo fixes.
I've tried to respect regional spelling differences and avoided proposing hyphenating compound words.

 Please enter the commit message for your changes. Lines starting
 2015-12-30 14:32:54 -03:00
hy 32f115c4c6 fix typos in downloader-middleware.rst and exceptions.rst, middlware -> middleware 2015-12-30 14:30:59 -03:00
David Tagatac 1ddcc7b96a minor: scrapy.Spider docs grammar 2015-12-30 14:28:09 -03:00
Aivars Kalvāns 1b85bcf336 Make common practices sample code match the comments 2015-12-30 14:27:42 -03:00
orangain aa941219f2 DOC: Add AjaxCrawlMiddleware to DOWNLOADER_MIDDLEWARES_BASE 2015-12-18 13:25:24 +09:00
Mikhail Korobov 8876111d5c Merge pull request #1512 from mgedmin/patch-1 
Fix list formatting
 2015-09-29 03:32:21 +05:00
Marius Gedminas f8d0682925 Typo 2015-09-28 12:36:34 +03:00
Marius Gedminas 5f83a93541 Fix list formatting 2015-09-28 12:29:12 +03:00
David Tagatac 9c9d2e059b minor: scrapy.Spider grammar and clarity 2015-08-06 17:56:37 -03:00
Pablo Hoffman 5303c66a58 remove version suffix from ubuntu package 2015-06-22 10:58:00 -03:00
Julia Medina e1a92eb45c DOC indent additional docs for configure_logging 
(cherry picked from commit 36bc912cdd)
 2015-06-12 16:09:54 -03:00
Mikhail Korobov 0f733e89e6 DOC remove FailureFormatter mentions, stop copy-pasting configure_logging docstring 
(cherry picked from commit a611f8dd2d)
 2015-06-12 16:09:46 -03:00
Mikhail Korobov f001641543 (backwards-incompatible) allow to pass settings=None to configure_logging 
* use explicit argument for disabling root handler;
* handle LOG_STDOUT even if install_root_handler is False

(cherry picked from commit 9a787893e3)
 2015-06-12 16:09:39 -03:00
Bryan Crowe 0e8f51beb1 Fix a couple typos 
(cherry picked from commit 6a4c475e87)
 2015-06-12 16:08:25 -03:00
Mikhail Korobov 2677f70fc3 DOC spider_error doesn't support deferreds 
(cherry picked from commit 790c67b643)
 2015-06-12 16:06:46 -03:00
Mikhail Korobov 7a30e6acbe make "settings" argument optional for Crawler, CrawlerRunner and CrawlerProcess 
(cherry picked from commit d047665c02)
 2015-06-12 16:05:36 -03:00
Julia Medina 5cd0296a16 Remove deprecated %z formatting from the default LOG_DATEFORMAT 2015-06-04 13:42:01 -03:00
Pablo Hoffman 525b349932 update old crawlera link 2015-06-01 20:38:17 -03:00
Mikhail Korobov 0b6c0eaa35 DOC fix non-working link (by removing it). 
See https://github.com/scrapy/scrapy/pull/1260
 2015-05-27 23:10:58 +05:00
Mikhail Korobov cc2258b2bb Merge pull request #1145 from bosnj/master 
[MRG+1] default return value for extract_first
 2015-05-21 22:03:54 +05:00
Mikhail Korobov 9b0ca1b7a0 drop support for FEED_EXPORT_FIELD=[] meaning "no fields" 2015-05-18 17:13:25 +05:00
Mikhail Korobov 9fb318338b support FEED_EXPORT_FIELDS=[] 2015-05-18 16:44:02 +05:00
Mikhail Korobov e1efd19175 TST, DOC document that Scrapy only infers field names for CSV 2015-05-18 16:43:23 +05:00
Julia Medina 7c61bd897c Fix in docs for error introduced in #1218 2015-05-14 20:09:19 -03:00
Daniel Graña 1195f906d6 Merge pull request #1218 from Curita/move-base-to-packages 
Move base classes to their packages
 2015-05-14 18:28:17 -03:00
Pablo Hoffman 65aa9ccc70 Merge pull request #1220 from eliasdorneles/building-settingslist-from-docs 
Building settings list from docs
 2015-05-13 14:43:19 -03:00
Elias Dorneles 5753e498bf fixes referencing, and list only settings not documented in current document 2015-05-09 16:15:06 -03:00
Julia Medina c271d8f0b1 Title underline too short in docs/topics/selectors.rst 2015-05-09 05:20:54 -03:00
Julia Medina 6fd7d85448 Wrong bullet list indentation in docs/topics/media-pipeline.rst 2015-05-09 05:19:15 -03:00
Julia Medina acc13c9821 Delete tab used as indentation in docs/topics/loaders.rst 2015-05-09 05:15:17 -03:00
Julia Medina 819a8eceee Mark as orphan the doc topics not listed in the index 2015-05-09 05:12:35 -03:00
Julia Medina d3f576a816 Move scrapy/spider.py to scrapy/spiders/__init__.py 2015-05-09 04:20:09 -03:00
Julia Medina d72536688f Move scrapy/linkextractor.py to scrapy/linkextractors/__init__.py 2015-05-09 03:28:37 -03:00
bosnj 8ae05478be added docs and test case, fixed handling empty string vs None 2015-05-04 21:22:17 +02:00
Elias Dorneles d1053d2a2f automatic settings list for docs [WIP] 2015-05-04 02:17:19 -03:00
Pablo Hoffman a5a8f82b06 move documentation about registering commands via setup.py to commands doc 2015-05-01 01:51:56 -03:00
Julia Medina c1634e4914 Add CrawlerProcess to "Running multiple spiders[...]" doc section 2015-04-29 23:09:20 -03:00
Julia Medina d6a06a769f Add CrawlerProcess to "Run Scrapy from a script" doc section 2015-04-29 23:09:20 -03:00
Julia Medina 3a71504d35 Extend CrawlerProcess documentation 2015-04-29 23:09:20 -03:00
Julia Medina a2ce78db63 Use autoclass for CrawlerRunner in docs/topics/api.rst 2015-04-29 23:09:20 -03:00
Julia Medina b827097c91 Rename scrapy/statscol.py to scrapy/statscollectors.py 2015-04-29 21:36:40 -03:00
Julia Medina 54a4ce069c Rename scrapy/dupefilter.py to scrapy/dupefilters.py 2015-04-29 21:27:19 -03:00
Julia Medina 645cdcbf9e Rename scrapy/loader/processor.py to scrapy/loader/processors.py 2015-04-29 21:27:19 -03:00