RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
4,802 Commits 49 Branches 132 Tags 138 MiB
Commit Graph

4802 Commits

Author SHA1 Message Date
David Tagatac 9c9d2e059b minor: scrapy.Spider grammar and clarity 2015-08-06 17:56:37 -03:00
nyov c63882ba79 Put a blurb about support channels in CONTRIBUTING 2015-08-06 17:54:13 -03:00
Andrew Murray a9ae7b0973 Fixed typos 2015-08-06 17:53:52 -03:00
Nikola Pavlović 7c8a4fed0b Fix reference. 2015-08-06 17:52:48 -03:00
Daniel Graña 5b8c9e5651 Add 1.0.1 release notes 2015-07-01 01:49:05 -03:00
Daniel Graña 1f01385379 Bump version: 1.0.0 → 1.0.1 2015-07-01 01:45:25 -03:00
Yaroslav Halchenko eca227e215 ENH: include tests/ to source distribution in MANIFEST.in 2015-07-01 01:40:39 -03:00
Capi Etheriel b8567bc4bc Fix SelectJmes documentation 2015-07-01 01:40:11 -03:00
Daniel Graña cc00ad20cf Unquote request path before passing to FTPClient, it already escape paths 2015-07-01 01:39:29 -03:00
Marco DallaG 392233f7e4 DOC Bring Ubuntu and Archlinux outside of Windows subsection 
In the installation guide, in the "Platform specific installation notes" section, Ubuntu and ArchLinux are currently subsections of Windows, which does not make sense imho.
This commit changes the section tree from:

Platform specific installation notes
- Windows
  -- Archlinux
  -- Ubuntu

To:

Platform specific installation notes
- Windows
- Ubuntu
- Archlinux
 2015-07-01 01:38:46 -03:00
Pablo Hoffman 5303c66a58 remove version suffix from ubuntu package 2015-06-22 10:58:00 -03:00
Julia Medina c89fa29c41 Update release date for 1.0 2015-06-19 18:49:13 -03:00
Julia Medina 3017b1033f Bump version: 1.0.0rc3 → 1.0.0 2015-06-19 17:56:44 -03:00
Daniel Graña 2ff9888e2d Generated version as pep440 and dpkg compatible 2015-06-16 00:13:30 +00:00
agusc 5455a44e4e removed SUFFIX from scrapy name package 2015-06-15 18:04:30 -03:00
Julia Medina 1e7eecc274 Bump version: 1.0.0rc2 → 1.0.0rc3 2015-06-12 16:41:50 -03:00
Julia Medina f83b18e427 Update release notes for 1.0.0rc3 2015-06-12 16:39:02 -03:00
Julia Medina e1a92eb45c DOC indent additional docs for configure_logging 
(cherry picked from commit 36bc912cdd)
 2015-06-12 16:09:54 -03:00
Mikhail Korobov 0f733e89e6 DOC remove FailureFormatter mentions, stop copy-pasting configure_logging docstring 
(cherry picked from commit a611f8dd2d)
 2015-06-12 16:09:46 -03:00
Mikhail Korobov f001641543 (backwards-incompatible) allow to pass settings=None to configure_logging 
* use explicit argument for disabling root handler;
* handle LOG_STDOUT even if install_root_handler is False

(cherry picked from commit 9a787893e3)
 2015-06-12 16:09:39 -03:00
Bryan Crowe 0e8f51beb1 Fix a couple typos 
(cherry picked from commit 6a4c475e87)
 2015-06-12 16:08:25 -03:00
Mikhail Korobov c34ec6694c Stop reactor on Ctrl-C regardless of 'stop_after_crawl'. Fixes GH-1279. 
(cherry picked from commit 64399d18d8)
 2015-06-12 16:07:24 -03:00
Mikhail Korobov 3b0391b8f2 CrawlerProcess cleanup 
* remove unneeded lambda;
* extract _get_dns_resolver method and format code to pep8.

(cherry picked from commit 33d145e2f5)
 2015-06-12 16:07:17 -03:00
Mikhail Korobov 2677f70fc3 DOC spider_error doesn't support deferreds 
(cherry picked from commit 790c67b643)
 2015-06-12 16:06:46 -03:00
Berker Peksag 423826c1be Fix typos in scrapy/commands/setting.py 
* intepreted -> interpreted
* "a list" instead of "an float" in --getlist help
* "an float"-> "a float"

Also, backslashes were redundant. So I removed them.

(cherry picked from commit 66e5591eb9)
 2015-06-12 16:06:15 -03:00
Mikhail Korobov 7a30e6acbe make "settings" argument optional for Crawler, CrawlerRunner and CrawlerProcess 
(cherry picked from commit d047665c02)
 2015-06-12 16:05:36 -03:00
Rolando Espinoza b285cebcbf Do leveldb compactation for the httpcache on closing. 2015-06-12 11:18:37 -03:00
Julia Medina a2dbde98d5 Bump version: 1.0.0rc1 → 1.0.0rc2 2015-06-05 17:12:56 -03:00
Julia Medina 6e61d54168 Update release notes for 1.0.0rc2 2015-06-05 17:10:18 -03:00
Julia Medina 5cd0296a16 Remove deprecated %z formatting from the default LOG_DATEFORMAT 2015-06-04 13:42:01 -03:00
Mikhail Korobov f6ae78f4b1 fixed spider custom_settings 
https://github.com/scrapy/scrapy/pull/1128 moved spidercls.update_settings
call to a later stage; this commit moves it back.
 2015-06-03 22:19:05 +05:00
Mikhail Korobov bd271d8b99 TST a test case to show custom_settings doesn't always work 2015-06-03 22:19:05 +05:00
Julia Medina 2d6450a4ad Add helper to update deprecated class paths 2015-06-01 20:39:29 -03:00
Pablo Hoffman 525b349932 update old crawlera link 2015-06-01 20:38:17 -03:00
Ally Weir 16218d6534 Spelling correction 
incorrect use of "too" instead of "to"
 2015-06-01 22:22:53 +05:00
Mikhail Korobov 19ac046343 fixed CrawlerProcess when settings are passed as dicts 
See https://github.com/scrapy/scrapy/pull/1156

(cherry picked from commit aa6a72707d)
 2015-06-01 12:50:41 -03:00
Mikhail Korobov 0b6c0eaa35 DOC fix non-working link (by removing it). 
See https://github.com/scrapy/scrapy/pull/1260
 2015-05-27 23:10:58 +05:00
Julia Medina e76359f2ae Update 1.0 release notes 
(cherry picked from commit 343d20d791)
 2015-05-27 12:02:56 -03:00
Alexander Chekunkov 6f6a251a9b LogCounterHandler is never removed from root handlers list, fix that 
lambda is garbage collected and because receiver is added as weak reference by default - when signals.engine_stopped is fired logging.root.removeHandler is not executed. Fixed that by assigning lambda to a private argument and not by using connect(..., weak=False) because I belive this lambda function should be collected with crawler object

(cherry picked from commit b2765aabd8)
 2015-05-27 12:02:45 -03:00
Alexander Chekunkov 6c264f0e22 remove CrawlerProcess.stopping as it isn't used any more 
(cherry picked from commit b0ea3e38d1)
 2015-05-27 12:02:34 -03:00
Pablo Hoffman 8d2531fb05 Merge pull request #1253 from scrapy/deferdelay 
Increase delay of defer calls
 2015-05-22 20:13:11 -03:00
Daniel Graña d439c26d76 update docstring and release notes 2015-05-22 20:00:58 -03:00
Alexey Vishnevsky 27ce3225bd Makes scrapy more async by letting to reactor spend another couple of cycles to accomplish its needs. 2015-05-22 17:05:19 -03:00
Julia Medina de6d232a02 Bump version: 0.25.1 → 1.0.0rc1 2015-05-22 13:24:27 -03:00
Julia Medina 29529e5e8e Merge pull request #1244 from Curita/1.0-release-notes 
1.0 release notes
 2015-05-22 13:21:17 -03:00
Julia Medina 600164594c New release cycle in .bumpversion.cfg 
1.0.0dev1 -> 1.0.0rc1 -> 1.0.0 -> 1.1.0dev1 -> ...
 2015-05-22 12:59:21 -03:00
Julia Medina afcf70cdc6 Add 1.0 release notes 2015-05-22 12:53:11 -03:00
Mikhail Korobov cc2258b2bb Merge pull request #1145 from bosnj/master 
[MRG+1] default return value for extract_first
 2015-05-21 22:03:54 +05:00
Daniel Graña 58717472f7 Merge pull request #1250 from chekunkov/scrapy-log-fix-incompatible-change 
[MRG+1] Keep level_names in scrapy.log for backwards compatibility
 2015-05-21 10:46:39 -03:00
Alexander Chekunkov 795ca3945f keep level_names in scrapy.log for backwards compatibility 2015-05-21 08:56:44 +00:00