From a21c90bee7658f3889a5093cda1693217c9b2e14 Mon Sep 17 00:00:00 2001 From: Valdir Stumm Jr Date: Wed, 3 Feb 2016 11:54:46 -0200 Subject: [PATCH 1/2] edits on Py3 Support and New features sections --- docs/news.rst | 76 +++++++++++++++++---------------------------------- 1 file changed, 25 insertions(+), 51 deletions(-) diff --git a/docs/news.rst b/docs/news.rst index 6a83a6163..f710192e8 100644 --- a/docs/news.rst +++ b/docs/news.rst @@ -9,34 +9,31 @@ Release notes Python 3 Support (basic) ~~~~~~~~~~~~~~~~~~~~~~~~ -We have been hard at work to make Scrapy work on Python 3. Some features -are still missing (and may never be ported to Python 3, see below), -but you can now run spiders on Python 3.3, 3.4 and 3.5. +We have been hard at work to make Scrapy run on Python 3. As a result, now you can run spiders on Python 3.3, 3.4 and 3.5, although some features are still missing (some of them may never be ported to Python 3). -Almost all of addons/middleware should work, but here are the current -limitations we know of: +Almost all addons/middlewares are expected to work. However, we are aware of some limitations: - s3 downloads are not supported (see :issue:`1718`) - sending emails is not supported - FTP download handler is not supported (non-Python 3 ported Twisted dependency) - telnet is not supported (non-Python 3 ported Twisted dependency) - there are problems with non-ASCII URLs in Python 3 -- reported problems with HTTP cache created in Python 2.x which can't be used in 3.x (to be checked) -- there is also a nasty issue with cryptography library: - recent versions don't work well on OS X + Python 3.5 (see https://github.com/pyca/cryptography/issues/2690), - downgrading to an older version helps - +- reported problems with HTTP caches created by Scrapy in Python 2.x which can't be reused in Scrapy in Python 3.x (to be checked) +- there is also a nasty issue with `cryptography` library: recent versions don't work well on OS X + Python 3.5 (see https://github.com/pyca/cryptography/issues/2690). As a workaround, you can downgrade the library to an older version. New Features and Enhancements ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ -- Command line tool has completion for zsh (:issue:`934`) -- ``scrapy shell`` works with local files again ; this was a regression +- Command line tool completion for zsh (:issue:`934`) +- ``scrapy shell`` works with local files again; this was a regression identified in 1.0+ releases (:issue:`1710`, :issue:`1550`) - ``scrapy shell`` now also checks a new ``SCRAPY_PYTHON_SHELL`` environment - variable to launch the interactive shell of your choice ; + variable to launch the interactive shell of your choice; ``bpython`` is a newly supported option too (:issue:`1444`) -- Autothrottle has gotten a code cleanup and better docs ; +- Scrapy shell now have `http` as the default schema for URLs. Now, you can + start it by: `scrapy shell scrapy.org` #1498 (https://github.com/scrapy/scrapy/commit/fe15f93e533be36e81e0385691fe5571c88b0b31). Fixes: #1487 **Warning: backwards incompatible!** + + see: https://github.com/scrapy/scrapy/issues/1550, https://github.com/scrapy/scrapy/pull/1710 +- Autothrottle code has been cleaned up and its docs have been improved; there's also a new ``AUTOTHROTTLE_TARGET_CONCURRENCY`` setting which allows to send more than 1 concurrent request on average (:issue:`1324`) - Memory usage extension has a new ``MEMUSAGE_CHECK_INTERVAL_SECONDS`` @@ -48,50 +45,27 @@ New Features and Enhancements - Scheme Download handlers are now lazy-loaded on first request using that scheme (``http(s)://``, ``ftp://``, ``file://``, ``s3://``) (:issue:`1390`, :issue:`1421`) -- RedirectMiddleware now skips status codes in ``handle_httpstatus_list``, - set either as spider attribute or ``Request``'s ``meta`` key +- RedirectMiddleware now skips the status codes from ``handle_httpstatus_list``. You can set it either as spider attribute or ``Request``'s ``meta`` key (:issue:`1334`, :issue:`1364`, :issue:`1447`) - - -- Form submit button plain #1469 (https://github.com/scrapy/scrapy/commit/b876755f1cee619d8c421357777d223037d5289c) - Fixes: Form submit button (https://github.com/scrapy/scrapy/issues/1354) -- Implement FormRequest.from_response CSS support #1382 (https://github.com/scrapy/scrapy/commit/a6e5c848feb672c117f3380976077b6d0f42e3a6) - + Fix version number to appear new feature #1706 - +- Form submission now works with `