From e9b3cf01f4393c50b4a10f2032db0fecae5aa5f4 Mon Sep 17 00:00:00 2001 From: Paul Tremberth Date: Fri, 9 Dec 2016 17:23:59 +0100 Subject: [PATCH 1/7] Update changelog for upcoming 1.3.0 release --- docs/news.rst | 20 ++++++++++++++++++++ 1 file changed, 20 insertions(+) diff --git a/docs/news.rst b/docs/news.rst index 5e28fb130..5f759f0fc 100644 --- a/docs/news.rst +++ b/docs/news.rst @@ -3,6 +3,26 @@ Release notes ============= +Scrapy 1.3.0 (2016-12-XX) +------------------------- + +New Features +~~~~~~~~~~~~ + +- ``MailSender`` now accepts single strings as values for ``to`` and ``cc`` + arguments (:issue:`2272`) + +Dependencies & Cleanups +~~~~~~~~~~~~~~~~~~~~~~~ + +- Scrapy now requires Twisted >= 13.1 which is the case for many Linux + distributions already. +- As a consequence, we got rid of ``scrapy.xlib.tx.*`` modules, which + copied some of Twisted code for users stuck with an "old" Twisted version +- ``ChunkedTransferMiddleware`` is deprecated and removed from the default + downloader middlewares. + + Scrapy 1.2.2 (2016-12-06) ------------------------- From 9d5afd8c35410e2874a97a17b1a2b5f4deef2b38 Mon Sep 17 00:00:00 2001 From: Paul Tremberth Date: Fri, 16 Dec 2016 18:46:49 +0100 Subject: [PATCH 2/7] Add note on HttpErrorMiddleware new logging level --- docs/news.rst | 6 ++++++ 1 file changed, 6 insertions(+) diff --git a/docs/news.rst b/docs/news.rst index 5f759f0fc..a7cc30b0b 100644 --- a/docs/news.rst +++ b/docs/news.rst @@ -22,6 +22,12 @@ Dependencies & Cleanups - ``ChunkedTransferMiddleware`` is deprecated and removed from the default downloader middlewares. +Logging +~~~~~~~ + +- ``HttpErrorMiddleware`` now logs errors with ``INFO`` level instead of ``DEBUG``; + this is technically **backwards incompatible** so please check your log parsers. + Scrapy 1.2.2 (2016-12-06) ------------------------- From 9098001888a57ac4db030fc6563d541174f47d47 Mon Sep 17 00:00:00 2001 From: Paul Tremberth Date: Mon, 19 Dec 2016 17:09:47 +0100 Subject: [PATCH 3/7] Add note on LOG_SHORT_NAMES --- docs/news.rst | 5 +++++ 1 file changed, 5 insertions(+) diff --git a/docs/news.rst b/docs/news.rst index a7cc30b0b..02227aa8e 100644 --- a/docs/news.rst +++ b/docs/news.rst @@ -27,6 +27,11 @@ Logging - ``HttpErrorMiddleware`` now logs errors with ``INFO`` level instead of ``DEBUG``; this is technically **backwards incompatible** so please check your log parsers. +- By default, logger names now use a long-form path, e.g. ``[scrapy.extensions.logstats]``, + instead of the shorter "top-level" variant of prior releases (e.g. ``[scrapy]``); + this is **backwards incompatible** if you have log parsers expecting the short + logger name part. You can switch back to short logger names using :setting:`LOG_SHORT_NAMES` + set to ``True``. Scrapy 1.2.2 (2016-12-06) From 49a84c2d414386b27a3f9e4439c5a967ce6cb9bc Mon Sep 17 00:00:00 2001 From: Paul Tremberth Date: Wed, 21 Dec 2016 14:32:21 +0100 Subject: [PATCH 4/7] Add note on HTTP redirects with shell and fetch --- docs/news.rst | 3 +++ 1 file changed, 3 insertions(+) diff --git a/docs/news.rst b/docs/news.rst index 02227aa8e..02976fedf 100644 --- a/docs/news.rst +++ b/docs/news.rst @@ -11,6 +11,9 @@ New Features - ``MailSender`` now accepts single strings as values for ``to`` and ``cc`` arguments (:issue:`2272`) +- ``scrapy fetch url``, ``scrapy shell url`` and ``fetch(url)`` inside + scrapy shell now follow HTTP redirections by default (:issue:`2290`); + See :command:`fetch` and :command:`shell` for details. Dependencies & Cleanups ~~~~~~~~~~~~~~~~~~~~~~~ From 4eeec3e42cf4a48dd3481e43ca064576a4a825d7 Mon Sep 17 00:00:00 2001 From: Paul Tremberth Date: Wed, 21 Dec 2016 15:59:18 +0100 Subject: [PATCH 5/7] Add preamble on why 1.3.0 comes so soon after 1.2.2 --- docs/news.rst | 8 ++++++++ 1 file changed, 8 insertions(+) diff --git a/docs/news.rst b/docs/news.rst index 02976fedf..09c47dc30 100644 --- a/docs/news.rst +++ b/docs/news.rst @@ -6,6 +6,14 @@ Release notes Scrapy 1.3.0 (2016-12-XX) ------------------------- +This release comes rather soon after 1.2.2 for one main reason: +it was found out that releases since 0.18 up to 1.2.2 (included) use +some backported code from Twisted, even if newer Twisted modules are available. +Scrapy now uses ``twisted.web.client`` and ``twisted.internet.endpoints`` directly. + +As it is a major change, we wanted to get the bug fix out quickly +while not breaking any projects using the 1.2 series. + New Features ~~~~~~~~~~~~ From d60a6899dfe0fa5ac08298fa466b71e4f221b93e Mon Sep 17 00:00:00 2001 From: Paul Tremberth Date: Wed, 21 Dec 2016 16:01:36 +0100 Subject: [PATCH 6/7] Merge logging changes into "New features" section --- docs/news.rst | 18 +++++++----------- 1 file changed, 7 insertions(+), 11 deletions(-) diff --git a/docs/news.rst b/docs/news.rst index 09c47dc30..f42edba30 100644 --- a/docs/news.rst +++ b/docs/news.rst @@ -22,6 +22,13 @@ New Features - ``scrapy fetch url``, ``scrapy shell url`` and ``fetch(url)`` inside scrapy shell now follow HTTP redirections by default (:issue:`2290`); See :command:`fetch` and :command:`shell` for details. +- ``HttpErrorMiddleware`` now logs errors with ``INFO`` level instead of ``DEBUG``; + this is technically **backwards incompatible** so please check your log parsers. +- By default, logger names now use a long-form path, e.g. ``[scrapy.extensions.logstats]``, + instead of the shorter "top-level" variant of prior releases (e.g. ``[scrapy]``); + this is **backwards incompatible** if you have log parsers expecting the short + logger name part. You can switch back to short logger names using :setting:`LOG_SHORT_NAMES` + set to ``True``. Dependencies & Cleanups ~~~~~~~~~~~~~~~~~~~~~~~ @@ -33,17 +40,6 @@ Dependencies & Cleanups - ``ChunkedTransferMiddleware`` is deprecated and removed from the default downloader middlewares. -Logging -~~~~~~~ - -- ``HttpErrorMiddleware`` now logs errors with ``INFO`` level instead of ``DEBUG``; - this is technically **backwards incompatible** so please check your log parsers. -- By default, logger names now use a long-form path, e.g. ``[scrapy.extensions.logstats]``, - instead of the shorter "top-level" variant of prior releases (e.g. ``[scrapy]``); - this is **backwards incompatible** if you have log parsers expecting the short - logger name part. You can switch back to short logger names using :setting:`LOG_SHORT_NAMES` - set to ``True``. - Scrapy 1.2.2 (2016-12-06) ------------------------- From b9e7ca044cfb82fc9592cef7e2fdcfa422fe8d44 Mon Sep 17 00:00:00 2001 From: Paul Tremberth Date: Wed, 21 Dec 2016 16:11:19 +0100 Subject: [PATCH 7/7] Reword things a tiny bit --- docs/news.rst | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/docs/news.rst b/docs/news.rst index f42edba30..6690ca558 100644 --- a/docs/news.rst +++ b/docs/news.rst @@ -8,8 +8,10 @@ Scrapy 1.3.0 (2016-12-XX) This release comes rather soon after 1.2.2 for one main reason: it was found out that releases since 0.18 up to 1.2.2 (included) use -some backported code from Twisted, even if newer Twisted modules are available. +some backported code from Twisted (``scrapy.xlib.tx.*``), +even if newer Twisted modules are available. Scrapy now uses ``twisted.web.client`` and ``twisted.internet.endpoints`` directly. +(See also cleanups below.) As it is a major change, we wanted to get the bug fix out quickly while not breaking any projects using the 1.2 series.