From 851adcedf2220a783cdfb2d6b5872580e18b8d88 Mon Sep 17 00:00:00 2001 From: Paul Tremberth Date: Mon, 6 Mar 2017 23:36:21 +0100 Subject: [PATCH] List merged pull requests since 1.3.3 --- docs/news.rst | 73 +++++++++++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 73 insertions(+) diff --git a/docs/news.rst b/docs/news.rst index da856d883..675a6d595 100644 --- a/docs/news.rst +++ b/docs/news.rst @@ -3,6 +3,78 @@ Release notes ============= +Scrapy 1.4.0 (2017-XX-XX) +------------------------- + +New Features +~~~~~~~~~~~~ + +- Use credentials from request.meta['proxy'] #2530 +- [httpcompression] add support for br - brotli content encoding #2535 +- Enable memusage extension by default. #2539 +- response.follow #2540 +- add flags to request #2082 +- Support Anonymous FTP #2343 +- HttpErrorMiddleware stats #2566 +- Retry stats #2543 +- Set canonicalize=False for LinkExtractor #2537 +- Referrer policies in RefererMiddleware #2306 +- Fix referrer policy from response headers and support explicit empty string #2627 +- Data URI download handler. #2334 +- HttpCacheMiddleware: log cache directory at instantiation #2611 +- Add warning on duplicate spider name #2612 +- Allowed passing objects of Mapping class or its subclass to the CaselessDict initializer #2646 +- Allow redirections in media files downloads #2616 +- Travis CI: use portable pypy for Linux #2710 + + +Bug fixes +~~~~~~~~~ + +- LinkExtractors: strip whitespaces #2547 +- FormRequest: handle whitespaces in action attribute properly #2548 +- Buffer CONNECT response bytes from proxy until all HTTP headers are received #2495 +- Fix FTP downloader and re-enable FTP tests on Python 3 #2599 +- Handle data loss gracefully. #2590 +- Use body to choose response type after decompression content #2393 +- Always decompress Content-Encoding: gzip at HttpCompression stage #2391 +- Respect custom log level (#2581, fixes #1612) +- [logformatter] 'flags' format spec backward compatibility #2649 +- 'make htmlview' does not open the webbrowser #2661 +- Remove "commands" from the command list #2695 + +Cleanups +~~~~~~~~ + +- TST remove temp files and folders #2570 +- TST fixed ProjectUtilsTest on OS X #2569 +- Separate building request from _requests_to_follow in CrawlSpider #2562 +- remove “Python 3 progress” badge #2567 +- add a couple more lines to gitignore #2557 +- deprecate Spider.make_requests_from_url. #1728 +- Remove bumpversion prerelease configuration #2159 +- Set context factory implementation based on Twisted version #2577 +- Add omitted "self" arguments #2595 +- Remove redundant slot.add_request() call in ExecutionEngine #2617 +- Removed contrib section in contribution documentation #2636 +- More specific exception catching: os.path.getmtime can only raise os.error in FSFilesStore #2644 + +Documentation +~~~~~~~~~~~~~ + +- Doc: binary mode is required for exporters #2564 +- document issue with FormRequest.from_response due to bug in lxml #2572 +- Use single quotes uniformly #2596 +- Document ftp_user and ftp_password meta keys #2587 +- Update release notes for 1.0.7, 1.1.4 and 1.2.3 #2625 +- DOC Mention brotli support in HttpCompressionMiddleware section #2628 +- Removed contrib section in contribution documentation #2636 +- docs: installation instructions, mention conda in the beginning (closes #2475) #2477 +- FAQ Rewrite note on Python 3 support on Windows #2690 +- DOC Rearrange selector sections #2705 +- Remove __nonzero__ from SelectorList docs #2683 + + Scrapy 1.3.3 (2017-03-10) ------------------------- @@ -15,6 +87,7 @@ Bug fixes A new setting is introduced to toggle between warning or exception if needed ; see :setting:`SPIDER_LOADER_WARN_ONLY` for details. + Scrapy 1.3.2 (2017-02-13) -------------------------