cd0d3fd48d
Merge pull request #4705 from Gallaecio/deprecation-policy
...
Cover our deprecation policy in the documentation
2020-08-14 00:27:37 +05:00
1f44464a4a
Merge pull request #4723 from Gallaecio/windows
...
test_utils_iterators.py: support Windows the right way
2020-08-14 00:23:55 +05:00
65e0abaea5
Document FEED_URI_PARAMS
2020-08-13 09:05:51 +02:00
24ba5a71ac
Maybe the problem is not in the code after all
2020-08-13 06:35:09 +02:00
5f4df622a1
test_utils_iterators.py: support Windows the right way
2020-08-13 05:41:06 +02:00
4c0afb606c
Update permission expectations
2020-08-12 17:45:26 +02:00
125a058340
Do not let umask affect the permissions of startproject-generated files
2020-08-12 17:07:21 +02:00
b1de55d37d
Fix marker syntax
2020-08-12 12:34:40 +02:00
8e393a0b21
Do not change the mitmproxy version for no-3.6 Python versions
2020-08-12 12:29:51 +02:00
394631fc0a
Restore 3.5 support for mitmproxy-based tests
2020-08-12 12:08:09 +02:00
1c4b4cc6b0
Support defining file path based on item in media pipelines ( #4686 )
2020-08-11 14:12:44 +02:00
b2f4df5cb7
Merge remote-tracking branch 'upstream/master' into documentation-build
2020-08-11 13:16:14 +02:00
aefd43a6c6
Upgrade minimum dependencies for Python 3.6 support
2020-08-11 12:52:54 +02:00
0cf1340c29
Merge pull request #4663 from ajaymittur28/scrapy-check-test
...
Add Tests to `scrapy check` command
2020-08-10 16:18:29 +05:00
702de0480b
Merge pull request #4564 from jacty/patch-1
...
Unnecessary update when value is None
2020-08-10 16:14:42 +05:00
cad84458ac
Merge pull request #4714 from linchiwei123/fix
...
Remove duplicated install_requires
2020-08-06 12:17:04 +05:00
4dc09f09aa
Update setup.py
2020-08-05 22:23:19 +08:00
1f0722c87e
Merge pull request #4701 from kshitijcode/weakkeycache-cleanup-4684
...
Code cleanup scrapy.utils.python.WeakKeyCache #4684
2020-08-05 17:48:41 +05:00
983b7ddf2e
aesthetic fixes
2020-08-05 16:13:52 +05:30
b35d1f2b2c
deleted tester.py
2020-08-05 09:14:04 +05:30
9d84289109
deprecated weakkeycache by specifying in __init__
2020-08-05 09:11:59 +05:30
336f19f5cc
Change super syntax ( #4707 )
2020-08-04 20:42:01 +02:00
4ee538e44b
Update unicode references from Python 2 times in the documentation ( #4703 )
2020-08-04 20:34:11 +02:00
1278e76d90
Bump version: 2.2.0 → 2.3.0
2020-08-04 20:07:02 +02:00
3600582f56
Cover Scrapy 2.2.1 and 2.3 in the release notes ( #4708 )
2020-08-04 20:05:56 +02:00
015b71d89f
Merge pull request #4704 from Gallaecio/python2-u-prefixes
...
Remove the u prefix from strings
2020-07-31 01:23:00 +05:00
5ec66be4a4
Merge branch 'master' into obsolete-s3feednokeys
2020-07-30 22:18:00 +02:00
6f4ccec567
Cover our deprecation policy in the documentation
2020-07-30 14:03:14 +02:00
890b2138a6
Remove the u prefix from strings
2020-07-30 13:39:30 +02:00
49337bd2ae
Code cleanup scrapy.utils.python.WeakKeyCache #4684 and fixing ci alerts
2020-07-30 12:25:21 +05:30
33ddc3d4f3
Trigger CI
2020-07-30 09:47:08 +05:30
5e2d1bd187
Merge pull request #4434 from BroodingKangaroo/ISSUE-4250-add_batch_deliveries
...
Feed exports: add batch deliveries
2020-07-29 23:03:28 +05:00
403bc7020a
Code cleanup scrapy.utils.python.WeakKeyCache #4684 and fixing ci alerts
2020-07-29 18:05:33 +05:30
e7a58fe157
Code cleanup scrapy.utils.python.WeakKeyCache #4684
2020-07-29 10:16:18 +05:30
5265853937
Use ItemAdapter.field_names when writing header in CsvItemExporter ( #4668 )
2020-07-28 11:15:14 +02:00
a6c1d79b7c
pep8 tiny changes
2020-07-28 11:53:05 +03:00
ce0c25fc85
Merge pull request #4690 from elacuesta/typing-setup-remove-monkeypatches
...
Remove monkeypatches module from mypy section in setup.cfg
2020-07-23 17:56:08 +05:00
8fae3d5bb7
Remove monkeypatches module from mypy section in setup.cfg
2020-07-22 16:08:35 -03:00
430d22e46e
Remove not used import warnings
2020-07-21 23:39:04 +02:00
2829cd4268
Allow use without credentials
2020-07-21 23:38:02 +02:00
98e8086d1b
Adapt S3FeedStorage testcase
2020-07-21 23:38:02 +02:00
234c8b8c50
Removing deprecated S3FeedStorage without AWS keys instancing.
2020-07-21 23:38:01 +02:00
ece4fa6c7c
Fix ignored testcase: boto is never installed
2020-07-21 23:38:01 +02:00
f3372a3753
Merge pull request #4254 from elacuesta/spider.parse
...
Change Scraper API to call internal `_parse` method
2020-07-21 17:37:54 +05:00
de297a3a16
enable ANSI color (instead of ANSI color codes) in the Windows terminal #4393 ( #4403 )
...
* changed ie. -> i.e.(spelling error) on lines 667, 763 (issue scrapy#4332)
* updated all text files for issue #4332 (ie. -> i.e.)
* Apply ie. → i.e. in source comments
* ie → e.g.
* modified scrapy/utils/display.py to stop ANSI color sequences in the Windows terminal (issue #4393 )
* modified scrapy/utils/display.py to stop ANSI color sequences in the Windows terminal (issue #4393 )
* enabled virtual terminal processing (pr #4403 )
* check for specific windows 10 version (pr #4403 )
* fixing flake-8 test (pr #4403 )
* added error handling for terminal info (pr #4403 )
* corrected stderr (pr #4403 )
* changed orientation, removed unwanted spaces (pr #4403 )
* no need for style variable (pr #4403 )
* fixing trailing whitespaces
* commenting windows check
* Update scrapy/utils/display.py
Co-Authored-By: Adrián Chaves <adrian@chaves.io>
* Update scrapy/utils/display.py
Co-Authored-By: Adrián Chaves <adrian@chaves.io>
* Update scrapy/utils/display.py
Co-Authored-By: Adrián Chaves <adrian@chaves.io>
* Update scrapy/utils/display.py
Co-Authored-By: Adrián Chaves <adrian@chaves.io>
* small fixes
* Shifting _color_support_info() function
* enabled virtual terminal processing (pr #4403 )
* check for specific windows 10 version (pr #4403 )
* fixing flake-8 test (pr #4403 )
* added error handling for terminal info (pr #4403 )
* corrected stderr (pr #4403 )
* changed orientation, removed unwanted spaces (pr #4403 )
* no need for style variable (pr #4403 )
* fixing trailing whitespaces
* commenting windows check
* Update scrapy/utils/display.py
Co-Authored-By: Adrián Chaves <adrian@chaves.io>
* Update scrapy/utils/display.py
Co-Authored-By: Adrián Chaves <adrian@chaves.io>
* Update scrapy/utils/display.py
Co-Authored-By: Adrián Chaves <adrian@chaves.io>
* Update scrapy/utils/display.py
Co-Authored-By: Adrián Chaves <adrian@chaves.io>
* small fixes
* Shifting _color_support_info() function
* error handling
* error handlingy
* raise ValueError
* added in-built function for version comparison
* recommit changes
* changed check -> parse
* version comparison -> parse_version
* added scrapy/utils/display.py in pytest.ini
* Trigger
* Add simple test for scrapy.utils.display._colorize
* Flake8: E501 for tests/test_utils_display.py
* assertEquals -> assertEqual
* Normal formatter for all platforms
* separate test for windows
* all curses under try block
* added global TestStr
* more test added
* small fix
* covering exceptions
* windows test failing
* Refactor output color handling
* Fix pprint test
* fix flake8
Co-authored-by: Adrián Chaves <adrian@chaves.io>
Co-authored-by: Eugenio Lacuesta <eugenio.lacuesta@gmail.com>
2020-07-20 17:23:38 +05:00
3e0492741d
Another try to fix test errors on Windows
2020-07-19 00:10:29 +03:00
86f7ac2f2b
Try to fix error at Windows
2020-07-17 18:22:47 +03:00
62a4ede5e9
Remove deprecated classes BaseSgmlLinkExtractor, RegexLinkExtractor and SgmlLinkExtractor ( #4356 )
2020-07-17 12:40:04 +02:00
d29bec60d7
Upgrade PyPy for CI, and test both 3.5 (oldest) and 3.6 (newest) ( #4504 )
...
* Upgrade PyPy for CI, and test both 3.5 (oldest) and 3.6 (newest)
* Log a detailed error message to discover why MockServer is not working
* Go for all lines!
* Disable tests based on mitmproxy while running on PyPy
* Fix test_get_func_args for PyPy 3.6+
* Make testPayloadDefaultCiphers work regardless of OpenSSL default ciphers
* Crossing fingers…
* Rename: testPayloadDefaultCiphers → testPayloadDisabledCipher
* Test the PyPy version currently documented as the minimum required version
* Fix the PYPY_VERSION tag
* Update the documentation about supported PyPy versions
* Also test the latest 3.5 Python version with PyPy
* Fix the PYPY_VERSION value for the latest 3.5 version
* Use pinned dependencies for asyncio and PyPy tests against oldest supported Python versions
* Fix PyPy installation for the pypy3-pinned Tox environment
* Try installing Cython
* Maybe PyPy requires lxml 3.6.0?
* install.rst: minor clarification
* lxml 4.0.0 is required on PyPy
* Require setuptools 18.5+
* Revert "Require setuptools 18.5+"
This reverts commit 017ec33ac2
2020-07-17 02:19:24 +05:00
9a74a71c63
Merge pull request #4682 from noviluni/remove_python2_reminiscence
...
remove python 2 reminiscence in cookies
2020-07-16 23:58:58 +05:00
Mikhail Korobov
Adrián Chaves
Ajay Mittur
Andrey Rahmatullin
linchiwei123
Kshitij Sharma
Marc Hernández
Artur Shellunts
Kshitij Sharma
Eugenio Lacuesta
BroodingKangaroo
Eugenio Lacuesta
nyov
Akshay Sharma