RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
10,393 Commits 49 Branches 132 Tags 133 MiB
Commit Graph

10393 Commits

Author SHA1 Message Date
Abdul Rauf c7d800ab22 CI: add Twine check in check workflow 2022-10-02 19:12:48 +05:00
Gábor Lipták 759ad5dee4
Require packaging 2022-10-02 09:09:04 -04:00
Oscar Dominguez af95331296
ci(test-macos): upgrade actions/setup-python to v4 2022-10-01 20:27:23 +02:00
Oscar Dominguez 1a2cb61e22
ci(test-macos): upgrade actions/checkout to v3 2022-10-01 20:27:10 +02:00
Oscar Dominguez 9fcbf3bcbc
ci(tests-windows): upgrade actions/checkout to v3 2022-10-01 19:38:16 +02:00
Oscar Dominguez c3f35d2ad7
ci(tests-windows): upgrade actions/setup-python to v4 2022-10-01 19:37:51 +02:00
Gábor Lipták 116d9a9748
Correct distutils deprecation warning 
Signed-off-by: Gábor Lipták <gliptak@gmail.com>
 2022-09-30 22:58:17 -04:00
Gábor Lipták 9f006e3aa5 Match pyOpenSSL and types-pyOpenSSL versions 
Signed-off-by: Gábor Lipták <gliptak@gmail.com>
 2022-09-30 22:27:57 -04:00
Laerte Pereira 3ca7877781
chore: Skip `batch_path_differ` test on Windows 2022-09-29 11:51:50 -03:00
Mikhail Korobov 1445ebd229
Merge pull request #5641 from Gallaecio/2.6.3-release-notes-for-master 
Copy 2.6.3 release notes from the 2.6 branch
 2022-09-27 20:53:56 +05:00
Adrián Chaves 1d79994dcc Copy 2.6.3 release notes from the 2.6 branch 2022-09-27 17:01:33 +02:00
Mikhail Korobov 07b079defd
Merge pull request #5634 from gliptak/tls1 
Cleanup METHOD_SSLv3
 2022-09-26 18:19:05 +05:00
Gábor Lipták 79a4bc3da0
Cleanup METHOD_SSLv3 
Signed-off-by: Gábor Lipták <gliptak@gmail.com>
 2022-09-25 17:01:43 -04:00
Mikhail Korobov 14b1565285
Merge pull request #5632 from gliptak/ssl1 
Match pyOpenSSL and service_identity to Twisted
 2022-09-25 23:06:45 +05:00
Gábor Lipták 385acd5598
Match pyOpenSSL and service_identity to Twisted 
Signed-off-by: Gábor Lipták <gliptak@gmail.com>
 2022-09-24 21:33:02 -04:00
Tim B 5f19420211
Documented how settings must be picklable (#5629) 
Co-authored-by: Adrián Chaves <adrian@chaves.io>
Co-authored-by: Laerte Pereira <5853172+Laerte@users.noreply.github.com>
 2022-09-21 08:27:27 +02:00
Gábor Lipták 1429aa011c
Update test-standard link in contributing docs (#5631) 2022-09-20 18:47:20 +02:00
Mikhail Korobov 681d114e21
Merge pull request #5624 from magsen/master 
fix: typo in tutorial
 2022-09-14 20:40:49 +05:00
Adrián Chaves 77c055ee28 Relax Proxy-Authorization restrictions 2022-09-14 14:47:14 +02:00
Magsen (CD) ce0ca51485
fix: typo in tutorial 
fix: typo in tutorial
 2022-09-13 12:07:58 +02:00
Mikhail Korobov 90b8503789
Merge pull request #5611 from mtabbasi/issue-5601 
BOM should take precedence over Content-Type header when detecting the encoding

Fixes GH-5601.
 2022-09-13 15:07:50 +05:00
zaid-ismail031 3cf97e4e20 Merge branch 'master' of https://github.com/scrapy/scrapy 2022-09-11 22:44:28 +02:00
Andrey Rahmatullin 3f060aeb56
Merge pull request #5617 from Laerte/fix/tests-w3lib 
Fix failed tests related to w3lib
 2022-09-07 12:52:41 +05:00
Laerte Pereira 582a6bf6db
refactor: Use `safe_url_string` to standardize url output 2022-09-06 10:03:18 -03:00
Laerte Pereira 1289422284
chore: Skip `test_ipv6_default_name_resolver` test if w3lib version >= 2.0.0 2022-09-06 08:17:58 -03:00
Laerte Pereira f4bcc3e67d
fix: failed tests 2022-09-06 01:15:41 -03:00
Mohammadtaher Abbasi a988c4b78b add test 2022-08-29 17:08:30 +04:30
Mohammadtaher Abbasi e411ea94eb BOM should take precedence over Content-Type header when detecting the encoding closes #5601 2022-08-28 20:28:13 +04:30
zaid-ismail031 c49b5aaf77 Changed incorrect information regarding the return type of parse/request callback method. 2022-08-26 21:17:31 +02:00
Alexandr N. Zamaraev 13c5ad7e68
Partial in is_generator_with_return_value 
See path in #5592
 2022-08-16 11:03:37 +07:00
GeorgeA92 aabdd0b657 per slot settings: logger deleted as not used (step 2) 2022-08-12 15:34:48 +03:00
Mikhail Korobov 52d93490f5
Merge pull request #4978 from wRAR/asyncio-parse-asyncgen-proper-rebased 
Support for async callbacks
 2022-07-30 00:34:37 +05:00
Adrián Chaves d599fff2b9 Test the life cycle of a storage file 2022-07-29 19:12:20 +02:00
GeorgeA92 4be9c969fd per slot settings: logger deleted as not used 2022-07-29 12:15:39 +03:00
felipeboffnunes 5735e93541 fix_post_processing_feed_export 2022-07-28 18:37:21 -03:00
Andrey Rakhmatullin c7b90c6e1e Extract more common code. 2022-07-28 13:44:36 +05:00
Andrey Rahmatullin 0f1112f3e2
Update docs/index.rst 
Co-authored-by: Adrián Chaves <adrian@chaves.io>
 2022-07-27 23:12:43 +05:00
Andrey Rahmatullin 83ecdf1bca
Update docs/topics/components.rst 
Co-authored-by: Adrián Chaves <adrian@chaves.io>
 2022-07-27 23:12:31 +05:00
Andrey Rahmatullin faa12d1fbe
Merge pull request #2 from scrapy/asyncio-parse-fixes 
Asyncio parse fixes
 2022-07-27 12:30:09 +05:00
Aftab Alam 67011cd957
updated README.rst , added hyperlink to banner (#5284) 
Co-authored-by: Mikhail Korobov <kmike84@gmail.com>
 2022-07-27 09:50:26 +05:00
Mikhail Korobov 56e2eeac10 fix typing issues by upgrading mypy 2022-07-27 09:41:12 +05:00
Mikhail Korobov 4dde2f2c36 Merge branch 'master' into asyncio-parse-fixes 2022-07-27 09:32:54 +05:00
Adrián Chaves 5862f6b8e1
Update frozen CI packages (#5574) 2022-07-25 17:25:10 +02:00
Adrián Chaves 737f39613c
Merge pull request #5573 from Gallaecio/2.6-into-master 
Merge 2.6 into the main branch
 2022-07-25 14:52:39 +02:00
Adrián Chaves 00ccb02f1f Merge remote-tracking branch 'upstream/2.6' 2022-07-25 14:13:22 +02:00
Adrián Chaves aecbccbaa5 Bump version: 2.6.1 → 2.6.2 2022-07-25 13:33:23 +02:00
Adrián Chaves af7dd16d8d
Merge pull request from GHSA-9x8m-2xpf-crp3 
* Enforce matching proxy request meta and Proxy-Authorization header

* Cover proxy credential security fix in the release notes

* Remove extra empty line

* Reword the security issue description

* Address scenario where Proxy-Authorization is unexpectedly removed by a prior middleware

* Set the release date of Scrapy 2.6.2 and 1.8.3
 2022-07-25 13:15:17 +02:00
Andrey Rakhmatullin b21c16099e Fix flake8 issues. 2022-07-22 19:18:33 +05:00
Andrey Rahmatullin a0681fb811
Merge branch 'master' into asyncio-parse-asyncgen-proper-rebased 2022-07-22 18:30:38 +05:00
Andrey Rahmatullin dc67100a8f
Merge pull request #1 from Gallaecio/asyncio-parse-asyncgen-proper-rebased 
Refactor the asynchronous process_spider_output documentation
 2022-07-22 18:28:56 +05:00