RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
9,319 Commits 42 Branches 132 Tags 161 MiB
Commit Graph

9319 Commits

Author SHA1 Message Date
Andrey Rahmatullin 125d0fcb8b
Merge pull request #5649 from oscard0m/patch-1 
ci(tests-windows): upgrade actions/setup-python to v4
 2022-10-03 17:13:05 +05:00
Andrey Rahmatullin 94f5737169
Merge pull request #5650 from oscard0m/patch-2 
ci(tests-windows): upgrade actions/checkout to v3
 2022-10-03 17:12:47 +05:00
Andrey Rahmatullin 029591616c
Merge pull request #5651 from oscard0m/patch-3 
ci(test-macos): upgrade actions/checkout to v3
 2022-10-03 17:12:35 +05:00
Andrey Rahmatullin c962dae420
Merge pull request #5652 from oscard0m/patch-4 
ci(test-macos): upgrade actions/setup-python to v4
 2022-10-03 17:11:52 +05:00
Andrey Rahmatullin a193d14af2
Merge pull request #5657 from elacuesta/crawlspider-support-async-def-callback 
CrawlSpider: add support for async callbacks
 2022-10-03 17:09:53 +05:00
Andrey Rahmatullin 2d1c0552f5
Merge pull request #5656 from armujahid/twinecheck 
CI: add Twine check in check workflow
 2022-10-03 17:00:35 +05:00
Andrey Rahmatullin a7f916b96f
Merge pull request #5661 from felipeands/refact/improve-code-base 
refact: add Osx DS_Store file to gitignore
 2022-10-03 16:54:16 +05:00
Felipe A 41041ae740
refact: add Osx DS_Store file to gitignore 2022-10-03 00:48:12 -03:00
Eugenio Lacuesta da8f915091
Adapt for asyng generator callbacks 2022-10-02 17:37:10 -03:00
Mikhail Korobov 4f296b61b0
Merge pull request #5608 from zaid-ismail031/master 
Changed incorrect info in documentation regarding the return type of parse method.
 2022-10-03 00:19:08 +05:00
Eugenio Lacuesta 80194f1c03
CrawlSpider: add support for async def callbacks 2022-10-02 15:22:06 -03:00
Abdul Rauf 69bf5c6625 CI: move twinecheck to tox env 2022-10-02 20:27:24 +05:00
Abdul Rauf c7d800ab22 CI: add Twine check in check workflow 2022-10-02 19:12:48 +05:00
Oscar Dominguez af95331296
ci(test-macos): upgrade actions/setup-python to v4 2022-10-01 20:27:23 +02:00
Oscar Dominguez 1a2cb61e22
ci(test-macos): upgrade actions/checkout to v3 2022-10-01 20:27:10 +02:00
Oscar Dominguez 9fcbf3bcbc
ci(tests-windows): upgrade actions/checkout to v3 2022-10-01 19:38:16 +02:00
Oscar Dominguez c3f35d2ad7
ci(tests-windows): upgrade actions/setup-python to v4 2022-10-01 19:37:51 +02:00
Mikhail Korobov 1445ebd229
Merge pull request #5641 from Gallaecio/2.6.3-release-notes-for-master 
Copy 2.6.3 release notes from the 2.6 branch
 2022-09-27 20:53:56 +05:00
Adrián Chaves 1d79994dcc Copy 2.6.3 release notes from the 2.6 branch 2022-09-27 17:01:33 +02:00
Mikhail Korobov 07b079defd
Merge pull request #5634 from gliptak/tls1 
Cleanup METHOD_SSLv3
 2022-09-26 18:19:05 +05:00
Gábor Lipták 79a4bc3da0
Cleanup METHOD_SSLv3 
Signed-off-by: Gábor Lipták <gliptak@gmail.com>
 2022-09-25 17:01:43 -04:00
Mikhail Korobov 14b1565285
Merge pull request #5632 from gliptak/ssl1 
Match pyOpenSSL and service_identity to Twisted
 2022-09-25 23:06:45 +05:00
Gábor Lipták 385acd5598
Match pyOpenSSL and service_identity to Twisted 
Signed-off-by: Gábor Lipták <gliptak@gmail.com>
 2022-09-24 21:33:02 -04:00
Tim B 5f19420211
Documented how settings must be picklable (#5629) 
Co-authored-by: Adrián Chaves <adrian@chaves.io>
Co-authored-by: Laerte Pereira <5853172+Laerte@users.noreply.github.com>
 2022-09-21 08:27:27 +02:00
Gábor Lipták 1429aa011c
Update test-standard link in contributing docs (#5631) 2022-09-20 18:47:20 +02:00
Mikhail Korobov 681d114e21
Merge pull request #5624 from magsen/master 
fix: typo in tutorial
 2022-09-14 20:40:49 +05:00
Magsen (CD) ce0ca51485
fix: typo in tutorial 
fix: typo in tutorial
 2022-09-13 12:07:58 +02:00
Mikhail Korobov 90b8503789
Merge pull request #5611 from mtabbasi/issue-5601 
BOM should take precedence over Content-Type header when detecting the encoding

Fixes GH-5601.
 2022-09-13 15:07:50 +05:00
zaid-ismail031 3cf97e4e20 Merge branch 'master' of https://github.com/scrapy/scrapy 2022-09-11 22:44:28 +02:00
Andrey Rahmatullin 3f060aeb56
Merge pull request #5617 from Laerte/fix/tests-w3lib 
Fix failed tests related to w3lib
 2022-09-07 12:52:41 +05:00
Laerte Pereira 582a6bf6db
refactor: Use `safe_url_string` to standardize url output 2022-09-06 10:03:18 -03:00
Laerte Pereira 1289422284
chore: Skip `test_ipv6_default_name_resolver` test if w3lib version >= 2.0.0 2022-09-06 08:17:58 -03:00
Laerte Pereira f4bcc3e67d
fix: failed tests 2022-09-06 01:15:41 -03:00
Mohammadtaher Abbasi a988c4b78b add test 2022-08-29 17:08:30 +04:30
Mohammadtaher Abbasi e411ea94eb BOM should take precedence over Content-Type header when detecting the encoding closes #5601 2022-08-28 20:28:13 +04:30
zaid-ismail031 c49b5aaf77 Changed incorrect information regarding the return type of parse/request callback method. 2022-08-26 21:17:31 +02:00
Mikhail Korobov 52d93490f5
Merge pull request #4978 from wRAR/asyncio-parse-asyncgen-proper-rebased 
Support for async callbacks
 2022-07-30 00:34:37 +05:00
Andrey Rakhmatullin c7b90c6e1e Extract more common code. 2022-07-28 13:44:36 +05:00
Andrey Rahmatullin 0f1112f3e2
Update docs/index.rst 
Co-authored-by: Adrián Chaves <adrian@chaves.io>
 2022-07-27 23:12:43 +05:00
Andrey Rahmatullin 83ecdf1bca
Update docs/topics/components.rst 
Co-authored-by: Adrián Chaves <adrian@chaves.io>
 2022-07-27 23:12:31 +05:00
Andrey Rahmatullin faa12d1fbe
Merge pull request #2 from scrapy/asyncio-parse-fixes 
Asyncio parse fixes
 2022-07-27 12:30:09 +05:00
Aftab Alam 67011cd957
updated README.rst , added hyperlink to banner (#5284) 
Co-authored-by: Mikhail Korobov <kmike84@gmail.com>
 2022-07-27 09:50:26 +05:00
Mikhail Korobov 56e2eeac10 fix typing issues by upgrading mypy 2022-07-27 09:41:12 +05:00
Mikhail Korobov 4dde2f2c36 Merge branch 'master' into asyncio-parse-fixes 2022-07-27 09:32:54 +05:00
Adrián Chaves 5862f6b8e1
Update frozen CI packages (#5574) 2022-07-25 17:25:10 +02:00
Adrián Chaves 737f39613c
Merge pull request #5573 from Gallaecio/2.6-into-master 
Merge 2.6 into the main branch
 2022-07-25 14:52:39 +02:00
Adrián Chaves 00ccb02f1f Merge remote-tracking branch 'upstream/2.6' 2022-07-25 14:13:22 +02:00
Adrián Chaves aecbccbaa5 Bump version: 2.6.1 → 2.6.2 2022-07-25 13:33:23 +02:00
Adrián Chaves af7dd16d8d
Merge pull request from GHSA-9x8m-2xpf-crp3 
* Enforce matching proxy request meta and Proxy-Authorization header

* Cover proxy credential security fix in the release notes

* Remove extra empty line

* Reword the security issue description

* Address scenario where Proxy-Authorization is unexpectedly removed by a prior middleware

* Set the release date of Scrapy 2.6.2 and 1.8.3
 2022-07-25 13:15:17 +02:00
Andrey Rakhmatullin b21c16099e Fix flake8 issues. 2022-07-22 19:18:33 +05:00