RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
9,327 Commits 49 Branches 132 Tags 129 MiB
Commit Graph

9327 Commits

Author SHA1 Message Date
Abinash Satapathy e60e8224a2
Update and rename INSTALL to INSTALL.md 2022-10-06 19:58:48 +02:00
Andrey Rahmatullin d96c465dde
Merge pull request #5639 from Laerte/fix/test_batch_path_differ 
fix: `batch_path_differ` test
 2022-10-05 14:44:30 +05:00
Andrey Rahmatullin 28d65c88b1
Merge pull request #5662 from gliptak/pyopenssl1 
Match pyOpenSSL and types-pyOpenSSL versions
 2022-10-04 12:54:30 +05:00
Mikhail Korobov 019e1c3c5e
Merge pull request #5645 from gliptak/version1 
Correct distutils deprecation warning
 2022-10-04 11:12:04 +05:00
Andrey Rahmatullin 125d0fcb8b
Merge pull request #5649 from oscard0m/patch-1 
ci(tests-windows): upgrade actions/setup-python to v4
 2022-10-03 17:13:05 +05:00
Andrey Rahmatullin 94f5737169
Merge pull request #5650 from oscard0m/patch-2 
ci(tests-windows): upgrade actions/checkout to v3
 2022-10-03 17:12:47 +05:00
Andrey Rahmatullin 029591616c
Merge pull request #5651 from oscard0m/patch-3 
ci(test-macos): upgrade actions/checkout to v3
 2022-10-03 17:12:35 +05:00
Andrey Rahmatullin c962dae420
Merge pull request #5652 from oscard0m/patch-4 
ci(test-macos): upgrade actions/setup-python to v4
 2022-10-03 17:11:52 +05:00
Andrey Rahmatullin a193d14af2
Merge pull request #5657 from elacuesta/crawlspider-support-async-def-callback 
CrawlSpider: add support for async callbacks
 2022-10-03 17:09:53 +05:00
Andrey Rahmatullin 2d1c0552f5
Merge pull request #5656 from armujahid/twinecheck 
CI: add Twine check in check workflow
 2022-10-03 17:00:35 +05:00
Andrey Rahmatullin a7f916b96f
Merge pull request #5661 from felipeands/refact/improve-code-base 
refact: add Osx DS_Store file to gitignore
 2022-10-03 16:54:16 +05:00
Felipe A 41041ae740
refact: add Osx DS_Store file to gitignore 2022-10-03 00:48:12 -03:00
Eugenio Lacuesta da8f915091
Adapt for asyng generator callbacks 2022-10-02 17:37:10 -03:00
Mikhail Korobov 4f296b61b0
Merge pull request #5608 from zaid-ismail031/master 
Changed incorrect info in documentation regarding the return type of parse method.
 2022-10-03 00:19:08 +05:00
Eugenio Lacuesta 80194f1c03
CrawlSpider: add support for async def callbacks 2022-10-02 15:22:06 -03:00
Abdul Rauf 69bf5c6625 CI: move twinecheck to tox env 2022-10-02 20:27:24 +05:00
Abdul Rauf c7d800ab22 CI: add Twine check in check workflow 2022-10-02 19:12:48 +05:00
Gábor Lipták 759ad5dee4
Require packaging 2022-10-02 09:09:04 -04:00
Oscar Dominguez af95331296
ci(test-macos): upgrade actions/setup-python to v4 2022-10-01 20:27:23 +02:00
Oscar Dominguez 1a2cb61e22
ci(test-macos): upgrade actions/checkout to v3 2022-10-01 20:27:10 +02:00
Oscar Dominguez 9fcbf3bcbc
ci(tests-windows): upgrade actions/checkout to v3 2022-10-01 19:38:16 +02:00
Oscar Dominguez c3f35d2ad7
ci(tests-windows): upgrade actions/setup-python to v4 2022-10-01 19:37:51 +02:00
Gábor Lipták 116d9a9748
Correct distutils deprecation warning 
Signed-off-by: Gábor Lipták <gliptak@gmail.com>
 2022-09-30 22:58:17 -04:00
Gábor Lipták 9f006e3aa5 Match pyOpenSSL and types-pyOpenSSL versions 
Signed-off-by: Gábor Lipták <gliptak@gmail.com>
 2022-09-30 22:27:57 -04:00
Laerte Pereira 3ca7877781
chore: Skip `batch_path_differ` test on Windows 2022-09-29 11:51:50 -03:00
Mikhail Korobov 1445ebd229
Merge pull request #5641 from Gallaecio/2.6.3-release-notes-for-master 
Copy 2.6.3 release notes from the 2.6 branch
 2022-09-27 20:53:56 +05:00
Adrián Chaves 1d79994dcc Copy 2.6.3 release notes from the 2.6 branch 2022-09-27 17:01:33 +02:00
Mikhail Korobov 07b079defd
Merge pull request #5634 from gliptak/tls1 
Cleanup METHOD_SSLv3
 2022-09-26 18:19:05 +05:00
Gábor Lipták 79a4bc3da0
Cleanup METHOD_SSLv3 
Signed-off-by: Gábor Lipták <gliptak@gmail.com>
 2022-09-25 17:01:43 -04:00
Mikhail Korobov 14b1565285
Merge pull request #5632 from gliptak/ssl1 
Match pyOpenSSL and service_identity to Twisted
 2022-09-25 23:06:45 +05:00
Gábor Lipták 385acd5598
Match pyOpenSSL and service_identity to Twisted 
Signed-off-by: Gábor Lipták <gliptak@gmail.com>
 2022-09-24 21:33:02 -04:00
Tim B 5f19420211
Documented how settings must be picklable (#5629) 
Co-authored-by: Adrián Chaves <adrian@chaves.io>
Co-authored-by: Laerte Pereira <5853172+Laerte@users.noreply.github.com>
 2022-09-21 08:27:27 +02:00
Gábor Lipták 1429aa011c
Update test-standard link in contributing docs (#5631) 2022-09-20 18:47:20 +02:00
Mikhail Korobov 681d114e21
Merge pull request #5624 from magsen/master 
fix: typo in tutorial
 2022-09-14 20:40:49 +05:00
Magsen (CD) ce0ca51485
fix: typo in tutorial 
fix: typo in tutorial
 2022-09-13 12:07:58 +02:00
Mikhail Korobov 90b8503789
Merge pull request #5611 from mtabbasi/issue-5601 
BOM should take precedence over Content-Type header when detecting the encoding

Fixes GH-5601.
 2022-09-13 15:07:50 +05:00
zaid-ismail031 3cf97e4e20 Merge branch 'master' of https://github.com/scrapy/scrapy 2022-09-11 22:44:28 +02:00
Andrey Rahmatullin 3f060aeb56
Merge pull request #5617 from Laerte/fix/tests-w3lib 
Fix failed tests related to w3lib
 2022-09-07 12:52:41 +05:00
Laerte Pereira 582a6bf6db
refactor: Use `safe_url_string` to standardize url output 2022-09-06 10:03:18 -03:00
Laerte Pereira 1289422284
chore: Skip `test_ipv6_default_name_resolver` test if w3lib version >= 2.0.0 2022-09-06 08:17:58 -03:00
Laerte Pereira f4bcc3e67d
fix: failed tests 2022-09-06 01:15:41 -03:00
Mohammadtaher Abbasi a988c4b78b add test 2022-08-29 17:08:30 +04:30
Mohammadtaher Abbasi e411ea94eb BOM should take precedence over Content-Type header when detecting the encoding closes #5601 2022-08-28 20:28:13 +04:30
zaid-ismail031 c49b5aaf77 Changed incorrect information regarding the return type of parse/request callback method. 2022-08-26 21:17:31 +02:00
Mikhail Korobov 52d93490f5
Merge pull request #4978 from wRAR/asyncio-parse-asyncgen-proper-rebased 
Support for async callbacks
 2022-07-30 00:34:37 +05:00
Andrey Rakhmatullin c7b90c6e1e Extract more common code. 2022-07-28 13:44:36 +05:00
Andrey Rahmatullin 0f1112f3e2
Update docs/index.rst 
Co-authored-by: Adrián Chaves <adrian@chaves.io>
 2022-07-27 23:12:43 +05:00
Andrey Rahmatullin 83ecdf1bca
Update docs/topics/components.rst 
Co-authored-by: Adrián Chaves <adrian@chaves.io>
 2022-07-27 23:12:31 +05:00
Andrey Rahmatullin faa12d1fbe
Merge pull request #2 from scrapy/asyncio-parse-fixes 
Asyncio parse fixes
 2022-07-27 12:30:09 +05:00
Aftab Alam 67011cd957
updated README.rst , added hyperlink to banner (#5284) 
Co-authored-by: Mikhail Korobov <kmike84@gmail.com>
 2022-07-27 09:50:26 +05:00