RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
9,921 Commits 42 Branches 132 Tags 162 MiB
Commit Graph

233 Commits

Author SHA1 Message Date
Andrey Rakhmatullin 712ee98848 Merge branch 'master' into typing-utils 2023-06-24 18:31:56 +04:00
Andrey Rakhmatullin 075b89eab5 Bump lxml and cryptography to versions with 3.8 wheels available. 2023-06-18 19:08:41 +04:00
Andrey Rakhmatullin 2122278d4b Drop Python 3.7 support. 2023-06-18 18:37:50 +04:00
Andrey Rakhmatullin 0adbd210ac Fix extra-deps-pinned tests. 2023-06-13 19:34:26 +04:00
Andrey Rakhmatullin 85fe88f80f
Merge pull request #5833 from GodelTech/issue_960_s3_feed_export 
Fix #960: S3 Feed Export throws boto error
 2023-06-13 18:44:06 +04:00
Andrey Rakhmatullin 048812ba35 Bump types-* versions. 2023-05-07 22:40:29 +04:00
Andrey Rakhmatullin 8c8fb67057
Update tool versions (#5908) 2023-04-24 09:34:34 +02:00
Jalil SA 5a37af146f
Update documentation expectations for Parsel 1.8.0 (#5902) 2023-04-21 09:29:57 +02:00
Andrey Rakhmatullin d911837389
Merge pull request #5881 from sbartlett97/LinkExtractor-Patch 
Patched LxmlParserLinkExtractor
 2023-04-12 12:28:21 +04:00
Adrián Chaves 3f0c2fae5e Skip test_skip_bad_links based on the w3lib version 2023-04-12 09:28:28 +02:00
Andrey Rakhmatullin c7730627a0
Typing improvements for some core components (#5889) 2023-04-11 13:47:41 +02:00
jazzthief a17d996da2
Change `boto3` version to 1.20.0 for `extra-deps-pinned` env 2023-03-16 17:20:22 +01:00
Adrián Chaves 590955fac8 Provide separate test environments for botocore and boto3 extras; add extra-deps-pinned and remote extras from pinned 2023-03-15 16:03:44 +01:00
Adrián Chaves 39dbfa1d82 Minimize test reliance on S3; do not install botocore on the default test environments 2023-03-15 15:31:39 +01:00
Andrey Rakhmatullin d7bf39ee78 Fix a merge problem. 2023-02-24 00:28:06 +04:00
Andrey Rakhmatullin 3a40c06ed9 Bump mypy and types-*. 2023-02-24 00:16:49 +04:00
Andrey Rakhmatullin 824641e349 Merge remote-tracking branch 'origin/master' into mypy-imports 2023-02-11 22:02:19 +04:00
Andrey Rakhmatullin b1f33a68ac Bump mypy and types-*. 2023-02-11 21:39:27 +04:00
Adrián Chaves 32a01e32f3 Update pylint exceptions, and run pylint by default with tox 2023-02-02 06:52:01 +01:00
Adrián Chaves b07d3f85a3 Upgrade CI tools 2023-02-02 06:37:40 +01:00
Adrián Chaves 78eaf0671b Remove typing-extensions from tox.ini 2023-01-30 14:33:11 +01:00
Andrey Rakhmatullin 69bb9a7859 Install types-Pillow and types-Pygments. 2023-01-25 23:52:46 +04:00
Andrey Rakhmatullin a4edff31b9 Replace lxml-stubs with types-lxml. 2023-01-25 23:30:21 +04:00
Adrián Chaves 9272c4af0c Merge remote-tracking branch 'scrapy/master' into no-callback 2023-01-25 17:41:41 +01:00
Emmanuel Rondan 8ee4817471 reaplying black, fixing conflicts and ignoring bandit checks on test directory 2023-01-20 10:55:46 -03:00
Adrián Chaves 4242ae405d Restore Python 3.7 support 2023-01-19 20:37:24 +01:00
Adrián Chaves 5c1559f60e Address typing issues 2023-01-19 20:30:22 +01:00
Adrián Chaves 16546564f6 Minimum cryptography: 3.3 → 3.4.6 2023-01-06 20:16:54 +01:00
Andrey Rakhmatullin 3e03004b3c
Merge pull request #5781 from Gallaecio/ci-clang 
Remove Reppy from CI
 2023-01-02 20:13:45 +05:00
Adrián Chaves 016d1de64e Remove Reppy from CI 2023-01-02 14:13:04 +01:00
Adrián Chaves 6084e8f627 Do not use -U for pip in Tox 2023-01-02 14:00:37 +01:00
Adrián Chaves e47ada2c7c Add CC to tox.ini:[testenv]passenv 2023-01-02 13:49:25 +01:00
Laerte Pereira deaf1fb6cf
Stop using setup.py (#5776) 2022-12-31 20:11:45 +01:00
Emmanuel Rondan c48accf7ca adding pre-commit with config 2022-12-26 13:51:27 -03:00
Emmanuel Rondan 09dc4cf308 adding black to tox and defining line length on pyproject.toml 2022-12-22 16:11:21 -03:00
Andrey Rahmatullin 5bd27191a2
Bump mypy, flake8, and pylint (#5738) 2022-11-28 19:37:57 +01:00
Andrey Rakhmatullin 5bf4260679 Update flake8. 2022-10-10 11:14:20 +06:00
Andrey Rakhmatullin 5fa613b419 Run flake8 directly. 2022-10-10 11:04:00 +06:00
Andrey Rakhmatullin d1515cc075 Update pylint. 2022-10-07 15:30:44 +06:00
Andrey Rakhmatullin ccb6a8c098 Add a note about flake8. 2022-10-07 15:27:14 +06:00
Andrey Rakhmatullin 424849b275 Update mypy. 2022-10-07 15:17:55 +06:00
Andrey Rahmatullin 28d65c88b1
Merge pull request #5662 from gliptak/pyopenssl1 
Match pyOpenSSL and types-pyOpenSSL versions
 2022-10-04 12:54:30 +05:00
Abdul Rauf 69bf5c6625 CI: move twinecheck to tox env 2022-10-02 20:27:24 +05:00
Gábor Lipták 9f006e3aa5 Match pyOpenSSL and types-pyOpenSSL versions 
Signed-off-by: Gábor Lipták <gliptak@gmail.com>
 2022-09-30 22:27:57 -04:00
Gábor Lipták 385acd5598
Match pyOpenSSL and service_identity to Twisted 
Signed-off-by: Gábor Lipták <gliptak@gmail.com>
 2022-09-24 21:33:02 -04:00
Mikhail Korobov 56e2eeac10 fix typing issues by upgrading mypy 2022-07-27 09:41:12 +05:00
Adrián Chaves 5862f6b8e1
Update frozen CI packages (#5574) 2022-07-25 17:25:10 +02:00
Laerte Pereira 407562b38b
Drop Python 3.6 support (#5514) 
* chore: Drop Python 3.6 support

* Attend PR comments

* Tweak versions

* Update dependencies version

* fix: Ubuntu workflow

* fix windows workflow

* chore: Remove comment

* update `install_requires` dependencies versions

* move lxml to main pinned requirements

* Attend code-review comments

* remove non-pinned 3.7 from windows workflow

* simplify condition

* lint

* remove paragraph

* refactor

* remove leftover
 2022-06-09 00:25:03 -03:00
Maxime Nannan 078622cfb0
Fix file expiration issue with GCS (#5318) 2022-05-20 08:30:06 +02:00
Andrey Rahmatullin 965fde24a4 Pin mitmproxy to < 8 for now (#5459) 2022-05-20 07:17:09 +02:00