RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
8,251 Commits 49 Branches 132 Tags 162 MiB
Commit Graph

113 Commits

Author SHA1 Message Date
Aditya 1c40dfa740 fix: handle CONNECTION_LOST & RESET separately 2020-07-07 15:36:41 +05:30
Aditya 7f5bb6b34c chore: add h2 to setup.py, tox.ini 
- Change log level for hpack to ERROR
 2020-07-06 13:12:04 +05:30
Aditya 6387445ef5 test(tox.ini): change Twisted -> Twisted[http2] 2020-06-28 18:44:57 +05:30
Eugenio Lacuesta 7babf359e0
Typing: Tox env, CI job 2020-06-18 13:56:07 -03:00
Eugenio Lacuesta ec98dabfab
Support for dataclass and attrs items (#3881) 2020-06-14 11:45:27 +02:00
Mikhail Korobov 794ab19660
Merge pull request #3727 from Gallaecio/pylint 
Use pylint
 2020-05-09 02:22:54 +05:00
Adrián Chaves a79cfce57b
Merge branch 'master' into pylint 2020-05-06 16:24:13 +02:00
Adrián Chaves 418b9b5f52 Travis CI: do not run security and Flake8 on multiple jobs 2020-05-06 11:15:02 +02:00
Adrián Chaves 5c0f11b4ef Simplify the asyncio Tox environment 2020-04-28 17:32:53 +02:00
Adrián Chaves 901892dab3 Fix the hoverxref configuration 2020-04-16 14:48:38 +02:00
Eugenio Lacuesta 11941c3244
Remove elusive six occurrence from tox.ini 2020-02-05 13:27:54 -03:00
Andrey Rakhmatullin 30ebd05a5f Simplify the tox asyncio entries. 2019-12-27 00:05:14 +05:00
Andrey Rakhmatullin 20289be810 Merge remote-tracking branch 'origin/master' into asyncio-base 2019-12-20 19:31:20 +05:00
Adrián Chaves 00517ec273
Merge branch 'master' into docs-py38 2019-12-18 15:50:49 +01:00
Adrián Chaves 8c5a8a02ae
Merge branch 'master' into pylint 2019-12-18 15:43:40 +01:00
Mikhail Korobov 053319334c
Merge pull request #4179 from Gallaecio/user-friendlier-tox 
Make tox configuration more user friendly
 2019-12-18 18:35:19 +05:00
Vostretsov Nikita 12f9ffeb5d remove requirements-py3.txt 2019-12-18 10:53:27 +00:00
Andrey Rakhmatullin afc886e578 Simplify tox.ini asyncio entries. 2019-12-13 19:34:58 +05:00
Andrey Rakhmatullin c079d5002b Run tests without asyncio support by default, add py35-asyncio and py38-asyncio envs. 2019-12-04 21:32:56 +05:00
Andrey Rakhmatullin cc19ab5439 Add tests that check asyncio support. 2019-12-04 21:32:56 +05:00
Adrián Chaves fc3af54dbd Make tox configuration more user friendly 2019-11-20 08:04:17 +01:00
Adrián Chaves 6d1667d5b8 Use the latest Python version to build the documentation 2019-11-18 11:13:34 +01:00
Mikhail Korobov 298d709e16
Merge pull request #4162 from Gallaecio/bandit 
Add bandit to CI
 2019-11-14 23:40:01 +05:00
Adrián Chaves 5ee5508cc3 Have CI record the 10 slowest tests 2019-11-14 15:42:34 +01:00
Adrián Chaves b8ef12cd47 Add bandit to CI 2019-11-14 12:11:28 +01:00
Adrián Chaves ecc46ac741
Merge branch 'master' into pylint 2019-11-11 10:45:25 +01:00
Adrián Chaves 1df5755699 Set the bases for testing code examples from the documentation 2019-11-08 16:00:10 +01:00
Adrián Chaves 40ed184914
Merge branch 'master' into pylint 2019-11-07 18:40:58 +01:00
Marc Hernández e8b1e46e85 Add pytest-flake8 (#3945) 2019-11-07 14:05:01 +01:00
Andrey Rahmatullin 229e722a03 Initial Python 2 removal (#4091) 2019-10-31 10:46:02 +01:00
Roy 74909030a5 [tox.ini] Removing obsolete py37 extra deps enviornment 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-28 12:52:36 +00:00
Adrián Chaves 02577f55a0 Have PyLint cover all Python files in the repository 2019-10-24 13:25:11 +02:00
Adrián Chaves 3b6f7ac9f2 Use pylint 2019-10-22 19:44:11 +02:00
Roy 3d4317bfe4 [tox.ini] Added python 3.8 fields 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-21 18:32:30 +01:00
Vostretsov Nikita e418554c21 use proper equal 2019-09-09 08:12:32 +00:00
Vostretsov Nikita 7af8c76649 add pinned versions 2019-09-09 08:10:09 +00:00
Vostretsov Nikita 9578f49099 use protego as a default robots.txt parser 2019-09-09 07:36:55 +00:00
Anubhav Patel 3a7b949d6d Adds integration with Protego robots.txt parser (#3935) 2019-08-27 09:41:31 +02:00
elacuesta 5dbeece8da [MRG+1] Drop py34 support - Update CI envs (#3892) 
* Drop py34 support

* Travis experiments

* More Travis experiments

* Bump Twisted version for py35+ (stretch)

* Remove Debian build

* Remove pinned lxml for Py34

* Fix merge error

* Remove unused tox env

* Add environment with pinned versions for py36

* Bump minimum Twisted version in py27; Envs with pinned versions for py27 and py35

* Add botocore as extra dep for py27 tests

* Update requirements-py2.txt

* Add botocore and Pillow as extra dependencies
 2019-08-07 12:36:52 +05:00
Anubhav Patel 8e813953bd [MRG+1] [GSoC 2019] Interface for robots.txt parsers (#3796) 
Make the robots.txt parser configurable through the new ROBOTSTXT_PARSER setting, support the Reppy and Robotexclusionrulesparser parsers, and allow implementing custom robots.txt parsers.
 2019-08-02 09:43:29 +02:00
Adrián Chaves c7b5ad0e20 Add a Sphinx extension to generate documentation coverage information 2019-06-04 15:03:25 +02:00
Daniel Graña 8ed6beb7f9 Needs to be installed within tox env 2018-12-20 19:39:29 -03:00
Konstantin Lopuhin 1d2e2735fc Merge branch 'master' of https://github.com/patiences/scrapy into patiences-master 2018-07-09 11:59:22 +03:00
Mikhail Korobov f11d65f7d6 TST make it clear which requirements are Python 2-only 
* rename requirements.txt to requirements-py2.txt, to make it clear they are Python 2-only
* make requirements-py3.txt consistent with requirements-py2.txt
 2018-06-29 18:34:11 +05:00
Mikhail Korobov 45f67eb64d TST exclude lxml==4.2.2 from tests, as it doesn't play well with Pillow 2018-06-28 01:02:30 +05:00
Vostretsov Nikita c5ddfddb7e blacklist twisted version with regression in constraints file 2018-05-17 08:53:42 +00:00
Patience Shyu aca2655c12 [WIP] Run tests for Python 3.7 2018-03-02 14:57:39 +01:00
Konstantin Lopuhin f71df6f9ad Run tests for PyPy3 2017-12-25 14:48:06 +03:00
Hugo 44623687ab Drop support for EOL Python 3.3 2017-12-19 17:59:05 +02:00
Aditya 97d047a055 Fix link for Tox 2017-10-28 16:48:41 +05:30