scrapy

Author	SHA1	Message	Date
Vostretsov Nikita	db202487f0	newer version of protego and move up to top	2019-09-09 14:05:45 +00:00
Vostretsov Nikita	7b33fa58fa	Update requirements-py2.txt Co-Authored-By: elacuesta <elacuesta@users.noreply.github.com>	2019-09-09 17:04:27 +03:00
Vostretsov Nikita	9578f49099	use protego as a default robots.txt parser	2019-09-09 07:36:55 +00:00
elacuesta	5dbeece8da	[MRG+1] Drop py34 support - Update CI envs (#3892 ) * Drop py34 support * Travis experiments * More Travis experiments * Bump Twisted version for py35+ (stretch) * Remove Debian build * Remove pinned lxml for Py34 * Fix merge error * Remove unused tox env * Add environment with pinned versions for py36 * Bump minimum Twisted version in py27; Envs with pinned versions for py27 and py35 * Add botocore as extra dep for py27 tests * Update requirements-py2.txt * Add botocore and Pillow as extra dependencies	2019-08-07 12:36:52 +05:00
Mikhail Korobov	25ac4691b4	require parsel 1.5+	2018-09-12 17:57:27 +05:00
Mikhail Korobov	f11d65f7d6	TST make it clear which requirements are Python 2-only * rename requirements.txt to requirements-py2.txt, to make it clear they are Python 2-only * make requirements-py3.txt consistent with requirements-py2.txt	2018-06-29 18:34:11 +05:00