RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
8,270 Commits 49 Branches 132 Tags 138 MiB
Commit Graph

67 Commits

Author SHA1 Message Date
Marc Hernández b97a39fda0
deprecate retry_on_eintr (#4683) 2020-07-16 17:38:22 +02:00
Ram Rachum 214da8e523
Use chain.from_iterable in python.py 2020-06-17 13:50:54 +03:00
marc 8971878c1d fix new detected flake8 cases 2020-05-13 14:11:10 +02:00
elacuesta dfbe1d9507
Remove object base class (#4430) 2020-03-16 20:12:46 +01:00
Marc Hernandez Cabot 03ed9e1786 delete old deprecated functions from scrapy.utils.python 2020-02-21 09:29:29 +01:00
Eugenio Lacuesta d6e928f472
Remove object as base class for MutableChain 
Plus some minor styling adjustments
 2020-01-10 04:40:10 -03:00
Eugenio Lacuesta c088c04f44
Spider middleware: catch exceptions right after the spider callback 2020-01-10 04:20:55 -03:00
Eugenio Lacuesta 714e0d3ac9
Merge remote-tracking branch 'upstream/master' into remove-six-code 2019-11-20 12:41:38 -03:00
Mikhail Korobov 65e2fb7d89
Merge pull request #4153 from Gallaecio/lgtm 
MutableChain: return self from __iter__
 2019-11-20 19:46:20 +05:00
Eugenio Lacuesta 05785c1c17
Merge remote-tracking branch 'upstream/master' into remove-six-code 2019-11-19 11:01:34 -03:00
Adrián Chaves f261cf65e9 Add missing blank lines between functions and classes 
Also fixed 2 unrelated Flake8 issues
 2019-11-18 17:16:09 +01:00
Adrián Chaves 99d8b05a0b Deprecate scrapy.utils.python.MutableChain.next 2019-11-18 10:58:47 +01:00
Andrey Rakhmatullin cfa633f5e8 Some text function messages cleanup, deprecate to_native_str. 2019-11-14 13:45:39 +05:00
Andrey Rakhmatullin 1d7c8cb0b1 Remove six.PY2 and six.PY3 conditionals. 2019-11-14 13:45:37 +05:00
Adrián Chaves a3a3107bc4 MutableChain: return self from __iter__ 2019-11-13 09:46:54 +01:00
Eugenio Lacuesta 586b25d27e
Remove six types 2019-11-03 12:10:37 -03:00
Eugenio Lacuesta ce8e515fa8
Remove six type wrappers 2019-11-03 00:36:25 -03:00
Eugenio Lacuesta 1aba513693
Remove six.iter* occurrences 2019-11-03 00:26:44 -03:00
Eugenio Lacuesta df00389c16
Remove six.moves occurrences 2019-11-03 00:00:49 -03:00
Andrey Rakhmatullin 5b70b051a6 Some text function messages cleanup, deprecate to_native_str. 2019-10-31 15:07:59 +05:00
Andrey Rakhmatullin bbd9f4be90 Remove six.PY2 and six.PY3 conditionals. 2019-10-31 15:07:10 +05:00
Ammar Najjar da8cd9448d
docs: always surround __init__ with `` in docs 
Issue #4086
 2019-10-21 19:56:58 +02:00
Ammar Najjar 68a7d05ed8
docs: use __init__ method instead of constructor 
Issue #4086
 2019-10-21 15:42:24 +02:00
nyov 7a398b7086 Deprecation removals for Scrapy 1.7 
Removing deprecations of 2015 and prior (pre-1.1)
 2019-07-06 13:41:56 +00:00
Konstantin Lopuhin b5c552d17f
Merge pull request #2061 from elacuesta/process_spider_exception_generator 
[MRG+1] process_spider_exception on generators
 2019-04-01 10:43:19 +03:00
Adrián Chaves 75d6f56c8a Switch from ` to `` where inline code formatting is desired 2019-03-01 16:56:58 +01:00
Eugenio Lacuesta a05eaeed73 Simplify MutableChain 2018-10-11 11:31:51 -03:00
Eugenio Lacuesta 58f5565357 Move MutableChain to scrapy.utils.python 2018-10-11 11:23:12 -03:00
Andrei Petre 6e6b5cc29f Use getfullargspec under the scenes for py3 to stop DeprecationWarning (#2864) 
Use getfullargspec under the scenes for py3 to stop DeprecationWarning. 

Closes #2862
 2017-08-01 11:14:43 -03:00
Konstantin Lopuhin ea08b95280 Remove Jython gc branch: it's not supported 2017-06-19 16:45:29 +03:00
Konstantin Lopuhin 19ca986aa1 Move garbage_collect to scrapy.utils.python 2017-06-15 13:14:31 +03:00
Mikhail Korobov e285b1d6c2 retry stats 2017-02-14 20:27:49 +05:00
nyov e8ca467572 Rename isbinarytext function to binary_is_text for clarity 
Closes #1389
 2016-03-30 15:44:15 +00:00
Jakob de Maeyer f249b309ab Move scrapy.utils.conf.remove_none_values to s.u.python.without_none_values 2015-10-27 12:43:33 +01:00
Mikhail Lyundin d022d3cb9e equal_attributes function optimization 2015-09-04 18:21:41 +03:00
Mikhail Lyundin d9fddabe95 Avoid creation of temporary list object in iflatten 2015-09-02 23:12:36 +03:00
Mikhail Korobov f576b3ffee [tmp] improve python 3 support for scrapy.utils.url 2015-07-25 00:40:45 +02:00
Mikhail Korobov 4073498652 port utils.python 
* stringify_dict is deprecated
* is_writable is deprecated
* setattr_default is deprecated
* get_spec is untested
* re_rsearch is untested
* retry_on_eintr is untested
 2015-07-23 18:33:56 +02:00
Mikhail Korobov 887936ebf6 PY3 port flatten and iflatten 2015-07-23 17:26:20 +02:00
Mikhail Korobov 61cd27e5c7 Rename unicode_to_str and str_to_unicode method. Fixes GH-778. 2015-07-23 15:00:06 +02:00
Mateusz Golewski f92bc09bf4 Add re_first() to SelectorList and iflatten() to utils.python 2015-03-18 21:11:08 -03:00
nramirezuy 86f61a9906 get_func_args maximum recursion fix #728 2014-07-21 13:12:59 -03:00
Felix Yan 4f24e724a3 PY3: use six.iterkeys, six.iteritems, and tempfile 2014-07-14 18:47:22 +08:00
Mikhail Korobov 19228c6584 Remove FixedSGMLParser: it is both useless and unused. 2014-07-03 03:59:28 +06:00
Mikhail Korobov 7316a37635 FixedSGMLParser is useless. 2014-07-03 01:32:33 +06:00
Mikhail Korobov 2b749668ba Deprecate scrapy.python.utils.FixedSGMLParser 
SGML link extractor that uses it is also going to be deprecated;
sgmllib module is not available in Python 3.
 2014-07-02 22:48:16 +06:00
Daniel Graña 589fd037d9 do not return applied arguments on partial functions 2013-12-30 09:25:11 -02:00
Beng Hee Eu 09c3f53693 Fixes #368: Support functools.partial in scrapy.utils.python.get_func_args() 2013-12-30 03:46:10 +08:00
Mikhail Korobov 84aa7599a4 no need to use dict in scrapy.utils.python.unique 2013-12-19 15:06:27 +06:00
alexanderlukanin13 d381a35732 Python 3 compatible syntax: print, except, raise, octal numbers; removed Python 2.2 boolean compatibility code in xlib/pydispatch/dispatcher.py 2013-10-20 01:59:35 +06:00