RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
8,063 Commits 42 Branches 132 Tags 165 MiB
Commit Graph

75 Commits

Author SHA1 Message Date
Grammy Jiang 9b4b43f8ac
Convert the relative imports to absolute imports 
This commits converts the relative imports to absolute imports in the
entire package
 2019-12-05 11:25:19 +11:00
Andrey Rahmatullin 229e722a03 Initial Python 2 removal (#4091) 2019-10-31 10:46:02 +01:00
nyov ecbfe4bd66 drop deprecated "optional_features" set 2015-09-15 09:00:08 +00:00
nyov b2fd9bdb63 lazy-load s3 boto 2015-08-01 03:43:03 +00:00
Julia Medina d3f576a816 Move scrapy/spider.py to scrapy/spiders/__init__.py 2015-05-09 04:20:09 -03:00
Elias Dorneles 3d3633f3d2 favoring web scraping over screen scraping in the descriptions 2015-04-25 11:20:20 -03:00
Julia Medina ffc60910aa Remove djangoitem since we moved it to scrapy/scrapy-djangoitem 2015-04-19 13:09:25 -03:00
Pablo Hoffman 5846d6154c emphasize web crawling over screen scraping on scrapy description. closes #586 2015-03-18 00:24:16 -03:00
Mikhail Korobov e62bbf0766 PY3 top-level shortcuts work 2014-08-02 00:24:32 +06:00
Mikhail Korobov e38e3d2752 PY3 make it possible to run some tests in Python3 
* switch to Twisted 14.0.0 because SVN version broke twisted.log in Python 3;
* skip top-level shortcuts to make at least some tests pass;
* use PY3 compatible import of _monkeypatches.
 2014-07-02 22:23:01 +06:00
Daniel Graña 21d073d03b Merge top-level-shortcuts 2014-04-23 23:14:09 -03:00
Mikhail Korobov e8e689acd1 fix scrapy.version_info when SCRAPY_VERSION_FROM_GIT is set 2014-04-16 22:59:28 +06:00
Daniel Graña 62c7daf785 Add basic top-level shortcuts 2014-04-15 01:09:35 +06:00
Daniel Graña 9a643d689c cleanup toplevel namespace 2014-04-15 01:09:35 +06:00
Mikhail Korobov 713aec3919 make scrapy.version_info a tuple of integers 2014-04-05 05:54:49 +06:00
Mikhail Korobov f80f10ae7e Merge pull request #452 from alexanderlukanin13/python3 
PY3: scrapy.__version__, NoneType, urlparse_monkeypatches
 2013-11-04 00:54:02 -08:00
alexanderlukanin13 6c7292a08e python3: scrapy.__version__, NoneType, urlparse_monkeypatches 2013-11-03 22:20:33 +06:00
Daniel Graña 2df8156431 Drop Python 2.6 support 2013-10-29 13:44:00 -02:00
alexanderlukanin13 ae4a61a2d5 Added "from __future__ import print_function" in all relevant places except xlib 2013-10-20 11:55:07 +06:00
alexanderlukanin13 d381a35732 Python 3 compatible syntax: print, except, raise, octal numbers; removed Python 2.2 boolean compatibility code in xlib/pydispatch/dispatcher.py 2013-10-20 01:59:35 +06:00
Daniel Graña bf37f78572 Drop libxml2 selectors backend 2013-10-11 18:02:35 -02:00
Pablo Hoffman da1f6d3144 remove unused imports and some assorted pylint-ing 2013-08-23 13:03:34 -03:00
Daniel Graña cf10474b8b improve twisted version tests and enable HTTP11 handler by default if supported 2013-06-04 16:59:35 -03:00
Pablo Hoffman 9968f99e06 remove ssl from optional_features to simplify code, as it is now required. also deprecate optional_features set 2013-03-20 09:52:40 -03:00
Daniel Graña 910effd145 get scrapy version from package data 2013-02-06 11:44:26 -02:00
Daniel Graña 3cbc4d0b94 django is an optional_features, its imports must not fail 2013-01-08 17:56:46 -02:00
Daniel Graña d4b8e2633e bumped version to 0.17.0 2012-10-18 17:11:33 -02:00
Daniel Graña f530b0b3eb make libxml2 optional now that lxml is the default 2012-05-16 18:17:51 -03:00
Pablo Hoffman b6ae266546 Removed (very old and possibly broken) backwards compatibility support for Twisted 2.5 2012-03-15 00:28:24 -03:00
Pablo Hoffman e521da2e2f Dropped support for Python 2.5. See: http://blog.scrapy.org/scrapy-dropping-support-for-python-25 2012-03-01 08:18:12 -02:00
Pablo Hoffman db92bc8c40 bumped version to 0.15.1, mainly to avoid package upgrade issues with new versioning based on git describe 2012-01-02 13:07:15 -02:00
Pablo Hoffman e29f9e5b24 bumped version to 0.15 2011-11-17 14:44:34 -02:00
Pablo Hoffman 0f649f0e30 bumped version to 0.14 2011-11-17 14:43:40 -02:00
Pablo Hoffman cd42bd7d0c Bumped version to 0.13 2011-01-02 17:21:31 -02:00
Pablo Hoffman 5879389ad0 Bumped version to 0.12 2011-01-02 16:16:40 -02:00
Pablo Hoffman 60bdb7dc0a Removed some deprecated code and modules 2010-12-13 10:34:07 -02:00
Pablo Hoffman 97a790d659 improved mechanism for tagging version with hg revision 2010-12-13 10:21:39 -02:00
Pablo Hoffman 67adb2a05f Always use micro versions in Scrapy from now on 2010-11-17 00:09:14 -02:00
Pablo Hoffman 571aeb559b Automated merge with http://hg.scrapy.org/scrapy-0.10 2010-10-05 12:44:41 -02:00
Pablo Hoffman 4bbcbd7b77 Don't fail if twisted is not available on scrapy/__init__.py, to avoid making setup.py depend on Twisted. Closes #256 2010-10-05 12:43:34 -02:00
Pablo Hoffman 61ab9b86b7 Bumped version to 0.10.4 2010-09-29 13:36:36 -03:00
Pablo Hoffman a5908f052f Bumped version to 0.10.3 2010-09-15 21:03:21 -03:00
Pablo Hoffman edfba29dfd Re-bumped version to 0.11 2010-09-15 14:27:27 -03:00
Pablo Hoffman c01b8651ff Bumped version to 0.10.2 2010-09-15 14:04:33 -03:00
Pablo Hoffman beee7e4fbc Merge with trunk 2010-09-15 01:50:42 -03:00
Pablo Hoffman d0c7a946bd Bumped version to 0.10.1 2010-09-13 19:02:21 -03:00
Pablo Hoffman 1fa96dbcd3 Bumped version to 0.11 2010-09-13 19:02:15 -03:00
Pablo Hoffman b16eff227b Bumped version to 0.10 2010-09-10 01:48:45 -03:00
Pablo Hoffman 38bbec8dca Bumped version to 0.10-rc1 2010-09-09 00:40:58 -03:00
Daniel Grana 1b11563383 monkeypatch urlparse if s3 netloc parsing fails (python issue7904). closes #223 2010-09-04 01:02:52 -03:00