RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
4,877 Commits 49 Branches 132 Tags 141 MiB
Commit Graph

4877 Commits

Author SHA1 Message Date
nyov 1a1bc2c6b5 PY3 port scrapy.downloadermiddlewares.robotstxt.RobotsTxtMiddleware 2015-07-29 04:21:57 +00:00
Daniel Graña 2c937f3554 PY3 port scrapy.dupefilters 2015-07-25 18:10:29 +02:00
Daniel Graña 776064aee1 PY3 port signals 2015-07-25 18:04:55 +02:00
Mikhail Korobov 82304c4fae PY3: fixed scrapy.utils.defer 2015-07-25 17:48:34 +02:00
Mikhail Korobov c53d6d7460 Merge pull request #1383 from zoliszeredi/py3/fix_test_utils_defer 
Py3/fix test utils defer
 2015-07-25 17:43:50 +02:00
Mikhail Korobov 7874bb9f13 PY3 port utils.request 2015-07-25 17:14:56 +02:00
Daniel Graña f750ee4c00 Remove ignored passing tests from py3 branch 2015-07-25 16:51:22 +02:00
Daniel Graña ea56067e40 ignore moved files from py3 tests 2015-07-25 16:39:02 +02:00
Mikhail Korobov e438df7028 PY3 enable Request and Response tests 2015-07-25 13:10:13 +02:00
Mikhail Korobov e853d9e910 partial port of Request and Response 2015-07-25 13:08:44 +02:00
Zoltán Szeredi 1bf7a98000 Remove test_utils_defer from ignores. 2015-07-25 13:05:50 +02:00
Zoltán Szeredi 9aaa8f8125 Improve python3 support for test_utils_defer. 2015-07-25 12:58:39 +02:00
Mikhail Korobov f576b3ffee [tmp] improve python 3 support for scrapy.utils.url 2015-07-25 00:40:45 +02:00
Mikhail Korobov 335aa5f276 Merge pull request #1379 from scrapy/py3-utils-python 
PY3 port scrapy.utils.python
 2015-07-24 12:17:16 +02:00
Mikhail Korobov a7b4a3e7f9 cleanup 
* run test_utils_python in Python 3;
* make tests for 'errors' argument more explicit
* add missing test_ prefix utf_16_strings_contain_null_bytes;
* cleanup test names.
 2015-07-23 20:03:33 +02:00
Mikhail Korobov 4073498652 port utils.python 
* stringify_dict is deprecated
* is_writable is deprecated
* setattr_default is deprecated
* get_spec is untested
* re_rsearch is untested
* retry_on_eintr is untested
 2015-07-23 18:33:56 +02:00
Mikhail Korobov 41bcae5d00 TST fix to_bytes and to_unicode tests in Python 3.x 2015-07-23 17:35:23 +02:00
Mikhail Korobov 887936ebf6 PY3 port flatten and iflatten 2015-07-23 17:26:20 +02:00
Mikhail Korobov 61cd27e5c7 Rename unicode_to_str and str_to_unicode method. Fixes GH-778. 2015-07-23 15:00:06 +02:00
Mikhail Korobov f93acffff4 Merge pull request #1366 from radarhere/patch-1 
Fixed typos
 2015-07-18 22:16:28 +05:00
Andrew Murray 198be7d679 Fixed typos 2015-07-16 23:59:02 +10:00
Julia Medina d706310d8b Merge pull request #1151 from marven/cache-control 
[MRG+1] RFC2616 policy enhancements + tests
 2015-07-11 08:06:20 -03:00
Julia Medina 6ac971ebac Merge pull request #1351 from scrapy/fix-regression-in-mock 
Fix a recent mock regression by not using it in a test
 2015-07-10 20:08:25 -03:00
Julia Medina d3d61fde87 Fix a recent mock regression by not using it in a test 2015-07-10 19:58:38 -03:00
Julia Medina 306b028ab3 Merge pull request #1348 from nzp/tutorial-ref-fix 
Fix reference in tutorial.
 2015-07-09 23:17:53 -03:00
Nikola Pavlović 7bef61dbbd Fix reference. 2015-07-10 02:35:27 +02:00
Julia Medina 8b3ca4f250 Merge pull request #1302 from eliasdorneles/improving-access-settings-docs 
[MRG+1] Improvements for docs on how to access settings
 2015-07-03 00:56:32 -03:00
Daniel Graña 2a7dc31f4c Merge pull request #1333 from demelziraptor/x-json-response 
interpreting application/x-json as TextResponse
 2015-07-02 15:20:47 -03:00
Demelziraptor 9a15fcf89a interpreting application/x-json as TextResponse 2015-07-02 19:56:30 +02:00
Daniel Graña 3fc4e0b319 Merge pull request #1282 from otherchirps/memusage-check-interval 
[MRG+1] Added MEMUSAGE_CHECK_INTERVAL_SECONDS to Memory usage extension options.
 2015-07-02 13:50:55 -03:00
Daniel Graña 6fa3f2421c Add 1.0.1 release notes 2015-07-01 01:49:44 -03:00
Daniel Graña 07f4f12e8b Merge pull request #1313 from eliasdorneles/support-empty-passwd-for-http-proxy 
[MRG+1] Support empty password for http_proxy config
 2015-06-30 19:58:16 -03:00
Daniel Graña 98707e15f6 Merge pull request #1324 from scrapy/autothrottle 
Autothrottle enhancements
 2015-06-26 22:26:06 -03:00
Mikhail Korobov d850238c22 add AUTOTHROTTLE_TARGET_CONCURRENCY option and expand AutoThrottle docs 2015-06-27 04:59:42 +05:00
Mikhail Korobov 63317531f9 DOC fix authrottle docs 
see https://github.com/scrapy/scrapy/pull/502/files#r8574692
 2015-06-26 20:47:58 +05:00
Mikhail Korobov 1fef9f1132 AutoThrottle: respect download_delay=0 spider attribute 2015-06-26 19:09:26 +05:00
Mikhail Korobov 17cb51315b drop support for AUTOTHROTTLE_MIN_DOWNLOAD_DELAY 
it was deprecated for years
 2015-06-26 19:07:54 +05:00
Mikhail Korobov 584252e8f2 move AutoThrottle default options to default_settings.py 2015-06-26 18:58:29 +05:00
Mikhail Korobov e6272e5209 make AutoThrottle._adjust_delay easier to understand 2015-06-26 18:44:23 +05:00
Daniel Graña 7c98855927 Merge pull request #1321 from yarikoptic/upstream-master 
ENH: include tests/ to source distribution in MANIFEST.in
 2015-06-26 00:32:02 -03:00
Daniel Graña 5bcda9b7d1 Merge pull request #1290 from scrapy/crawler-runner-cleanup 
extract CrawlerRunner._crawl method which always expects Crawler
 2015-06-26 00:21:23 -03:00
Yaroslav Halchenko 5207d44055 ENH: include tests/ to source distribution in MANIFEST.in 2015-06-25 23:00:00 -04:00
Daniel Graña 148fb14040 Merge pull request #1319 from yarikoptic/fix-fail-if-docsbuild-fails 
[MRG+1] BF: fail if docs failed to build
 2015-06-25 23:35:42 -03:00
Yaroslav Halchenko 5f3e1e9a16 ENH: make explicit build-ignore-errors to be used by linkfix 2015-06-25 21:30:35 -04:00
Mikhail Korobov 2e55e65edc Merge pull request #1320 from barraponto/patch-2 
Fix SelectJmes documentation
 2015-06-25 23:20:46 +05:00
Capi Etheriel 4cea1c1231 Fix SelectJmes documentation 2015-06-25 15:11:56 -03:00
Yaroslav Halchenko 49fe915798 BF: fail if docs failed to build 2015-06-25 10:12:56 -04:00
Pablo Hoffman 8a140b6ba1 Merge pull request #1315 from scrapy/downloader-slots-cleanup 
Small downloader slots cleanup
 2015-06-24 16:25:13 -03:00
Mikhail Korobov ea4b175c2d Merge pull request #1254 from scrapy/bugfix-1232 
[MRG +1] Unquote request path before passing to FTPClient, it already escape paths
 2015-06-24 18:04:45 +05:00
Mikhail Korobov 08501bff92 Merge pull request #1316 from dallagi/patch-1 
DOC Bring Ubuntu and Archlinux outside of Windows subsection
 2015-06-24 17:38:12 +05:00