RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
8,242 Commits 42 Branches 132 Tags 168 MiB
Commit Graph

8242 Commits

Author SHA1 Message Date
Eugenio Lacuesta 93436f9d3a
Chain pickling exception, test_squeues.py updates 2020-05-06 14:05:27 -03:00
Eugenio Lacuesta b1ddd7bd7b
Refactor test_squeues.py 2020-05-06 13:44:02 -03:00
Andrey Rahmatullin b76d280cc3
Merge pull request #4540 from elacuesta/flake8-remove-e123 
Flake8: remove E123
 2020-05-06 21:38:04 +05:00
Eugenio Lacuesta d0bb04f089
Switch to pickle protocol 4 2020-05-06 13:37:23 -03:00
Andrey Rahmatullin 4957a0a172
Merge pull request #4539 from elacuesta/flake8-remove-e125 
Flake8: remove E125
 2020-05-06 21:36:20 +05:00
Andrey Rahmatullin 977ce9f7a8
Merge pull request #4538 from elacuesta/flake8-remove-e127 
Flake8: remove E127
 2020-05-06 21:34:24 +05:00
Eugenio Lacuesta 8643e8d355
Flake8: remove E123 (Closing bracket does not match indentation of opening bracket's line) 2020-05-06 12:26:04 -03:00
Michał Panek 628c4a5319
Add a warning/error in case of incorrect gcs permissions (#4508) 2020-05-06 17:09:20 +02:00
Adrián Chaves a79cfce57b
Merge branch 'master' into pylint 2020-05-06 16:24:13 +02:00
Eugenio Lacuesta 63600243e0
Flake8: remove E125 (Continuation line with same indent as next logical line) 
Also remove E401 from pytest.ini - no occurrences in the codebase
 2020-05-06 10:26:52 -03:00
Eugenio Lacuesta fe0c582ee0
Flake8: remove E127 in tests (continuation line over-indented for visual indent) 2020-05-06 09:49:10 -03:00
Eugenio Lacuesta 49e8a337f7
Flake8: remove E127 (continuation line over-indented for visual indent) 2020-05-06 09:37:01 -03:00
Eugenio Lacuesta 8d1e3ee0dd
Remove deprecated BaseItem from the docs 2020-05-06 09:24:40 -03:00
Adrián Chaves 98835a0d40
Merge branch 'master' into test-ubuntu-bionic 2020-05-06 13:59:01 +02:00
Adrián Chaves 418b9b5f52 Travis CI: do not run security and Flake8 on multiple jobs 2020-05-06 11:15:02 +02:00
Eugenio Lacuesta 17c0cf64ae
Flake8: remove W504 code (#4525) 
Co-authored-by: Mikhail Korobov <kmike84@gmail.com>
 2020-05-06 00:14:48 +02:00
Eugenio Lacuesta 7988c676a9
Update Item docstring, update BaseItem occurrences 2020-05-05 13:11:01 -03:00
Eugenio Lacuesta 622ce86066
Test: make sure scrapy.item.Item does not issue a deprecation warning 2020-05-04 16:22:24 -03:00
Mikhail Korobov 8f72b70f06
Merge pull request #4533 from scrapy/doc-old-twisted 
Don't mention unsupported package versions in docs
 2020-05-04 23:51:40 +05:00
Mikhail Korobov fe6154e4fa clarify DOWNLOADER_HTTPCLIENTFACTORY docs 2020-05-04 18:18:38 +05:00
Eugenio Lacuesta e1948b4923
Add example about bytes_received signal 2020-05-04 09:07:27 -03:00
Eugenio Lacuesta f75941f79d
Deprecate scrapy.item.BaseItem 2020-05-04 08:53:32 -03:00
Mikhail Korobov 83d7360bb7 Don't mention unsupported package versions in docs 2020-05-04 02:00:11 +05:00
BroodingKangaroo dad2ea7522 Change time_id to batch_time 2020-05-02 01:21:03 +03:00
Eugenio Lacuesta 4d625afda5
Merge branch 'master' into bytes_received_signal 2020-05-01 16:11:32 -03:00
BroodingKangaroo df81870f39 Merge branch 'master' of https://github.com/scrapy/scrapy into ISSUE-4250-add_batch_deliveries 2020-05-01 12:18:39 +03:00
BroodingKangaroo 3f9874fac9 Add test s3 export 2020-05-01 11:52:16 +03:00
Mikhail Korobov b6eae22b38
Merge pull request #4522 from Gallaecio/travis-tox-py 
Remove TOXENV from .travis.yml unless needed
 2020-04-29 00:26:00 +05:00
Mikhail Korobov 6c69b03a27
Merge pull request #4521 from Gallaecio/tox-asyncio 
Simplify the asyncio Tox environment
 2020-04-29 00:25:42 +05:00
Mikhail Korobov 65ba9e1063
Merge pull request #4517 from Gallaecio/run-quick-tests-first 
Run quick tests first in Travis CI
 2020-04-29 00:19:55 +05:00
Eugenio Lacuesta f787b8483c IPv6 test: check for the absence of DNSLookupError 2020-04-28 17:50:06 +02:00
Adrián Chaves 3a64f3eb29 Remove TOXENV from .travis.yml unless needed 2020-04-28 17:44:19 +02:00
Adrián Chaves 5c0f11b4ef Simplify the asyncio Tox environment 2020-04-28 17:32:53 +02:00
Adrián Chaves 15d96ab8b5 Test the latest Ubuntu along the latest Python 2020-04-28 17:09:05 +02:00
Adrián Chaves e3c3ec2ba9 Run quick tests first in Travis CI 2020-04-28 13:48:50 +02:00
Ashe c207dbf939
Remove the asyncio warning from coroutines page (#4513) 2020-04-27 19:45:19 +02:00
BroodingKangaroo 204737042a Extract the slot closing functionality to the function; minor changes 2020-04-27 12:52:18 +03:00
BroodingKangaroo a18621552f Merge branch 'master' of https://github.com/BroodingKangaroo/scrapy into ISSUE-4250-add_batch_deliveries 2020-04-27 10:34:36 +03:00
BroodingKangaroo 2eee6c8101 Documentation spelling fix 2020-04-27 09:58:14 +03:00
BroodingKangaroo f0f1be76d1 Using time_id instead of time as a timestamp 2020-04-27 09:56:57 +03:00
Adrián Chaves 3878b67a37 Bump version: 2.0.0 → 2.1.0 2020-04-24 11:46:54 +02:00
Adrián Chaves ffe576c4ed
Cover Scrapy 2.1 in the release notes (#4499) 
Co-authored-by: Mikhail Korobov <kmike84@gmail.com>
 2020-04-24 11:44:36 +02:00
Eugenio Lacuesta efb6f13deb
Remove assertions from production code (#4440) 2020-04-23 12:40:10 +02:00
Aditya Kumar e4750f2fbd
async/deferred signal handlers (#4390) 
* [docs] async/deferred signal handlers

* [docs] update deferred signals example

* [docs] add subsections for built-in signals

* docs(signals): update signal handler example

* docs(signals): update signal handler example
 2020-04-20 20:47:57 +05:00
ilias-ant 773ddf77ba added more tests to cover the (downloaded, uptodate, cached) status functionality 2020-04-19 14:14:17 +03:00
sakshamb2113 bfeb2c8c13
Added warning to use double quotes in Windows for scrapy shell in shell.rst (#4450) 
* modified debugging memory leaks with guppy in leaks.rst

* modified leaks.rst(issue #4285)

* removed guppy from telnet.py

* Fix undefined name error

* removed hpy key from telnet_vars in telnet.py

* updated shell.rst

* Update docs/topics/shell.rst

Co-Authored-By: Adrián Chaves <adrian@chaves.io>

Co-authored-by: Adrián Chaves <adrian@chaves.io>
 2020-04-18 20:21:26 +05:00
Mikhail Korobov 66ab3347c2
Merge pull request #4507 from elacuesta/docs-update-deprecated-feed-settings 
Docs: replace deprecated FEED_FORMAT and FEED_URI settings
 2020-04-18 20:19:01 +05:00
BroodingKangaroo ec76445dd6 Update tests 2020-04-18 09:29:23 +03:00
Eugenio Lacuesta 04b6295a69
Docs: replace deprecated FEED_* settings 2020-04-17 20:50:17 -03:00
Mikhail Korobov 209ab05315
Merge pull request #4500 from victor-torres/reference-callback 
Serialize requests with callback references as spider attribute
 2020-04-17 18:58:28 +05:00