Konstantin Lopuhin
b5c552d17f
Merge pull request #2061 from elacuesta/process_spider_exception_generator
...
[MRG+1] process_spider_exception on generators
2019-04-01 10:43:19 +03:00
Eugenio Lacuesta
f5e0b6b89a
parse command: rename cb_kwargs option to cbkwargs
2019-03-29 14:03:26 -03:00
Eugenio Lacuesta
e8af6331b5
Add cb_kwargs option to the parse command
2019-03-28 15:03:40 -03:00
Eugenio Lacuesta
70a4d93aa3
Callback kwargs: more tests
2019-03-28 13:28:19 -03:00
Mikhail Korobov
ec719f55e7
Merge pull request #3682 from elacuesta/rule_process_request_response_parameter
...
[MRG+1] Rule.process_request: access Response object
2019-03-28 01:39:54 +05:00
Eugenio Lacuesta
c43a23152b
Merge remote-tracking branch 'upstream/master' into callback_kwargs
2019-03-27 14:42:41 -03:00
Maram Sumanth
2fd8b7c28c
[MRG+1] redirect_reasons in Request.meta ( #3687 )
2019-03-27 00:15:53 +05:00
Vostretsov Nikita
73e4ff5304
report warnings
2019-03-25 13:48:58 +00:00
Vostretsov Nikita
103fdc40c1
Merge remote-tracking branch 'upstream/master' into round-robin-scheduler-tested
2019-03-25 16:16:42 +03:00
Vostretsov Nikita
31b8a6b33a
report warnings
2019-03-25 16:08:40 +03:00
Lucy Wang
df574de8cc
improve tests and fix some lint warnings ( #6 )
...
* refactor downloader-aware test cases
* fix lint
* add doctest for _path_safe
* remove unused code
* better doctest
2019-03-25 16:08:40 +03:00
Vostretsov Nikita
8afffb7234
Tests Cleanup
...
add doctest for function
no need in this variables
move common assertion inside function
rename variable
rename variables
rename function
use function
this is not a method of public API
correct name for test
Update docs/topics/settings.rst
Co-Authored-By: whalebot-helmsman <whalebot.helmsman@gmail.com>
2019-03-25 16:08:40 +03:00
Vostretsov Nikita
989bba6cb3
Revert "new signal"
...
This reverts commit 646164fd7d6dd52061804d2df7424cff929bf739.
remove tests
Revert "emit new signal"
This reverts commit fcde0c6880678957a76af6083b6248f430a00fcf.
Revert "documentation for new signal"
This reverts commit 8aeb9f696ece95c16499a96767a7afa3d9c4abf4.
2019-03-25 16:08:40 +03:00
Vostretsov Nikita
443fb98a47
Use downloader directly
...
rename variable
remove old write function
remove unused imports
remove old read function
remove unused function
use mock methods
mock downloader
close downloader
add parse method
use new PQ class
create mock downloader
use downloader directly
remove mark/unmark mechanism
2019-03-25 16:08:40 +03:00
Vostretsov Nikita
3b1db71dac
New signal
...
update signature
documentation for new signal
utilize new signal
correct signal handler signature
emit new signal
test another signal
new signal
rename test file
faster test
rename test case
tests for signal emitting in bad cases
2019-03-25 16:08:40 +03:00
Vostretsov Nikita
757f53a324
Address Lucy's comments
...
add tests to check correctness of slot setermination
unmark requests after downloading
shorter
better exception message
2019-03-25 16:08:40 +03:00
Mikhail Korobov
90934959d0
actually apply __slots__ suggestion
...
[wip] refactoring
* SlotPriorityQueues doesn't care about objects inside, it is now just
a container for multiple priority queues
* assorted variable renames
* don't inherit DownloaderAwarePriorityQueue from SlotBasedPriorityQueue
* apply @whalebot-helmsman's suggestions for __slots__ and meta issues
more bike-shedding
* remove mutable default arguments
* more verbose variable names
remove unneeded code
* PriorityAsTupleQueue.is_empty does the same as len(self) == 0
* custom PriorityAsTupleQueue.close is not needed after a switch
to namedtuples
* is_new and is_empty return values are unused
* "url" local variable is unused
PrioritySlot.__str__ shouldn't return unicode in Python 2
also, do some bike-shedding: _pathable -> _path_safe
use namedtuple for PrioritySlot
cleanup: _get_from_request does the same here
Request.meta is always a dict
2019-03-25 16:08:40 +03:00
Eugenio Lacuesta
1b4385b7e3
Rule.process_request: move deprecation warnings and compiling code, update tests
2019-03-22 19:46:17 -03:00
Mikhail Korobov
729580dae2
Merge pull request #3671 from Gallaecio/item-deepcopy
...
Implement Item.deepcopy()
2019-03-22 22:56:39 +05:00
Adrián Chaves
7c148fce5a
Implement Item.deepcopy()
2019-03-22 17:07:10 +01:00
Konstantin Lopuhin
af2b666595
Merge pull request #3505 from kasun/json_request
...
[MRG+2] Request subclass for json requests #3504
2019-03-22 18:25:54 +03:00
Vostretsov Nikita
987c2ae4a9
test ip concurrency incompatibility with DAPQ
2019-03-22 15:40:37 +03:00
Vostretsov Nikita
4163a7a1c7
no need for this
2019-03-22 15:40:37 +03:00
Vostretsov Nikita
d970be64cc
Integration test
...
integration testing only everything is working, not logic of PQ
use method
create slot attribute in constructor
corect class for test case
stop crawler in teardown method
use class
correct entity naming
python 2 adaptation
integration test with crawler and spider
2019-03-22 15:40:36 +03:00
Vostretsov Nikita
a23e1894b3
Fix boto problem
...
another way to fix boto problem
Revert "fix for travis ci based on https://github.com/boto/boto/issues/3717 "
This reverts commit 150d2564ff0ea994652da7f5be333d72e0b38d93.
fix for travis ci based on https://github.com/boto/boto/issues/3717
2019-03-22 15:40:36 +03:00
Vostretsov Nikita
f56079f6c7
Test cleanups
...
PEP8 fixes
no need to close implicitly
do not use pytest
need to put it into class
remove round-robin queue
additional check for empty queue
use pytest tmpdir fixture
2019-03-22 15:40:36 +03:00
Vostretsov Nikita
821f5bb260
First implementation
...
handle exception
use O(N) instead of O(NlogN)
here we have request as struct
additional check for meptiness
small performance improvement
do not consume another request
test number of responses
mark requests
back to 3 slots test case
raise exceptions in case of missed meta
add marks to requests and work only with your own requests
only disk queue should obtain signals
separate functions for slot rasd/write
use signlas without variable
stop crawler
get signals in correct place
logic test for download-aware priority queue
update comment for structure
ensure text type
transform slot name to path
use implicit structure
use unicode type implicitly
use real crawler
add signals
more slot accounting
simple implementation of pop
small slot accounting code
no need for custom len function
ability to call super in py27
add slots
generic tests for downloader aware queue
dummy implementation of crawler aware priority queue
move common logic to base class
rename class
pass crawler to pqclass constructor
do not copy quelib.PriorityQueue code
add comment about new class
remove obsolete function
modify behaviour of queuelib.PriorityQueue to dodge very complex priority
better way to get name
remove obsolete commentary
check boundaries
function for priority convertion with known limits
correct import path
move file
do not switch on by deffault as ip concurrency not supported
set scheduler slot in case of empty slot
use constant
single place for added urls
single place for constants
use as default queue
correct format for error text
test migration from old version with on disk queue
in these tests we have only two inflection points - jobdir and priority_queue_cls
we do not need separate mock spider, use usual one
do not rely on order of dict elements, imply order of list
test round robiness of priority queue
add comments and requirements for our magick function
remove debug logging
put queues into slot
as we fabricate priorities we do not need special types anymore
fabricate priority for priority queue
more versatile priorities
Scheduler class is not inflection point
wrap correct types
check for emptinees before initialization
tests for new priority queue
correct default type for startprios
use exact values
put common settings to base class
test priorities for disk scheduler
test dequeue for disk scheduler
test length for disk scheduler
setUp/tearDown methods for on disk schedulers
new methods
remove excessive line
base class to handle scheduler creation
correct method names
test priorities
deque test
close scheduler on test end
enqueue some requests
test template for scheduler
use downloader slot
I/O implementation for RoundRobin queue
round-robin implementation without I/O and slot detection
wrappers for every disk queue class
2019-03-22 15:40:36 +03:00
Eugenio Lacuesta
6760bca74b
Rename Request.kwargs to Request.cb_kwargs
2019-03-15 22:42:29 +00:00
Eugenio Lacuesta
645e8d16a4
Count keyword argument checks
2019-03-15 22:20:36 +00:00
Eugenio Lacuesta
01ed605d02
PEP8 changes to test_spider.py
2019-03-15 16:54:14 +00:00
Victor Torres
fda1d04b81
Merge branch 'master' into feed-storage-s3-acl
2019-03-15 13:26:45 -03:00
Adrián Chaves
70a0f1f2e4
Merge pull request #3610 from Gallaecio/spidercls-check
...
[MRG+1] Check that spidercls arguments in scrapy.crawler classes are not spid…
2019-03-15 08:25:16 +01:00
Adrián Chaves
1f7413dc88
Merge pull request #3635 from matthieucham/feature-filteringlinkextractor-restrict-text
...
[MRG+1] Feature filteringlinkextractor restrict text
2019-03-15 07:58:28 +01:00
Mikhail Korobov
5dc94db847
Merge branch 'master' into backward
2019-03-14 22:21:09 +05:00
Eugenio Lacuesta
22fda61d62
Rule.process_request: tests
2019-03-13 10:54:38 +00:00
Adrián Chaves
75d6f56c8a
Switch from ` to `` where inline code formatting is desired
2019-03-01 16:56:58 +01:00
Adrián Chaves
858f5be747
backwards → backward (adj.)
2019-03-01 16:10:23 +01:00
Matthieu Grandrie
e3b15252c8
New constructor arg *restrict_text* for FilteringLinkExtractor.
...
Same as allow and deny args, it holds a string, a regex or an iterable of. Links whose text don't match one of the regex are filtered out.
DOC restrict_text in LxmlLinkExtractor
2019-02-28 17:21:17 +01:00
Victor Torres
9b8ba4c383
try to import botocore before runing some tests
2019-02-14 16:20:56 -02:00
Victor Torres
ea8be627d1
botocore is not supported on debian jessie
2019-02-13 20:32:36 -02:00
Victor Torres
dc0b643832
refactoring tests to avoid mocking private method
2019-02-13 19:44:50 -02:00
Adrián Chaves
03e61b9908
Check that spidercls arguments in scrapy.crawler classes are not spider objects
2019-02-12 14:46:27 +01:00
Victor Torres
1eac2a163c
simplifying how we deal with threads.deferToThread calls
2019-02-08 16:50:39 -02:00
Victor Torres
f824f5b2d1
testing public method store instead of private method _store_in_thread
...
need to mock deferToThread function
2019-02-08 15:51:23 -02:00
Victor Torres
079af889e7
also testing without botocore
2019-02-08 15:51:23 -02:00
Victor Torres
126207fb7b
PEP8: use short name for mock method
2019-02-08 15:51:23 -02:00
Victor Torres
ad83ffdf1f
refactoring
2019-02-08 15:51:23 -02:00
Daniel Graña
65d631329a
Be consistent with domain used for links to documentation website
2019-01-31 01:28:53 -03:00
Júlio César Batista
8eade7d864
Testing stats and log messages from RFPDupeFilter
2019-01-18 11:39:35 -02:00
kasun Herath
f3813e376c
Merge remote-tracking branch 'origin/master' into json_request
2019-01-14 23:03:21 +05:30
kasun Herath
3f914f6d8c
made jsonrequest dump into private method
2019-01-14 23:03:14 +05:30
Eugenio Lacuesta
57e7c76977
Test callback kwargs
2019-01-09 10:40:44 -03:00
Eugenio Lacuesta
770a501fb3
Test request kwargs (copy, serialization)
2019-01-09 10:40:03 -03:00
Eugenio Lacuesta
9759112a3a
Merge branch 'master' into process_spider_exception_generator
2019-01-03 11:34:07 -03:00
Victor Torres
fe283bcd05
add test case for sitemap filter with alternate links
2018-12-27 11:40:14 -03:00
Victor Torres
5e7ecf9dc1
add tests for sitemapindex
2018-12-27 11:40:14 -03:00
Victor Torres
657f0663b3
rename param from urls to entries
2018-12-27 11:40:14 -03:00
Victor Torres
d7d5917ff1
add tests for the sitemap_filter method in the SitemapSpider class
2018-12-27 11:40:14 -03:00
Daniel Graña
93cf38354d
Merge pull request #3394 from hcoura/dh-lazyloading-optional
...
Make lazy loading Download Handlers optional
2018-12-26 11:16:19 -03:00
Daniel Graña
f6ce716372
Merge pull request #3476 from elacuesta/deque_appendleft
...
[MRG+1] Use collections.deque instead of list to store MiddlewareManager's methods
2018-12-26 11:13:52 -03:00
Mikhail Korobov
dbfabf02e8
Merge branch 'master' into telnet-auth
2018-12-26 01:04:34 +05:00
kasun Herath
8f1507a4a5
dumps_kwargs
2018-12-17 23:14:06 +05:30
kasun Herath
ecda69130e
allow to send empty data values and docs changes
2018-12-10 22:34:49 +05:30
kasun Herath
c347acbff6
warning if body and data are provided
2018-12-09 11:27:09 +05:30
kasun Herath
cd619c1d4f
removed overriden replace method
2018-12-08 22:10:45 +05:30
kasun Herath
1b2b8b4bf0
fix tests under py3
2018-11-27 08:57:44 +05:30
kasun Herath
1ce6662a9d
Implement Request subclass for json requests
2018-11-24 20:02:00 +05:30
Eugenio Lacuesta
f97e3e90f2
Use collections.deque instead of list to store methods
2018-10-29 12:40:20 -03:00
Eugenio Lacuesta
e0360e5223
Add tests for MutableChain
2018-10-11 11:55:13 -03:00
Eugenio Lacuesta
2396356a82
Merge branch 'master' into process_spider_exception_generator
2018-10-10 11:37:43 -03:00
Henrique Coura
441e1e750f
Style changes
2018-09-26 13:28:34 -03:00
Henrique Coura
e57a629efc
Generate only password, encode username/password only on login
2018-09-26 11:54:57 -03:00
Henrique Coura
37cfb49805
Randomly generate telnet credentials by default
2018-09-24 16:42:49 -03:00
Mikhail Korobov
2c3b2158c9
DOC address @stummjr's review comments
...
* fixed several small issues
* re-written "Creating Selectors" section
* fixed remaining .extract usage in tests
2018-09-18 05:02:17 +05:00
Mikhail Korobov
53da56c8dc
TST update tests to use get/getall/attrib instead of extract
2018-09-12 17:57:27 +05:00
Daniel Graña
7223978594
Merge pull request #3381 from StasDeep/fix/issue-3380
...
[MRG+1] Use dont_filter=True for contracts requests
2018-09-06 11:41:02 -03:00
Daniel Graña
2aae514f99
Merge branch 'master' into fix/issue-3380
2018-09-05 12:25:07 -03:00
Daniel Graña
d7b98a3714
Merge branch 'master' into feature/issue-3364
2018-09-05 11:26:59 -03:00
Daniel Graña
ae8a0dc77c
Merge pull request #3383 from StasDeep/feature/issue-3382
...
[MRG+1] Add ability to use FormRequest in contracts
2018-09-05 11:21:26 -03:00
Daniel Graña
4da0b59cd7
Merge pull request #3393 from whalebot-helmsman/singal-request-added-to-downloader-slot
...
[MRG+1] New signal for reqeuests reached downloader
2018-09-05 11:17:13 -03:00
Stas Glubokiy
8dbbbd1395
Use request_cls attribute in contract definition
2018-09-03 20:07:37 +03:00
Henrique Coura
167211ffb0
Default is lazy, load_object exception handling, code improvements
2018-08-20 15:54:04 -03:00
Stas Glubokiy
9ab85fe788
Merge branch 'master' of github.com:StasDeep/scrapy into feature/issue-3382
2018-08-19 17:21:28 +03:00
Stas Glubokiy
57824600a8
Use six.get_unbound_function in test_same_url
2018-08-19 16:56:41 +03:00
Stas Glubokiy
0467737cf0
Fix mockserver usage
2018-08-18 15:43:46 +03:00
Stas Glubokiy
1311f6b536
Merge branch 'master' of github.com:StasDeep/scrapy into fix/issue-3380
2018-08-18 15:42:10 +03:00
Stas Glubokiy
11576f5c8f
Merge branch 'master' of github.com:StasDeep/scrapy into feature/issue-3364
2018-08-18 15:24:07 +03:00
Henrique Coura
5bac436764
Make lazy loading Download Handlers optional
2018-08-17 15:07:37 -03:00
Vostretsov Nikita
afb1458bd3
tests for new signal
2018-08-17 14:39:54 +00:00
Mikhail Korobov
c7654f7cb1
Merge pull request #3379 from StasDeep/fix/issue-3378
...
Use inspect.getmembers in tested_methods_from_spidercls
2018-08-17 19:25:41 +05:00
Stas Glubokiy
ddd69f4c10
Use MockServer in test_same_url
2018-08-15 20:39:43 +03:00
Stas Glubokiy
2cb4decb6a
Move TestSameUrlSpider to test method
2018-08-15 20:36:10 +03:00
Stas Glubokiy
4de493efdd
Add test_same_url
2018-08-15 20:24:00 +03:00
Daniel Graña
38608bc249
Use ignore_errors option from rmtree
2018-08-15 11:59:09 -03:00
Daniel Graña
4eaf8690b1
Twisted's unittest.Testcase assertRaiess can't be used as context manager
2018-08-15 08:54:18 -03:00
Daniel Grana
a304d6b692
Workaround to pass tests/test_feedexporter.py under windows
2018-08-15 02:23:07 -07:00
Daniel Grana
e7fe243c3e
Fix test_crawler under windows
2018-08-15 01:09:23 -07:00
Daniel Grana
96517cb7de
Fix test_command_parse under windows
2018-08-15 01:08:40 -07:00
Daniel Graña
d93d960319
Fix test_utils_project under Windows
2018-08-15 01:53:20 -03:00
Jakob de Maeyer
cb28175750
Fix csviter tests by explicitly using newline only
2018-08-15 01:35:01 -03:00
Daniel Graña
ca53a8699a
Fix presentation of template directory in startproject command
2018-08-15 01:35:01 -03:00
Daniel Graña
0e532e3dd8
Creating a connection to 0.0.0.0 fails on windows but not on linux nor mac
2018-08-15 01:35:01 -03:00
Daniel Graña
a21abac743
fix ftp tests on windows
2018-08-15 01:35:01 -03:00
Daniel Graña
fb09148c91
Fix bad merge on ParseCommandTest
2018-08-15 01:35:01 -03:00
Jakob de Maeyer
22505a34a9
Fix cmdline profiling test on Windows by using proper path composing
2018-08-15 01:35:01 -03:00
Jakob de Maeyer
034152961d
Fix Feedexport test in Windows by using proper file URI
2018-08-15 01:35:01 -03:00
Daniel Graña
ed8255bde0
Fix merge issues with stderr/out fixes for windows buffering
2018-08-15 01:33:38 -03:00
Jakob de Maeyer
57a1d66c61
Fix test issues caused by Windows pipe buffer filling up
2018-08-15 01:33:38 -03:00
Jakob de Maeyer
152fde70b1
Fix FTPTestCase by using Windows-friendly temporary file name
2018-08-15 01:33:38 -03:00
Daniel Graña
19ad94105f
pywin32 is required to run tests under windows
2018-08-15 01:33:38 -03:00
Daniel Graña
4c53957f5b
Skip leveldb tests on windows
2018-08-15 01:33:38 -03:00
Stas Glubokiy
b4b1e48343
Add ability to use FormRequest in contracts
2018-08-11 22:18:43 +03:00
Stas Glubokiy
76220e8733
Use inspect.getmembers in tested_methods_from_spidercls
2018-08-11 18:49:12 +03:00
Stas Glubokiy
8bc536d88b
Merge branch 'master' of github.com:StasDeep/scrapy into feature/issue-3364
2018-08-11 18:34:37 +03:00
Stas Glubokiy
ebbde57eca
Add custom contracts tests
2018-08-11 18:21:07 +03:00
Stas Glubokiy
16dad81715
Fix contract errback
2018-08-09 21:07:25 +03:00
Eugenio Lacuesta
40449fa0eb
Update docs, add tests, remove FIXME comment
2018-08-03 18:20:25 -03:00
Eugenio Lacuesta
8c55f5eb15
Simplify check for re-raised exception. Add tests.
2018-08-03 15:16:26 -03:00
Daniel Graña
db714f5a07
Merge pull request #3283 from CCInCharge/issue3247
...
Fix #3247 : Allow scrapy.FormRequest.from_response method to handle duplicate keys
2018-08-02 14:49:14 -03:00
Eugenio Lacuesta
801d3c07b4
Fix bad exception handling, add tests
2018-07-27 15:06:37 -03:00
Eugenio Lacuesta
d6d3e87e3a
Rename test file
2018-07-27 14:47:52 -03:00
Eugenio Lacuesta
9e14f8c7e4
Fix test for dupefilter
2018-07-26 16:24:58 -03:00
Eugenio Lacuesta
0089a4ab31
Add test for direct creation of dupefilter (no from_crawler/from_settings)
2018-07-26 16:24:58 -03:00
Eugenio Lacuesta
d306fe30ac
Test dupefilter creation by the Scheduler
2018-07-26 16:24:58 -03:00
Eugenio Lacuesta
701cd2ff9d
Add from_crawler support to dupefilters
2018-07-26 16:24:58 -03:00
CCInCharge
782f866572
Fix #3247 : Allow scrapy.FormRequest.from_response method to handle duplicate keys
2018-07-25 21:46:42 -07:00
Daniel Graña
b6abd45926
Merge pull request #3342 from elacuesta/copy-request-flags
...
[MRG+1] Include flags when copying requests
2018-07-25 11:58:25 -03:00
Eugenio Lacuesta
784eed1130
Improve test coverage (downloader middleware)
2018-07-20 19:08:46 -03:00
Eugenio Lacuesta
917c1fde68
Merge branch 'master' into enhancement/alternate-feedexport-constructors
2018-07-20 12:09:50 -03:00
Eugenio Lacuesta
98d74d1083
Requested changes
2018-07-20 12:08:49 -03:00
Eugenio Lacuesta
6a38fc39f8
Include flags when copying requests
2018-07-19 11:56:23 -03:00
Eugenio Lacuesta
71a1406c99
Logging changes
2018-07-18 17:43:05 -03:00
Eugenio Lacuesta
6329441c82
ModuleNotFoundError was added in py3.6
2018-07-18 17:31:31 -03:00
Eugenio Lacuesta
a3af0bfd56
More tests
2018-07-18 15:15:55 -03:00
Eugenio Lacuesta
56e92d90fd
Update tests
2018-07-17 15:15:38 -03:00
Eugenio Lacuesta
e96b7782bc
Merge branch 'master' into process_spider_exception_generator_experiment
2018-07-15 18:17:37 -03:00
Eugenio Lacuesta
b8e8922d54
Simplify stuff. Add more tests.
2018-07-15 18:17:00 -03:00
Eugenio Lacuesta
cff9e87625
Fix tests
2018-07-15 16:21:08 -03:00
Eugenio Lacuesta
e7e18db179
Fix tests
2018-07-13 16:40:30 -03:00
Daniel Graña
01e317e79b
Merge pull request #3327 from nyov/deprecations
...
[MRG+1] Remove deprecated CrawlerSettings class and Settings attributes
2018-07-11 12:01:49 -03:00
Daniel Graña
9c6d265280
Merge pull request #3152 from nctl144/ftp_linkextractors
...
[MRG+1] add ftp to the scheme list
2018-07-11 11:50:02 -03:00
nyov
4f6778aa73
Remove deprecated CrawlerSettings class and Settings attributes
2018-07-09 17:16:31 +00:00
Konstantin Lopuhin
92b504eae5
Fix telnet warnings in tests
...
Disable telnet console if it's not available, else we'll get an extra
warning about failure to enable it, and tests will fail.
2018-07-09 13:44:02 +03:00
Konstantin Lopuhin
722e1afcdb
Update ancient pytest on python 3
...
2.9 gives collection errors on python 3.7 due to PEP 479.
2018-07-09 12:21:19 +03:00
Eugenio Lacuesta
0a0e62272e
New tests
2018-07-04 16:19:19 -03:00
Eugenio Lacuesta
0b2870634a
Do not inherit from object
2018-07-04 16:14:51 -03:00
chainly
74ce156154
add item_error to be catchable ( #3256 )
2018-07-03 16:00:59 -03:00
Eugenio Lacuesta
4fca9aba85
Recover from a callback exception
2018-07-01 13:45:18 -03:00
Eugenio Lacuesta
6ed9440ed5
Tests for exceptions on spider callbacks
2018-07-01 13:45:18 -03:00
Eugenio Lacuesta
735de8167d
Test for exceptions on process_spider_input
2018-07-01 13:45:18 -03:00