| .. |
|
sample_data
|
linkextractor: unique after urljoin_rfc
|
2010-04-02 19:45:30 +08:00 |
|
test_cmdline
|
Removed hacky SCRAPY_SETTINGS_DISABLED environment variable
|
2010-09-22 16:08:18 -03:00 |
|
test_contrib_ibl
|
Fix wrong slice of tokens in recursive extraction of follow region
|
2010-10-22 14:21:52 -02:00 |
|
test_djangoitem
|
use explicit relative import on djangoitem tests
|
2009-08-29 21:04:32 -03:00 |
|
test_spidermanager
|
Added ISpiderManager interface and a test to verify the default SpiderManager comforms to it
|
2010-09-03 14:29:27 -03:00 |
|
test_utils_misc
|
Rewritten walk_modules function to support eggs, and added tests
|
2010-07-30 17:05:55 -03:00 |
|
__init__.py
|
Added scrapy.utils.py26.json to use python2.6 json module when available, otherwise failback to simplejson module or scrapy.xlib.simplejson. This way we can always assume json and avoid conditional code.
|
2010-04-12 10:44:07 -03:00 |
|
test_clientform.py
|
Applied patch to ClientForm to fix bug with wrong entities. Also added tests and left patch in repo in case we upgrade ClientForm in the future and need to re-apply it
|
2010-07-13 19:46:53 -03:00 |
|
test_commands.py
|
Removed hacky SCRAPY_SETTINGS_DISABLED environment variable
|
2010-09-22 16:08:18 -03:00 |
|
test_contrib_exp_crawlspider_matchers.py
|
contrib_exp: added crawlspider v2 package + tests
|
2010-02-19 18:19:01 -04:00 |
|
test_contrib_exp_crawlspider_reqext.py
|
Support relative url used in base tag. closes #148
|
2010-03-25 12:38:37 -03:00 |
|
test_contrib_exp_crawlspider_reqgen.py
|
removed obsolete test
|
2010-06-09 13:06:05 -03:00 |
|
test_contrib_exp_crawlspider_reqproc.py
|
contrib_exp: added crawlspider v2 package + tests
|
2010-02-19 18:19:01 -04:00 |
|
test_contrib_exp_crawlspider_rules.py
|
made Spider name required again (do not default)
|
2010-04-05 12:34:29 -03:00 |
|
test_contrib_exp_crawlspider_spider.py
|
made Spider name required again (do not default)
|
2010-04-05 12:34:29 -03:00 |
|
test_contrib_exp_loader_lxmlloader.py
|
added LxmlItemLoader
|
2009-09-29 16:17:30 -03:00 |
|
test_contrib_exporter.py
|
Added JSON item exporter with doc and unittests (closes #192), and also:
|
2010-08-07 15:52:59 -03:00 |
|
test_contrib_feedexport.py
|
Added IFeedStorage interface and test all Feed Storages conform to it. Also added test for StdoutFeedStorage
|
2010-09-06 10:22:28 -03:00 |
|
test_contrib_linkextractors.py
|
BaseSgmlLinkExtractor: Fix extract '>>' as '>'
|
2010-09-19 19:28:35 -03:00 |
|
test_contrib_loader.py
|
Fixed Item Loader bug that was preventing values that evaluate to False from being loaded. Patch contributed by Anibal Pacheco. Closes #174
|
2010-08-22 22:07:44 -03:00 |
|
test_contrib_spidercontext.py
|
Added SpiderContext extension. Closes #203
|
2010-09-08 15:52:35 -03:00 |
|
test_contrib_spiderqueue.py
|
Added SpiderQueue tests. SQS spider queue not tested because operations take too long to complete and it's not easy to know when they have. Closes #227
|
2010-09-06 09:47:45 -03:00 |
|
test_dependencies.py
|
fixed bug in OpenSSL depedency test which was comparing versions alphabetically, instead of numerically
|
2009-12-02 13:59:58 -02:00 |
|
test_downloader_handlers.py
|
make download_timeout configurable by request. closes #229
|
2010-09-07 13:01:40 -03:00 |
|
test_downloadermiddleware_cookies.py
|
made Spider name required again (do not default)
|
2010-04-05 12:34:29 -03:00 |
|
test_downloadermiddleware_decompression.py
|
made Spider name required again (do not default)
|
2010-04-05 12:34:29 -03:00 |
|
test_downloadermiddleware_defaultheaders.py
|
Ported code to use new unified access to spider settings, keeping backwards compatibility for old spider attributes. Refs #245
|
2010-09-22 16:09:13 -03:00 |
|
test_downloadermiddleware_downloadtimeout.py
|
Ported code to use new unified access to spider settings, keeping backwards compatibility for old spider attributes. Refs #245
|
2010-09-22 16:09:13 -03:00 |
|
test_downloadermiddleware_httpauth.py
|
Added a weak key factory based cache
|
2010-09-06 00:50:56 -03:00 |
|
test_downloadermiddleware_httpcache.py
|
Splitted settings classes from settings singleton. Closes #244
|
2010-09-22 15:47:33 -03:00 |
|
test_downloadermiddleware_httpcompression.py
|
Force recalculating the encoding on HTTPCompression middleware until we are sure the responsetypes guessing is reliable. Refs #239, #240
|
2010-09-15 13:57:17 -03:00 |
|
test_downloadermiddleware_httpproxy.py
|
removed unused import
|
2010-08-10 18:26:40 -03:00 |
|
test_downloadermiddleware_redirect.py
|
Added dont_redirect request.meta key to make RedirectMiddleware ignore requests. Closes #233
|
2010-09-09 21:37:35 -03:00 |
|
test_downloadermiddleware_retry.py
|
Make RetryMiddleware obey Request.meta 'dont_retry' key when processing exceptions. Closes #259
|
2010-10-11 21:28:42 -02:00 |
|
test_downloadermiddleware_stats.py
|
StatsCollector: ported methods to receive spider instances (closes #113), removed list_domains() method, added iter_spider_stats() method
|
2009-11-14 20:28:59 -02:00 |
|
test_downloadermiddleware_useragent.py
|
Ported code to use new unified access to spider settings, keeping backwards compatibility for old spider attributes. Refs #245
|
2010-09-22 16:09:13 -03:00 |
|
test_dupefilter.py
|
made Spider name required again (do not default)
|
2010-04-05 12:34:29 -03:00 |
|
test_engine.py
|
Ported code to use new unified access to spider settings, keeping backwards compatibility for old spider attributes. Refs #245
|
2010-09-22 16:09:13 -03:00 |
|
test_http_cookies.py
|
Removed forked cookielib tests, because Python cookielib has been suffering several changes and maintaining a fork of the tests has become a pain. Instead, we've added specific tests for the urllib2 request/response wrappers
|
2010-09-27 07:55:27 -03:00 |
|
test_http_headers.py
|
added some unittests to make sure certain objects are using __slots__ and are also weak-referenceable
|
2009-08-18 20:40:04 -03:00 |
|
test_http_request.py
|
Added formname parameter for FormRequest.from_response
|
2010-09-20 08:33:24 -03:00 |
|
test_http_response.py
|
Changed TextResponse.replace() behaviour by keeping previous encoding when not specified
|
2010-09-09 18:01:00 -03:00 |
|
test_item.py
|
Raise when trying to set an item field value using setattr api, and added tests.
|
2010-06-22 14:00:31 -03:00 |
|
test_libxml2.py
|
* Added lxml backend for XPath selectors. Closes #147
|
2010-10-25 14:47:10 -02:00 |
|
test_log.py
|
Added support for logging twisted errors generated outside of Scrapy - refs #188
|
2010-08-05 20:46:54 -03:00 |
|
test_logformatter.py
|
Fixed encoding error with some item dropped messages. Closes #232
|
2010-09-08 15:34:13 -03:00 |
|
test_mail.py
|
removed (somewhat hacky) MAIL_DEBUG setting
|
2010-08-22 22:42:00 -03:00 |
|
test_middleware.py
|
Splitted settings classes from settings singleton. Closes #244
|
2010-09-22 15:47:33 -03:00 |
|
test_pipeline_images.py
|
disconnect signals before uninstalling crawler in image tests
|
2010-10-23 05:10:52 -02:00 |
|
test_pipeline_media.py
|
test media_to_download mediapipeline hook. ref #269
|
2010-10-25 13:16:11 -02:00 |
|
test_queue.py
|
Fixed issue with unicode keyword arguments bug in earlier Python versions (see http://bugs.python.org/issue2646). Closes #250
|
2010-09-25 21:17:36 -03:00 |
|
test_responsetypes.py
|
Fixed bug in HTTP Compression middleware which was failing to properly discover the encoding when the encoding was declared inside the response body. Closes #239. Also changed responsetypes to return Response class (instead of HtmlResponse) when the response has a Content-Encoding header
|
2010-09-14 20:22:25 -03:00 |
|
test_schedulermiddleware_duplicatesfilter.py
|
moved scrapy.core.exceptions to scrapy.exceptions, keeping backwards compatibility
|
2010-08-10 17:36:48 -03:00 |
|
test_selector_libxml2.py
|
* Added lxml backend for XPath selectors. Closes #147
|
2010-10-25 14:47:10 -02:00 |
|
test_selector_lxml.py
|
skip lxml selector tests if lxml is not available. refs #147
|
2010-10-25 14:56:33 -02:00 |
|
test_settings.py
|
Added tests for CrawlerSettings and SpiderSettings classes
|
2010-09-22 16:09:13 -03:00 |
|
test_spider.py
|
Don't set allowed_domains attribute in BaseSpider constructor
|
2010-09-04 03:20:05 -03:00 |
|
test_spidermiddleware_depth.py
|
Removed settings.disabled hack used in some tests. Closes #143
|
2010-09-06 11:04:27 -03:00 |
|
test_spidermiddleware_httperror.py
|
silence HttpError exceptions raised by httperror spidermiddleware if not handled by spider
|
2010-05-21 17:54:32 -03:00 |
|
test_spidermiddleware_offsite.py
|
Don't filter out requests coming from spiders that don't define allowed_domains. Closes #225
|
2010-09-04 02:23:04 -03:00 |
|
test_spidermiddleware_referer.py
|
made Spider name required again (do not default)
|
2010-04-05 12:34:29 -03:00 |
|
test_spidermiddleware_urllength.py
|
Removed settings.disabled hack used in some tests. Closes #143
|
2010-09-06 11:04:27 -03:00 |
|
test_spiderqueue.py
|
Added SpiderQueue tests. SQS spider queue not tested because operations take too long to complete and it's not easy to know when they have. Closes #227
|
2010-09-06 09:47:45 -03:00 |
|
test_stats.py
|
Splitted stats collector classes from stats collection facility (#204)
|
2010-08-22 01:24:07 -03:00 |
|
test_urlparse_monkeypatches.py
|
monkeypatch urlparse if s3 netloc parsing fails (python issue7904). closes #223
|
2010-09-04 01:02:52 -03:00 |
|
test_utils_conf.py
|
Support passing spider arguments in crawl command with -a option. Closes #216
|
2010-08-28 14:43:28 -03:00 |
|
test_utils_datatypes.py
|
mv scrapy/trunk to root as part of svn2hg migration
|
2009-05-06 15:55:17 -03:00 |
|
test_utils_defer.py
|
Improve spider errors logging which were previously logged as confusing "Unhandled errors" - closes #196
|
2010-08-13 01:45:47 -03:00 |
|
test_utils_encoding.py
|
Some improvements to Response encoding support:
|
2010-03-25 15:47:10 -03:00 |
|
test_utils_http.py
|
Added a weak key factory based cache
|
2010-09-06 00:50:56 -03:00 |
|
test_utils_httpobj.py
|
remove Url class and use str instead for Request and Response urls. Also added urlparse_cached function for achieving the same caching functionality provided by old Url class
|
2009-08-17 21:16:55 -03:00 |
|
test_utils_iterators.py
|
* Added lxml backend for XPath selectors. Closes #147
|
2010-10-25 14:47:10 -02:00 |
|
test_utils_jsonrpc.py
|
Check that arguments and keyword arguments are not passed simultaneously in jsonrpc_client_call()
|
2010-08-27 13:45:52 -03:00 |
|
test_utils_markup.py
|
remove_tags: add keep argument
|
2010-04-24 19:08:01 +08:00 |
|
test_utils_memory.py
|
Fixed exception thrown when in FreeBSD when /proc exists but it's not mounted. Closes #235
|
2010-09-10 15:17:36 -03:00 |
|
test_utils_python.py
|
Fixed issue with unicode keyword arguments bug in earlier Python versions (see http://bugs.python.org/issue2646). Closes #250
|
2010-09-25 21:17:36 -03:00 |
|
test_utils_request.py
|
Make url/body attributes of Request/Response objects read-only - use replace() to change them. Deprecation warning left for backwards compatibilty.
|
2010-09-08 00:15:11 -03:00 |
|
test_utils_response.py
|
Fixed bug with float values in meta refresh
|
2010-07-01 11:46:06 -03:00 |
|
test_utils_serialize.py
|
Replaced old manager references with crawler
|
2010-08-25 19:31:04 -03:00 |
|
test_utils_signal.py
|
Added support for returning deferreds from (some) signal handlers. Closes #193
|
2010-08-14 21:10:37 -03:00 |
|
test_utils_simpledb.py
|
simpledb collector: moved to_sdb_value function to utils.simpledb, and added unittests
|
2009-08-30 12:37:30 -03:00 |
|
test_utils_spider.py
|
Fixed bug with runspider command that appeared after the introduction of new spider manager in r2121. Also factored out common code shared by new spider manager and runspider command, with tests included.
|
2010-08-19 01:58:10 -03:00 |
|
test_utils_sqlite.py
|
Fixed bugs with SQLiteDict and added tests
|
2010-09-08 14:32:28 -03:00 |
|
test_utils_url.py
|
Another fix to tests, broken by recent Python changes
|
2010-09-26 21:09:14 -03:00 |
|
test_webclient.py
|
Fixed issue with non-standard line ending in HTTP headers. Closes #258
|
2010-10-09 20:43:05 -02:00 |