| .. |
|
sample_data
|
linkextractor: unique after urljoin_rfc
|
2010-04-02 19:45:30 +08:00 |
|
test_cmdline
|
Yet another scrapy.cmdline code refactoring by removing --settings and --version options, adding a version command and adding a UsageError exception for signaling usage errors. Updated all commands accordingly
|
2010-08-28 18:06:51 -03:00 |
|
test_contrib_ibl
|
Fixed tests on Windows
|
2010-08-22 19:37:20 -03:00 |
|
test_djangoitem
|
use explicit relative import on djangoitem tests
|
2009-08-29 21:04:32 -03:00 |
|
test_spidermanager
|
Added ISpiderManager interface and a test to verify the default SpiderManager comforms to it
|
2010-09-03 14:29:27 -03:00 |
|
test_utils_misc
|
Rewritten walk_modules function to support eggs, and added tests
|
2010-07-30 17:05:55 -03:00 |
|
__init__.py
|
Added scrapy.utils.py26.json to use python2.6 json module when available, otherwise failback to simplejson module or scrapy.xlib.simplejson. This way we can always assume json and avoid conditional code.
|
2010-04-12 10:44:07 -03:00 |
|
test_clientform.py
|
Applied patch to ClientForm to fix bug with wrong entities. Also added tests and left patch in repo in case we upgrade ClientForm in the future and need to re-apply it
|
2010-07-13 19:46:53 -03:00 |
|
test_commands.py
|
Yet another scrapy.cmdline code refactoring by removing --settings and --version options, adding a version command and adding a UsageError exception for signaling usage errors. Updated all commands accordingly
|
2010-08-28 18:06:51 -03:00 |
|
test_conf.py
|
Added Settings class tests, and fixed minor bug
|
2009-12-02 15:52:17 -02:00 |
|
test_contrib_exp_crawlspider_matchers.py
|
contrib_exp: added crawlspider v2 package + tests
|
2010-02-19 18:19:01 -04:00 |
|
test_contrib_exp_crawlspider_reqext.py
|
Support relative url used in base tag. closes #148
|
2010-03-25 12:38:37 -03:00 |
|
test_contrib_exp_crawlspider_reqgen.py
|
removed obsolete test
|
2010-06-09 13:06:05 -03:00 |
|
test_contrib_exp_crawlspider_reqproc.py
|
contrib_exp: added crawlspider v2 package + tests
|
2010-02-19 18:19:01 -04:00 |
|
test_contrib_exp_crawlspider_rules.py
|
made Spider name required again (do not default)
|
2010-04-05 12:34:29 -03:00 |
|
test_contrib_exp_crawlspider_spider.py
|
made Spider name required again (do not default)
|
2010-04-05 12:34:29 -03:00 |
|
test_contrib_exp_loader_lxmlloader.py
|
added LxmlItemLoader
|
2009-09-29 16:17:30 -03:00 |
|
test_contrib_exporter.py
|
Added JSON item exporter with doc and unittests (closes #192), and also:
|
2010-08-07 15:52:59 -03:00 |
|
test_contrib_feedexport.py
|
Added IFeedStorage interface and test all Feed Storages conform to it. Also added test for StdoutFeedStorage
|
2010-09-06 10:22:28 -03:00 |
|
test_contrib_linkextractors.py
|
linkextractor: unique after urljoin_rfc
|
2010-04-02 19:45:30 +08:00 |
|
test_contrib_loader.py
|
Fixed Item Loader bug that was preventing values that evaluate to False from being loaded. Patch contributed by Anibal Pacheco. Closes #174
|
2010-08-22 22:07:44 -03:00 |
|
test_contrib_spiderqueue.py
|
Added SpiderQueue tests. SQS spider queue not tested because operations take too long to complete and it's not easy to know when they have. Closes #227
|
2010-09-06 09:47:45 -03:00 |
|
test_dependencies.py
|
fixed bug in OpenSSL depedency test which was comparing versions alphabetically, instead of numerically
|
2009-12-02 13:59:58 -02:00 |
|
test_downloader_handlers.py
|
make download_timeout configurable by request. closes #229
|
2010-09-07 13:01:40 -03:00 |
|
test_downloadermiddleware_cookies.py
|
made Spider name required again (do not default)
|
2010-04-05 12:34:29 -03:00 |
|
test_downloadermiddleware_decompression.py
|
made Spider name required again (do not default)
|
2010-04-05 12:34:29 -03:00 |
|
test_downloadermiddleware_defaultheaders.py
|
Added a weak key factory based cache
|
2010-09-06 00:50:56 -03:00 |
|
test_downloadermiddleware_downloadtimeout.py
|
make download_timeout configurable by request. closes #229
|
2010-09-07 13:01:40 -03:00 |
|
test_downloadermiddleware_httpauth.py
|
Added a weak key factory based cache
|
2010-09-06 00:50:56 -03:00 |
|
test_downloadermiddleware_httpcache.py
|
Make ignored schemes configurable in HttpCacheMiddleware. closes #224
|
2010-09-04 02:58:43 -03:00 |
|
test_downloadermiddleware_httpcompression.py
|
made Spider name required again (do not default)
|
2010-04-05 12:34:29 -03:00 |
|
test_downloadermiddleware_httpproxy.py
|
removed unused import
|
2010-08-10 18:26:40 -03:00 |
|
test_downloadermiddleware_redirect.py
|
moved scrapy.core.exceptions to scrapy.exceptions, keeping backwards compatibility
|
2010-08-10 17:36:48 -03:00 |
|
test_downloadermiddleware_retry.py
|
made Spider name required again (do not default)
|
2010-04-05 12:34:29 -03:00 |
|
test_downloadermiddleware_stats.py
|
StatsCollector: ported methods to receive spider instances (closes #113), removed list_domains() method, added iter_spider_stats() method
|
2009-11-14 20:28:59 -02:00 |
|
test_downloadermiddleware_useragent.py
|
removed unused import
|
2010-08-10 18:22:05 -03:00 |
|
test_dupefilter.py
|
made Spider name required again (do not default)
|
2010-04-05 12:34:29 -03:00 |
|
test_engine.py
|
Fixed typo
|
2010-08-25 21:06:10 -03:00 |
|
test_http_cookies.py
|
removed wtf line
|
2009-07-08 18:19:54 -03:00 |
|
test_http_headers.py
|
added some unittests to make sure certain objects are using __slots__ and are also weak-referenceable
|
2009-08-18 20:40:04 -03:00 |
|
test_http_request.py
|
Make url/body attributes of Request/Response objects read-only - use replace() to change them. Deprecation warning left for backwards compatibilty.
|
2010-09-08 00:15:11 -03:00 |
|
test_http_response.py
|
Make url/body attributes of Request/Response objects read-only - use replace() to change them. Deprecation warning left for backwards compatibilty.
|
2010-09-08 00:15:11 -03:00 |
|
test_item.py
|
Raise when trying to set an item field value using setattr api, and added tests.
|
2010-06-22 14:00:31 -03:00 |
|
test_log.py
|
Added support for logging twisted errors generated outside of Scrapy - refs #188
|
2010-08-05 20:46:54 -03:00 |
|
test_logformatter.py
|
Fixed log formatter tests
|
2010-08-26 23:23:58 -03:00 |
|
test_mail.py
|
removed (somewhat hacky) MAIL_DEBUG setting
|
2010-08-22 22:42:00 -03:00 |
|
test_middleware.py
|
added new MiddlewareManager class that will be used as base class for pipeline and middlewares
|
2010-08-10 18:03:47 -03:00 |
|
test_pipeline_images.py
|
Removed settings.disabled hack used in some tests. Closes #143
|
2010-09-06 11:04:27 -03:00 |
|
test_pipeline_media.py
|
Refactoring of Crawler, Commands, Execution Queue and Spider Manager:
|
2010-08-25 19:24:36 -03:00 |
|
test_queue.py
|
Make execution queue poll interval configurable through a new QUEUE_POLL_INTERVAL setting
|
2010-09-05 02:23:08 -03:00 |
|
test_responsetypes.py
|
mv scrapy/trunk to root as part of svn2hg migration
|
2009-05-06 15:55:17 -03:00 |
|
test_schedulermiddleware_duplicatesfilter.py
|
moved scrapy.core.exceptions to scrapy.exceptions, keeping backwards compatibility
|
2010-08-10 17:36:48 -03:00 |
|
test_selector.py
|
fixed bug caused when instantiating selectors with responses containing empty bodies
|
2009-10-21 16:37:30 -02:00 |
|
test_spider.py
|
Don't set allowed_domains attribute in BaseSpider constructor
|
2010-09-04 03:20:05 -03:00 |
|
test_spidermiddleware_depth.py
|
Removed settings.disabled hack used in some tests. Closes #143
|
2010-09-06 11:04:27 -03:00 |
|
test_spidermiddleware_httperror.py
|
silence HttpError exceptions raised by httperror spidermiddleware if not handled by spider
|
2010-05-21 17:54:32 -03:00 |
|
test_spidermiddleware_offsite.py
|
Don't filter out requests coming from spiders that don't define allowed_domains. Closes #225
|
2010-09-04 02:23:04 -03:00 |
|
test_spidermiddleware_referer.py
|
made Spider name required again (do not default)
|
2010-04-05 12:34:29 -03:00 |
|
test_spidermiddleware_urllength.py
|
Removed settings.disabled hack used in some tests. Closes #143
|
2010-09-06 11:04:27 -03:00 |
|
test_spiderqueue.py
|
Added SpiderQueue tests. SQS spider queue not tested because operations take too long to complete and it's not easy to know when they have. Closes #227
|
2010-09-06 09:47:45 -03:00 |
|
test_stats.py
|
Splitted stats collector classes from stats collection facility (#204)
|
2010-08-22 01:24:07 -03:00 |
|
test_urlparse_monkeypatches.py
|
monkeypatch urlparse if s3 netloc parsing fails (python issue7904). closes #223
|
2010-09-04 01:02:52 -03:00 |
|
test_utils_conf.py
|
Support passing spider arguments in crawl command with -a option. Closes #216
|
2010-08-28 14:43:28 -03:00 |
|
test_utils_datatypes.py
|
mv scrapy/trunk to root as part of svn2hg migration
|
2009-05-06 15:55:17 -03:00 |
|
test_utils_defer.py
|
Improve spider errors logging which were previously logged as confusing "Unhandled errors" - closes #196
|
2010-08-13 01:45:47 -03:00 |
|
test_utils_encoding.py
|
Some improvements to Response encoding support:
|
2010-03-25 15:47:10 -03:00 |
|
test_utils_http.py
|
Added a weak key factory based cache
|
2010-09-06 00:50:56 -03:00 |
|
test_utils_httpobj.py
|
remove Url class and use str instead for Request and Response urls. Also added urlparse_cached function for achieving the same caching functionality provided by old Url class
|
2009-08-17 21:16:55 -03:00 |
|
test_utils_iterators.py
|
better skip test message
|
2010-08-22 19:08:52 -03:00 |
|
test_utils_jsonrpc.py
|
Check that arguments and keyword arguments are not passed simultaneously in jsonrpc_client_call()
|
2010-08-27 13:45:52 -03:00 |
|
test_utils_markup.py
|
remove_tags: add keep argument
|
2010-04-24 19:08:01 +08:00 |
|
test_utils_memory.py
|
make sure get_vmvalue_from_procfs returns int
|
2009-08-18 00:59:32 -03:00 |
|
test_utils_python.py
|
Added a weak key factory based cache
|
2010-09-06 00:50:56 -03:00 |
|
test_utils_request.py
|
Make url/body attributes of Request/Response objects read-only - use replace() to change them. Deprecation warning left for backwards compatibilty.
|
2010-09-08 00:15:11 -03:00 |
|
test_utils_response.py
|
Fixed bug with float values in meta refresh
|
2010-07-01 11:46:06 -03:00 |
|
test_utils_serialize.py
|
Replaced old manager references with crawler
|
2010-08-25 19:31:04 -03:00 |
|
test_utils_signal.py
|
Added support for returning deferreds from (some) signal handlers. Closes #193
|
2010-08-14 21:10:37 -03:00 |
|
test_utils_simpledb.py
|
simpledb collector: moved to_sdb_value function to utils.simpledb, and added unittests
|
2009-08-30 12:37:30 -03:00 |
|
test_utils_spider.py
|
Fixed bug with runspider command that appeared after the introduction of new spider manager in r2121. Also factored out common code shared by new spider manager and runspider command, with tests included.
|
2010-08-19 01:58:10 -03:00 |
|
test_utils_sqlite.py
|
Fixed bugs with SQLiteDict and added tests
|
2010-09-08 14:32:28 -03:00 |
|
test_utils_url.py
|
Scrapy shell refactoring
|
2010-08-20 11:26:14 -03:00 |
|
test_webclient.py
|
rewrote of downloader handlers
|
2009-10-05 04:10:22 -02:00 |
cb7cc7c8bb