| .. |
|
sample_data
|
linkextractor: unique after urljoin_rfc
|
2010-04-02 19:45:30 +08:00 |
|
test_cmdline
|
moved scrapy.command.cmdline module to scrapy.cmdline (keeping backwards compatibility until 0.10)
|
2010-05-26 10:29:32 -03:00 |
|
test_contrib_ibl
|
removed nltk dependency from IBL code
|
2010-06-22 13:38:32 -03:00 |
|
test_contrib_spidermanager
|
Fixed SpiderManager tests that failed with dropin.cache write permissions errors in some cases
|
2010-05-26 11:58:31 -03:00 |
|
test_djangoitem
|
use explicit relative import on djangoitem tests
|
2009-08-29 21:04:32 -03:00 |
|
__init__.py
|
Added scrapy.utils.py26.json to use python2.6 json module when available, otherwise failback to simplejson module or scrapy.xlib.simplejson. This way we can always assume json and avoid conditional code.
|
2010-04-12 10:44:07 -03:00 |
|
test_clientform.py
|
Applied patch to ClientForm to fix bug with wrong entities. Also added tests and left patch in repo in case we upgrade ClientForm in the future and need to re-apply it
|
2010-07-13 19:46:53 -03:00 |
|
test_commands.py
|
moved scrapy.command.cmdline module to scrapy.cmdline (keeping backwards compatibility until 0.10)
|
2010-05-26 10:29:32 -03:00 |
|
test_conf.py
|
Added Settings class tests, and fixed minor bug
|
2009-12-02 15:52:17 -02:00 |
|
test_contrib_exp_crawlspider_matchers.py
|
contrib_exp: added crawlspider v2 package + tests
|
2010-02-19 18:19:01 -04:00 |
|
test_contrib_exp_crawlspider_reqext.py
|
Support relative url used in base tag. closes #148
|
2010-03-25 12:38:37 -03:00 |
|
test_contrib_exp_crawlspider_reqgen.py
|
removed obsolete test
|
2010-06-09 13:06:05 -03:00 |
|
test_contrib_exp_crawlspider_reqproc.py
|
contrib_exp: added crawlspider v2 package + tests
|
2010-02-19 18:19:01 -04:00 |
|
test_contrib_exp_crawlspider_rules.py
|
made Spider name required again (do not default)
|
2010-04-05 12:34:29 -03:00 |
|
test_contrib_exp_crawlspider_spider.py
|
made Spider name required again (do not default)
|
2010-04-05 12:34:29 -03:00 |
|
test_contrib_exp_loader_lxmlloader.py
|
added LxmlItemLoader
|
2009-09-29 16:17:30 -03:00 |
|
test_contrib_exporter.py
|
Added scrapy.utils.py26.json to use python2.6 json module when available, otherwise failback to simplejson module or scrapy.xlib.simplejson. This way we can always assume json and avoid conditional code.
|
2010-04-12 10:44:07 -03:00 |
|
test_contrib_linkextractors.py
|
linkextractor: unique after urljoin_rfc
|
2010-04-02 19:45:30 +08:00 |
|
test_contrib_loader.py
|
ItemLoader: add test for adding a dict value
|
2010-04-24 21:21:12 +08:00 |
|
test_contrib_logformatter.py
|
some improvements to 'Crawled' log lines, delegating the formatting to a pluggable function
|
2009-10-06 22:47:17 -02:00 |
|
test_core_queue.py
|
Added ExecutionQueue class for feeding spiders and requests to scrape. This
|
2010-05-26 10:29:32 -03:00 |
|
test_dependencies.py
|
fixed bug in OpenSSL depedency test which was comparing versions alphabetically, instead of numerically
|
2009-12-02 13:59:58 -02:00 |
|
test_downloader_handlers.py
|
downloader_handler: test HEAD method
|
2010-05-04 15:50:26 +08:00 |
|
test_downloadermiddleware_cookies.py
|
made Spider name required again (do not default)
|
2010-04-05 12:34:29 -03:00 |
|
test_downloadermiddleware_decompression.py
|
made Spider name required again (do not default)
|
2010-04-05 12:34:29 -03:00 |
|
test_downloadermiddleware_defaultheaders.py
|
made Spider name required again (do not default)
|
2010-04-05 12:34:29 -03:00 |
|
test_downloadermiddleware_httpauth.py
|
made Spider name required again (do not default)
|
2010-04-05 12:34:29 -03:00 |
|
test_downloadermiddleware_httpcache.py
|
added minor delay to httpcache tests, for them to pass on win32
|
2009-12-12 15:30:21 -02:00 |
|
test_downloadermiddleware_httpcompression.py
|
made Spider name required again (do not default)
|
2010-04-05 12:34:29 -03:00 |
|
test_downloadermiddleware_httpproxy.py
|
made Spider name required again (do not default)
|
2010-04-05 12:34:29 -03:00 |
|
test_downloadermiddleware_redirect.py
|
downloadermiddleware/redirect: always do "HEAD" if origin request method is HEAD
|
2010-05-04 16:11:45 +08:00 |
|
test_downloadermiddleware_retry.py
|
made Spider name required again (do not default)
|
2010-04-05 12:34:29 -03:00 |
|
test_downloadermiddleware_stats.py
|
StatsCollector: ported methods to receive spider instances (closes #113), removed list_domains() method, added iter_spider_stats() method
|
2009-11-14 20:28:59 -02:00 |
|
test_downloadermiddleware_useragent.py
|
made Spider name required again (do not default)
|
2010-04-05 12:34:29 -03:00 |
|
test_dupefilter.py
|
made Spider name required again (do not default)
|
2010-04-05 12:34:29 -03:00 |
|
test_engine.py
|
Added ExecutionQueue class for feeding spiders and requests to scrape. This
|
2010-05-26 10:29:32 -03:00 |
|
test_http_cookies.py
|
removed wtf line
|
2009-07-08 18:19:54 -03:00 |
|
test_http_headers.py
|
added some unittests to make sure certain objects are using __slots__ and are also weak-referenceable
|
2009-08-18 20:40:04 -03:00 |
|
test_http_request.py
|
allow passing custom headers in FormRequest.from_response()
|
2010-07-08 14:02:28 -03:00 |
|
test_http_response.py
|
Minimize effect of http://bugs.python.org/issue8271 on TextResponses by changing str.decode errors policy by custom `replace` alike error handler
|
2010-04-07 00:29:53 -03:00 |
|
test_item.py
|
Raise when trying to set an item field value using setattr api, and added tests.
|
2010-06-22 14:00:31 -03:00 |
|
test_log.py
|
fixed bug when using log.start() with log level module constants instead of string names, and added regression tests
|
2009-10-31 14:36:38 -02:00 |
|
test_mail.py
|
Some mail improvements and tests.
|
2010-05-28 16:51:47 -03:00 |
|
test_pipeline_images.py
|
fixed bug in images pipeline bug in win32 systems, and added regression tests
|
2009-10-07 22:34:38 -02:00 |
|
test_pipeline_media.py
|
mediapipeline: bugfix error raised when media requests has not callbacks, remove item_media_{downloaded,failed} hooks in favour or request.{errback,calback}, and add tests
|
2010-06-14 12:34:52 -03:00 |
|
test_responsetypes.py
|
mv scrapy/trunk to root as part of svn2hg migration
|
2009-05-06 15:55:17 -03:00 |
|
test_schedulermiddleware_duplicatesfilter.py
|
made Spider name required again (do not default)
|
2010-04-05 12:34:29 -03:00 |
|
test_selector.py
|
fixed bug caused when instantiating selectors with responses containing empty bodies
|
2009-10-21 16:37:30 -02:00 |
|
test_spider.py
|
made Spider name required again (do not default)
|
2010-04-05 12:34:29 -03:00 |
|
test_spidermiddleware_depth.py
|
StatsCollector: ported methods to receive spider instances (closes #113), removed list_domains() method, added iter_spider_stats() method
|
2009-11-14 20:28:59 -02:00 |
|
test_spidermiddleware_httperror.py
|
silence HttpError exceptions raised by httperror spidermiddleware if not handled by spider
|
2010-05-21 17:54:32 -03:00 |
|
test_spidermiddleware_offsite.py
|
made Spider name required again (do not default)
|
2010-04-05 12:34:29 -03:00 |
|
test_spidermiddleware_referer.py
|
made Spider name required again (do not default)
|
2010-04-05 12:34:29 -03:00 |
|
test_spidermiddleware_urlfilter.py
|
made Spider name required again (do not default)
|
2010-04-05 12:34:29 -03:00 |
|
test_spidermiddleware_urllength.py
|
made Spider name required again (do not default)
|
2010-04-05 12:34:29 -03:00 |
|
test_stats.py
|
made Spider name required again (do not default)
|
2010-04-05 12:34:29 -03:00 |
|
test_utils_conf.py
|
added support for defining EXTENSIONS setting using dicts, like middleware settings
|
2009-08-18 11:05:36 -03:00 |
|
test_utils_datatypes.py
|
mv scrapy/trunk to root as part of svn2hg migration
|
2009-05-06 15:55:17 -03:00 |
|
test_utils_defer.py
|
remove obsolete deferred_imap util, use coiterate+imap instead
|
2009-06-23 14:45:16 -07:00 |
|
test_utils_encoding.py
|
Some improvements to Response encoding support:
|
2010-03-25 15:47:10 -03:00 |
|
test_utils_httpobj.py
|
remove Url class and use str instead for Request and Response urls. Also added urlparse_cached function for achieving the same caching functionality provided by old Url class
|
2009-08-17 21:16:55 -03:00 |
|
test_utils_iterators.py
|
move lxml based xmliter function to contrib_exp
|
2009-10-14 13:22:28 -02:00 |
|
test_utils_jsonrpc.py
|
* Added Scrapy Web Service with documentation and tests.
|
2010-06-09 13:46:22 -03:00 |
|
test_utils_markup.py
|
remove_tags: add keep argument
|
2010-04-24 19:08:01 +08:00 |
|
test_utils_memory.py
|
make sure get_vmvalue_from_procfs returns int
|
2009-08-18 00:59:32 -03:00 |
|
test_utils_misc.py
|
arg_to_iter: return [arg] if arg is a dict
|
2010-04-24 21:20:23 +08:00 |
|
test_utils_python.py
|
utils.python: added equal_attributes() to compare two objects arbitrary attributes
|
2010-02-19 17:57:48 -04:00 |
|
test_utils_request.py
|
switched request_fingerprint to use WeakKeyDictionary for caching (instead of Request.cache)
|
2009-08-24 08:45:23 -03:00 |
|
test_utils_response.py
|
Fixed bug with float values in meta refresh
|
2010-07-01 11:46:06 -03:00 |
|
test_utils_serialize.py
|
utils.serialize: added support for encoding Deferreds, and to refer spiders by name using 'spider::name'
|
2010-06-11 18:16:09 -03:00 |
|
test_utils_signal.py
|
send_catch_log: pass through results from sendRobust
|
2009-08-22 16:38:25 -03:00 |
|
test_utils_simpledb.py
|
simpledb collector: moved to_sdb_value function to utils.simpledb, and added unittests
|
2009-08-30 12:37:30 -03:00 |
|
test_utils_spider.py
|
check iterable output of crawl spider and add tests for common function used to iterate spider output
|
2009-09-21 13:57:16 -03:00 |
|
test_utils_url.py
|
url_query_cleaner: cleanup and avoid rejoining key-sep-value to build the query again
|
2010-05-12 14:09:37 -03:00 |
|
test_webclient.py
|
rewrote of downloader handlers
|
2009-10-05 04:10:22 -02:00 |
cc32f6ec66