RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
scrapy/scrapy/tests
History
Artem Bogomyagkov 1d5967cee6 httpcompression middleware improvement 2012-10-10 20:20:13 +03:00
..
sample_data httpcompression middleware improvement 2012-10-10 20:20:13 +03:00
test_cmdline removed another instance of scrapy.conf singleton, this time from test_cmdline 2012-09-11 16:37:55 -03:00
test_djangoitem promoted DjangoItem to main contrib 2012-08-29 11:23:11 -03:00
test_spidermanager Added ISpiderManager interface and a test to verify the default SpiderManager comforms to it 2010-09-03 14:29:27 -03:00
test_utils_misc make trial run doctests 2010-10-26 20:50:41 -02:00
__init__.py Added scrapy.utils.py26.json to use python2.6 json module when available, otherwise failback to simplejson module or scrapy.xlib.simplejson. This way we can always assume json and avoid conditional code. 2010-04-12 10:44:07 -03:00
test_command_fetch.py fixed some tests accidentally broken in previous commit 2011-06-06 16:11:43 -03:00
test_command_shell.py Changed default representation of items to pretty-printed dicts. This improves 2011-06-03 01:13:01 -03:00
test_command_version.py * Added tests for shell/fetch/version commands (closes #255) 2010-11-28 18:14:45 -02:00
test_commands.py format log lines lazily in case they are dropped by loglevels 2012-08-31 17:14:35 -03:00
test_contracts.py make tests code python 2.6 compatible 2012-09-28 18:55:12 -03:00
test_contrib_exporter.py fixed typo in tests 2012-08-22 13:50:23 -03:00
test_contrib_feedexport.py changed feed exports storage api so that file/stdio outputs directly without using a temporary file 2011-10-23 02:49:17 -02:00
test_contrib_linkextractors.py removed deprecated/undocumented class: HTMLImageLinkExtractor 2012-04-19 12:07:46 -03:00
test_contrib_loader.py improved errors of ItemLoader.load_item() so that it shows the field name and value of the output processor that failed 2011-06-23 12:39:51 -03:00
test_contrib_spiderstate.py make SpiderState extension always available, regardless of whether there is a job dir, and make sure it always set spider.state attribute, for consistency between in-memory and on-disk runs 2011-09-23 12:56:44 -03:00
test_dependencies.py fixed bug in OpenSSL depedency test which was comparing versions alphabetically, instead of numerically 2009-12-02 13:59:58 -02:00
test_downloader_handlers.py removed another instance of scrapy.conf.settings singleton, this time from download handlers 2012-09-03 16:44:18 -03:00
test_downloadermiddleware_cookies.py domain and path support for request cookies 2012-06-25 20:17:59 +02:00
test_downloadermiddleware_decompression.py fixed tests to work on windows 2012-08-30 11:24:29 -03:00
test_downloadermiddleware_defaultheaders.py Removed per-spider settings concept, and scrapy.conf.settings singleton from many extensions and middlewares. There are some still remaining, that will be removed in future commits 2012-08-21 17:27:45 -03:00
test_downloadermiddleware_downloadtimeout.py Removed per-spider settings concept, and scrapy.conf.settings singleton from many extensions and middlewares. There are some still remaining, that will be removed in future commits 2012-08-21 17:27:45 -03:00
test_downloadermiddleware_httpauth.py Added a weak key factory based cache 2010-09-06 00:50:56 -03:00
test_downloadermiddleware_httpcache.py make DBM the new default storage backend for HTTP cache middleware, simplified DBM storage backend code to avoid dealing with many spiders at once (not needed), and update httpcache stats names (hit -> hits, miss -> misses) 2012-09-17 10:11:07 -03:00
test_downloadermiddleware_httpcompression.py Dropped support for Python 2.5. See: http://blog.scrapy.org/scrapy-dropping-support-for-python-25 2012-03-01 08:18:12 -02:00
test_downloadermiddleware_httpproxy.py removed unused import 2010-08-10 18:26:40 -03:00
test_downloadermiddleware_redirect.py Removed per-spider settings concept, and scrapy.conf.settings singleton from many extensions and middlewares. There are some still remaining, that will be removed in future commits 2012-08-21 17:27:45 -03:00
test_downloadermiddleware_retry.py Removed per-spider settings concept, and scrapy.conf.settings singleton from many extensions and middlewares. There are some still remaining, that will be removed in future commits 2012-08-21 17:27:45 -03:00
test_downloadermiddleware_stats.py Removed signals/stats singletons 2012-08-21 18:32:30 -03:00
test_downloadermiddleware_useragent.py Removed per-spider settings concept, and scrapy.conf.settings singleton from many extensions and middlewares. There are some still remaining, that will be removed in future commits 2012-08-21 17:27:45 -03:00
test_dupefilter.py fixed unittest broken by previous commit 2011-08-24 11:31:52 -03:00
test_engine.py restored stats_spider_{opened,closing,closed} signals in backwards compatibility mode 2012-09-14 12:38:00 -03:00
test_http_cookies.py Removed forked cookielib tests, because Python cookielib has been suffering several changes and maintaining a fork of the tests has become a pain. Instead, we've added specific tests for the urllib2 request/response wrappers 2010-09-27 07:55:27 -03:00
test_http_headers.py persistent scheduler: use pickle (instead of marshal) as the default serialization format, to support serializing more objects out of the box. also removed __slots__ from Request/Response objects to make them serializable by default. 2011-09-01 14:27:29 -03:00
test_http_request.py do not treat input type "image" as form input. #111 2012-04-25 16:12:48 -03:00
test_http_response.py be consistent removing BOM from decoded bodies. #123 2012-04-27 00:31:03 -03:00
test_item.py Changed default representation of items to pretty-printed dicts. This improves 2011-06-03 01:13:01 -03:00
test_libxml2.py fix libxml2 test 2012-05-16 18:54:02 -03:00
test_link.py warn if Link objects are instantiated with unicode urls 2012-05-16 13:12:25 -03:00
test_log.py - removed scrapy.conf singleton from scrapy.log, scrapy.responsetypes, 2012-09-19 03:03:34 -03:00
test_logformatter.py format log lines lazily in case they are dropped by loglevels 2012-08-31 17:14:35 -03:00
test_mail.py refactored MailSender to get rid of scrapy.conf singleton, also removed ill-designed scrapy.mail.mail_sent signal 2012-09-11 16:27:19 -03:00
test_middleware.py Splitted settings classes from settings singleton. Closes #244 2010-09-22 15:47:33 -03:00
test_pipeline_images.py replace "import Image" by more standard "from PIL import Image". closes #88 2012-04-20 19:05:55 -03:00
test_pipeline_media.py fixed wrong code in test 2011-06-10 18:27:39 -03:00
test_responsetypes.py Handle as html standard mimetype defined by Open Mobile Alliance 2012-02-24 16:16:35 -02:00
test_selector.py fix `tail` issue when extracting nodes [lxml] 2012-05-07 17:23:27 +02:00
test_selector_libxml2.py make libxml2 optional now that lxml is the default 2012-05-16 18:17:51 -03:00
test_selector_lxml.py Cache response's element trees using LxmlDocument similar to Libxml2Document 2012-04-13 14:43:30 -03:00
test_settings.py Removed per-spider settings concept, and scrapy.conf.settings singleton from many extensions and middlewares. There are some still remaining, that will be removed in future commits 2012-08-21 17:27:45 -03:00
test_spider.py test that default start_request return value type is a generator. refs #98 2012-03-05 17:53:20 -02:00
test_spidermiddleware_depth.py Removed signals/stats singletons 2012-08-21 18:32:30 -03:00
test_spidermiddleware_httperror.py silence HttpError exceptions raised by httperror spidermiddleware if not handled by spider 2010-05-21 17:54:32 -03:00
test_spidermiddleware_offsite.py Do not filter requests with dont_filter attribute set in OffsiteMiddleware 2011-09-08 15:18:10 -03:00
test_spidermiddleware_referer.py made Spider name required again (do not default) 2010-04-05 12:34:29 -03:00
test_spidermiddleware_urllength.py Removed settings.disabled hack used in some tests. Closes #143 2010-09-06 11:04:27 -03:00
test_squeue.py Some changes to persistent scheduler after some initial usage feedback: 2011-09-23 13:03:07 -03:00
test_stats.py major Stats Collection refactoring: removed separation of global/per-spider stats, removed stats-related signals (stats_spider_opened, etc). Stats are much simpler now, backwards compatibility is kept on the Stats Collector API. 2012-09-14 12:31:33 -03:00
test_urlparse_monkeypatches.py Correctly handle query parameters on s3:// urls 2011-08-08 13:23:45 -03:00
test_utils_conf.py Support passing spider arguments in crawl command with -a option. Closes #216 2010-08-28 14:43:28 -03:00
test_utils_datatypes.py Initial support for a persistent scheduler, to support pausing and resuming 2011-08-02 11:57:55 -03:00
test_utils_defer.py Improve spider errors logging which were previously logged as confusing "Unhandled errors" - closes #196 2010-08-13 01:45:47 -03:00
test_utils_gz.py httpcompression middleware improvement 2012-10-10 20:20:13 +03:00
test_utils_http.py added new downloader middleware: ChunkedTransferMiddleware 2011-08-09 03:03:25 -03:00
test_utils_httpobj.py remove Url class and use str instead for Request and Response urls. Also added urlparse_cached function for achieving the same caching functionality provided by old Url class 2009-08-17 21:16:55 -03:00
test_utils_iterators.py fixed tests to work on windows 2012-08-30 11:24:29 -03:00
test_utils_jsonrpc.py Dropped support for Python 2.5. See: http://blog.scrapy.org/scrapy-dropping-support-for-python-25 2012-03-01 08:18:12 -02:00
test_utils_pqueue.py Some changes to persistent scheduler after some initial usage feedback: 2011-09-23 13:03:07 -03:00
test_utils_python.py fixed some bugs in get_func_args() and added more test cases 2012-09-04 19:01:20 -03:00
test_utils_queue.py remove usage of assertLess() which is only available on python 2.7+ 2011-09-26 12:21:52 -03:00
test_utils_reqser.py Initial support for a persistent scheduler, to support pausing and resuming 2011-08-02 11:57:55 -03:00
test_utils_request.py Make url/body attributes of Request/Response objects read-only - use replace() to change them. Deprecation warning left for backwards compatibilty. 2010-09-08 00:15:11 -03:00
test_utils_response.py ignore meta-refresh redirects embedded in <script> tags. related to issue 18 2011-11-14 16:54:13 -02:00
test_utils_serialize.py Dropped support for Python 2.5. See: http://blog.scrapy.org/scrapy-dropping-support-for-python-25 2012-03-01 08:18:12 -02:00
test_utils_signal.py Added support for returning deferreds from (some) signal handlers. Closes #193 2010-08-14 21:10:37 -03:00
test_utils_sitemap.py scrapy.utils.sitemap: added one more case of parsing invalid sitemaps 2011-08-07 03:24:32 -03:00
test_utils_spider.py Fixed bug with runspider command that appeared after the introduction of new spider manager in r2121. Also factored out common code shared by new spider manager and runspider command, with tests included. 2010-08-19 01:58:10 -03:00
test_utils_template.py make trial run doctests 2010-10-26 20:50:41 -02:00
test_utils_url.py handle missing paths in urls as / 2012-05-03 13:56:45 -03:00
test_webclient.py Do not raise PartialDownloadError if Content-Length doesn't match the body size. This fixes the error reported in: https://groups.google.com/d/topic/scrapy-users/FQ25O3KPQuU/discussion 2011-10-25 13:04:58 -02:00