| .. |
|
command
|
added runspider command to run spiders directly, without having to create a project
|
2009-09-14 22:05:14 -03:00 |
|
conf
|
Big Scrapy core refactoring to pass around spider references instead of domains.
|
2009-09-12 14:34:18 -03:00 |
|
contrib
|
bugfix image thumb when no thumb is configured
|
2009-09-15 09:35:21 -03:00 |
|
contrib_exp
|
moved SpiderProfiler extension to scrapy.contrib_exp and removed references from documentation
|
2009-09-01 22:38:37 -03:00 |
|
core
|
added support for returning deferreds in spider manager close_domain() method, and making sure engine_stopped signal is always sent (even when no spiders have run)
|
2009-09-15 09:27:30 -03:00 |
|
http
|
Big Scrapy core refactoring to pass around spider references instead of domains.
|
2009-09-12 14:34:18 -03:00 |
|
management
|
adapted web console to use unix timestamps for uptime instead of datetime
|
2009-09-14 20:35:07 -03:00 |
|
selector
|
added support for instantiating TextResponse (or any subclass) with unicode urls, improved organization of request/response unittests
|
2009-09-07 09:37:46 -03:00 |
|
spider
|
Big Scrapy core refactoring to pass around spider references instead of domains.
|
2009-09-12 14:34:18 -03:00 |
|
stats
|
removed obsolete scrapy.utils.db module
|
2009-09-04 17:38:14 -03:00 |
|
templates
|
Do not impose an arbitrary encoding in spider templates, because we don't know beforehand what enconding our users will use in their editors.
|
2009-09-12 21:04:21 -03:00 |
|
tests
|
XmlItemExporter: added built-in support for exporting multi-valued fields (for convenience)
|
2009-09-14 22:05:52 -03:00 |
|
utils
|
renamed defer_failed to defer_fail
|
2009-09-15 08:44:31 -03:00 |
|
xlib
|
minor docstring update
|
2009-08-20 14:40:37 -03:00 |
|
xpath
|
moved scrapy.xpath to scrapy.selector
|
2009-08-19 21:50:52 -03:00 |
|
__init__.py
|
moved patches.py to xlib/patches.py to avoid import errors
|
2009-07-29 19:01:36 -03:00 |
|
crawler.py
|
added missing colon
|
2009-09-12 19:33:16 -03:00 |
|
extension.py
|
added support for defining EXTENSIONS setting using dicts, like middleware settings
|
2009-08-18 11:05:36 -03:00 |
|
item.py
|
made DjangoItem a descendant of Item and its metaclass
|
2009-08-26 11:38:49 -03:00 |
|
link.py
|
updated some documentation references in source code
|
2009-08-19 22:41:26 -03:00 |
|
log.py
|
Some enhancements to Scrapy core:
|
2009-09-03 08:27:48 -03:00 |
|
mail.py
|
updated some documentation references in source code
|
2009-08-19 22:41:26 -03:00 |
|
shell.py
|
Big Scrapy core refactoring to pass around spider references instead of domains.
|
2009-09-12 14:34:18 -03:00 |
08aedcbe76