| .. |
|
commands
|
Some changes to scrapy deploy command:
|
2013-03-06 11:41:34 -02:00 |
|
contracts
|
scrapy contracts: python2.6 compat
|
2012-10-28 18:23:21 +01:00 |
|
contrib
|
httpcache: added tests for custom dbm module.
|
2013-02-01 12:41:52 -04:00 |
|
contrib_exp
|
format log lines lazily in case they are dropped by loglevels
|
2012-08-31 17:14:35 -03:00 |
|
core
|
remove debugging code
|
2013-02-27 03:52:55 -02:00 |
|
http
|
Find form nodes in invalid html5 documents
|
2013-01-24 17:47:53 -02:00 |
|
selector
|
added remove_namespaces() method to XmlXPathSelector objects
|
2013-01-18 12:20:03 -02:00 |
|
settings
|
Log overriden Scrapy settings when Scrapy starts.
|
2013-02-28 11:35:11 -02:00 |
|
templates
|
Fix broken doc links.
|
2012-11-12 22:43:42 +02:00 |
|
tests
|
arg_to_iter: treat items the same way as dicts (ie. non iterables). fixes #248
|
2013-02-27 02:39:31 -02:00 |
|
utils
|
arg_to_iter: replaced double call to isinstance with a single one. refs #248
|
2013-02-27 03:51:23 -02:00 |
|
xlib
|
fix urlparse monkeypatches for python 2.7.4. closes #144
|
2012-06-18 11:50:43 -03:00 |
|
VERSION
|
get scrapy version from package data
|
2013-02-06 11:44:26 -02:00 |
|
__init__.py
|
get scrapy version from package data
|
2013-02-06 11:44:26 -02:00 |
|
cmdline.py
|
pluggable sub-commands for scrapy comand-line
|
2013-03-06 05:25:38 +11:00 |
|
command.py
|
added --pdb command option to enable pdb debugger on failure.
|
2013-02-11 12:34:29 -04:00 |
|
conf.py
|
better backwards compatibility for scrapy.conf.settings
|
2012-10-25 11:41:40 -02:00 |
|
crawler.py
|
Log overriden Scrapy settings when Scrapy starts.
|
2013-02-28 11:35:11 -02:00 |
|
dupefilter.py
|
pass close reason to close() method of new DupeFilter
|
2011-08-24 11:26:35 -03:00 |
|
exceptions.py
|
proper unittest-like output for scrapy contracts
|
2012-10-27 23:26:40 +02:00 |
|
extension.py
|
Made ExtensionManager a subclass of MiddlewareManager
|
2010-08-22 05:33:08 -03:00 |
|
interfaces.py
|
removed class method from_settings from ISpiderManager interface
|
2011-08-26 09:24:01 -03:00 |
|
item.py
|
made scrapy/item.py pep8 compliant
|
2013-02-20 11:38:50 -02:00 |
|
link.py
|
warn if Link objects are instantiated with unicode urls
|
2012-05-16 13:12:25 -03:00 |
|
linkextractor.py
|
added more extensions to ignore on link extractors
|
2012-08-07 14:23:50 -03:00 |
|
log.py
|
removed scrapy.log.started attribute, and avoid checking if log has already been started (since it should be called once anyway)
|
2012-10-09 16:05:19 -02:00 |
|
logformatter.py
|
Log level return from LogFormatter methods
|
2012-12-29 11:43:41 +07:00 |
|
mail.py
|
refactored MailSender to get rid of scrapy.conf singleton, also removed ill-designed scrapy.mail.mail_sent signal
|
2012-09-11 16:27:19 -03:00 |
|
middleware.py
|
format log lines lazily in case they are dropped by loglevels
|
2012-08-31 17:14:35 -03:00 |
|
mime.types
|
moved module scrapy.core.downloader.responsetypes to scrapy.responsetypes
|
2011-08-07 02:49:57 -03:00 |
|
project.py
|
Another step towards singleton removal: deprecated crawler singleton import (from scrapy.project import crawler) by a new class method that extensions can implement to receive the crawler
|
2011-08-08 11:42:44 -03:00 |
|
resolver.py
|
removed wrong blocking api usage (socket.gethostbyname()) from downloader when using CONCURRENT_REQUESTS_PER_IP
|
2011-08-03 23:55:59 -03:00 |
|
responsetypes.py
|
- removed scrapy.conf singleton from scrapy.log, scrapy.responsetypes,
|
2012-09-19 03:03:34 -03:00 |
|
shell.py
|
fetch command should catch IgnoreRequest exception
|
2013-03-02 20:13:14 -06:00 |
|
signalmanager.py
|
remove debugging code
|
2013-02-27 03:52:55 -02:00 |
|
signals.py
|
restored stats_spider_{opened,closing,closed} signals in backwards compatibility mode
|
2012-09-14 12:38:00 -03:00 |
|
spider.py
|
spider.log to pass keyword arguments into twisted log.msg
|
2013-02-11 05:00:06 +11:00 |
|
spidermanager.py
|
Removed signals/stats singletons
|
2012-08-21 18:32:30 -03:00 |
|
squeue.py
|
Some changes to persistent scheduler after some initial usage feedback:
|
2011-09-23 13:03:07 -03:00 |
|
stats.py
|
Removed signals/stats singletons
|
2012-08-21 18:32:30 -03:00 |
|
statscol.py
|
minor message update: spider stats -> Scrapy stats
|
2012-10-12 16:53:44 -02:00 |
|
telnet.py
|
format log lines lazily in case they are dropped by loglevels
|
2012-08-31 17:14:35 -03:00 |
|
webservice.py
|
format log lines lazily in case they are dropped by loglevels
|
2012-08-31 17:14:35 -03:00 |
b5b37197bf