| .. |
|
commands
|
scrapy deploy: retry setup.py bdist_egg on EINTR. closes #9
|
2012-09-07 15:40:26 -03:00 |
|
contrib
|
major Stats Collection refactoring: removed separation of global/per-spider stats, removed stats-related signals (stats_spider_opened, etc). Stats are much simpler now, backwards compatibility is kept on the Stats Collector API.
|
2012-09-14 12:31:33 -03:00 |
|
contrib_exp
|
format log lines lazily in case they are dropped by loglevels
|
2012-08-31 17:14:35 -03:00 |
|
core
|
restored stats_spider_{opened,closing,closed} signals in backwards compatibility mode
|
2012-09-14 12:38:00 -03:00 |
|
http
|
be consistent removing BOM from decoded bodies. #123
|
2012-04-27 00:31:03 -03:00 |
|
selector
|
make libxml2 optional now that lxml is the default
|
2012-05-16 18:17:51 -03:00 |
|
settings
|
Updated documentation after singleton removal changes.
|
2012-08-28 18:35:57 -03:00 |
|
templates
|
update docstring in project template to avoid confusion with genspider command, which may be considered as an advanced feature. refs #107
|
2012-04-19 02:35:48 -03:00 |
|
tests
|
restored stats_spider_{opened,closing,closed} signals in backwards compatibility mode
|
2012-09-14 12:38:00 -03:00 |
|
utils
|
removed another instance of scrapy.conf.settings singleton, this time from scrapy.cmdline (which manages scrapy command line tool), by moving the get_project_settings() function to scrapy.utils.project
|
2012-09-16 20:53:52 -03:00 |
|
xlib
|
fix urlparse monkeypatches for python 2.7.4. closes #144
|
2012-06-18 11:50:43 -03:00 |
|
__init__.py
|
make libxml2 optional now that lxml is the default
|
2012-05-16 18:17:51 -03:00 |
|
cmdline.py
|
removed another instance of scrapy.conf.settings singleton, this time from scrapy.cmdline (which manages scrapy command line tool), by moving the get_project_settings() function to scrapy.utils.project
|
2012-09-16 20:53:52 -03:00 |
|
command.py
|
Dropped support for Python 2.5. See: http://blog.scrapy.org/scrapy-dropping-support-for-python-25
|
2012-03-01 08:18:12 -02:00 |
|
conf.py
|
removed another instance of scrapy.conf.settings singleton, this time from scrapy.cmdline (which manages scrapy command line tool), by moving the get_project_settings() function to scrapy.utils.project
|
2012-09-16 20:53:52 -03:00 |
|
crawler.py
|
format log lines lazily in case they are dropped by loglevels
|
2012-08-31 17:14:35 -03:00 |
|
dupefilter.py
|
pass close reason to close() method of new DupeFilter
|
2011-08-24 11:26:35 -03:00 |
|
exceptions.py
|
replaced DeprecationWarning by a new ScrapyDeprecationWarning category, since the default DeprecationWarning is silenced on Python 2.7+
|
2011-08-08 10:39:53 -03:00 |
|
extension.py
|
Made ExtensionManager a subclass of MiddlewareManager
|
2010-08-22 05:33:08 -03:00 |
|
interfaces.py
|
removed class method from_settings from ISpiderManager interface
|
2011-08-26 09:24:01 -03:00 |
|
item.py
|
Changed default representation of items to pretty-printed dicts. This improves
|
2011-06-03 01:13:01 -03:00 |
|
link.py
|
warn if Link objects are instantiated with unicode urls
|
2012-05-16 13:12:25 -03:00 |
|
linkextractor.py
|
added more extensions to ignore on link extractors
|
2012-08-07 14:23:50 -03:00 |
|
log.py
|
format log lines lazily in case they are dropped by loglevels
|
2012-08-31 17:14:35 -03:00 |
|
logformatter.py
|
format log lines lazily in case they are dropped by loglevels
|
2012-08-31 17:14:35 -03:00 |
|
mail.py
|
refactored MailSender to get rid of scrapy.conf singleton, also removed ill-designed scrapy.mail.mail_sent signal
|
2012-09-11 16:27:19 -03:00 |
|
middleware.py
|
format log lines lazily in case they are dropped by loglevels
|
2012-08-31 17:14:35 -03:00 |
|
mime.types
|
moved module scrapy.core.downloader.responsetypes to scrapy.responsetypes
|
2011-08-07 02:49:57 -03:00 |
|
project.py
|
Another step towards singleton removal: deprecated crawler singleton import (from scrapy.project import crawler) by a new class method that extensions can implement to receive the crawler
|
2011-08-08 11:42:44 -03:00 |
|
resolver.py
|
removed wrong blocking api usage (socket.gethostbyname()) from downloader when using CONCURRENT_REQUESTS_PER_IP
|
2011-08-03 23:55:59 -03:00 |
|
responsetypes.py
|
Dropped support for Python 2.5. See: http://blog.scrapy.org/scrapy-dropping-support-for-python-25
|
2012-03-01 08:18:12 -02:00 |
|
shell.py
|
scrapy shell: start shell in main thread and crawler in secondary thread, instead of the other way around. fixes #100
|
2012-05-22 19:15:54 -03:00 |
|
signalmanager.py
|
Removed signals/stats singletons
|
2012-08-21 18:32:30 -03:00 |
|
signals.py
|
restored stats_spider_{opened,closing,closed} signals in backwards compatibility mode
|
2012-09-14 12:38:00 -03:00 |
|
spider.py
|
Removed per-spider settings concept, and scrapy.conf.settings singleton from many extensions and middlewares. There are some still remaining, that will be removed in future commits
|
2012-08-21 17:27:45 -03:00 |
|
spidermanager.py
|
Removed signals/stats singletons
|
2012-08-21 18:32:30 -03:00 |
|
squeue.py
|
Some changes to persistent scheduler after some initial usage feedback:
|
2011-09-23 13:03:07 -03:00 |
|
stats.py
|
Removed signals/stats singletons
|
2012-08-21 18:32:30 -03:00 |
|
statscol.py
|
major Stats Collection refactoring: removed separation of global/per-spider stats, removed stats-related signals (stats_spider_opened, etc). Stats are much simpler now, backwards compatibility is kept on the Stats Collector API.
|
2012-09-14 12:31:33 -03:00 |
|
telnet.py
|
format log lines lazily in case they are dropped by loglevels
|
2012-08-31 17:14:35 -03:00 |
|
webservice.py
|
format log lines lazily in case they are dropped by loglevels
|
2012-08-31 17:14:35 -03:00 |
cd823018aa