| .. |
|
commands
|
Dropped support for Python 2.5. See: http://blog.scrapy.org/scrapy-dropping-support-for-python-25
|
2012-03-01 08:18:12 -02:00 |
|
contrib
|
Fix autothrottle in order to modify also inactive downloader slots, so cases fixed by inactive slots patch will work ok also when using autothrottle
|
2012-04-03 23:14:00 +00:00 |
|
contrib_exp
|
moved module scrapy.core.downloader.responsetypes to scrapy.responsetypes
|
2011-08-07 02:49:57 -03:00 |
|
core
|
Avoid logging useless error messages about ignored requests in robots.txt
|
2012-04-10 13:37:32 -03:00 |
|
http
|
Adapt response encoding detection to pass test cases
|
2012-02-28 14:32:55 -02:00 |
|
selector
|
lxml boolean results fix. oops #116
|
2012-04-13 09:29:56 -03:00 |
|
settings
|
changed default user agent to Scrapy/0.15 (+http://scrapy.org) and removed no longer needed BOT_VERSION setting
|
2012-03-23 13:45:21 -03:00 |
|
templates
|
changed default user agent to Scrapy/0.15 (+http://scrapy.org) and removed no longer needed BOT_VERSION setting
|
2012-03-23 13:45:21 -03:00 |
|
tests
|
lxml boolean results fix. oops #116
|
2012-04-13 09:29:56 -03:00 |
|
utils
|
fix typo in module description. closes #112
|
2012-04-11 10:44:31 -03:00 |
|
xlib
|
Removed (very old and possibly broken) backwards compatibility support for Twisted 2.5
|
2012-03-15 00:28:24 -03:00 |
|
__init__.py
|
Removed (very old and possibly broken) backwards compatibility support for Twisted 2.5
|
2012-03-15 00:28:24 -03:00 |
|
cmdline.py
|
removed backwards compatibility code for old scrapy versions
|
2012-03-06 05:42:09 -02:00 |
|
command.py
|
Dropped support for Python 2.5. See: http://blog.scrapy.org/scrapy-dropping-support-for-python-25
|
2012-03-01 08:18:12 -02:00 |
|
conf.py
|
Removed hacky SCRAPY_SETTINGS_DISABLED environment variable
|
2010-09-22 16:08:18 -03:00 |
|
crawler.py
|
added from_crawler class method to SpiderManager
|
2011-08-16 11:16:35 -03:00 |
|
dupefilter.py
|
pass close reason to close() method of new DupeFilter
|
2011-08-24 11:26:35 -03:00 |
|
exceptions.py
|
replaced DeprecationWarning by a new ScrapyDeprecationWarning category, since the default DeprecationWarning is silenced on Python 2.7+
|
2011-08-08 10:39:53 -03:00 |
|
extension.py
|
Made ExtensionManager a subclass of MiddlewareManager
|
2010-08-22 05:33:08 -03:00 |
|
interfaces.py
|
removed class method from_settings from ISpiderManager interface
|
2011-08-26 09:24:01 -03:00 |
|
item.py
|
Changed default representation of items to pretty-printed dicts. This improves
|
2011-06-03 01:13:01 -03:00 |
|
link.py
|
added fragment attribute ot Link object
|
2011-07-27 12:28:36 -03:00 |
|
linkextractor.py
|
Some Link extractor improvements:
|
2011-05-18 12:32:34 -03:00 |
|
log.py
|
removed backwards compatibility code for old scrapy versions
|
2012-03-06 05:42:09 -02:00 |
|
logformatter.py
|
improved download errors propagation to the spiders, and removed no longer needed code to simplify
|
2011-07-13 14:10:05 -03:00 |
|
mail.py
|
removed (somewhat hacky) MAIL_DEBUG setting
|
2010-08-22 22:42:00 -03:00 |
|
middleware.py
|
Another step towards singleton removal: deprecated crawler singleton import (from scrapy.project import crawler) by a new class method that extensions can implement to receive the crawler
|
2011-08-08 11:42:44 -03:00 |
|
mime.types
|
moved module scrapy.core.downloader.responsetypes to scrapy.responsetypes
|
2011-08-07 02:49:57 -03:00 |
|
project.py
|
Another step towards singleton removal: deprecated crawler singleton import (from scrapy.project import crawler) by a new class method that extensions can implement to receive the crawler
|
2011-08-08 11:42:44 -03:00 |
|
resolver.py
|
removed wrong blocking api usage (socket.gethostbyname()) from downloader when using CONCURRENT_REQUESTS_PER_IP
|
2011-08-03 23:55:59 -03:00 |
|
responsetypes.py
|
Dropped support for Python 2.5. See: http://blog.scrapy.org/scrapy-dropping-support-for-python-25
|
2012-03-01 08:18:12 -02:00 |
|
shell.py
|
fixed "No free spider slots" bug when calling fetch() from scrapy shell
|
2011-11-14 20:03:43 -02:00 |
|
signals.py
|
Merged item passed and item scraped concepts, as they have often proved
|
2011-06-03 01:13:00 -03:00 |
|
spider.py
|
change start_request to return a generator instead of a list, in order
|
2012-03-05 12:49:17 -02:00 |
|
spidermanager.py
|
improve handling of KeyError exception when creating spiders in spider manager. closes issue 49
|
2011-11-14 17:00:25 -02:00 |
|
squeue.py
|
Some changes to persistent scheduler after some initial usage feedback:
|
2011-09-23 13:03:07 -03:00 |
|
stats.py
|
Splitted stats collector classes from stats collection facility (#204)
|
2010-08-22 01:24:07 -03:00 |
|
statscol.py
|
call stats collector engine_stopped() after the engine is closed (to make sure all data from extensions has been collected), and added that method to documented api
|
2011-06-06 03:12:40 -03:00 |
|
telnet.py
|
Some telnet console changes:
|
2011-08-08 15:01:08 -03:00 |
|
webservice.py
|
Another step towards singleton removal: deprecated crawler singleton import (from scrapy.project import crawler) by a new class method that extensions can implement to receive the crawler
|
2011-08-08 11:42:44 -03:00 |
3dbe211d29