RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
scrapy/scrapy
History
Pablo Hoffman aac26d3586 fixed links to doc. closes #150 2012-06-24 01:01:09 -03:00
..
commands scrapy shell: start shell in main thread and crawler in secondary thread, instead of the other way around. fixes #100 2012-05-22 19:14:55 -03:00
contrib replace "import Image" by more standard "from PIL import Image". closes #88 2012-04-20 19:04:44 -03:00
contrib_exp moved module scrapy.core.downloader.responsetypes to scrapy.responsetypes 2011-08-07 02:49:57 -03:00
core dont discard slot when empty, just save in another dict in order to recycle if needed again. 2012-04-09 01:10:38 -03:00
http meta tag attributes for content-type http equiv can be in any order. #123 2012-04-27 01:04:00 -03:00
selector do not fail handling unicode xpaths in libxml2 backed selectors 2012-04-04 17:21:18 -03:00
settings removed some obsolete remaining code related to sqlite support in scrapy 2012-03-16 12:04:41 -03:00
templates update docstring in project template to avoid confusion with genspider command, which may be considered as an advanced feature. refs #107 2012-04-19 02:15:30 -03:00
tests meta tag attributes for content-type http equiv can be in any order. #123 2012-04-27 01:04:00 -03:00
utils fixed struct.error on http compression middleware. closes #87 2012-02-11 20:28:20 -02:00
xlib fix urlparse monkeypatches for python 2.7.4. closes #144 2012-06-18 12:00:00 -03:00
__init__.py bump version to 0.14.4 2012-05-15 15:28:45 -03:00
cmdline.py new mechanism to override settings in scrapy commands before the Crawler object is available 2011-09-15 13:27:01 -03:00
command.py new mechanism to override settings in scrapy commands before the Crawler object is available 2011-09-15 13:27:01 -03:00
conf.py Removed hacky SCRAPY_SETTINGS_DISABLED environment variable 2010-09-22 16:08:18 -03:00
crawler.py added from_crawler class method to SpiderManager 2011-08-16 11:16:35 -03:00
dupefilter.py pass close reason to close() method of new DupeFilter 2011-08-24 11:26:35 -03:00
exceptions.py replaced DeprecationWarning by a new ScrapyDeprecationWarning category, since the default DeprecationWarning is silenced on Python 2.7+ 2011-08-08 10:39:53 -03:00
extension.py Made ExtensionManager a subclass of MiddlewareManager 2010-08-22 05:33:08 -03:00
interfaces.py removed class method from_settings from ISpiderManager interface 2011-08-26 09:24:01 -03:00
item.py Changed default representation of items to pretty-printed dicts. This improves 2011-06-03 01:13:01 -03:00
link.py added fragment attribute ot Link object 2011-07-27 12:28:36 -03:00
linkextractor.py Some Link extractor improvements: 2011-05-18 12:32:34 -03:00
log.py replaced DeprecationWarning by a new ScrapyDeprecationWarning category, since the default DeprecationWarning is silenced on Python 2.7+ 2011-08-08 10:39:53 -03:00
logformatter.py improved download errors propagation to the spiders, and removed no longer needed code to simplify 2011-07-13 14:10:05 -03:00
mail.py removed (somewhat hacky) MAIL_DEBUG setting 2010-08-22 22:42:00 -03:00
middleware.py Another step towards singleton removal: deprecated crawler singleton import (from scrapy.project import crawler) by a new class method that extensions can implement to receive the crawler 2011-08-08 11:42:44 -03:00
mime.types moved module scrapy.core.downloader.responsetypes to scrapy.responsetypes 2011-08-07 02:49:57 -03:00
project.py Another step towards singleton removal: deprecated crawler singleton import (from scrapy.project import crawler) by a new class method that extensions can implement to receive the crawler 2011-08-08 11:42:44 -03:00
resolver.py removed wrong blocking api usage (socket.gethostbyname()) from downloader when using CONCURRENT_REQUESTS_PER_IP 2011-08-03 23:55:59 -03:00
responsetypes.py moved module scrapy.core.downloader.responsetypes to scrapy.responsetypes 2011-08-07 02:49:57 -03:00
shell.py scrapy shell: start shell in main thread and crawler in secondary thread, instead of the other way around. fixes #100 2012-05-22 19:14:55 -03:00
signals.py Merged item passed and item scraped concepts, as they have often proved 2011-06-03 01:13:00 -03:00
spider.py Added support for unifying access to per-spider settings. Refs #245 2010-09-22 16:09:13 -03:00
spidermanager.py improve handling of KeyError exception when creating spiders in spider manager. closes issue 49 2011-11-14 17:00:25 -02:00
squeue.py Some changes to persistent scheduler after some initial usage feedback: 2011-09-23 13:03:07 -03:00
stats.py Splitted stats collector classes from stats collection facility (#204) 2010-08-22 01:24:07 -03:00
statscol.py call stats collector engine_stopped() after the engine is closed (to make sure all data from extensions has been collected), and added that method to documented api 2011-06-06 03:12:40 -03:00
telnet.py fixed links to doc. closes #150 2012-06-24 01:01:09 -03:00
webservice.py fixed bug in json-rpc webservice reported in https://groups.google.com/d/topic/scrapy-users/qgVBmFybNAQ/discussion. also removed no longer supported 'run' command from extras/scrapy-ws.py 2012-05-03 12:08:03 -03:00