RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
scrapy/scrapy
History
Pablo Hoffman 7afedb89e9 backwards compatibility support for scrapy.conf.settings singleton for when scrapy.conf is imported *before* calling scrapy.cmdline.execute(), such as in custom bot runners 2012-09-19 12:44:59 -03:00
..
commands scrapy deploy: retry setup.py bdist_egg on EINTR. closes #9 2012-09-07 15:40:26 -03:00
contrib make DBM the new default storage backend for HTTP cache middleware, simplified DBM storage backend code to avoid dealing with many spiders at once (not needed), and update httpcache stats names (hit -> hits, miss -> misses) 2012-09-17 10:11:07 -03:00
contrib_exp format log lines lazily in case they are dropped by loglevels 2012-08-31 17:14:35 -03:00
core - removed scrapy.conf singleton from scrapy.log, scrapy.responsetypes, 2012-09-19 03:03:34 -03:00
http - removed scrapy.conf singleton from scrapy.log, scrapy.responsetypes, 2012-09-19 03:03:34 -03:00
selector - removed scrapy.conf singleton from scrapy.log, scrapy.responsetypes, 2012-09-19 03:03:34 -03:00
settings - removed scrapy.conf singleton from scrapy.log, scrapy.responsetypes, 2012-09-19 03:03:34 -03:00
templates update docstring in project template to avoid confusion with genspider command, which may be considered as an advanced feature. refs #107 2012-04-19 02:35:48 -03:00
tests - removed scrapy.conf singleton from scrapy.log, scrapy.responsetypes, 2012-09-19 03:03:34 -03:00
utils make DBM the new default storage backend for HTTP cache middleware, simplified DBM storage backend code to avoid dealing with many spiders at once (not needed), and update httpcache stats names (hit -> hits, miss -> misses) 2012-09-17 10:11:07 -03:00
xlib fix urlparse monkeypatches for python 2.7.4. closes #144 2012-06-18 11:50:43 -03:00
__init__.py make libxml2 optional now that lxml is the default 2012-05-16 18:17:51 -03:00
cmdline.py backwards compatibility support for scrapy.conf.settings singleton for when scrapy.conf is imported *before* calling scrapy.cmdline.execute(), such as in custom bot runners 2012-09-19 12:44:59 -03:00
command.py - removed scrapy.conf singleton from scrapy.log, scrapy.responsetypes, 2012-09-19 03:03:34 -03:00
conf.py backwards compatibility support for scrapy.conf.settings singleton for when scrapy.conf is imported *before* calling scrapy.cmdline.execute(), such as in custom bot runners 2012-09-19 12:44:59 -03:00
crawler.py - removed scrapy.conf singleton from scrapy.log, scrapy.responsetypes, 2012-09-19 03:03:34 -03:00
dupefilter.py pass close reason to close() method of new DupeFilter 2011-08-24 11:26:35 -03:00
exceptions.py replaced DeprecationWarning by a new ScrapyDeprecationWarning category, since the default DeprecationWarning is silenced on Python 2.7+ 2011-08-08 10:39:53 -03:00
extension.py Made ExtensionManager a subclass of MiddlewareManager 2010-08-22 05:33:08 -03:00
interfaces.py removed class method from_settings from ISpiderManager interface 2011-08-26 09:24:01 -03:00
item.py Changed default representation of items to pretty-printed dicts. This improves 2011-06-03 01:13:01 -03:00
link.py warn if Link objects are instantiated with unicode urls 2012-05-16 13:12:25 -03:00
linkextractor.py added more extensions to ignore on link extractors 2012-08-07 14:23:50 -03:00
log.py merge adding missing changes from previous commit 2012-09-19 03:19:03 -03:00
logformatter.py - removed scrapy.conf singleton from scrapy.log, scrapy.responsetypes, 2012-09-19 03:03:34 -03:00
mail.py refactored MailSender to get rid of scrapy.conf singleton, also removed ill-designed scrapy.mail.mail_sent signal 2012-09-11 16:27:19 -03:00
middleware.py format log lines lazily in case they are dropped by loglevels 2012-08-31 17:14:35 -03:00
mime.types moved module scrapy.core.downloader.responsetypes to scrapy.responsetypes 2011-08-07 02:49:57 -03:00
project.py Another step towards singleton removal: deprecated crawler singleton import (from scrapy.project import crawler) by a new class method that extensions can implement to receive the crawler 2011-08-08 11:42:44 -03:00
resolver.py removed wrong blocking api usage (socket.gethostbyname()) from downloader when using CONCURRENT_REQUESTS_PER_IP 2011-08-03 23:55:59 -03:00
responsetypes.py - removed scrapy.conf singleton from scrapy.log, scrapy.responsetypes, 2012-09-19 03:03:34 -03:00
shell.py scrapy shell: start shell in main thread and crawler in secondary thread, instead of the other way around. fixes #100 2012-05-22 19:15:54 -03:00
signalmanager.py Removed signals/stats singletons 2012-08-21 18:32:30 -03:00
signals.py restored stats_spider_{opened,closing,closed} signals in backwards compatibility mode 2012-09-14 12:38:00 -03:00
spider.py Removed per-spider settings concept, and scrapy.conf.settings singleton from many extensions and middlewares. There are some still remaining, that will be removed in future commits 2012-08-21 17:27:45 -03:00
spidermanager.py Removed signals/stats singletons 2012-08-21 18:32:30 -03:00
squeue.py Some changes to persistent scheduler after some initial usage feedback: 2011-09-23 13:03:07 -03:00
stats.py Removed signals/stats singletons 2012-08-21 18:32:30 -03:00
statscol.py major Stats Collection refactoring: removed separation of global/per-spider stats, removed stats-related signals (stats_spider_opened, etc). Stats are much simpler now, backwards compatibility is kept on the Stats Collector API. 2012-09-14 12:31:33 -03:00
telnet.py format log lines lazily in case they are dropped by loglevels 2012-08-31 17:14:35 -03:00
webservice.py format log lines lazily in case they are dropped by loglevels 2012-08-31 17:14:35 -03:00