scrapy/scrapy
Mikhail Korobov de3e451564 fix XmlItemExporter in Python 2.7.4 and 2.7.5 2013-08-21 13:57:02 -03:00
..
commands obey request method when scrapy deploy is redirected to a new endpoint 2013-05-30 18:34:59 -03:00
contracts scrapy contracts: python2.6 compat 2012-10-28 18:23:21 +01:00
contrib fix XmlItemExporter in Python 2.7.4 and 2.7.5 2013-08-21 13:57:02 -03:00
contrib_exp format log lines lazily in case they are dropped by loglevels 2012-08-31 17:14:35 -03:00
core Merge pull request #329 from kalessin/ftphandler 2013-07-15 16:39:46 -07:00
http Skipping cookie retrieval for non http requests 2013-07-22 11:33:26 -03:00
selector added remove_namespaces() method to XmlXPathSelector objects 2013-01-18 12:20:03 -02:00
settings Added COMPRESSION_ENABLED setting to enable or disable the HttpCompressionMiddleware 2013-08-01 11:31:28 -03:00
templates Fix broken doc links. 2012-11-12 22:43:42 +02:00
tests Skipping cookie retrieval for non http requests 2013-07-22 11:33:26 -03:00
utils fixed scrapy.utils.gz.gunzip() broken after changes from Python 2.7.3 to 2.7.4 2013-08-09 18:20:04 -03:00
xlib Merge pull request #205 from joehillen/master 2013-07-16 12:34:17 -07:00
VERSION updated release notes and bumped version to 0.18.0 2013-08-09 19:02:28 -03:00
__init__.py improve twisted version tests and enable HTTP11 handler by default if supported 2013-06-04 16:59:35 -03:00
cmdline.py pluggable sub-commands for scrapy comand-line 2013-03-06 05:25:38 +11:00
command.py added --pdb command option to enable pdb debugger on failure. 2013-02-11 12:34:29 -04:00
conf.py better backwards compatibility for scrapy.conf.settings 2012-10-25 11:41:40 -02:00
crawler.py Log overriden Scrapy settings when Scrapy starts. 2013-02-28 11:35:11 -02:00
dupefilter.py log (just once) when duplicate requests are filtered out. closes #105, #249 2013-03-12 19:28:43 -03:00
exceptions.py proper unittest-like output for scrapy contracts 2012-10-27 23:26:40 +02:00
extension.py Made ExtensionManager a subclass of MiddlewareManager 2010-08-22 05:33:08 -03:00
interfaces.py removed class method from_settings from ISpiderManager interface 2011-08-26 09:24:01 -03:00
item.py deleted unused import 2013-04-19 14:51:59 -03:00
link.py warn if Link objects are instantiated with unicode urls 2012-05-16 13:12:25 -03:00
linkextractor.py added more extensions to ignore on link extractors 2012-08-07 14:23:50 -03:00
log.py log optional features available on startup 2013-06-04 19:25:26 -03:00
logformatter.py Log level return from LogFormatter methods 2012-12-29 11:43:41 +07:00
mail.py refactored MailSender to get rid of scrapy.conf singleton, also removed ill-designed scrapy.mail.mail_sent signal 2012-09-11 16:27:19 -03:00
middleware.py format log lines lazily in case they are dropped by loglevels 2012-08-31 17:14:35 -03:00
mime.types moved module scrapy.core.downloader.responsetypes to scrapy.responsetypes 2011-08-07 02:49:57 -03:00
project.py Another step towards singleton removal: deprecated crawler singleton import (from scrapy.project import crawler) by a new class method that extensions can implement to receive the crawler 2011-08-08 11:42:44 -03:00
resolver.py removed wrong blocking api usage (socket.gethostbyname()) from downloader when using CONCURRENT_REQUESTS_PER_IP 2011-08-03 23:55:59 -03:00
responsetypes.py - removed scrapy.conf singleton from scrapy.log, scrapy.responsetypes, 2012-09-19 03:03:34 -03:00
shell.py fetch command should catch IgnoreRequest exception 2013-03-02 20:13:14 -06:00
signalmanager.py remove debugging code 2013-02-27 03:52:55 -02:00
signals.py removed request_received and added request_scheduled 2013-06-26 16:45:46 -03:00
spider.py spider.log to pass keyword arguments into twisted log.msg 2013-02-11 05:00:06 +11:00
spidermanager.py from_crawler added to spiders 2013-06-27 15:06:18 -03:00
squeue.py ported code to use queuelib 2013-04-23 17:48:09 -03:00
stats.py Removed signals/stats singletons 2012-08-21 18:32:30 -03:00
statscol.py minor message update: spider stats -> Scrapy stats 2012-10-12 16:53:44 -02:00
telnet.py change manager in telnet variable to crawler 2013-05-08 11:58:15 +08:00
webservice.py format log lines lazily in case they are dropped by loglevels 2012-08-31 17:14:35 -03:00