| .. |
|
commands
|
Amend "settings" command to output JSON for dict settings
|
2016-01-29 21:12:03 +01:00 |
|
contracts
|
Allow spiders to return dicts. See GH-1064.
|
2015-03-18 07:26:56 +05:00 |
|
contrib
|
fixed backwards compatibility for scrapy.contrib.exporter.PythonItemExporter
|
2015-05-05 22:06:18 +05:00 |
|
contrib_exp
|
Move scrapy/contrib/downloadermiddleware to scrapy/downloadermiddlewares
|
2015-04-29 21:24:30 -03:00 |
|
core
|
Merge pull request #1822 from nyov/nyov/scheduler
|
2016-03-02 14:20:40 +01:00 |
|
downloadermiddlewares
|
Merge pull request #1735 from ArturGaspar/master
|
2016-02-03 13:30:06 -02:00 |
|
extensions
|
S3FeedStorageTest: add botocore support, and organize boto/botocore checks
|
2016-02-15 19:59:47 +03:00 |
|
http
|
Fix method name: this always returns unicode keys and values
|
2016-02-18 10:10:16 +03:00 |
|
linkextractors
|
Add pps extension to IGNORED_EXTENSIONS
|
2016-03-01 21:02:13 -03:00 |
|
loader
|
Merge pull request #1467 from dacjames/master
|
2015-09-16 22:03:19 -03:00 |
|
pipelines
|
Fix documentation for S3_STORE_ACL (now settings.FILES_STORE_S3_ACL) settings: it has nothing to do with feed exporters.
|
2016-02-24 10:16:41 +03:00 |
|
selector
|
response.text. Fixes GH-1729.
|
2016-01-27 01:28:11 +05:00 |
|
settings
|
Allow core Scheduler priority queue customization
|
2016-03-01 13:58:40 +00:00 |
|
spidermiddlewares
|
PY3 depth, offsite and referer spider middlewares; Crawler
|
2015-08-28 04:11:30 +05:00 |
|
spiders
|
Fix SitemapSpider to extract sitemap urls from robots.txt properly
|
2016-02-06 23:54:07 +09:00 |
|
templates
|
Enable robots.txt handling by default for new projects. Fixes GH-1668.
|
2016-01-26 17:47:46 +05:00 |
|
utils
|
Pass exception directly to SkipTest()
|
2016-02-21 01:16:46 +01:00 |
|
xlib
|
add deprecation for pydispatch (thanks for the help @redapple)
|
2016-02-11 16:15:28 -02:00 |
|
VERSION
|
Bump version: 1.2.0dev1 → 1.2.0dev2
|
2016-02-03 22:58:21 -03:00 |
|
__init__.py
|
drop deprecated "optional_features" set
|
2015-09-15 09:00:08 +00:00 |
|
_monkeypatches.py
|
BF: robustify _monkeypatches check for twisted - str() name first (Closes: #1634)
|
2015-12-18 16:16:05 -05:00 |
|
cmdline.py
|
Remove --lsprof command-line option. Fixes GH-1531
|
2016-01-19 00:00:31 +05:00 |
|
command.py
|
scrapy/command.py shim
|
2015-05-09 03:20:48 -03:00 |
|
conf.py
|
better backwards compatibility for scrapy.conf.settings
|
2012-10-25 11:41:40 -02:00 |
|
crawler.py
|
Remove unneeded `raise` (thanks @lopuhin).
|
2016-02-19 18:31:49 +05:00 |
|
dupefilter.py
|
scrapy/dupefilter.py shim
|
2015-04-29 21:27:20 -03:00 |
|
dupefilters.py
|
fixed RFPDupeFilter persistence
|
2015-07-28 14:32:14 +05:00 |
|
exceptions.py
|
pylint cleanup: unused imports and old-style exceptions
|
2013-10-18 19:23:45 +06:00 |
|
exporters.py
|
Fixed bug on XMLItemExporter with non-string fields in items
|
2016-01-30 10:00:06 -02:00 |
|
extension.py
|
Replace BaseSettings._getcomposite() with public .getwithbase() method
|
2015-11-11 17:39:57 +01:00 |
|
interfaces.py
|
rename scrapy.spidermanager.SpiderManager to scrapy.spiderloader.SpiderLoader
|
2015-04-16 20:07:53 +05:00 |
|
item.py
|
item fields defined on fields class attribute fix
|
2015-05-13 15:51:23 -03:00 |
|
link.py
|
PY3 raise an exception if bytes are passed as url to Link constructor
|
2015-08-28 23:04:02 +05:00 |
|
linkextractor.py
|
scrapy/linkextractor.py shim
|
2015-05-09 03:28:39 -03:00 |
|
log.py
|
keep level_names in scrapy.log for backwards compatibility
|
2015-05-21 08:56:44 +00:00 |
|
logformatter.py
|
fix Referer logging
|
2015-08-26 02:19:33 +05:00 |
|
mail.py
|
MailSender.send: allow passing a charset.
|
2016-02-04 19:33:44 +01:00 |
|
middleware.py
|
Use long classes names for enabled middlewares in startup logs
|
2016-01-26 16:41:16 +01:00 |
|
mime.types
|
moved module scrapy.core.downloader.responsetypes to scrapy.responsetypes
|
2011-08-07 02:49:57 -03:00 |
|
project.py
|
Drop support for scrapy.project.crawler (And scrapy.stats consequently)
|
2014-08-12 14:02:56 -03:00 |
|
resolver.py
|
Dns cache size and timeout options
|
2015-04-02 18:30:59 +02:00 |
|
responsetypes.py
|
More liberal Content-Disposition header parsing
|
2016-02-17 16:55:28 +01:00 |
|
shell.py
|
Optimization - avoid temporary list objects, unnecessary function call
|
2015-09-08 22:10:24 +03:00 |
|
signalmanager.py
|
PY3 port signals
|
2015-07-25 18:04:55 +02:00 |
|
signals.py
|
An attempt to resolve #977, add signal to be sent when request is dropped by the scheduler
|
2014-11-27 15:10:15 +03:00 |
|
spider.py
|
scrapy/spider.py shim
|
2015-05-09 04:27:43 -03:00 |
|
spiderloader.py
|
Refactored SpiderLoader class constructor for easier subclassing
|
2016-02-25 21:08:50 -03:00 |
|
spidermanager.py
|
rename scrapy.spidermanager.SpiderManager to scrapy.spiderloader.SpiderLoader
|
2015-04-16 20:07:53 +05:00 |
|
squeue.py
|
scrapy/squeue.py shim
|
2015-04-29 21:27:19 -03:00 |
|
squeues.py
|
Test for AttributeError when pickling objects (Python>=3.5)
|
2016-01-18 18:14:33 +01:00 |
|
stats.py
|
Drop support for scrapy.project.crawler (And scrapy.stats consequently)
|
2014-08-12 14:02:56 -03:00 |
|
statscol.py
|
scrapy/statscol.py shim
|
2015-04-29 21:37:26 -03:00 |
|
statscollectors.py
|
enable test_stats and test_utils_log tests in Python 3
|
2015-08-26 01:58:59 +05:00 |
|
telnet.py
|
Relocate telnetconsole to extensions/
|
2015-10-05 21:16:04 +03:00 |
9f4fe5dc4a