| .. |
|
commands
|
Merge pull request #2957 from ScrapingLab/add_meta_json_to_parse_command
|
2017-11-29 16:26:48 -03:00 |
|
contracts
|
…
|
|
|
contrib
|
…
|
|
|
contrib_exp
|
…
|
|
|
core
|
consume start requests unit get a signal value
|
2018-04-23 10:46:19 +00:00 |
|
downloadermiddlewares
|
Merge branch 'master' into master
|
2018-02-08 23:43:29 +03:00 |
|
extensions
|
use INFO log level to show telnet host/port
|
2018-02-08 05:09:02 +05:00 |
|
http
|
corrected syntax error in XPath
|
2018-03-19 19:28:41 +05:30 |
|
linkextractors
|
[MRG+1] Add 'flv' to ignored video extensions. (#3165)
|
2018-03-13 10:35:27 +03:00 |
|
loader
|
…
|
|
|
pipelines
|
Merge branch 'master' into extending-s3-files-store
|
2017-12-31 16:44:38 -03:00 |
|
selector
|
…
|
|
|
settings
|
Use https link in default user agent
|
2017-10-28 23:37:44 +05:30 |
|
spidermiddlewares
|
url_pattern is now being compiled before entering the loop
|
2017-12-07 18:38:29 +01:00 |
|
spiders
|
new method with ability to control consumption
|
2018-04-23 10:45:14 +00:00 |
|
templates
|
Migrate all subdomains on readthedocs.org to readthedocs.io
|
2017-10-28 16:53:32 +05:30 |
|
utils
|
Fix OS signal names
|
2018-01-27 21:24:15 +00:00 |
|
xlib
|
Wipe scrapy.xlib.tx
|
2016-12-02 21:22:35 +00:00 |
|
VERSION
|
Bump version: 1.4.0 → 1.5.0
|
2017-12-30 02:09:52 +05:00 |
|
__init__.py
|
…
|
|
|
__main__.py
|
Add support for executing scrapy using -m option of python
|
2017-05-15 22:52:23 -03:00 |
|
_monkeypatches.py
|
Use https links wherever possible
|
2017-10-28 16:24:40 +05:30 |
|
cmdline.py
|
Move garbage_collect to scrapy.utils.python
|
2017-06-15 13:14:31 +03:00 |
|
command.py
|
…
|
|
|
conf.py
|
…
|
|
|
crawler.py
|
use new method
|
2018-04-23 10:45:30 +00:00 |
|
dupefilter.py
|
…
|
|
|
dupefilters.py
|
…
|
|
|
exceptions.py
|
…
|
|
|
exporters.py
|
Use https links wherever possible
|
2017-10-28 16:24:40 +05:30 |
|
extension.py
|
…
|
|
|
interfaces.py
|
…
|
|
|
item.py
|
BUG: Fix __classcell__ propagation.
|
2017-02-08 02:12:52 -04:00 |
|
link.py
|
…
|
|
|
linkextractor.py
|
…
|
|
|
log.py
|
…
|
|
|
logformatter.py
|
[logformatter] backward compat comments
|
2017-03-17 08:11:20 +01:00 |
|
mail.py
|
Use a helper for to_bytes() and None input
|
2017-10-05 10:16:42 +02:00 |
|
middleware.py
|
…
|
|
|
mime.types
|
…
|
|
|
project.py
|
…
|
|
|
resolver.py
|
Do not cache DNS responses when cache size is 0
|
2017-07-04 23:18:15 +02:00 |
|
responsetypes.py
|
…
|
|
|
shell.py
|
Populate spider variable when using shell.inspect_response
|
2017-07-03 11:28:04 -03:00 |
|
signalmanager.py
|
Use https links wherever possible
|
2017-10-28 16:24:40 +05:30 |
|
signals.py
|
…
|
|
|
spider.py
|
…
|
|
|
spiderloader.py
|
Add SPIDER_LOADER_WARN_ONLY to toggle between spiderloader failure and warning
|
2017-03-07 17:40:40 +01:00 |
|
spidermanager.py
|
…
|
|
|
squeue.py
|
…
|
|
|
squeues.py
|
Clarify comment about Pyhton versions
|
2018-02-08 15:47:20 -03:00 |
|
stats.py
|
…
|
|
|
statscol.py
|
…
|
|
|
statscollectors.py
|
…
|
|
|
telnet.py
|
…
|
|
a44c990a59