RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
6,516 Commits 49 Branches 132 Tags 158 MiB
Commit Graph

6516 Commits

Author SHA1 Message Date
Mikhail Korobov 79df51aae1 Merge pull request #2978 from codeaditya/https-links 
Use https for external links wherever possible in docs
 2017-10-27 14:14:37 +05:00
Daniel Graña 1d9c8f5295 Merge pull request #2921 from revolter/hotfix/disable-logging 
[MRG+1] Add option to disable automatic log handler install
 2017-10-26 15:04:18 -03:00
Aditya 9dd680d5c9 Use https for external links wherever possible in docs 2017-10-26 23:33:45 +05:30
Daniel Graña dc4b36a89e Merge pull request #2952 from NoExitTV/Unhelpful-log-message-from-core.downloader.handlers.http11 
[MRG+1] Changed unhelpful log message from core.downloader.handlers.http11
 2017-10-26 11:38:43 -03:00
Daniel Graña 4f8b45ec83 Merge pull request #2929 from djunzu/add_m4v_to_ignored_extensions 
[MRG+1] Add m4v extension to IGNORED_EXTENSIONS in LinkExtractor.
 2017-10-26 11:35:32 -03:00
Daniel Graña 9be8f02de8 Merge pull request #2942 from rodrigc/twisted-17.9.0 
[MRG+1] Bump Twisted requirement on Python 3 to 17.9.0 to catch many Python 3 fixes.
 2017-10-26 09:58:56 -03:00
Mikhail Korobov 98fb03e8bd Merge pull request #2958 from codeaditya/update-links 
Link "Debugging in Python" article to its new location
 2017-10-26 17:01:47 +05:00
Mikhail Korobov 496fc60b25 Merge pull request #2963 from djunzu/mention_request_meta_depth_on_depthmiddleware_doc 
Add note about request.meta['depth'] in DepthMiddleware
 2017-10-26 16:15:36 +05:00
Mikhail Korobov 73c40eb324 Merge pull request #2964 from weldon0405/patch-1 
Update tutorial.rst startproject files
 2017-10-26 16:05:31 +05:00
Mikhail Korobov 124d577da1 Merge pull request #2976 from weldon0405/patch-2 
updated file structure to include middlewares.py
 2017-10-26 16:04:59 +05:00
Weldon Malbrough 95815d27e8 updated file structure to include middlewares.py 2017-10-25 23:16:30 -04:00
Weldon Malbrough 169dc2860e Update tutorial.rst startproject files 
Added middlewares.py to accurately reflect the file structure created by "scrapy startproject tutorial"
 2017-10-16 22:46:32 -04:00
djunzu 8288f78a39 Add note about request.meta['depth'] in DepthMiddleware 2017-10-16 21:34:37 -02:00
Aditya 9cdf34b7c7 Link "Debugging in Python" article to its new location 
Reference: https://web.archive.org/web/20170203104051/http://www.ferg.org/papers/debugging_in_python.html
 2017-10-10 22:49:22 +05:30
NoExitTV 9b8503011e Changed log message to include information about request as user djunzu commented 2017-10-06 13:45:35 +02:00
NoExitTV 345d948f2f Changed the log message to make it more clear. As requested in issue #2927 2017-10-05 15:37:05 +02:00
NoExitTV 938bc18405 Changed the log message to make it more clear. As requested in issue #2927 2017-10-05 15:31:00 +02:00
NoExitTV e914556adf Changed the log message to make it more clear. As requested in issue #2927 2017-10-05 15:12:01 +02:00
Paul Tremberth f729d74886 Use a helper for to_bytes() and None input 2017-10-05 10:16:42 +02:00
Paul Tremberth 9cd348d94a Handle None values for smtp user and password 2017-10-05 10:16:42 +02:00
Paul Tremberth 0d8a33fddc Update docs 2017-10-05 10:16:42 +02:00
Paul Tremberth 80bb4fcf97 Convert SMTP credentials to bytes if needed 2017-10-05 10:16:42 +02:00
Paul Tremberth 12c7628fcb Encode message using supplied charset 2017-10-05 10:16:42 +02:00
Craig Rodrigues fc406801f1 ESMTPSenderFactory takes a message of bytes 2017-10-05 10:16:42 +02:00
Daniel Graña 5fac2d7b90 Merge pull request #2923 from rhoboro/fixes-685 
[MRG+2] Fixes #685 FilesPipeline support for Google Cloud Storage.
 2017-10-02 13:52:20 -03:00
Mikhail Korobov 92fa74fb43 Merge pull request #2922 from stav/doc.response-body 
[Doc] Update Response.body type
 2017-10-02 10:26:54 +02:00
Mikhail Korobov 3431870b53 Merge pull request #2924 from superyyrrzz/patch-1 
minor fix typo
 2017-10-02 10:25:40 +02:00
Mikhail Korobov 2e4ddc6912 Merge pull request #2947 from lagenar/fix-tests-typo 
Fix typos in tests
 2017-10-02 10:24:27 +02:00
Lucas Moauro 59c3f6f095 Fix typos in tests 2017-10-01 12:24:56 -03:00
rhoboro d4555b2bcc update docs for supporting google cloud storage 2017-09-29 13:04:17 +09:00
Mikhail Korobov 346310cd10 Merge pull request #2915 from redapple/versions-with-cryptography 
Print cryptography package version
 2017-09-28 13:04:56 +02:00
Paul Tremberth e733f51d4b Fix test 2017-09-25 12:49:27 +02:00
Craig Rodrigues 00c81a32ee Bump Twisted requirement to 17.9.0 to catch many Python 3 fixes. 2017-09-23 11:01:34 -07:00
Mikhail Korobov 5d17f38aee Merge pull request #2935 from lopuhin/pypy2.7-build 
Update pypy version regexp to get last release
 2017-09-20 17:59:46 +05:00
Konstantin Lopuhin 84111969c4 Update pypy version regexp to get last release 
PyPy changed naming conention since 5.8 release, not it's called
pypy2.7-x.x.x
 2017-09-20 13:35:48 +02:00
djunzu dcb279bd6c Add m4v extension to IGNORED_EXTENSIONS in LinkExtractor. 
modified:   scrapy/linkextractors/__init__.py
 2017-09-17 16:09:22 -03:00
Renze Yu 088b80d41a minor fix typo 2017-09-13 23:29:22 +08:00
rhoboro ee166ec44f Support for ImagesPipeline 2017-09-13 17:35:46 +09:00
rhoboro e5d4364b2a Add tests for GCS Storage 2017-09-13 16:24:16 +09:00
rhoboro d71a063403 Support for Google Cloud Storage 2017-09-13 16:00:26 +09:00
Steven Almeroth 3637b75a67 [Doc] Update Response.body type 2017-09-12 17:41:47 -04:00
Iulian Onofrei aab98080a0 Add option to disable automatic log handler install 2017-09-11 00:40:55 +03:00
Paul Tremberth abaf466bb3 Print cryptography package version 2017-09-07 11:43:20 +02:00
cclauss b8fabeed86 ur'string' not needed in Py 2, syntax error in Py3 
This instance was missed in #2909 --> ur'Scrapy developers' --> u'Scrapy developers'
 2017-09-04 14:29:23 +02:00
Mikhail Korobov 6213fa5175 Merge pull request #2909 from cclauss/patch-2 
ur'string' not needed in Py 2, syntax error in Py3
 2017-09-01 15:42:02 +05:00
cclauss b702236082 ur'string' not needed in Py 2, syntax error in Py3 
Convert `u'(.*)\:\d+\:\s\[(.*)\]\s(?:(.*)\sto\s(.*)|(.*))'`--> `u'(.*)\:\d+\:\s\[(.*)\]\s(?:(.*)\sto\s(.*)|(.*))'`to be compatible with both Python 2 and Python 3.  See #2891
 2017-09-01 11:56:09 +02:00
cclauss 9f16f040b6 ur'string' not needed in Py 2, syntax error in Py3 
Convert `ur'Scrapy Documentation'`--> `u'Scrapy Documentation'`to be compatible with both Python 2 and Python 3.  See #2891
 2017-09-01 11:53:59 +02:00
Mikhail Korobov 65ac0b06df Merge pull request #2894 from redapple/log-custom-overriden-settings 
Move logging of overriden settings to Crawler init
 2017-08-29 19:20:46 +05:00
Pablo Hoffman a429d78019 update scrapinghub.com urls to use https 2017-08-24 16:03:36 -03:00
Paul Tremberth 7a35a1ad4a Remove trailing bracket from components versions log 2017-08-23 17:54:14 +02:00