RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
10,710 Commits 49 Branches 132 Tags 158 MiB
Commit Graph

10710 Commits

Author SHA1 Message Date
Kostis Anagnostopoulos 3a493b6066 fix: do not catch system exceptions like KeyboardInterrupt 2019-04-05 11:52:00 +02:00
Mikhail Korobov d39feabae3
Merge pull request #3724 from float13/tutorial_grammar 
[MRG+1] Docs - Tutorial - Minor grammar edits
 2019-04-05 12:31:59 +05:00
float13 a101d5fe5c text edit - delete 2 extra words 2019-04-05 01:12:20 -04:00
float13 77e3695686 grammar fix - add apostrophe-s to browser 2019-04-05 01:04:59 -04:00
float13 d711ecfc18 grammar fix - delete extra word "shell" 2019-04-05 00:56:51 -04:00
float13 6336e1d1f3 grammar fix - delete unneeded apostrophe in "lets" 2019-04-05 00:54:46 -04:00
Mikhail Korobov c2d8f6f456
Merge pull request #3718 from Gallaecio/deprecate-is-gzipped 
Deprecate the scrapy.utils.gz.is_gzipped function
 2019-04-03 19:01:35 +05:00
Adrián Chaves 7acf4eec79 Deprecate the scrapy.utils.gz.is_gzipped function 2019-04-02 18:36:03 +02:00
Eugenio Lacuesta 7a38623cec [Docs] Clarify comment about meta dictionary 2019-04-01 17:09:49 -03:00
Eugenio Lacuesta 8ebbc731b2 [Docs] Rephrase Rule docs 2019-04-01 16:15:03 -03:00
Eugenio Lacuesta 07ff9248a5 [Docs] CrawlSpider: add note about link text 2019-04-01 12:31:26 -03:00
Konstantin Lopuhin b5c552d17f
Merge pull request #2061 from elacuesta/process_spider_exception_generator 
[MRG+1] process_spider_exception on generators
 2019-04-01 10:43:19 +03:00
Eugenio Lacuesta 0522fe35c3 parse command: improve option description 2019-03-29 16:15:34 -03:00
Eugenio Lacuesta 294ef51bb2 parse command: update docs about passing callback keyword arguments 2019-03-29 16:12:55 -03:00
Eugenio Lacuesta ccb56a317e Update docs about cb_kwargs and meta 2019-03-29 14:13:50 -03:00
Eugenio Lacuesta f5e0b6b89a parse command: rename cb_kwargs option to cbkwargs 2019-03-29 14:03:26 -03:00
Adrián Chaves 484bd0d22a Allow customizing export column names 2019-03-29 15:16:54 +01:00
Vostretsov Nikita 1c6733454e added underlines 2019-03-29 10:44:55 +00:00
Vostretsov Nikita ef743983a9 change wording 2019-03-29 10:38:13 +00:00
Vostretsov Nikita f08f841d0b remove small single use method 2019-03-29 10:35:49 +00:00
Vostretsov Nikita 539a08cb85 Merge branch 'round-robin-scheduler-tested' of github.com:whalebot-helmsman/scrapy into round-robin-scheduler-tested 2019-03-29 10:31:52 +00:00
Vostretsov Nikita 554d872822 remove spacing 2019-03-29 10:31:15 +00:00
Vostretsov Nikita 2b4bcfaf49 remove comment 2019-03-29 10:30:26 +00:00
Adrián Chaves 1ee99e1f42
Update docs/topics/settings.rst 
Co-Authored-By: whalebot-helmsman <whalebot.helmsman@gmail.com>
 2019-03-29 10:29:15 +00:00
Adrián Chaves bd228f1d96
Update docs/topics/broad-crawls.rst 
Co-Authored-By: whalebot-helmsman <whalebot.helmsman@gmail.com>
 2019-03-29 10:29:04 +00:00
Adrián Chaves e3df6be360
Update docs/topics/broad-crawls.rst 
Co-Authored-By: whalebot-helmsman <whalebot.helmsman@gmail.com>
 2019-03-29 10:28:52 +00:00
Adrián Chaves 46b9ab0c58
Update docs/topics/broad-crawls.rst 
Co-Authored-By: whalebot-helmsman <whalebot.helmsman@gmail.com>
 2019-03-29 10:28:36 +00:00
Eugenio Lacuesta 8fb077694f Request.cb_kwargs: Update docs 2019-03-28 16:32:35 -03:00
Eugenio Lacuesta e8af6331b5 Add cb_kwargs option to the parse command 2019-03-28 15:03:40 -03:00
Eugenio Lacuesta 3efe3bea1c Update docs about cb_kwargs and meta 2019-03-28 14:16:03 -03:00
Eugenio Lacuesta 70a4d93aa3 Callback kwargs: more tests 2019-03-28 13:28:19 -03:00
Mikhail Korobov ec719f55e7
Merge pull request #3682 from elacuesta/rule_process_request_response_parameter 
[MRG+1] Rule.process_request: access Response object
 2019-03-28 01:39:54 +05:00
Eugenio Lacuesta c43a23152b Merge remote-tracking branch 'upstream/master' into callback_kwargs 2019-03-27 14:42:41 -03:00
Eugenio Lacuesta 8528f5065f [Doc] Update cb_kwargs example 2019-03-27 14:42:26 -03:00
Anubhav Patel ca882d8d9f include test 2019-03-27 19:10:44 +05:30
Anubhav Patel 9c9bca4e1c make suggested changes. 2019-03-27 18:29:48 +05:30
Mikhail Korobov 845bae6637
Update docs/topics/broad-crawls.rst 
Co-Authored-By: whalebot-helmsman <whalebot.helmsman@gmail.com>
 2019-03-27 08:49:19 +00:00
Mikhail Korobov 820adb69c0
Merge pull request #3701 from Gallaecio/documentation-policy-api 
Update the documentation policies: Ask to use docstrings to document …
 2019-03-27 12:25:38 +05:00
Adrián Chaves ce837b0f74 Update the documentation policies: Ask to use docstrings to document API members 2019-03-27 07:09:18 +01:00
Maram Sumanth 2fd8b7c28c [MRG+1] redirect_reasons in Request.meta (#3687) 2019-03-27 00:15:53 +05:00
Maram Sumanth 5f2ad5377e
fixed typo 2019-03-26 16:46:15 +05:30
Adrián Chaves 431f18a9a1 Document FilesPipeline.file_path and ImagesPipeline.file_path 2019-03-26 12:15:19 +01:00
Maram Sumanth ae856e8ba8
corrected tests 2019-03-26 16:21:52 +05:30
Maram Sumanth 213b9eb879
Update test_http_request.py 2019-03-26 15:59:38 +05:30
Maram Sumanth dc8310e292
changed tests 2019-03-26 15:42:58 +05:30
Adrián Chaves ba13de29e1
Merge branch 'master' into feat-685 2019-03-26 10:38:38 +01:00
Vostretsov Nikita 73e4ff5304 report warnings 2019-03-25 13:48:58 +00:00
Vostretsov Nikita 103fdc40c1 Merge remote-tracking branch 'upstream/master' into round-robin-scheduler-tested 2019-03-25 16:16:42 +03:00
Vostretsov Nikita 31b8a6b33a report warnings 2019-03-25 16:08:40 +03:00
Lucy Wang df574de8cc improve tests and fix some lint warnings (#6) 
* refactor downloader-aware test cases

* fix lint

* add doctest for _path_safe

* remove unused code

* better doctest
 2019-03-25 16:08:40 +03:00