RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
9,291 Commits 49 Branches 132 Tags 153 MiB
Commit Graph

9291 Commits

Author SHA1 Message Date
Adrián Chaves fbb42fe14e Cover PEP 257 in the documentation policies 2019-04-17 08:25:22 +02:00
Mikhail Korobov 4b791274d6
Merge pull request #3735 from anubhavp28/smallfix 
[MRG+1] Changes a parameter name in class `DummyPolicy`
 2019-04-13 01:52:22 +05:00
Mikhail Korobov 71cfe550fb
Merge pull request #3737 from anubhavp28/anothersmallfix 
[MRG+1] Fixes a link in comment
 2019-04-13 01:50:19 +05:00
Adrián Chaves 92fa657f9e
Merge pull request #3730 from ankostis/doc_logstats_delay 
[MRG+1] doc: document LOGSTATS_INTERVAL setting
 2019-04-11 17:34:45 +02:00
Matthijs Vos 07adca34e1 Fix 'Too many values to unpack' 2019-04-10 13:01:46 +02:00
Matthijs Vos 50730ed228 Try it with a string 2019-04-10 13:01:01 +02:00
Matthijs Vos d27c2c68ba Wrap scrapy check in environment 2019-04-10 12:56:50 +02:00
Anubhav Patel 4cfdc14974 fixes a link in comment 2019-04-09 17:52:02 +05:30
Anubhav Patel e6048d55f9 changes parameter name 2019-04-09 17:34:20 +05:30
Mikhail Korobov 9280185054
Merge pull request #3520 from whalebot-helmsman/round-robin-scheduler-tested 
[MRG+1] Downloader-aware Priority Queue for Scrapy
 2019-04-07 00:06:08 +05:00
Maram Sumanth aa46e1995c [MRG+1] Show elapsed time in statscollector (#3638) 
* Update corestats.py

* Update corestats.py

* corrected tests

* Update corestats.py

* Update scrapy/extensions/corestats.py
 2019-04-07 00:03:40 +05:00
Mikhail Korobov f816375df5
Merge pull request #3726 from ankostis/fixctrlc 
[MRG+1] fix: do not catch system exceptions like KeyboardInterrupt
 2019-04-06 23:54:15 +05:00
Kostis Anagnostopoulos a8f83ab967 doc: document LOGSTATS_INTERVAL setting 2019-04-06 14:58:32 +02:00
Daniel Graña 2079e3c42a
Merge pull request #3728 from victor-torres/process_spider_exception 
[MRG+1] fix typo on Spider Middleware template (Response -> Request)
 2019-04-06 06:52:31 -03:00
Victor Torres 35ce92a419 fix typo (Response -> Request) 
check docs for more information b5c552d17f/docs/topics/spider-middleware.rst
 2019-04-05 14:31:15 -03:00
Kostis Anagnostopoulos 3a493b6066 fix: do not catch system exceptions like KeyboardInterrupt 2019-04-05 11:52:00 +02:00
Mikhail Korobov d39feabae3
Merge pull request #3724 from float13/tutorial_grammar 
[MRG+1] Docs - Tutorial - Minor grammar edits
 2019-04-05 12:31:59 +05:00
float13 a101d5fe5c text edit - delete 2 extra words 2019-04-05 01:12:20 -04:00
float13 77e3695686 grammar fix - add apostrophe-s to browser 2019-04-05 01:04:59 -04:00
float13 d711ecfc18 grammar fix - delete extra word "shell" 2019-04-05 00:56:51 -04:00
float13 6336e1d1f3 grammar fix - delete unneeded apostrophe in "lets" 2019-04-05 00:54:46 -04:00
Mikhail Korobov c2d8f6f456
Merge pull request #3718 from Gallaecio/deprecate-is-gzipped 
Deprecate the scrapy.utils.gz.is_gzipped function
 2019-04-03 19:01:35 +05:00
Adrián Chaves 7acf4eec79 Deprecate the scrapy.utils.gz.is_gzipped function 2019-04-02 18:36:03 +02:00
Eugenio Lacuesta 7a38623cec [Docs] Clarify comment about meta dictionary 2019-04-01 17:09:49 -03:00
Eugenio Lacuesta 8ebbc731b2 [Docs] Rephrase Rule docs 2019-04-01 16:15:03 -03:00
Eugenio Lacuesta 07ff9248a5 [Docs] CrawlSpider: add note about link text 2019-04-01 12:31:26 -03:00
Konstantin Lopuhin b5c552d17f
Merge pull request #2061 from elacuesta/process_spider_exception_generator 
[MRG+1] process_spider_exception on generators
 2019-04-01 10:43:19 +03:00
Eugenio Lacuesta 0522fe35c3 parse command: improve option description 2019-03-29 16:15:34 -03:00
Eugenio Lacuesta 294ef51bb2 parse command: update docs about passing callback keyword arguments 2019-03-29 16:12:55 -03:00
Eugenio Lacuesta ccb56a317e Update docs about cb_kwargs and meta 2019-03-29 14:13:50 -03:00
Eugenio Lacuesta f5e0b6b89a parse command: rename cb_kwargs option to cbkwargs 2019-03-29 14:03:26 -03:00
Adrián Chaves 484bd0d22a Allow customizing export column names 2019-03-29 15:16:54 +01:00
Vostretsov Nikita 1c6733454e added underlines 2019-03-29 10:44:55 +00:00
Vostretsov Nikita ef743983a9 change wording 2019-03-29 10:38:13 +00:00
Vostretsov Nikita f08f841d0b remove small single use method 2019-03-29 10:35:49 +00:00
Vostretsov Nikita 539a08cb85 Merge branch 'round-robin-scheduler-tested' of github.com:whalebot-helmsman/scrapy into round-robin-scheduler-tested 2019-03-29 10:31:52 +00:00
Vostretsov Nikita 554d872822 remove spacing 2019-03-29 10:31:15 +00:00
Vostretsov Nikita 2b4bcfaf49 remove comment 2019-03-29 10:30:26 +00:00
Adrián Chaves 1ee99e1f42
Update docs/topics/settings.rst 
Co-Authored-By: whalebot-helmsman <whalebot.helmsman@gmail.com>
 2019-03-29 10:29:15 +00:00
Adrián Chaves bd228f1d96
Update docs/topics/broad-crawls.rst 
Co-Authored-By: whalebot-helmsman <whalebot.helmsman@gmail.com>
 2019-03-29 10:29:04 +00:00
Adrián Chaves e3df6be360
Update docs/topics/broad-crawls.rst 
Co-Authored-By: whalebot-helmsman <whalebot.helmsman@gmail.com>
 2019-03-29 10:28:52 +00:00
Adrián Chaves 46b9ab0c58
Update docs/topics/broad-crawls.rst 
Co-Authored-By: whalebot-helmsman <whalebot.helmsman@gmail.com>
 2019-03-29 10:28:36 +00:00
Eugenio Lacuesta 8fb077694f Request.cb_kwargs: Update docs 2019-03-28 16:32:35 -03:00
Eugenio Lacuesta e8af6331b5 Add cb_kwargs option to the parse command 2019-03-28 15:03:40 -03:00
Eugenio Lacuesta 3efe3bea1c Update docs about cb_kwargs and meta 2019-03-28 14:16:03 -03:00
Eugenio Lacuesta 70a4d93aa3 Callback kwargs: more tests 2019-03-28 13:28:19 -03:00
Mikhail Korobov ec719f55e7
Merge pull request #3682 from elacuesta/rule_process_request_response_parameter 
[MRG+1] Rule.process_request: access Response object
 2019-03-28 01:39:54 +05:00
Eugenio Lacuesta c43a23152b Merge remote-tracking branch 'upstream/master' into callback_kwargs 2019-03-27 14:42:41 -03:00
Eugenio Lacuesta 8528f5065f [Doc] Update cb_kwargs example 2019-03-27 14:42:26 -03:00
Anubhav Patel 9c9bca4e1c make suggested changes. 2019-03-27 18:29:48 +05:30