RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
7,096 Commits 49 Branches 132 Tags 137 MiB
Commit Graph

7096 Commits

Author SHA1 Message Date
Daniel Graña 8a022ac6ea
Merge pull request #3810 from Gallaecio/documentation-coverage 
Skip scrapy.contracts private APIs in the documentation coverage report
 2019-06-13 17:16:07 -03:00
Daniel Graña c05d24c571
Merge pull request #3819 from sortafreel/fix_missing_values 
[MRG+1] Fix missing values
 2019-06-13 00:06:25 -03:00
Daniel Graña 66c40d0e5d
Merge pull request #3825 from Gallaecio/fix-py34-setup 
Require Twisted<=19.2.0 for Python 3.4
 2019-06-12 17:40:26 -03:00
Daniel Graña 1a6ce134a4
Merge pull request #3827 from Gallaecio/fix-appveyor-config 
Set the cloned directory as PYTHONPATH in appveyor.yml
 2019-06-12 17:40:09 -03:00
sortafreel cdeccac6d6 Linting (return previous indentation). 2019-06-11 17:38:06 +03:00
Adrián Chaves fe0f80f2f4 Set the cloned directory as PYTHONPATH in appveyor.yml 2019-06-11 15:56:27 +02:00
Adrián Chaves 0da972339b Require Twisted<=19.2.0 for Python 3.4 2019-06-11 14:11:38 +02:00
sortafreel 7dad2f7b13 Add more tests. 2019-06-11 07:43:03 +03:00
sortafreel a1bca6a8e7 Add tests. 2019-06-11 07:36:29 +03:00
Adrián Chaves c7ba72b5dc Skip scrapy.contracts private APIs in the documentation coverage report 2019-06-07 13:14:33 +02:00
Sortafreel 754f52b027 Preprocess values if item built from dict. 
https://github.com/scrapy/scrapy/issues/3804
 2019-06-07 03:20:45 +03:00
Sortafreel bd8a10384b Add values (if there're any) when initiating items from dicts 
https://github.com/scrapy/scrapy/issues/3804
 2019-06-07 01:50:03 +03:00
Mikhail Korobov 29bbbaa4dd
Merge pull request #3812 from duketemon/master 
[MRG+1] Tutorial: scrapy shell example should say "text" not "title" (#3807)
 2019-06-05 20:00:26 +05:00
Artem Kuchumov c81e15ed6e
Tutorial: scrapy shell example should say "text" not "title" (#3807) 
Tutorial: scrapy shell example should say "text" not "title"
 2019-06-05 13:15:23 +05:00
Mikhail Korobov f755507d68
Merge pull request #3567 from Gallaecio/documentation-coverage 
Add a Sphinx extension to generate documentation coverage information
 2019-06-04 18:47:24 +05:00
Mikhail Korobov a3dab41de8
Merge pull request #3806 from Gallaecio/statscollectors-currentmodule 
Fix a double indexing of the scrapy.statscollectors module in the doc…
 2019-06-04 18:11:08 +05:00
Adrián Chaves c7b5ad0e20 Add a Sphinx extension to generate documentation coverage information 2019-06-04 15:03:25 +02:00
Adrián Chaves ea209a0ea7 Fix module double indexing issues in the documentation 2019-06-04 14:35:27 +02:00
Mikhail Korobov 890e7fbd5b
Merge pull request #3791 from barraponto/patch-3 
[MRG+1] Fix documentation for spiderloader
 2019-05-28 19:16:12 +01:00
Mikhail Korobov 8d50384210
Merge pull request #3797 from mar-heaven/master 
[MRG+1] remove a "is"
 2019-05-28 19:12:04 +01:00
mar-heaven 18f01ea6ec
remove a "is" 
When I translated in Chinese, I found a needless "is"
 2019-05-27 17:15:30 +08:00
Capi Etheriel 7d36fa7435
Fix documentation for spiderloader 2019-05-24 10:32:55 -03:00
Mikhail Korobov a3d38041e2
Merge pull request #3764 from Jeffallan/patch-1 
[MRG+1] Update telnetconsole.rst
 2019-05-09 20:59:30 +05:00
Mikhail Korobov 137a3d8146
Merge pull request #3762 from Vandenn/update-logging-docs 
[MRG+1] doc: update configure_logging docs to discourage use with CrawlerProcess
 2019-05-09 20:59:20 +05:00
Mikhail Korobov 2f0285b653
Merge pull request #3767 from firegolem/patch-1 
[MRG+1] Fix a broken github help link
 2019-05-09 20:58:38 +05:00
Aditya 3a7850fa15
Update contributing.rst 2019-05-05 18:45:40 +05:30
Jeffallan 5814344adf
Update telnetconsole.rst 
Change spelling of bellow to below.
 2019-05-04 14:15:47 -05:00
Vandenn 122ca62119 doc: update configure_logging docs to discourage use with CrawlerProcess 2019-05-03 16:39:26 +08:00
Mikhail Korobov 6e49c379a8
Merge pull request #3748 from Gallaecio/docstring-conventions 
Cover PEP 257 in the documentation policies
 2019-04-17 13:22:11 +05:00
Mikhail Korobov 5b667b6156
Merge pull request #3707 from Gallaecio/pytest-xdist 
Use pytest-xdist
 2019-04-17 13:20:37 +05:00
Adrián Chaves 5a6fb3daa6 Use pytest-xdist 2019-04-17 09:02:34 +02:00
Adrián Chaves fbb42fe14e Cover PEP 257 in the documentation policies 2019-04-17 08:25:22 +02:00
Mikhail Korobov 4b791274d6
Merge pull request #3735 from anubhavp28/smallfix 
[MRG+1] Changes a parameter name in class `DummyPolicy`
 2019-04-13 01:52:22 +05:00
Mikhail Korobov 71cfe550fb
Merge pull request #3737 from anubhavp28/anothersmallfix 
[MRG+1] Fixes a link in comment
 2019-04-13 01:50:19 +05:00
Adrián Chaves 92fa657f9e
Merge pull request #3730 from ankostis/doc_logstats_delay 
[MRG+1] doc: document LOGSTATS_INTERVAL setting
 2019-04-11 17:34:45 +02:00
Anubhav Patel 4cfdc14974 fixes a link in comment 2019-04-09 17:52:02 +05:30
Anubhav Patel e6048d55f9 changes parameter name 2019-04-09 17:34:20 +05:30
Mikhail Korobov 9280185054
Merge pull request #3520 from whalebot-helmsman/round-robin-scheduler-tested 
[MRG+1] Downloader-aware Priority Queue for Scrapy
 2019-04-07 00:06:08 +05:00
Maram Sumanth aa46e1995c [MRG+1] Show elapsed time in statscollector (#3638) 
* Update corestats.py

* Update corestats.py

* corrected tests

* Update corestats.py

* Update scrapy/extensions/corestats.py
 2019-04-07 00:03:40 +05:00
Mikhail Korobov f816375df5
Merge pull request #3726 from ankostis/fixctrlc 
[MRG+1] fix: do not catch system exceptions like KeyboardInterrupt
 2019-04-06 23:54:15 +05:00
Kostis Anagnostopoulos a8f83ab967 doc: document LOGSTATS_INTERVAL setting 2019-04-06 14:58:32 +02:00
Daniel Graña 2079e3c42a
Merge pull request #3728 from victor-torres/process_spider_exception 
[MRG+1] fix typo on Spider Middleware template (Response -> Request)
 2019-04-06 06:52:31 -03:00
Victor Torres 35ce92a419 fix typo (Response -> Request) 
check docs for more information b5c552d17f/docs/topics/spider-middleware.rst
 2019-04-05 14:31:15 -03:00
Kostis Anagnostopoulos 3a493b6066 fix: do not catch system exceptions like KeyboardInterrupt 2019-04-05 11:52:00 +02:00
Mikhail Korobov d39feabae3
Merge pull request #3724 from float13/tutorial_grammar 
[MRG+1] Docs - Tutorial - Minor grammar edits
 2019-04-05 12:31:59 +05:00
float13 a101d5fe5c text edit - delete 2 extra words 2019-04-05 01:12:20 -04:00
float13 77e3695686 grammar fix - add apostrophe-s to browser 2019-04-05 01:04:59 -04:00
float13 d711ecfc18 grammar fix - delete extra word "shell" 2019-04-05 00:56:51 -04:00
float13 6336e1d1f3 grammar fix - delete unneeded apostrophe in "lets" 2019-04-05 00:54:46 -04:00
Mikhail Korobov c2d8f6f456
Merge pull request #3718 from Gallaecio/deprecate-is-gzipped 
Deprecate the scrapy.utils.gz.is_gzipped function
 2019-04-03 19:01:35 +05:00