RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
10,710 Commits 49 Branches 132 Tags 158 MiB
Commit Graph

10710 Commits

Author SHA1 Message Date
Andrew Baxter 72b7d3e90a Make the regex align to the spec better; add unit tests for name variations 2019-05-27 23:30:23 +09:00
mar-heaven 18f01ea6ec
remove a "is" 
When I translated in Chinese, I found a needless "is"
 2019-05-27 17:15:30 +08:00
Anubhav Patel 90fdefcbca cache if convert_image has deprecated signature 2019-05-25 19:11:48 +05:30
Anubhav Patel da82ede8a0
describe method as a command 2019-05-25 17:19:10 +05:30
Claudio Salazar 461682fc3d Whitelist form methods in FormRequest.from_response method 2019-05-25 11:01:19 +02:00
Andrew Baxter 144afcee79 Use regex to check for private methods 2019-05-25 00:52:00 +09:00
Capi Etheriel 0ee2284fcc
Add 429 to RETRY_HTTP_CODES 2019-05-24 11:11:15 -03:00
Capi Etheriel 7d36fa7435
Fix documentation for spiderloader 2019-05-24 10:32:55 -03:00
Andrew Baxter e667ca7682 Account for mangling when serializing requests with private callbacks 2019-05-24 21:45:53 +09:00
Anubhav Patel c8e28ec194 makes suggested changes 2019-05-23 15:04:21 +05:30
Anubhav Patel 2994b624e0 makes suggested changes 2019-05-17 12:14:43 +00:00
Anubhav Patel 653ac3eebe makes suggested changes 2019-05-16 06:20:39 +00:00
Mikhail Korobov a3d38041e2
Merge pull request #3764 from Jeffallan/patch-1 
[MRG+1] Update telnetconsole.rst
 2019-05-09 20:59:30 +05:00
Mikhail Korobov 137a3d8146
Merge pull request #3762 from Vandenn/update-logging-docs 
[MRG+1] doc: update configure_logging docs to discourage use with CrawlerProcess
 2019-05-09 20:59:20 +05:00
Mikhail Korobov 2f0285b653
Merge pull request #3767 from firegolem/patch-1 
[MRG+1] Fix a broken github help link
 2019-05-09 20:58:38 +05:00
Adrián Chaves 611249bb7f Implement the METAREFRESH_IGNORE_TAGS setting 2019-05-08 12:52:29 +02:00
Anubhav Patel 881bade2c1 tests for new API 2019-05-07 16:12:26 +05:30
Anubhav Patel 33925a7761 test for deprecation warning 2019-05-07 15:44:21 +05:30
Aditya 3a7850fa15
Update contributing.rst 2019-05-05 18:45:40 +05:30
Jeffallan 5814344adf
Update telnetconsole.rst 
Change spelling of bellow to below.
 2019-05-04 14:15:47 -05:00
Adrián Chaves bc1a929213
Improve the documentation about detecting check runs 2019-05-03 14:42:12 +02:00
Matthijs Vos f6485e6697 Restore alphabetic order and two lines between import and code 2019-05-03 13:55:18 +02:00
Matthijs Vos 8bd207a2f6 Add documentation 2019-05-03 13:50:24 +02:00
Vandenn 122ca62119 doc: update configure_logging docs to discourage use with CrawlerProcess 2019-05-03 16:39:26 +08:00
Anubhav Patel 2a6bcdb413 makes fix backward compatible 2019-04-29 21:21:02 +05:30
Matthijs Vos 7809c0b14e Revert another non-change comment 2019-04-20 09:25:01 +02:00
Matthijs Vos 935387aaea Revert some non-changes 2019-04-18 22:10:23 +02:00
Matthijs Vos 6d52708579 Add reset case 2019-04-18 15:19:23 +02:00
Matthijs Vos 2973998947 Add set_environ test 2019-04-18 14:50:02 +02:00
Mikhail Korobov 6e49c379a8
Merge pull request #3748 from Gallaecio/docstring-conventions 
Cover PEP 257 in the documentation policies
 2019-04-17 13:22:11 +05:00
Mikhail Korobov 5b667b6156
Merge pull request #3707 from Gallaecio/pytest-xdist 
Use pytest-xdist
 2019-04-17 13:20:37 +05:00
Adrián Chaves 5a6fb3daa6 Use pytest-xdist 2019-04-17 09:02:34 +02:00
Adrián Chaves fbb42fe14e Cover PEP 257 in the documentation policies 2019-04-17 08:25:22 +02:00
Anubhav Patel 6039b66f42 aesthetic changes 2019-04-13 10:17:26 +05:30
Anubhav Patel c6769d6887 make suggested changes 2019-04-13 10:10:08 +05:30
Mikhail Korobov 4b791274d6
Merge pull request #3735 from anubhavp28/smallfix 
[MRG+1] Changes a parameter name in class `DummyPolicy`
 2019-04-13 01:52:22 +05:00
Mikhail Korobov 71cfe550fb
Merge pull request #3737 from anubhavp28/anothersmallfix 
[MRG+1] Fixes a link in comment
 2019-04-13 01:50:19 +05:00
Adrián Chaves 92fa657f9e
Merge pull request #3730 from ankostis/doc_logstats_delay 
[MRG+1] doc: document LOGSTATS_INTERVAL setting
 2019-04-11 17:34:45 +02:00
Matthijs Vos 07adca34e1 Fix 'Too many values to unpack' 2019-04-10 13:01:46 +02:00
Matthijs Vos 50730ed228 Try it with a string 2019-04-10 13:01:01 +02:00
Matthijs Vos d27c2c68ba Wrap scrapy check in environment 2019-04-10 12:56:50 +02:00
Anubhav Patel 4cfdc14974 fixes a link in comment 2019-04-09 17:52:02 +05:30
Anubhav Patel e6048d55f9 changes parameter name 2019-04-09 17:34:20 +05:30
Anubhav Patel 398639a0bf fix test 2019-04-08 12:27:36 +05:30
Mikhail Korobov 9280185054
Merge pull request #3520 from whalebot-helmsman/round-robin-scheduler-tested 
[MRG+1] Downloader-aware Priority Queue for Scrapy
 2019-04-07 00:06:08 +05:00
Maram Sumanth aa46e1995c [MRG+1] Show elapsed time in statscollector (#3638) 
* Update corestats.py

* Update corestats.py

* corrected tests

* Update corestats.py

* Update scrapy/extensions/corestats.py
 2019-04-07 00:03:40 +05:00
Mikhail Korobov f816375df5
Merge pull request #3726 from ankostis/fixctrlc 
[MRG+1] fix: do not catch system exceptions like KeyboardInterrupt
 2019-04-06 23:54:15 +05:00
Kostis Anagnostopoulos a8f83ab967 doc: document LOGSTATS_INTERVAL setting 2019-04-06 14:58:32 +02:00
Daniel Graña 2079e3c42a
Merge pull request #3728 from victor-torres/process_spider_exception 
[MRG+1] fix typo on Spider Middleware template (Response -> Request)
 2019-04-06 06:52:31 -03:00
Victor Torres 35ce92a419 fix typo (Response -> Request) 
check docs for more information b5c552d17f/docs/topics/spider-middleware.rst
 2019-04-05 14:31:15 -03:00