RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
9,042 Commits 49 Branches 132 Tags 143 MiB
Commit Graph

9042 Commits

Author SHA1 Message Date
Paweł Miech e4bdd1cb95
downloader.webclient: make reactor import local (#5357) 2021-12-31 11:57:12 +01:00
Andrey Oskin b81938684b
Docs: correct process repetition start step (#5356) 
The process repeats from step 3, the scheduler feeds request to the engine. Steps 1 and 2 are not parts of the loop as their incarnations steps 7 and 8 are parts of the loop.
 2021-12-31 11:49:18 +01:00
Andrey Rahmatullin 7380888cad
Fix a warning message. (#5359) 2021-12-30 10:55:16 -03:00
yogender26 d6a384b3cf
corrrection of coma (#5347) 2021-12-22 23:39:05 +01:00
Andrey Rahmatullin 9ec60e8e4a
Merge pull request #5320 from zessx/5319-oib-base-tag 2021-12-21 17:49:31 +05:00
Andrey Rahmatullin 0862b179e3
Merge pull request #5333 from wRAR/pylint-2.12 
Fix and pin pylint.
 2021-12-16 18:54:27 +05:00
Andrey Rakhmatullin 6ec66c96fb Fix and pin pylint. 2021-11-26 12:25:45 +05:00
Alex c316ca45a5
Use augmented assignment statements (#5322) 2021-11-16 10:20:56 +01:00
Samuel Marchal 75ed765476 Test coverage for open_in_browser base tag injection (#5319) 2021-11-15 16:44:56 +01:00
Samuel Marchal f2c800c5c9 Improve open_in_browser base tag injection (#5319) 2021-11-15 16:44:56 +01:00
Andrey Rahmatullin 28eba610e2
Re-enable Windows tests for Python 3.9 and 3.10. (#5316) 2021-11-15 08:24:54 +01:00
Andrey Rahmatullin 9828cb3f0b
Merge pull request #5310 from azzamsa/more-test 
test: `test_format_engine_status`
 2021-11-08 20:13:00 +05:00
azzamsa 55cce25a79 test: `test_format_engine_status` 2021-11-05 03:02:02 +07:00
Andrey Rahmatullin ed50a81f50
Merge pull request #5299 from azzamsa/fix-tests 
fix: `CodeBlockParser` has been renamed to `PythonCodeBlockParser`
 2021-11-04 19:00:14 +05:00
azzamsa 67994d1ddd fix: `CodeBlockParser` has been renamed to `PythonCodeBlockParser` 2021-10-27 22:19:07 +07:00
Andrey Rahmatullin 3225de7257
Merge pull request #5292 from azzamsa/tox-patch 
refactor: use `pytest` command as the recommended entry point
 2021-10-25 11:34:59 +05:00
azzamsa 51adf71b1b refactor: use `pytest` command as the recommended entry point 
`pytest` is recommended command since pytest 3.0.
There is a possibility for `py.test` to be deprecated or even removed.

https://github.com/pytest-dev/pytest/issues/1629
 2021-10-24 10:52:56 +07:00
Andrey Rahmatullin 144d1eb834
Add Deferred-to-Future helpers (#5288) 2021-10-22 18:46:01 +02:00
Eugenio Lacuesta cfff79cee6
Make Python 3.10 support official (#5265) 2021-10-18 22:09:17 +02:00
Andrey Rahmatullin afa5881ada
Merge pull request #5279 from erikkemperman/option-logfile-truncate 
Add LOG_FILE_APPEND to settings
 2021-10-18 11:51:42 +05:00
Andrey Rahmatullin 975f15003e
Merge pull request #5281 from raphaelts3/add-pronounced-docs 
Add how Scrapy is pronounced to the docs
 2021-10-18 11:49:55 +05:00
raphaelts3 027ecd8686
Update docs/intro/overview.rst 
Co-authored-by: azzamsa <17734314+azzamsa@users.noreply.github.com>
 2021-10-16 10:52:54 -03:00
Raphael Tomé Santana aec7146e2f Add how Scrapy is pronounced to the docs 2021-10-15 20:38:53 -03:00
Adrián Chaves d774d6a9c4
Remove unused variable 2021-10-15 17:25:22 +02:00
Adrián Chaves 98ee3ddffe
Freeze flake8 2021-10-15 17:18:46 +02:00
Erik Kemperman ca320feb2a
Add LOG_FILE_APPEND to settings 2021-10-15 16:36:41 +02:00
Andrey Rahmatullin 5b13bfd14a
Merge pull request #5269 from Ankur19/allow-non-text-response-types-in-ItemLoader 
Fix bug #5145 - Removing Selector for Response's that are not Http or Xml
 2021-10-14 16:19:54 +05:00
Andrey Rahmatullin 808fb63273
Merge pull request #5276 from imba-tjd/patch-1 
docs: fix typo
 2021-10-14 12:51:30 +05:00
谭九鼎 3243aa2cd5
docs: fix typo 2021-10-14 10:18:26 +08:00
Jake Herbst d08199f631
Removing unnecessary line from docs to prevent test failure (#5274) 2021-10-12 19:20:09 +02:00
Andrey Rahmatullin 1ae53a9d7c
Merge pull request #5256 from rydwhelchel/documentation-changes 
docs: restructed phrasing for clarity
 2021-10-12 16:49:31 +05:00
Andrey Rahmatullin d90b2a2bfc
Merge pull request #5250 from iDeepverma/URLLENGTH_LIMIT-doc 
Documentation update for URLLENGTH_LIMIT
 2021-10-12 16:48:42 +05:00
Andrey Rahmatullin 8a743ae43a
Merge pull request #5266 from MarvinPetzoldt/patch-1 
Fixed documentation example
 2021-10-12 16:46:51 +05:00
Andrey Rahmatullin ce96a961e1
Merge pull request #5271 from kianmeng/fix-typos 
Fix typos
 2021-10-12 16:46:05 +05:00
Andrey Rahmatullin eb0e99dc20
Merge pull request #5254 from PeterMorrison1/FilePipeline-expire-doc 
Document file expiration method in media-pipeline (#5120)
 2021-10-12 16:41:16 +05:00
Kian-Meng, Ang 3a263280ba Fix typos 2021-10-11 22:32:42 +08:00
ankur19 6fbd6f941f Fix issue#5145 
Fix condition for failing tests

set Selector to None on AttributeError

Add test and remove unused imports

Fix imports
 2021-10-10 15:55:22 -04:00
Eugenio Lacuesta 65d60b9692
[docs] add missing parameter to headers_received signal (#5270) 2021-10-10 10:06:36 +02:00
Georgiy Zatserklianyi d3f1bf79e8
Use f-strings where appropriate (#5246) 2021-10-07 16:27:20 +02:00
Eugenio Lacuesta 029cab72e8
[CI] fix pypy test (#5264) 2021-10-06 19:34:09 +02:00
MarvinPetzoldt b1cb007b3b
Fixed documentation example 2021-10-06 19:08:19 +02:00
Laerte 6c858cec91
Cookies: Cast primitive types to str (#5253) 
* cast primitive types to str

* add tests
 2021-10-06 12:32:04 -03:00
Adrián Chaves 214525c2c1
Merge pull request #5263 from Gallaecio/port-security-fix 
Port security fix from 1.8.1 and 2.5.1 to the main branch
 2021-10-06 13:14:35 +02:00
Adrián Chaves 735750c254 Cover 1.8.1 in the release notes 2021-10-06 12:33:57 +02:00
Adrián Chaves f0105a882d Cover 2.5.1 in the release notes 2021-10-06 12:33:44 +02:00
Andrey Rakhmatullin 7ec5f299c4 Small documentation fixes. 2021-10-06 12:33:32 +02:00
Andrey Rakhmatullin b081f18a2f Add http_auth_domain to HttpAuthMiddleware. 2021-10-06 12:33:18 +02:00
Ryan Whelchel 764cf0178b
Update docs/intro/tutorial.rst 
Co-authored-by: Adrián Chaves <adrian@chaves.io>
 2021-10-05 10:22:57 -04:00
Ryan Whelchel b9647b85d3
docs: restructed phrasing for clarity 2021-10-03 17:32:38 -04:00
Andrey Rahmatullin cbf9349552
Merge pull request #5255 from raihan71/raihan71-patch-1 
Using Logo Scrapy in Readme.md
 2021-10-03 19:59:47 +05:00