RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
9,017 Commits 49 Branches 132 Tags 144 MiB
Commit Graph

9017 Commits

Author SHA1 Message Date
Erik Kemperman ca320feb2a
Add LOG_FILE_APPEND to settings 2021-10-15 16:36:41 +02:00
Andrey Rahmatullin 5b13bfd14a
Merge pull request #5269 from Ankur19/allow-non-text-response-types-in-ItemLoader 
Fix bug #5145 - Removing Selector for Response's that are not Http or Xml
 2021-10-14 16:19:54 +05:00
Andrey Rahmatullin 808fb63273
Merge pull request #5276 from imba-tjd/patch-1 
docs: fix typo
 2021-10-14 12:51:30 +05:00
谭九鼎 3243aa2cd5
docs: fix typo 2021-10-14 10:18:26 +08:00
Jake Herbst d08199f631
Removing unnecessary line from docs to prevent test failure (#5274) 2021-10-12 19:20:09 +02:00
Andrey Rahmatullin 1ae53a9d7c
Merge pull request #5256 from rydwhelchel/documentation-changes 
docs: restructed phrasing for clarity
 2021-10-12 16:49:31 +05:00
Andrey Rahmatullin d90b2a2bfc
Merge pull request #5250 from iDeepverma/URLLENGTH_LIMIT-doc 
Documentation update for URLLENGTH_LIMIT
 2021-10-12 16:48:42 +05:00
Andrey Rahmatullin 8a743ae43a
Merge pull request #5266 from MarvinPetzoldt/patch-1 
Fixed documentation example
 2021-10-12 16:46:51 +05:00
Andrey Rahmatullin ce96a961e1
Merge pull request #5271 from kianmeng/fix-typos 
Fix typos
 2021-10-12 16:46:05 +05:00
Andrey Rahmatullin eb0e99dc20
Merge pull request #5254 from PeterMorrison1/FilePipeline-expire-doc 
Document file expiration method in media-pipeline (#5120)
 2021-10-12 16:41:16 +05:00
Kian-Meng, Ang 3a263280ba Fix typos 2021-10-11 22:32:42 +08:00
ankur19 6fbd6f941f Fix issue#5145 
Fix condition for failing tests

set Selector to None on AttributeError

Add test and remove unused imports

Fix imports
 2021-10-10 15:55:22 -04:00
Eugenio Lacuesta 65d60b9692
[docs] add missing parameter to headers_received signal (#5270) 2021-10-10 10:06:36 +02:00
Georgiy Zatserklianyi d3f1bf79e8
Use f-strings where appropriate (#5246) 2021-10-07 16:27:20 +02:00
Eugenio Lacuesta 029cab72e8
[CI] fix pypy test (#5264) 2021-10-06 19:34:09 +02:00
MarvinPetzoldt b1cb007b3b
Fixed documentation example 2021-10-06 19:08:19 +02:00
Laerte 6c858cec91
Cookies: Cast primitive types to str (#5253) 
* cast primitive types to str

* add tests
 2021-10-06 12:32:04 -03:00
Adrián Chaves 214525c2c1
Merge pull request #5263 from Gallaecio/port-security-fix 
Port security fix from 1.8.1 and 2.5.1 to the main branch
 2021-10-06 13:14:35 +02:00
Adrián Chaves 735750c254 Cover 1.8.1 in the release notes 2021-10-06 12:33:57 +02:00
Adrián Chaves f0105a882d Cover 2.5.1 in the release notes 2021-10-06 12:33:44 +02:00
Andrey Rakhmatullin 7ec5f299c4 Small documentation fixes. 2021-10-06 12:33:32 +02:00
Andrey Rakhmatullin b081f18a2f Add http_auth_domain to HttpAuthMiddleware. 2021-10-06 12:33:18 +02:00
Ryan Whelchel 764cf0178b
Update docs/intro/tutorial.rst 
Co-authored-by: Adrián Chaves <adrian@chaves.io>
 2021-10-05 10:22:57 -04:00
Ryan Whelchel b9647b85d3
docs: restructed phrasing for clarity 2021-10-03 17:32:38 -04:00
Andrey Rahmatullin cbf9349552
Merge pull request #5255 from raihan71/raihan71-patch-1 
Using Logo Scrapy in Readme.md
 2021-10-03 19:59:47 +05:00
Raihan Nismara ef263042d7
Using Logo Scrapy in Readme.md 
Logo scrapy used in readme.md made looks nicer
 2021-10-03 13:26:20 +07:00
Adrián Chaves f108800222
Update spider-middleware.rst 2021-10-02 13:25:15 +02:00
Deepanshu verma de70b3c58b
Update spider-middleware.rst 
added empty line
 2021-10-02 12:12:58 +05:30
Peter Morrison 47533985f4 Document file expiration method in media-pipeline 2021-10-01 12:30:14 -06:00
Deepanshu de2043f9c1 updated docs/topics/spider-middleware.rst 2021-10-01 20:20:00 +05:30
Adrián Chaves d91d82b506
Make Scrapy SFW again 2021-10-01 16:31:29 +02:00
Deepanshu verma fbb1236fd6
Update docs/topics/settings.rst 
added suggestion

Co-authored-by: Adrián Chaves <adrian@chaves.io>
 2021-10-01 18:46:11 +05:30
Deepanshu verma 552457e6f2
Merge branch 'scrapy:master' into URLLENGTH_LIMIT-doc 2021-10-01 16:40:48 +05:30
Eugenio Lacuesta 890f884de4
Allow 'callback' key in keyword arguments for request callbacks (#5251) 2021-10-01 09:50:42 +02:00
Deepanshu 74f146bbe0 Document update URLLENGTH_LIMIT 2021-10-01 01:47:05 +05:30
Andrey Rahmatullin 7d557f898c
Merge pull request #5239 from maanijou/master 
Improve documentation for spider middlewares
 2021-09-27 15:42:31 +05:00
Andrey Rahmatullin 6249175317
Merge pull request #5244 from kamran890/spider-state-doc 
Document spider.state attribute (#5174)
 2021-09-27 15:41:58 +05:00
Adrián Chaves 3c57825b0f
Update docs/topics/spider-middleware.rst 2021-09-26 13:41:26 +02:00
Reza (Milad) Maanijou dfdb779756
Apply review comments 2021-09-26 12:45:44 +03:30
Reza (Milad) Maanijou 1829dd774c
Update spider-middleware.rst 2021-09-25 20:22:09 +03:30
kamran890 e5998fb846 Document spider.state attribute (#5174) 2021-09-22 03:15:12 +05:00
maanijou ac9175964d Improve documentation for spider middlewares 2021-09-12 17:59:20 +02:00
Andrey Rahmatullin 8284de5e76
Fix/silence the Pylint messages added in 2.10 (#5235) 2021-08-24 12:15:29 +02:00
D R Siddhartha 43ea21e830
Feed post-processing plugin support (#5190) 2021-08-24 11:48:01 +02:00
Matsievskiy S.V 3f635eb683
Extract domain from genspider URL (#4439) 2021-08-24 11:05:50 +02:00
Andrey Rahmatullin ada539a63a
Merge pull request #4676 from Gallaecio/startproject-existing-folder 
Fix startproject failing for existing folders
 2021-08-24 12:18:49 +05:00
Andrey Rakhmatullin cd17c829cf Revert "Move documentation about avoiding bans into a topic of its own (#4039)" 
This reverts commit 2d2581c68f.
 2021-08-23 19:55:35 +05:00
Andrey Rahmatullin 731f2d3085
Merge pull request #4178 from elacuesta/remove_spider_make_requests_from_url 2021-08-20 16:16:25 +05:00
Andrey Rahmatullin bdf8355ce1
Merge pull request #5231 from umairnsr87/umairnsr87/issues/5226 
updated documentation for python version for reppy
 2021-08-18 21:08:32 +05:00
databender 572d347b3b warning view updated 2021-08-18 16:17:52 +05:30