RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
6,905 Commits 49 Branches 132 Tags 145 MiB
Commit Graph

6905 Commits

Author SHA1 Message Date
Anubhav Patel da82ede8a0
describe method as a command 2019-05-25 17:19:10 +05:30
Anubhav Patel 9c9bca4e1c make suggested changes. 2019-03-27 18:29:48 +05:30
Anubhav Patel 044318920a doc for creating custom cache storage backend. 2019-03-17 16:54:28 +05:30
Adrián Chaves d346b8cb0f
Merge pull request #3626 from Gallaecio/middlewares-from-crawler 
[MRG+1] Document that the main entry point of downloader and spider middlewar…
 2019-03-15 08:58:35 +01:00
Adrián Chaves 70a0f1f2e4
Merge pull request #3610 from Gallaecio/spidercls-check 
[MRG+1] Check that spidercls arguments in scrapy.crawler classes are not spid…
 2019-03-15 08:25:16 +01:00
Adrián Chaves 1f7413dc88
Merge pull request #3635 from matthieucham/feature-filteringlinkextractor-restrict-text 
[MRG+1] Feature filteringlinkextractor restrict text
 2019-03-15 07:58:28 +01:00
Adrián Chaves 2bd5790d9b
Merge pull request #3629 from johndela1/master 
[MRG+1] rel_has_nofollow: remove redundant if statement
 2019-03-15 07:53:23 +01:00
Mikhail Korobov 09e56ae43e
Merge pull request #3648 from Gallaecio/backward 
backwards → backward (adj.)
 2019-03-14 22:21:34 +05:00
Mikhail Korobov 5dc94db847
Merge branch 'master' into backward 2019-03-14 22:21:09 +05:00
Mikhail Korobov 54d106033f
Merge pull request #3649 from Gallaecio/inline-code-formatting 
[MRG+1] Switch from ` to `` where inline code formatting is desired
 2019-03-14 22:18:57 +05:00
Mikhail Korobov 7c54479a0e
Merge pull request #3662 from anubhavp28/link-patch 
Fix a link inside docs
 2019-03-14 22:18:04 +05:00
Mikhail Korobov c3b6755671
Merge pull request #3668 from Gallaecio/retry-complete-docs 
Remove the unexisting retry_complete signal from the documentation
 2019-03-14 22:16:28 +05:00
Mikhail Korobov f439553844
Merge pull request #3670 from Gallaecio/depth-first-doc 
Clarify the documentation of DEPTH_PRIORITY further
 2019-03-14 22:10:42 +05:00
Mikhail Korobov 9c2c312451
Merge pull request #3673 from Gallaecio/friendlier-documentation-1 
Use the description from README.rst on index.rst
 2019-03-14 21:53:44 +05:00
Mikhail Korobov 39a17aff3a
Merge pull request #3676 from Gallaecio/patch-1 
Update developer-tools.rst
 2019-03-14 21:52:37 +05:00
Adrián Chaves 91aec8b3bb
Update developer-tools.rst 
Fixes #3674
 2019-03-08 18:19:30 +01:00
Adrián Chaves b1063d9b2c Use the description from README.rst on index.rst 2019-03-08 17:22:49 +01:00
Adrián Chaves e108e3adbf Clarify the documentation of DEPTH_PRIORITY further 2019-03-08 15:13:11 +01:00
Adrián Chaves 4ef38d925e Remove the unexisting retry_complete signal from the documentation 2019-03-08 14:21:00 +01:00
Anubhav Patel 184def1060 fix a link inside docs 2019-03-07 00:09:10 +05:30
Adrián Chaves 75d6f56c8a Switch from ` to `` where inline code formatting is desired 2019-03-01 16:56:58 +01:00
Adrián Chaves 858f5be747 backwards → backward (adj.) 2019-03-01 16:10:23 +01:00
Matthieu Grandrie e3b15252c8 New constructor arg *restrict_text* for FilteringLinkExtractor. 
Same as allow and deny args, it holds a string, a regex or an iterable of. Links whose text don't match one of the regex are filtered out.
DOC restrict_text in LxmlLinkExtractor
 2019-02-28 17:21:17 +01:00
Daniel Graña c72ab1d4ba
Merge pull request #3625 from Ordepsousa/master 
[MRG+1] A different S3 Endpoint URL is now possible when uploading images
 2019-02-20 11:39:21 -03:00
John de la Garza b02d26fae8 rel_has_nofollow: remove redundant if statement 2019-02-15 16:54:33 -08:00
Pedro Sousa 430e939248
Added missing AWS Settings for ImagesPipeline 2019-02-13 19:59:40 +00:00
Adrián Chaves 50bf4c60c4 Document that the main entry point of downloader and spider middlewares is from_crawler() 2019-02-13 17:39:20 +01:00
Pedro Sousa 04ccf79e38
A different S3 Endpoint URL is now possible when uploading images 2019-02-13 15:39:45 +00:00
Adrián Chaves 03e61b9908 Check that spidercls arguments in scrapy.crawler classes are not spider objects 2019-02-12 14:46:27 +01:00
Raul Gallegos b364bfb68b
Merge pull request #3615 from Gallaecio/form-request-example 
Indicate that users must implement their own authentication result check
 2019-02-06 23:11:51 -05:00
Adrián Chaves 38af090f4d Indicate that users must implement their own authentication result check 
The example of form-based login could lead some users to think its authentication result
check was final. See https://stackoverflow.com/a/54410966/939364

This change should make it more obvious that users are expected to implement their
own logic to check whether authentication worked or not.
 2019-02-04 11:17:58 +01:00
Daniel Graña 65d631329a Be consistent with domain used for links to documentation website 2019-01-31 01:28:53 -03:00
Daniel Graña 88326cd8be Set release date to 1.6.0 2019-01-31 01:16:45 -03:00
Daniel Graña b8594353d0 Bump version: 1.5.0 → 1.6.0 2019-01-30 18:00:40 -03:00
Daniel Graña 1312174607
Merge pull request #3549 from scrapy/release-notes-1.6 
1.6 release notes
 2019-01-30 15:03:49 -03:00
Mikhail Korobov 91791cd329 DOC final changelog cleanups 2019-01-30 12:49:36 -03:00
Mikhail Korobov 2c8c8b2dd8 DOC fix after bad merge - remove duplicate entries in changelog 2019-01-30 12:49:36 -03:00
Mikhail Korobov 0fc9d705c2 DOC mention that telnet security improvements happened in 1.5.2 2019-01-30 12:49:36 -03:00
Mikhail Korobov 4cf4dd1d3e DOC add recent changes to changelog 2019-01-30 12:49:36 -03:00
Mikhail Korobov 638469f9ef DOC extract_first/extract matches get/getall better 
Thanks @Gallaecio!
 2019-01-30 12:49:36 -03:00
Mikhail Korobov e479f5aa15 DOC update changelog 
* changes from recently merged pull requests
* more highlights
* re-organized headers
* Selector API changes
 2019-01-30 12:49:36 -03:00
Mikhail Korobov 706910790b [wip] draft 1.6 release notes 2019-01-30 12:49:36 -03:00
Daniel Graña b5026b842c
Merge pull request #3544 from joaquingx/fix-item-pipeline-x 
Fix item-pipeline example
 2019-01-28 10:44:19 -03:00
Daniel Graña c4f57608d6
Merge pull request #3588 from ejulio/dupefilter-debug 
[MRG+1] Adding requests referer to RFPDupeFilter log messages
 2019-01-28 10:22:48 -03:00
Harry Moreno 8fca98616a fix grammar 2019-01-28 10:19:31 -03:00
Daniel Graña 0e5b6755ba
Merge pull request #3605 from morenoh149/patch-2 
fix grammar
 2019-01-28 10:18:45 -03:00
Harry Moreno b828b5f8c8
fix grammar 2019-01-26 18:39:05 -05:00
Daniel Graña 71743a6546 Add release notes for v1.5.2 2019-01-22 18:56:47 -03:00
Júlio César Batista 8eade7d864 Testing stats and log messages from RFPDupeFilter 2019-01-18 11:39:35 -02:00
Júlio César Batista bdf12f7750 Logging the request referer when DUPEFILTER_DEBUG is active 2019-01-18 11:38:59 -02:00