RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
5,589 Commits 49 Branches 132 Tags 133 MiB
Commit Graph

1252 Commits

Author SHA1 Message Date
Pawel Miech dc8db8b35e docs on Scrapy on Windows + Python 3 2016-07-08 11:17:04 +02:00
Pawel Miech adb837d7b7 [docs] warnings about windows + python 3 in faq and install 2016-07-08 11:16:52 +02:00
Pawel Miech d191785194 [docs] add note about windows + python3 2016-07-08 11:16:42 +02:00
Paul Tremberth 7b7e492d28 Do not commit on any HTML parsing speed assumption with BS4+lxml 2016-06-16 22:27:17 +02:00
Paul Tremberth 9db63f588d Add note on how to choose parser with BeautifulSoup 2016-06-16 22:27:04 +02:00
Paul Tremberth 05ce6afa3f Add FAQ entry on using BeautifulSoup in spider callbacks 2016-06-16 22:26:54 +02:00
Matt O'Connell 04d4cca545 Typo fixes 2016-06-16 22:21:41 +02:00
Konstantin Lopuhin e6a0baa8fe Use "url" variable in the example 
Instead of hardcoded http://www.example.com: without it url variable is unused and only one request will make it past dupefilter.
 2016-06-08 17:37:26 +02:00
Paul Tremberth 1be1b454ef DOC Add info and example on errbacks 2016-06-08 17:32:56 +02:00
Paul Tremberth efaabbdb99 DOC Update copyright notice 2016-06-08 17:31:37 +02:00
Paul Tremberth 239254b282 [DOC][Overview] Use idiomatic .extract_first() 2016-06-08 17:27:55 +02:00
Paul Tremberth 4ea2453ae0 DOC Place FEED_TEMPDIR setting at lexicographical position 2016-06-08 17:24:33 +02:00
Paul Tremberth bcf902bde0 Update release notes and date for 1.1.0 2016-05-11 17:31:50 +02:00
Panayiotis Lipiridis 28efd8dd35 Github >> GitHub 2016-05-11 17:10:12 +02:00
Paul Tremberth c9fa29cbd9 Merge 1.0.6 release notes 2016-05-11 14:51:15 +02:00
Paul Tremberth 651c6f639e Add notes on botocore support and JsonItemExporter opening/closing brackets 2016-04-28 17:54:37 +02:00
Paul Tremberth 15ed4bfd8d Update release notes with recent features and bug fixes. 2016-04-28 15:39:19 +02:00
Paul Tremberth bd6b3c0608 Reference StackOverflow's "minimal, complete, and verifiable example" guide 2016-04-12 16:13:05 +02:00
Konstantin Lopuhin db61d54663 Fix FAQ entry about python versions support 2016-04-12 16:12:46 +02:00
djunzu fd98e3c031 Update docs. 
modified:   docs/topics/media-pipeline.rst
 2016-04-11 18:06:03 +02:00
nblock 00792557ec Fix spelling mistake 2016-04-11 17:36:31 +02:00
Aron Bordin b2e914943d added FEED_TEMPDIR to settings 2016-04-04 13:59:04 +02:00
Mikhail Korobov 288f8c09f8 DOC clarify Architecture docs 2016-03-31 12:33:29 +02:00
Mikhail Korobov 1c70ece728 DOC improved Architecture overview 
* spiders don't have to work on specific domains;
* explain what to use Downloader middleware for
  and what to use Spider middleware for;
* Engine no longer locates spiders based on domains;
* "Spider middleware output direction" step was missing.

See also: GH-1569.
 2016-03-31 12:33:29 +02:00
Aron Bordin 7b1dddceb3 small doc style fixes 2016-03-30 18:36:34 +02:00
nyov 718d386ebd Update documentation links 2016-03-30 18:36:34 +02:00
Paul Tremberth 844f040bc4 Add support for Sphinx 1.4 
See http://www.sphinx-doc.org/en/stable/changes.html#release-1-4-released-mar-28-2016

sphinx_rtd_theme has become optional, needs to be added to reqs

https://github.com/sphinx-doc/sphinx/pull/2320 changes node entries tuples
to 5 values instead of 4

`sh` syntax highlighting added very locally in selectors.rst
because of this warning/error with Sphinx 1.4:

```
Warning, treated as error:
/home/paul/src/scrapy/docs/topics/selectors.rst:743:
WARNING: Could not lex literal_block as "python". Highlighting skipped.
```
 2016-03-30 17:49:14 +02:00
Lele 15ffb076ca Changed sel. to response. for clarity 
Changed sel. to response. to comply with the rest of the examples in the same section, to avoid confusion.
 2016-03-30 10:53:54 +02:00
Paul Tremberth a4cc8cd2a2 Update release notes about change of default S3 ACL policy to "private" 2016-02-29 13:15:50 +01:00
Paul Tremberth acfc915b7a Update release notes about HTTPS downloader 2016-02-27 15:13:30 +01:00
Paul Tremberth c1337d74ab Document DOWNLOADER_* settings for HTTP/1.0 and TLS 2016-02-27 15:12:56 +01:00
Konstantin Lopuhin 9083b68125 Fix documentation for S3_STORE_ACL (now settings.FILES_STORE_S3_ACL) settings: it has nothing to do with feed exporters. 2016-02-24 22:26:22 +01:00
Konstantin Lopuhin b9c6d67365 See #1778 - change default S3 ACL to "private" and allow customization via settings 2016-02-24 22:26:22 +01:00
Konstantin Lopuhin 25e481fd14 [backport][1.1.x] Py3 S3 botocore 
Originally from https://github.com/scrapy/scrapy/pull/1761
 2016-02-18 22:48:37 +01:00
Elias Dorneles f928014d91 add deprecation for pydispatch (thanks for the help @redapple) 2016-02-15 11:40:08 +01:00
Paul Tremberth b1fac01258 Update release notes 2016-02-11 18:44:26 +01:00
Nicolas Pennequin 9cdbe177b7 Update the email doc for the charset argument to send(). 2016-02-09 19:52:06 +01:00
Elias Dorneles ca08314654 makes more explicit source of problems in Python 3 limitations 2016-02-03 21:38:25 -02:00
Elias Dorneles 2167573b32 fix comment about disabling robots.txt 2016-02-03 21:31:27 -02:00
Elias Dorneles 3180abc800 applying more review comments 2016-02-03 21:28:05 -02:00
Elias Dorneles d40add7b27 add note about robots.txt waiting and make it explicit builtin extensions only are ported 2016-02-03 21:18:25 -02:00
Elias Dorneles 9cfefd5277 favor beta over basic to describe PY3 support 2016-02-03 20:59:56 -02:00
Elias Dorneles 2f697ce59f added note about how to revert to old behavior for robotstxt 2016-02-03 20:51:26 -02:00
Elias Dorneles 89a088b3c3 applying review comments 2016-02-03 20:45:55 -02:00
Paul Tremberth 972f192568 Blank line before CoC 2016-02-03 22:58:49 +01:00
Paul Tremberth 728e505e53 Merge remote-tracking branch 'origin/master' into release-notes-1.1 2016-02-03 22:47:15 +01:00
Valdir Stumm Jr dd7b0eb359 Updates to release notes 2016-02-03 19:23:02 -02:00
Paul Tremberth 51dc741fa2 Add 1.0.5 release notes 2016-02-03 21:07:21 +01:00
Valdir Stumm Jr 0f816524e8 edit API changes, Deprecations, and Relocations sections. 2016-02-03 16:21:32 -02:00
Paul Tremberth fd3193da86 Reword some of "New Features and Enhancements" 2016-02-03 18:19:38 +01:00