RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
5,661 Commits 49 Branches 132 Tags 138 MiB
Commit Graph

1265 Commits

Author SHA1 Message Date
Paul Tremberth 05787d09e7 Add release notes for 1.1.2 version 2016-08-18 16:18:27 +02:00
Jesús Losada 2295499957 Add documentation on Amazon S3 ACLs 2016-08-01 15:56:18 +02:00
Jesús Losada f6def018a1 Document S3 capabilities in FilesPipeline and ImagesPipeline 2016-08-01 15:56:18 +02:00
Paul Tremberth 7e7c832f9f Update 1.1.1 release date 2016-07-13 17:59:11 +02:00
Paul Tremberth ed79193f49 Update notes with latest 1.1 commits 2016-07-13 17:49:17 +02:00
Paul Tremberth 51ed24904b Update release notes for upcoming 1.1.1 release 2016-07-13 17:36:48 +02:00
Kenneth Schnall 758802d41b Update practices.rst 2016-07-13 17:25:08 +02:00
Pawel Miech d40de1e013 [image_pipeline] style edits 
* 80 characters line limit
* shortening some code
* removed dead code
* add doctest for _key_for_pipe function
 2016-07-13 17:02:13 +02:00
Pawel Miech d9a9f76ca0 [files-pipeline] update docs with note about settings 
for subclasses.
 2016-07-13 17:02:13 +02:00
Pawel Miech c6277c9963 [image-pipeline] image settings with class name 
allow to have image settings with class name, so that settings for user defined ImagePipeline
subclasses can be defined easily.
 2016-07-13 17:02:12 +02:00
Pawel Miech 6bec0f773b [image_pipeline] tests for class attrs backward compatibility 
and docs about image pipeline settings.
 2016-07-13 17:02:12 +02:00
Valdir Stumm Junior 848bd4c2a2 document new genspider behavior 2016-07-08 18:48:39 +02:00
Νικόλαος-Διγενής Καραγιάννης 8ffb30fbef Encourage descriptive PR titles 2016-07-08 12:30:54 +02:00
Pawel Miech dc8db8b35e docs on Scrapy on Windows + Python 3 2016-07-08 11:17:04 +02:00
Pawel Miech adb837d7b7 [docs] warnings about windows + python 3 in faq and install 2016-07-08 11:16:52 +02:00
Pawel Miech d191785194 [docs] add note about windows + python3 2016-07-08 11:16:42 +02:00
Paul Tremberth 7b7e492d28 Do not commit on any HTML parsing speed assumption with BS4+lxml 2016-06-16 22:27:17 +02:00
Paul Tremberth 9db63f588d Add note on how to choose parser with BeautifulSoup 2016-06-16 22:27:04 +02:00
Paul Tremberth 05ce6afa3f Add FAQ entry on using BeautifulSoup in spider callbacks 2016-06-16 22:26:54 +02:00
Matt O'Connell 04d4cca545 Typo fixes 2016-06-16 22:21:41 +02:00
Konstantin Lopuhin e6a0baa8fe Use "url" variable in the example 
Instead of hardcoded http://www.example.com: without it url variable is unused and only one request will make it past dupefilter.
 2016-06-08 17:37:26 +02:00
Paul Tremberth 1be1b454ef DOC Add info and example on errbacks 2016-06-08 17:32:56 +02:00
Paul Tremberth efaabbdb99 DOC Update copyright notice 2016-06-08 17:31:37 +02:00
Paul Tremberth 239254b282 [DOC][Overview] Use idiomatic .extract_first() 2016-06-08 17:27:55 +02:00
Paul Tremberth 4ea2453ae0 DOC Place FEED_TEMPDIR setting at lexicographical position 2016-06-08 17:24:33 +02:00
Paul Tremberth bcf902bde0 Update release notes and date for 1.1.0 2016-05-11 17:31:50 +02:00
Panayiotis Lipiridis 28efd8dd35 Github >> GitHub 2016-05-11 17:10:12 +02:00
Paul Tremberth c9fa29cbd9 Merge 1.0.6 release notes 2016-05-11 14:51:15 +02:00
Paul Tremberth 651c6f639e Add notes on botocore support and JsonItemExporter opening/closing brackets 2016-04-28 17:54:37 +02:00
Paul Tremberth 15ed4bfd8d Update release notes with recent features and bug fixes. 2016-04-28 15:39:19 +02:00
Paul Tremberth bd6b3c0608 Reference StackOverflow's "minimal, complete, and verifiable example" guide 2016-04-12 16:13:05 +02:00
Konstantin Lopuhin db61d54663 Fix FAQ entry about python versions support 2016-04-12 16:12:46 +02:00
djunzu fd98e3c031 Update docs. 
modified:   docs/topics/media-pipeline.rst
 2016-04-11 18:06:03 +02:00
nblock 00792557ec Fix spelling mistake 2016-04-11 17:36:31 +02:00
Aron Bordin b2e914943d added FEED_TEMPDIR to settings 2016-04-04 13:59:04 +02:00
Mikhail Korobov 288f8c09f8 DOC clarify Architecture docs 2016-03-31 12:33:29 +02:00
Mikhail Korobov 1c70ece728 DOC improved Architecture overview 
* spiders don't have to work on specific domains;
* explain what to use Downloader middleware for
  and what to use Spider middleware for;
* Engine no longer locates spiders based on domains;
* "Spider middleware output direction" step was missing.

See also: GH-1569.
 2016-03-31 12:33:29 +02:00
Aron Bordin 7b1dddceb3 small doc style fixes 2016-03-30 18:36:34 +02:00
nyov 718d386ebd Update documentation links 2016-03-30 18:36:34 +02:00
Paul Tremberth 844f040bc4 Add support for Sphinx 1.4 
See http://www.sphinx-doc.org/en/stable/changes.html#release-1-4-released-mar-28-2016

sphinx_rtd_theme has become optional, needs to be added to reqs

https://github.com/sphinx-doc/sphinx/pull/2320 changes node entries tuples
to 5 values instead of 4

`sh` syntax highlighting added very locally in selectors.rst
because of this warning/error with Sphinx 1.4:

```
Warning, treated as error:
/home/paul/src/scrapy/docs/topics/selectors.rst:743:
WARNING: Could not lex literal_block as "python". Highlighting skipped.
```
 2016-03-30 17:49:14 +02:00
Lele 15ffb076ca Changed sel. to response. for clarity 
Changed sel. to response. to comply with the rest of the examples in the same section, to avoid confusion.
 2016-03-30 10:53:54 +02:00
Paul Tremberth a4cc8cd2a2 Update release notes about change of default S3 ACL policy to "private" 2016-02-29 13:15:50 +01:00
Paul Tremberth acfc915b7a Update release notes about HTTPS downloader 2016-02-27 15:13:30 +01:00
Paul Tremberth c1337d74ab Document DOWNLOADER_* settings for HTTP/1.0 and TLS 2016-02-27 15:12:56 +01:00
Konstantin Lopuhin 9083b68125 Fix documentation for S3_STORE_ACL (now settings.FILES_STORE_S3_ACL) settings: it has nothing to do with feed exporters. 2016-02-24 22:26:22 +01:00
Konstantin Lopuhin b9c6d67365 See #1778 - change default S3 ACL to "private" and allow customization via settings 2016-02-24 22:26:22 +01:00
Konstantin Lopuhin 25e481fd14 [backport][1.1.x] Py3 S3 botocore 
Originally from https://github.com/scrapy/scrapy/pull/1761
 2016-02-18 22:48:37 +01:00
Elias Dorneles f928014d91 add deprecation for pydispatch (thanks for the help @redapple) 2016-02-15 11:40:08 +01:00
Paul Tremberth b1fac01258 Update release notes 2016-02-11 18:44:26 +01:00
Nicolas Pennequin 9cdbe177b7 Update the email doc for the charset argument to send(). 2016-02-09 19:52:06 +01:00