RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
4,895 Commits 49 Branches 132 Tags 130 MiB
Commit Graph

4895 Commits

Author SHA1 Message Date
Paul Tremberth 600e7bbd75 Bump version: 1.0.6 → 1.0.7 2017-03-03 19:19:12 +01:00
Paul Tremberth e5d30eb4e1 Set release date for 1.0.7 2017-03-03 19:18:09 +01:00
Mikhail Korobov 93ce7fc007 Merge pull request #2618 from scrapy/release-notes-1.0.7 
[1.0.x] Update release notes for 1.0.7
 2017-03-03 23:17:22 +05:00
Paul Tremberth 299ea830d6 Update release notes for 1.0.7 2017-03-03 19:13:19 +01:00
Mikhail Korobov 93fc13566a Merge pull request #2613 from redapple/no-twisted-17 
[1.0.x] Stricter requirements
 2017-03-02 22:42:11 +05:00
Paul Tremberth b05ae71852 Require at least lxml 2.3 2017-03-02 16:32:10 +01:00
Paul Tremberth 459ff0397d Only support Twisted prior to v17 2017-03-02 14:22:28 +01:00
Paul Tremberth 3f4616c6b9 Bump version: 1.0.5 → 1.0.6 2016-05-04 17:10:13 +02:00
Paul Tremberth 5764511cd3 Merge pull request #1966 from scrapy/release-notes-1.0.6 
Add release notes for 1.0.6
 2016-05-04 16:27:29 +02:00
Paul Tremberth a591b8ed12 Add release notes for 1.0.6 2016-05-04 16:10:24 +02:00
Paul Tremberth fd0570e2f8 Merge pull request #1906 from redapple/backport-1.0-pr1857 
[Backport][1.0] response_status_message should not fail on non-standard HTTP codes
 2016-04-07 22:56:09 +02:00
Paul Tremberth 5bf10cc8ff Fix tests on URL path encoding for links from latin1 document 
UTF-8 is to be used for path component.
Page encoding only affects query part of URLs.
 2016-04-07 22:43:47 +02:00
pawelmhm 8efd6d26ad [Backport][1.0] response_status_message should not fail on non-standard HTTP codes 
utility is used in retry middleware and it was failing to handle non-standard HTTP codes.
Instead of raising exceptions when passing through to_native_str it should return
"Unknown status" message.
 2016-04-06 20:21:26 +02:00
Paul Tremberth 38b09085eb Add support for Sphinx 1.4 
See http://www.sphinx-doc.org/en/stable/changes.html#release-1-4-released-mar-28-2016

sphinx_rtd_theme has become optional, needs to be added to reqs

https://github.com/sphinx-doc/sphinx/pull/2320 changes node entries tuples
to 5 values instead of 4

`sh` syntax highlighting added very locally in selectors.rst
because of this warning/error with Sphinx 1.4:

```
Warning, treated as error:
/home/paul/src/scrapy/docs/topics/selectors.rst:743:
WARNING: Could not lex literal_block as "python". Highlighting skipped.
```
 2016-03-30 17:55:20 +02:00
Paul Tremberth 26642388c3 Merge pull request #1875 from nanolab/patch-1 
[MRG+1] FS cache storage misuses mtime for expiration
 2016-03-30 10:47:27 +02:00
nanolab 5b98e9c4b5 Update httpcache.py 
It checks cache directory modification time, but have to check file modification time.
 2016-03-23 11:37:01 +02:00
Elias Dorneles 4b324a8f5b Merge pull request #1869 from eldios/patch-1 
Changed sel. to response. for clarity
 2016-03-18 10:38:12 -03:00
Lele 6d193e4dab Changed sel. to response. for clarity 
Changed sel. to response. to comply with the rest of the examples in the same section, to avoid confusion.
 2016-03-18 03:30:31 +01:00
Paul Tremberth a046ce843a Merge pull request #1753 from scrapy/release-1.0.5 
[MRG+1] Release 1.0.5
 2016-02-03 20:55:48 +01:00
Paul Tremberth fd0a0ce054 Add 1.0.5 release notes 2016-02-03 16:08:46 +01:00
Paul Tremberth c099220c3c Bump version: 1.0.4 → 1.0.5 2016-02-03 15:24:28 +01:00
Daniel Graña 0013080a3c Merge pull request #1690 from atmosx/buildbot-pytest 
[MRG+1] Changed buildbot makefile to use 'pytest'
 2016-01-19 13:32:49 -03:00
Elias Dorneles 9396e0ee3f Merge pull request #1669 from redapple/bogus-links 
[MRG+1] [1.0.x backport] [LinkExtractors] Ignore bogus links
 2016-01-19 13:48:00 -02:00
Panagiotis Atmatzidis 1f3d90ad46 Changed buildbot makefile to use 'pytest' 2016-01-19 09:03:01 +02:00
Mikhail Korobov 4b3ea07983 Merge pull request #1627 from Yedie-Fang/patch-1 
Update media-pipeline.rst
 2016-01-19 00:08:30 +05:00
Elias Dorneles 1987476f0c Merge pull request #1675 from kadimi/patch-1 
Update tutorial.rst
 2016-01-14 09:25:23 -02:00
Nabil Kadimi 808a9ea9fb Update tutorial.rst 2016-01-14 07:59:06 +00:00
Mikhail Korobov a4b103f0d2 Merge pull request #1643 from orangain/doc-downloader-middleware-base-1.0 
DOC: Add AjaxCrawlMiddleware to DOWNLOADER_MIDDLEWARES_BASE
 2016-01-13 12:57:02 +05:00
Andrew Scorpil 108195e780 [LinkExtractors] Ignore bogus links 
(rebased the code for scrapy 1.0 and made a few code improvements --nyov)
 2016-01-11 15:42:56 +01:00
Daniel Graña 1a0fbf5ee5 Yet another try to build 1.0.4 tag 2015-12-30 16:21:06 -03:00
Daniel Graña d758758ddc Another try to upload to pypi 2015-12-30 16:12:20 -03:00
Daniel Graña 93deea8d5a Bump version: 1.0.3 → 1.0.4 2015-12-30 15:48:49 -03:00
Daniel Graña bf5628199d Add 1.0.4 release notes 2015-12-30 15:48:49 -03:00
Daniel Graña 0797680bc4 Merge branch 'release-1.0.4' into 1.0 2015-12-30 15:40:19 -03:00
Alexander Sibiryakov 7dfa979197 Ignoring xlib/tx folder, depending on Twisted version. 2015-12-30 15:31:10 -03:00
Daniel Graña 6e42f0bf44 Run on new travis-ci infra 2015-12-30 15:23:11 -03:00
seales 823a1cc685 Spelling fixes 2015-12-30 15:23:11 -03:00
Νικόλαος-Διγενής Καραγιάννης da3c155b39 escape nodename in xmliter regex 2015-12-30 15:23:10 -03:00
Νικόλαος-Διγενής Καραγιάννης 4418fc3b86 test xml nodename with dots 2015-12-30 15:23:10 -03:00
Mikhail Korobov a55078cff2 TST don't use broken Pillow version in tests 2015-12-30 15:23:10 -03:00
Pablo Hoffman 86fc33060b disable log on version command. closes #1426 2015-12-30 15:23:10 -03:00
Pablo Hoffman db4c9fee4c disable log on startproject command 2015-12-30 15:23:10 -03:00
Daniel Graña df2b9448a9 Add PyPI download stats badge 2015-12-30 15:02:18 -03:00
Mikhail Korobov a83ab41ba0 don't run tests twice on Travis if a PR is made from a scrapy/scrapy branch 2015-12-30 14:58:42 -03:00
Mikhail Korobov 73ac80d3ca Add Python 3 porting status badge to the README 2015-12-30 14:47:35 -03:00
Mikhail Korobov 97d080ee26 fixed RFPDupeFilter persistence 2015-12-30 14:47:08 -03:00
Mikhail Korobov 97f2fb302d TST a test to show that dupefilter persistence is not working 2015-12-30 14:47:01 -03:00
Daniel Graña d9b4850c44 explicit close file on file:// scheme handler 2015-12-30 14:46:52 -03:00
Νικόλαος-Διγενής Καραγιάννης c0d0734027 Disable dupefilter in shell 2015-12-30 14:42:41 -03:00
orangain aa239ade8a DOC: Add captions to toctrees which appear in sidebar 2015-12-30 14:35:26 -03:00