RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
6,830 Commits 49 Branches 132 Tags 145 MiB
Commit Graph

6830 Commits

Author SHA1 Message Date
Maram Sumanth 8831fafabc
Update test_http_request.py 2019-03-04 15:42:48 +05:30
Maram Sumanth fdf03a6d0d
correcting tests 2019-03-04 15:12:44 +05:30
Maram Sumanth d75b61b96a
Update test_http_request.py 2019-03-04 15:07:12 +05:30
Maram Sumanth 6eca6f92c6
Update form.py 2019-03-04 14:59:34 +05:30
Maram Sumanth 722a30ac2b
Update test_http_request.py 2019-01-19 13:20:05 +05:30
Maram Sumanth 7dee841b8b
Update form.py 2019-01-19 13:20:01 +05:30
Maram Sumanth a9f68acb6d
modified code 2019-01-17 23:51:09 +05:30
Maram Sumanth 6be73f06c3
Updated tests 2019-01-17 23:50:58 +05:30
Maram Sumanth 6f86c93f36
Increased test cases 2019-01-16 23:54:35 +05:30
Maram Sumanth 3e67fa8fc1
Improved for better user readability 2019-01-16 23:01:38 +05:30
Maram Sumanth 9f1f4df966
Update test_http_request.py 2019-01-16 22:59:41 +05:30
Maram Sumanth 023290dabc
Update test_http_request.py 2019-01-13 23:50:31 +05:30
Maram Sumanth 4abcdcb306
Update test_http_request.py 2019-01-13 23:22:53 +05:30
Maram Sumanth 9a4bbd6d02
Update form.py 2019-01-13 23:05:58 +05:30
Maram Sumanth 1bea5d3076
Fixed error 2019-01-13 22:35:16 +05:30
Maram Sumanth b5e454809e
Included test 2019-01-13 20:12:31 +05:30
Maram Sumanth ac111088c6
duplicate keys handled 2019-01-13 20:12:29 +05:30
Daniel Graña 23bffff567
Merge pull request #3526 from lucywang000/update-travis 
remove "sudo: false" now that travis no longer supports it
 2018-12-20 19:54:34 -03:00
Daniel Graña d4fd1236b7
Merge pull request #3538 from scrapy/boto-import-error-under-jessie 
Fix boto import error under Jessie testing environment
 2018-12-20 19:49:55 -03:00
Daniel Graña 8ed6beb7f9 Needs to be installed within tox env 2018-12-20 19:39:29 -03:00
Daniel Graña f6dfc5f3dd Fix boto import error under Jessie testing environment 2018-12-20 19:23:23 -03:00
Daniel Graña 665c04b0c1
Merge pull request #3518 from Gallaecio/scrapy-project-doc 
Document the SCRAPY_PROJECT environment variable
 2018-12-12 11:56:47 -03:00
Lucy Wang 4d48759978 remove "sudo: false" now that travis no longer supports it 
https://changelog.travis-ci.com/deprecation-container-based-linux-build-environment-82037
 2018-12-10 14:44:17 +08:00
Mikhail Korobov e766bde3a3
Merge pull request #3517 from Gallaecio/install-troubleshooting 
[MRG+1] Add a troubleshooting section to the installation instructions
 2018-12-06 18:07:43 +05:00
Adrián Chaves 62f3349c1a Document the SCRAPY_PROJECT environment variable 
Fixes #1109
 2018-12-03 17:14:10 +01:00
Adrián Chaves 274b65dff4 Add a troubleshooting section to the installation instructions 
Its initial content covers the workaround for #2473.
 2018-12-03 16:36:05 +01:00
Konstantin Lopuhin 886513c375
Merge pull request #3495 from toddrme2178/patch-1 
[MRG+1] Include additional files in sdists
 2018-11-20 11:10:32 +03:00
Todd 491929c212
Include additional files in sdists 
In particular this includes files needed for running the tests, as well as the changelog.
 2018-11-16 13:38:19 -05:00
Mikhail Korobov dc65e7527d
Merge pull request #3468 from ilhaoni/feature/update-docs-intro-tutorial 
[MRG+1] Update Scrapy Tutorial docs
 2018-11-06 03:33:09 +05:00
Immanuella Lim 6c98010f11 Remove 'Dive into Python3' reference 2018-11-04 16:04:45 +08:00
Immanuella Lim c9b5bd6ad7 Remove ad link Dive Into Python3 from tutorial docs 2018-10-18 02:22:32 +08:00
Daniel Graña 06f2db7fd1
Merge pull request #3445 from jfflisikowski/3097-item-urls-not-defined-in-example 
[MRG+1] Updating debug example file (#3097)
 2018-10-16 19:51:32 -03:00
jfflisikowski edaf74bfae Correct the unclear comments by adding <# < processing code not shown > 2018-10-02 19:48:48 +02:00
Daniel Graña bafd174a9f
Merge pull request #3390 from scrapy/parsel-1.5 
[MRG+1] update Scrapy to use parsel 1.5
 2018-09-18 13:07:41 -03:00
Mikhail Korobov ffbd33edac DOC mention gotcha with `foo::text` selector and empty `foo` elements 
also, move "Selecting attributes" reference closer to `a::atr(href)` example
 2018-09-18 05:03:35 +05:00
Mikhail Korobov 2c3b2158c9 DOC address @stummjr's review comments 
* fixed several small issues
* re-written "Creating Selectors" section
* fixed remaining .extract usage in tests
 2018-09-18 05:02:17 +05:00
Mikhail Korobov 9db21e5502 DOC fix remove_namespaces example 
See https://github.com/scrapy/parsel/pull/119
 2018-09-15 02:43:37 +05:00
Mikhail Korobov dc95ecbe25 DOC use autodocs for selectors; document more methods and attributes; suggest get/getall 2018-09-12 18:36:25 +05:00
Mikhail Korobov 7fdfdb7fa2 DOC reorganize selectors tutorial, port more topics from parsel docs, adjust wording in the introduction 2018-09-12 17:57:27 +05:00
Mikhail Korobov bdcc045f62 DOC switch from .extract to get/getall API in docs 
Also, response.urljoin is added in a few places, for robustness.
 2018-09-12 17:57:27 +05:00
Mikhail Korobov afce9716fa DOC mention .attrib in the tutorial 2018-09-12 17:57:27 +05:00
Mikhail Korobov 12e42bbe06 switch SgmlLinkExtractor to .getall 2018-09-12 17:57:27 +05:00
Mikhail Korobov 460f0f0451 [backwards incompatible] switch ItemLoader from .extract to .getall. 
This change is backwards incompatible if ItemLoader is used with a custom Selector
subclass which overrides .extract without overriding .getall.
 2018-09-12 17:57:27 +05:00
Mikhail Korobov 8c29be606c update spider templates to use .get 2018-09-12 17:57:27 +05:00
Mikhail Korobov 53da56c8dc TST update tests to use get/getall/attrib instead of extract 2018-09-12 17:57:27 +05:00
Mikhail Korobov 2c48d156db DOC cleanup references in tutorials: 
* remove unused link
* fix ReST syntax
* fix a link to regular expression docs
 2018-09-12 17:57:27 +05:00
Mikhail Korobov 09fd6c2a81 DOC unlink Firefox & Firebug sections from the tutorial for now. 
See https://github.com/scrapy/scrapy/issues/3373 and https://github.com/scrapy/scrapy/issues/3372 for motivation.
 2018-09-12 17:57:27 +05:00
Mikhail Korobov d32c4deaa9 DOC update Scrapy selectors tutorial to match parsel's tutorial better 2018-09-12 17:57:27 +05:00
Mikhail Korobov ca27010d4f DOC .extract_first() -> .get() 2018-09-12 17:57:27 +05:00
Mikhail Korobov 395d9d033a add pytest temp files to gitignore 2018-09-12 17:57:27 +05:00