RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
6,222 Commits 42 Branches 132 Tags 165 MiB
Commit Graph

6222 Commits

Author SHA1 Message Date
Julia Medina 6da091f162 Remove djangoitem topic from index 2015-04-20 20:19:28 -03:00
Nikolaos-Digenis Karagiannis d39722f6a3 ItemLoader.load_item: iterate over copy of fields 2015-04-20 11:05:56 +03:00
Nikolaos-Digenis Karagiannis 017fb25bee loader test with processors that use item's values 2015-04-20 11:04:31 +03:00
Daniel Graña 16a1a938c1 Add 0.24.6 release notes 2015-04-20 01:40:21 -03:00
Mikhail Korobov 1794a893f4 Merge pull request #1172 from bagratte/docs 
minor corrections in documentation.
 2015-04-19 21:41:29 +05:00
Julia Medina ffc60910aa Remove djangoitem since we moved it to scrapy/scrapy-djangoitem 2015-04-19 13:09:25 -03:00
bagratte 1312bcd007 minor corrections in documentation. 2015-04-19 18:58:15 +04:00
bagratte beea9267a1 minor corrections in documentation. 2015-04-18 19:48:25 +04:00
Mikhail Korobov bb4c8c33cc Merge pull request #1171 from rajathkumarmp/edit-doc 
Added link to ipython in Tutorial.
 2015-04-18 14:13:10 +05:00
rajathkumarmp 02629b5f7b Added link to ipython in doc. 2015-04-18 13:00:34 +05:30
Pablo Hoffman 757309efea Merge pull request #1169 from bagratte/docs 
add some minor stylistic and grammar corrections to tutorial.rst.
 2015-04-17 19:52:11 -03:00
José Ricardo dffc4549d7 Fix small typo in the docs 2015-04-17 23:37:12 +05:00
bagratte 8d339da4e5 add some minor stylistic and grammar corrections to tutorial.rst. 2015-04-17 20:55:02 +04:00
Mikhail Korobov ad587ea792 rename CrawlerRunner.spiders to CrawlerRunner.spider_loader 2015-04-17 01:54:26 +05:00
Mikhail Korobov fee5565709 don't expose deprecated crawler.spiders attribute in telnet console 2015-04-17 01:25:48 +05:00
Mikhail Korobov 271f7f54d5 TST install service_identity package in tests to prevent warnings 
Also, Twisted version is bumped for Python 3.x tests, just in case.

service_identity is not added to Scrapy requirements because Scrapy
supports older Twisted / PyOpenSSL versions which don't use it.
 2015-04-16 22:54:51 +05:00
Mikhail Korobov 403e7c7c70 rename scrapy.spidermanager.SpiderManager to scrapy.spiderloader.SpiderLoader 2015-04-16 20:07:53 +05:00
Elias Dorneles a1f3b3c7f0 images.rst -> media-pipeline.rst 2015-04-15 14:26:08 -03:00
Elias Dorneles fd1c688ad6 addressing issues from review at #1150 2015-04-15 14:21:48 -03:00
Pablo Hoffman fb85bd4b10 Merge pull request #1132 from sibiryakov/dns-options2 
[MRG+1] Dns cache size and timeout options
 2015-04-15 14:08:19 -03:00
Pablo Hoffman 20c8d712de Merge pull request #1164 from scrapy/deploy-docs-2 
deployment docs tweaks
 2015-04-15 13:57:51 -03:00
Mikhail Korobov cb5280ab0d DOC tweak deployment docs 2015-04-15 19:25:22 +05:00
Nicolás Alejandro Ramírez Quiros e054b3c45f Merge pull request #1160 from scrapy/docs-theme 
Change local docs theme
 2015-04-15 10:34:19 -03:00
mrpandav 954c8fcecb changes `test_from_response_formname_notexists_fallback_formid` unit test for pull request #1137 - addition of new shortcut for html form election by formid attribute 2015-04-15 16:49:09 +05:30
Mikhail Korobov a11bd3e89d DOC update docs readme file - sphinx >= 1.3 is now required. 2015-04-15 11:50:57 +05:00
mrpandav 020a32a3d9 Adding tests for pull request #1137 - addition of new shortcut for html form election by formid attribute 2015-04-15 11:23:25 +05:30
Julia Medina 526aa07f44 Merge pull request #1156 from kmike/crawlers-accept-dicts 
allow Crawler, CrawlerRunner and CrawlerProcess to accept dicts instead of Setting objects
 2015-04-15 02:15:32 -03:00
Daniel Graña c013baa602 Merge pull request #1161 from scrapy/telnet-disable 
disable scrapy.telnet if twisted.conch is not available
 2015-04-15 00:32:42 -03:00
Daniel Graña e3aaeb7f06 Merge pull request #1162 from kmike/ajaxcrawl-py3 
fix Python 3 syntax errors in ajaxcrawl.py
 2015-04-15 00:32:03 -03:00
Mikhail Korobov 0b76487629 PY3 fix Python 3 syntax errors in ajaxcrawl.py 
Tests for _has_ajaxcrawlable_meta passin Python 3.
 2015-04-15 04:16:26 +05:00
Mikhail Korobov 378b6efc0e PY3 disable scrapy.telnet if twisted.conch is not available 2015-04-15 04:06:36 +05:00
Mikhail Korobov f40587c661 Merge pull request #1131 from torymur/master 
Fix #1130
 2015-04-15 03:52:07 +05:00
Mikhail Korobov dd84f4bd9a DOC remove css file which isno longer needed 2015-04-15 03:44:49 +05:00
Mikhail Korobov 7dcd7f3ca7 DOC make local docs use the same theme as readthedocs.org 
sphinx_rtd_theme is builtin in recent Sphinx versions.
 2015-04-15 03:43:30 +05:00
Mikhail Korobov abeb8e3a01 TST skip a test in Python 3 because it imports some parts of Twisted which are not ported yet 2015-04-15 03:27:11 +05:00
Mikhail Korobov 647eeaea61 TST add a test for GH-1050. 2015-04-15 03:23:30 +05:00
Mikhail Korobov 1534e8540b FEED_EXPORT_FIELDS option 2015-04-15 02:48:26 +05:00
Mikhail Korobov 7644813286 allow Crawler, CrawlerRunner and CrawlerProcess to accept dicts instead of Setting objects 2015-04-14 23:26:05 +05:00
Nicolás Alejandro Ramírez Quiros c2c8098562 Merge pull request #1155 from kmike/remove-deprecated 
remove deprecated code from FeedExporter
 2015-04-14 14:09:10 -03:00
Mikhail Korobov 5436ba117b remove deprecated code from FeedExporter 2015-04-14 20:19:28 +05:00
Mikhail Korobov 973c31f735 TST cleanup: use assertIn instead of assert_ 2015-04-14 20:11:46 +05:00
Pablo Hoffman 71c0aface7 Merge pull request #1148 from Curita/verify-spidermanager-interface 
Verify SPIDER_MANAGER_CLASS interface while loading it in CrawlerRunner
 2015-04-13 14:25:32 -03:00
Daniel Graña e85679fa6b Merge pull request #1147 from Curita/pass-crawlers-to-runner-crawl-calls 
Allow passing Crawler instances directly to CrawlerRunner.crawl()
 2015-04-13 14:23:15 -03:00
Julia Medina 5af557e610 Merge pull request #1152 from jdemaeyer/fix/tests-settings-api 
Fix deprecated settings API in tests
 2015-04-12 23:56:40 -03:00
Daniel Graña f71175a449 More replaces of references to old `sel` shortcut 2015-04-12 21:56:23 -03:00
Daniel Graña f9208dbcc4 Merge pull request #1154 from dianakhuang/patch-2 
Remove references to the `sel` object in shell.rst
 2015-04-12 21:55:35 -03:00
Diana Huang 91a60d9f3d Remove references to the `sel` object in shell.rst 
The current documentation has references to the deprecated `sel` when interacting with the shell. I've removed them and replaced uses of `sel.xpath` with `response.xpath` instead.
 2015-04-12 13:44:32 -04:00
Jakob de Maeyer cf9d848f0f Fixed deprecated settings API in cmdline test 2015-04-12 14:18:47 +02:00
mrpandav 1eccd34a70 adding feature improvement for selecting form using form-id, in addition to formname , formnumer before we go for xpath.. making it more idiomatic in nature 2015-04-12 11:11:28 +05:30
Elias Dorneles dce48b8654 documenting Files Pipeline together with Images Pipeline 2015-04-11 13:57:55 -03:00