RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
4,590 Commits 49 Branches 132 Tags 143 MiB
Commit Graph

4590 Commits

Author SHA1 Message Date
Daniel Graña 7740581f88 Merge remote-tracking branch 'upstream/master' 2012-05-17 08:50:28 -03:00
Daniel Graña c3a3108799 multiple build enviroments for travis-ci 2012-05-17 08:49:45 -03:00
Pablo Hoffman 1bc18434f5 removed obsolete entries from MANIFEST.in 2012-05-17 01:09:48 -03:00
Daniel Graña 7fc573a230 fix libxml2 test 2012-05-16 18:54:02 -03:00
Daniel Graña f530b0b3eb make libxml2 optional now that lxml is the default 2012-05-16 18:17:51 -03:00
Daniel Graña 8376d95ce8 add travis-ci build configuration file 2012-05-16 16:54:12 -03:00
Pablo Hoffman b4f368c37e warn if Link objects are instantiated with unicode urls 2012-05-16 13:12:25 -03:00
Pablo Hoffman 30b6c77ce5 fixed typo in previous commit 2012-05-16 09:16:46 -03:00
Pablo Hoffman b53bc66c76 added lxml/libxml2 versions to 'scrapy version' output 2012-05-16 09:12:02 -03:00
Daniel Graña d74a067227 require w3lib 1.2 or greater 2012-05-15 17:11:51 -03:00
Daniel Graña ae2ff4d33a update news file with 0.14.4 release notes 2012-05-15 16:16:02 -03:00
Pablo Hoffman 9686f97242 added precise to supported ubuntu distros 2012-05-12 19:54:36 -03:00
Pablo Hoffman 58e88ed246 scrapyd: do not set SCRAPY_FEED_URI/SCRAPY_LOG_FILE if items_dir/logs_dir settings are not set 2012-05-08 17:43:00 -03:00
Daniel Graña 43732e5042 Merge pull request #129 from saxicek/master 
ImagesPipeline should not fail if Item['images'] is not defined.
 2012-05-07 10:38:49 -07:00
Daniel Graña 69078368ab Merge pull request #130 from alexcepoi/lxml-fixes 
fix `tail` issue when extracting nodes [lxml]
 2012-05-07 08:37:36 -07:00
Alexandru Cepoi 045ff8e5a7 fix `tail` issue when extracting nodes [lxml] 2012-05-07 17:23:27 +02:00
Libor Nenadl 2b93b0a93c Do not try to set item['images'] if it is not defined in the Item. 2012-05-05 14:53:02 +02:00
Daniel Graña 43028876b5 Merge pull request #128 from dangra/cannonicalize-missing-url-path 
handle missing paths in urls as /
 2012-05-03 10:27:11 -07:00
Daniel Graña 72b1c2e88b handle missing paths in urls as / 2012-05-03 13:56:45 -03:00
Pablo Hoffman 9c3b9f2968 fixed bug in json-rpc webservice reported in https://groups.google.com/d/topic/scrapy-users/qgVBmFybNAQ/discussion. also removed no longer supported 'run' command from extras/scrapy-ws.py 2012-05-03 12:05:40 -03:00
Pablo Hoffman abcac4fcbd updated maintainer to scrapinghub 2012-05-02 03:25:35 -03:00
Daniel Graña 2681be59f7 Merge pull request #127 from stav/master 
scrapy.contrib.spiders.Rule documentation indentation
 2012-04-30 12:16:45 -07:00
stav 86dba76d1f documentation indentation 2012-04-30 13:09:34 -05:00
Pablo Hoffman f5b87dbef8 added NEWS file pointing to docs/news.rst 2012-04-28 23:32:51 -03:00
Pablo Hoffman 78185921c2 renamed and improved README to provide a more helpful github landing page 2012-04-28 23:30:00 -03:00
Daniel Graña 9d66d7cdf9 be consistent removing BOM from decoded bodies. #123 2012-04-27 00:31:03 -03:00
Daniel Graña 8cae228df1 do not treat input type "image" as form input. #111 2012-04-25 16:12:48 -03:00
Daniel Graña 5b9a7814a5 support TextResponse in open_in_browser util 2012-04-25 16:04:37 -03:00
Pablo Hoffman 7865fbf05a replace "import Image" by more standard "from PIL import Image". closes #88 2012-04-20 19:05:55 -03:00
Daniel Graña 66de3d1757 return trial status as bin/runtests.sh exit value. #118 2012-04-20 16:40:55 -03:00
Daniel Graña db99ae3958 test more border cases for formrequest 2012-04-20 16:39:50 -03:00
Daniel Graña 28401fd47d Merge dev.scrapinghub.com:~/src/scrapy 2012-04-20 09:32:43 -03:00
Daniel Graña 29d6bcf0d1 Workaround bug in lxml for multiple select options 
In lxml version pre 2.3.1 there is a bug that returns
all options elements instead of those selected for select tag

it is mentioned in 2.3.1 release notes
http://lxml.de/2.3/changes-2.3.1.html

and fixed by
57f49eed82 (L1R1139)
 2012-04-20 12:24:30 +00:00
Pablo Hoffman c7f33c534b removed redundant lines from release notes 2012-04-20 09:09:55 -03:00
Daniel Graña 15c8c01828 add 0.14.3 release notes 2012-04-19 23:25:15 -03:00
Daniel Graña f34dd11c16 forgot to include pydispatch license. #118 2012-04-19 22:49:47 -03:00
Daniel Graña 771abd57c1 include egg files used by testsuite in source distribution. #118 2012-04-19 22:38:45 -03:00
Daniel Graña 8b45a00f36 Merge dangra/lxml-formrequest 2012-04-19 17:10:29 -03:00
Daniel Graña 72485128cb Add a test case to cover input elements as not direct child of form element. #111 #121 2012-04-19 16:58:01 -03:00
Daniel Graña 3b2458dbbb cleanup all FormRequest test cases. #111 #121 2012-04-19 16:48:39 -03:00
Daniel Graña 4340a13db5 More lxml FormRequest fixes. #111 #121 
* test textarea elements
* handle odd cases for select elements like chrome and FF browsers does
* Remove test case already covered by per tag test cases
 2012-04-19 16:48:31 -03:00
Daniel Graña 84d5f5ea53 test and fix each form input type with border cases. #111 #121 2012-04-19 15:40:07 -03:00
Daniel Graña 63e4355fba find form input elements using one xpath #111 #121 2012-04-19 14:11:13 -03:00
Daniel Graña 5c03c1df2d Merge pull request #121 from artem-dev/master 
fix FormRequest for case when a form values are missed
 2012-04-19 08:18:02 -07:00
Pablo Hoffman 97f362d64e removed deprecated/undocumented class: HTMLImageLinkExtractor 2012-04-19 12:07:46 -03:00
Artem Bogomyagkov 3a7c28f155 fixed FormRequest for a form missed values case 2012-04-19 18:07:38 +03:00
Pablo Hoffman 13ac6f63eb Merge pull request #119 from andrix/fix-htmlimagelinkextractor 
Fix HTMLImageLinkExtractor to work with libxml2 and lxml selectors
 2012-04-19 07:56:38 -07:00
Pablo Hoffman 1e521a3ff3 improved command line tool usage help which explains that more commands are available when run from project directory. refs #107 2012-04-19 02:54:57 -03:00
Pablo Hoffman 2fb5e62c39 doc: update overview page to point to the genspider command. refs #107 2012-04-19 02:37:22 -03:00
Pablo Hoffman 1c5294bee1 update docstring in project template to avoid confusion with genspider command, which may be considered as an advanced feature. refs #107 2012-04-19 02:35:48 -03:00