RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
1,780 Commits 49 Branches 132 Tags 138 MiB
Commit Graph

1780 Commits

Author SHA1 Message Date
Ismael Carnales 4ecc909bc1 Fix RobotsTxtMiddleware reference in doc 2009-12-04 15:37:24 -02:00
Ismael Carnales f86f62c5d9 Use setuptools for install, if not present fallback to distutils 2009-11-20 09:30:06 -02:00
Pablo Hoffman 9ff4dbf636 renamed file missing from previous commit 
--HG--
rename : scrapy/xlib/patches.py => scrapy/xlib/twisted_250_monkeypatches.py
 2009-11-19 11:23:36 -02:00
Pablo Hoffman bf55a4708f prevent 'import scrapy' from failing when twisted module is not available, also moved twisted 2.5.0 monkeypatch into a more specific module name 2009-11-19 10:41:36 -02:00
Pablo Hoffman c4f77c4da0 minor fixes to images doc (thanks amccloud) 2009-11-16 11:15:25 -02:00
Pablo Hoffman 0d6aee1f12 updated wrong documentation 2009-11-13 20:03:56 -02:00
Pablo Hoffman d5ae94df55 fixed bug when using log.start() with log level module constants instead of string names, and added regression tests 2009-10-31 14:36:38 -02:00
Pablo Hoffman b41c5b5d5b fixed typo in intro/install doc (thanks phaithful) 2009-10-29 10:41:20 -02:00
Pablo Hoffman 10d6d49085 Added tag 0.7 for changeset 2077c6107e33 2009-10-07 23:57:04 -02:00
Pablo Hoffman bd481751d8 moved images pipeline documentation to stable doc 
--HG--
rename : docs/experimental/images.rst => docs/topics/images.rst
 2009-10-07 22:57:25 -02:00
Pablo Hoffman b4d202a6b0 added note about memory usage extension not working on windows 2009-10-07 22:57:10 -02:00
Pablo Hoffman daf86144c8 another win32 bug fixed in images pipeline (regression tests already covered it) 2009-10-07 22:39:19 -02:00
Pablo Hoffman 5c68e2b34b fixed bug in images pipeline bug in win32 systems, and added regression tests 2009-10-07 22:34:38 -02:00
Pablo Hoffman 37d9e015bb minor fix to tutorial 2009-10-07 20:15:49 -02:00
Pablo Hoffman aacb7965b4 improved check for missing callback in Requests 2009-10-03 14:08:40 -03:00
Pablo Hoffman 0f1bb87198 fixed bug in parse command with requests which don't have __dict__ attribute 2009-10-02 09:20:22 -03:00
Ismael Carnales bb4871b7a7 added xpathitemloader tests 2009-09-29 16:05:34 -03:00
Ismael Carnales 16ada1d5dc fixed ItemLoader replace_value 2009-09-29 16:05:32 -03:00
Pablo Hoffman a0eec7eaf6 some typos fixes and updates to install doc 2009-09-29 09:44:02 -03:00
Pablo Hoffman 4a371a6cd3 removed unmaintained spidermonkey bindings 2009-09-29 09:33:20 -03:00
Ismael Carnales 1646482bef reformatted installation guide 2009-09-29 08:41:34 -03:00
Pablo Hoffman f565127eb2 added some missing file to MANIFEST.in 2009-09-28 23:55:00 -03:00
Pablo Hoffman 4a9d9282bc removed obsolete scrapy architecture dia diagram 2009-09-28 23:54:01 -03:00
Pablo Hoffman 7e12d3d41b removed old adaptors tests sample data 2009-09-28 23:16:17 -03:00
Pablo Hoffman 7428e4cebf splitted make_release.sh in: build_release.sh and sign_release.sh 
--HG--
rename : extras/make_release.sh => extras/build_release.sh
 2009-09-28 23:07:00 -03:00
Pablo Hoffman 504293b8c4 renamed tag: 0.7.0-rc1 to 0.7-rc1 2009-09-28 22:29:23 -03:00
Pablo Hoffman 2be739964d bumped version to 0.7 final 2009-09-28 22:28:49 -03:00
Daniel Grana 1f9e0f10eb don't log ignored requests errors at images pipeline 2009-09-28 12:38:49 -03:00
Daniel Grana c795771282 remove unused line from project settings template 2009-09-23 14:53:40 -03:00
Daniel Grana dfd35c5280 Add common javascript mimetypes to be detected as TextResponses, also improve mimetype detection to avoid querying twice classes dict 2009-09-23 14:26:58 -03:00
Ismael Carnales ef0e5d368f updated spider templates to reflect the new spider callback return policy 2009-09-22 11:25:42 -03:00
Ismael Carnales 5862ba7db7 modified doc to reflect the new spider callback return policy (lists not needed) 2009-09-22 11:25:40 -03:00
Ismael Carnales 802f918b69 removed obsolete doc static file 2009-09-22 11:25:38 -03:00
Daniel Grana 6467c7055d check iterable output of crawl spider and add tests for common function used to iterate spider output 2009-09-21 13:57:16 -03:00
Pablo Hoffman b6155801f0 Added tag 0.7.0-rc1 for changeset f4a14daa04e6 2009-09-18 00:52:41 -03:00
Pablo Hoffman bc778a0e5b make_release.sh: added warning about broken bdist_wininst 2009-09-17 15:28:36 -03:00
Daniel Grana 1b28858bf9 improve XmlRpcRequest and update tests to cover more cases 2009-09-17 14:26:42 -03:00
Pablo Hoffman 48c3fb3ace made XmlRpcRequestTest inherit from RequestTest and removed redundant test 2009-09-17 12:21:43 -03:00
Pablo Hoffman 6845505e7a added make_release.sh script 2009-09-17 11:46:47 -03:00
Pablo Hoffman 6e10914454 added pypi classifiers to setup.py 2009-09-17 11:22:48 -03:00
Pablo Hoffman 6e93872955 updated installation guide for using releases 2009-09-17 11:06:55 -03:00
Pablo Hoffman 653db1d673 added bitmap for windows installer 2009-09-17 02:01:40 -03:00
Pablo Hoffman 132557dd14 some deployment changes in preparation for the 0.7.0 release candidate 2009-09-16 22:40:36 -03:00
Ismael Carnales fd41f06056 added doc on how to enable an Item Pipeline component 2009-09-16 14:19:16 -03:00
Ismael Carnales 404e7e09d7 changed spider doc references in BaseSpider class 2009-09-16 14:10:11 -03:00
Daniel Grana 062730cbd8 fix csv exporter documentation 2009-09-16 00:17:50 -03:00
Daniel Grana 08aedcbe76 Automated merge with ssh://hg.scrapy.org/scrapy 2009-09-15 09:35:24 -03:00
Daniel Grana e8514445dc bugfix image thumb when no thumb is configured 2009-09-15 09:35:21 -03:00
Pablo Hoffman 02e228ad76 added support for returning deferreds in spider manager close_domain() method, and making sure engine_stopped signal is always sent (even when no spiders have run) 2009-09-15 09:27:30 -03:00
Pablo Hoffman 66ff3b3013 renamed defer_failed to defer_fail 2009-09-15 08:44:31 -03:00