RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
1,589 Commits 49 Branches 132 Tags 141 MiB
Commit Graph

1589 Commits

Author SHA1 Message Date
Pablo Hoffman 02de8cb6fa some other minor code cleanups for Settings class 2009-08-27 14:41:49 -03:00
Pablo Hoffman 90e6aefb4d some refactoring to Settings class 2009-08-27 14:08:48 -03:00
Pablo Hoffman 78481bf4d3 fixed bug when spider returns None 2009-08-27 12:10:31 -03:00
Pablo Hoffman ab0def3f8b made scrapy.command.cmdline module executable from command line 2009-08-27 11:49:35 -03:00
Pablo Hoffman 625137464f fixed bug in help command (thanks slav0nic for reporting) 2009-08-26 16:18:25 -03:00
Ismael Carnales 0e163a9816 added override field save test to DjangoItem 2009-08-26 11:58:40 -03:00
Ismael Carnales 62e03419b7 fixed bug in DjangoItem 2009-08-26 11:45:59 -03:00
Ismael Carnales 8efe6eb55e made DjangoItem a descendant of Item and its metaclass 2009-08-26 11:38:49 -03:00
Ismael Carnales fb39bca24f added djangoitem doc 2009-08-26 08:44:22 -03:00
Pablo Hoffman 65ab611fb0 more updates to HttpErrorMiddleware doc 2009-08-26 08:30:18 -03:00
Pablo Hoffman 44783a3a06 minor improvements to FAQ entry 2009-08-26 00:18:58 -03:00
Pablo Hoffman 4dba75a73f updated HttpErrorMiddleware doc 2009-08-25 20:13:58 -03:00
Daniel Grana 14c6c4623a remove debug line :( 2009-08-25 16:51:41 -03:00
Daniel Grana fe4683d637 pylinted decorators utils 2009-08-25 16:50:40 -03:00
Daniel Grana 9f1ed63763 report caller's file:lineno of deprecated function instead of file:lineno of deprecated function 2009-08-24 20:27:08 -03:00
Ismael Carnales 9bafa7325c fixed errors in djangoitem tests 2009-08-24 17:30:58 -03:00
Ismael Carnales decbdc5346 added DjangoItem item class 2009-08-24 17:16:18 -03:00
Daniel Grana 7b30c31b59 Automated merge with ssh://hg.scrapy.org/scrapy 2009-08-24 16:46:25 -03:00
Daniel Grana 9fbaef90fe fix spider templates handling in genspider command 2009-08-24 16:46:20 -03:00
Pablo Hoffman 8a074c9cb5 removed scrapy-admin.py command, and left only scrapy-ctl as the only scrapy command 2009-08-24 15:43:36 -03:00
Ismael Carnales 39540b188a changed torrent in overview doc 2009-08-24 15:11:04 -03:00
Ismael Carnales 4b5aa30867 minor update to tutorial 2009-08-24 14:34:17 -03:00
Pablo Hoffman 0363040884 doc: added FAQ entry about Accept-Language 2009-08-24 13:56:44 -03:00
Ismael Carnales 85282a4b76 added scrapy commandline scripts doc 2009-08-24 12:02:44 -03:00
Pablo Hoffman ead8cb9fac removed documentation about ugly DontCloseDomain exception (which will be removed in the future) 2009-08-24 11:57:21 -03:00
Pablo Hoffman 74f706b356 renamed "parse_item" method of XMLFeedSpider to "parse_node", keeping backwards compatibility 2009-08-24 10:54:34 -03:00
Pablo Hoffman 31693eb90f dropped "cache" attribute of Request and Response objects 2009-08-24 10:34:05 -03:00
Pablo Hoffman 79bf4c817a replaced old memoizemethod decorator with a more efficient one (memoizemethod_noargs) 2009-08-24 10:21:04 -03:00
Pablo Hoffman 4f2925420f minor improvements to Response.__repr__ 2009-08-24 09:54:02 -03:00
Pablo Hoffman b71de57b21 some simplifications to Request and Response classes 2009-08-24 09:47:26 -03:00
Pablo Hoffman 81832773ee ported get_base_url and get_meta_refresh to use WeakKeyDictionary (instead of Request.cache) 2009-08-24 08:58:51 -03:00
Pablo Hoffman 49e11d34c2 switched request_fingerprint to use WeakKeyDictionary for caching (instead of Request.cache) 2009-08-24 08:45:23 -03:00
Pablo Hoffman 0186c6937a HTTP auth middleware: added doc and unittest 2009-08-24 08:07:20 -03:00
Pablo Hoffman c7e916407d fixed test name 2009-08-24 07:57:00 -03:00
Pablo Hoffman 2cb0cfe7ea simplified some code 2009-08-24 07:29:30 -03:00
Daniel Grana 73e7788ba2 dont try to guess if spider output is iterable for Items and Requests objects 2009-08-24 01:25:14 -03:00
Daniel Grana 6e2bd49a81 Host header must include port number when port used for connecting is not default protocol port 2009-08-24 01:16:49 -03:00
Pablo Hoffman 46aaea9f32 doc: improved documentation about debugging leaks 2009-08-23 20:36:00 -03:00
Pablo Hoffman 0ed849248f some improvements to item exporters 
- passed previous class attributes to instances attributes
- better handling of constructor arguments
- better coverage on unittets (including encoding)
- updated documentation with new changes
 2009-08-23 05:48:35 -03:00
Pablo Hoffman de89909195 send_catch_log: pass through results from sendRobust 2009-08-22 16:38:25 -03:00
Pablo Hoffman 499dc6677c utils.signal: made send_catch_log function more robust (by using pydispatch.robust.sendRobust) and added unittests 2009-08-22 16:22:31 -03:00
Pablo Hoffman f204da82d1 disconnecting signal handlers after using them in stats unittests 2009-08-22 16:22:02 -03:00
Pablo Hoffman 825cec51ff fixed bug recently introduced in stats collector closing logic, and added unittests 2009-08-21 23:23:46 -03:00
Pablo Hoffman 7461710ef1 added some missing dots 2009-08-21 21:54:10 -03:00
Pablo Hoffman 9635a7839c rearranged documentation into a better organization 
--HG--
rename : docs/topics/index.rst => docs/index.rst
 2009-08-21 21:49:54 -03:00
Pablo Hoffman 4761e0c88d minor doc correction 2009-08-21 19:11:59 -03:00
Pablo Hoffman 012fd1cc2f moved api-stability.rst doc to root and updated it 
--HG--
rename : docs/misc/api-stability.rst => docs/api-stability.rst
 2009-08-21 16:29:23 -03:00
Pablo Hoffman 07c1f3b8d8 updated ugly argument name 2009-08-21 16:13:25 -03:00
Ismael Carnales 5050787380 removed spider templates from project, addeded sumcommands to manage templates in genspider 2009-08-21 16:10:45 -03:00
Pablo Hoffman ef6f04eb06 moved doc about debugging memory leaks to its own topic and added doc about trackref module 2009-08-21 16:07:16 -03:00