RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
1,598 Commits 49 Branches 132 Tags 141 MiB
Commit Graph

1598 Commits

Author SHA1 Message Date
Pablo Hoffman ee40929df4 some line wrapping at 80 cols 2009-08-28 17:52:44 -03:00
Pablo Hoffman 3e7e321a07 sorted out import order and removed unused imports from previous changeset 2009-08-28 17:47:45 -03:00
Ismael Carnales 0b68d4bbef added tests for scrapy-ctl commands 2009-08-28 14:42:07 -03:00
Ismael Carnales 3616ccb479 changed SCRAPYSETTINGS_MODULE to SCRAPY_SETTINGS_MODULE 2009-08-28 11:20:05 -03:00
Pablo Hoffman 0bfa1a910c removed wrong docstring 2009-08-28 02:21:32 -03:00
Pablo Hoffman da20cf53f5 added compatibility with python 2.5 2009-08-27 20:05:11 -03:00
Pablo Hoffman 609aed4553 added inspect_response() function for inspecting responses from spiders 2009-08-27 19:33:33 -03:00
Pablo Hoffman ea4f16bae6 refactored scrapy shell implementation, dropping IPython dependency, and adding a new 'view' shortcut 2009-08-27 18:24:08 -03:00
Pablo Hoffman 13be33f0e7 added open_in_browser function to scrapy.utils.response 2009-08-27 18:20:51 -03:00
Pablo Hoffman 02de8cb6fa some other minor code cleanups for Settings class 2009-08-27 14:41:49 -03:00
Pablo Hoffman 90e6aefb4d some refactoring to Settings class 2009-08-27 14:08:48 -03:00
Pablo Hoffman 78481bf4d3 fixed bug when spider returns None 2009-08-27 12:10:31 -03:00
Pablo Hoffman ab0def3f8b made scrapy.command.cmdline module executable from command line 2009-08-27 11:49:35 -03:00
Pablo Hoffman 625137464f fixed bug in help command (thanks slav0nic for reporting) 2009-08-26 16:18:25 -03:00
Ismael Carnales 0e163a9816 added override field save test to DjangoItem 2009-08-26 11:58:40 -03:00
Ismael Carnales 62e03419b7 fixed bug in DjangoItem 2009-08-26 11:45:59 -03:00
Ismael Carnales 8efe6eb55e made DjangoItem a descendant of Item and its metaclass 2009-08-26 11:38:49 -03:00
Ismael Carnales fb39bca24f added djangoitem doc 2009-08-26 08:44:22 -03:00
Pablo Hoffman 65ab611fb0 more updates to HttpErrorMiddleware doc 2009-08-26 08:30:18 -03:00
Pablo Hoffman 44783a3a06 minor improvements to FAQ entry 2009-08-26 00:18:58 -03:00
Pablo Hoffman 4dba75a73f updated HttpErrorMiddleware doc 2009-08-25 20:13:58 -03:00
Daniel Grana 14c6c4623a remove debug line :( 2009-08-25 16:51:41 -03:00
Daniel Grana fe4683d637 pylinted decorators utils 2009-08-25 16:50:40 -03:00
Daniel Grana 9f1ed63763 report caller's file:lineno of deprecated function instead of file:lineno of deprecated function 2009-08-24 20:27:08 -03:00
Ismael Carnales 9bafa7325c fixed errors in djangoitem tests 2009-08-24 17:30:58 -03:00
Ismael Carnales decbdc5346 added DjangoItem item class 2009-08-24 17:16:18 -03:00
Daniel Grana 7b30c31b59 Automated merge with ssh://hg.scrapy.org/scrapy 2009-08-24 16:46:25 -03:00
Daniel Grana 9fbaef90fe fix spider templates handling in genspider command 2009-08-24 16:46:20 -03:00
Pablo Hoffman 8a074c9cb5 removed scrapy-admin.py command, and left only scrapy-ctl as the only scrapy command 2009-08-24 15:43:36 -03:00
Ismael Carnales 39540b188a changed torrent in overview doc 2009-08-24 15:11:04 -03:00
Ismael Carnales 4b5aa30867 minor update to tutorial 2009-08-24 14:34:17 -03:00
Pablo Hoffman 0363040884 doc: added FAQ entry about Accept-Language 2009-08-24 13:56:44 -03:00
Ismael Carnales 85282a4b76 added scrapy commandline scripts doc 2009-08-24 12:02:44 -03:00
Pablo Hoffman ead8cb9fac removed documentation about ugly DontCloseDomain exception (which will be removed in the future) 2009-08-24 11:57:21 -03:00
Pablo Hoffman 74f706b356 renamed "parse_item" method of XMLFeedSpider to "parse_node", keeping backwards compatibility 2009-08-24 10:54:34 -03:00
Pablo Hoffman 31693eb90f dropped "cache" attribute of Request and Response objects 2009-08-24 10:34:05 -03:00
Pablo Hoffman 79bf4c817a replaced old memoizemethod decorator with a more efficient one (memoizemethod_noargs) 2009-08-24 10:21:04 -03:00
Pablo Hoffman 4f2925420f minor improvements to Response.__repr__ 2009-08-24 09:54:02 -03:00
Pablo Hoffman b71de57b21 some simplifications to Request and Response classes 2009-08-24 09:47:26 -03:00
Pablo Hoffman 81832773ee ported get_base_url and get_meta_refresh to use WeakKeyDictionary (instead of Request.cache) 2009-08-24 08:58:51 -03:00
Pablo Hoffman 49e11d34c2 switched request_fingerprint to use WeakKeyDictionary for caching (instead of Request.cache) 2009-08-24 08:45:23 -03:00
Pablo Hoffman 0186c6937a HTTP auth middleware: added doc and unittest 2009-08-24 08:07:20 -03:00
Pablo Hoffman c7e916407d fixed test name 2009-08-24 07:57:00 -03:00
Pablo Hoffman 2cb0cfe7ea simplified some code 2009-08-24 07:29:30 -03:00
Daniel Grana 73e7788ba2 dont try to guess if spider output is iterable for Items and Requests objects 2009-08-24 01:25:14 -03:00
Daniel Grana 6e2bd49a81 Host header must include port number when port used for connecting is not default protocol port 2009-08-24 01:16:49 -03:00
Pablo Hoffman 46aaea9f32 doc: improved documentation about debugging leaks 2009-08-23 20:36:00 -03:00
Pablo Hoffman 0ed849248f some improvements to item exporters 
- passed previous class attributes to instances attributes
- better handling of constructor arguments
- better coverage on unittets (including encoding)
- updated documentation with new changes
 2009-08-23 05:48:35 -03:00
Pablo Hoffman de89909195 send_catch_log: pass through results from sendRobust 2009-08-22 16:38:25 -03:00
Pablo Hoffman 499dc6677c utils.signal: made send_catch_log function more robust (by using pydispatch.robust.sendRobust) and added unittests 2009-08-22 16:22:31 -03:00