RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
scrapy/scrapy
History
Rolando Espinoza La fuente 35a7059636 cleanup and refactor of parse & fetch commands 
* removed scrapy.utils.fetch
 * each command schedule requests and start scrapy engine
 * fetch command instance BaseSpider if given url does not match any spider or match more than one
 * parse command schedule url if one spider matches
 * parse and fetch doesn't support multiple urls as parameter
 * force spider behavior --spider moved from BaseCommand to only commands: fetch, parse, crawl
 		2010-04-01 17:16:38 -03:00
..
command cleanup and refactor of parse & fetch commands 2010-04-01 17:16:38 -03:00
conf Some improvements to Response encoding support: 2010-03-25 15:47:10 -03:00
contrib spidermanager refactoring 2010-04-01 17:16:38 -03:00
contrib_exp Support relative url used in base tag. closes #148 2010-03-25 12:38:37 -03:00
core spidermanager refactoring 2010-04-01 17:16:38 -03:00
http More refactoring to encoding handling in TextResponse and subclasses 2010-03-31 18:21:41 -03:00
management adapted web console to use unix timestamps for uptime instead of datetime 2009-09-14 20:35:07 -03:00
selector Improved encoding support by explicitly passing encoding to all str_to_unicode() and unicode_to_str() calls 2010-03-24 12:14:07 -03:00
spider removed some old code from scrapy.spider.models 2009-12-02 23:30:00 -02:00
stats removed old untested (and probably broken) code 2010-04-01 04:05:53 -03:00
templates templates: updated code 2010-01-11 12:26:43 -04:00
tests scrapy manager refactor 2010-04-01 17:16:38 -03:00
utils cleanup and refactor of parse & fetch commands 2010-04-01 17:16:38 -03:00
xlib renamed file missing from previous commit 2009-11-19 11:23:36 -02:00
__init__.py Automated merge with http://hg.scrapy.org/scrapy-0.8 2010-03-27 13:25:06 -03:00
extension.py added support for defining EXTENSIONS setting using dicts, like middleware settings 2009-08-18 11:05:36 -03:00
item.py removed deprecated ScrapedItem (previously kept for backwards compatibility) 2009-11-06 16:39:15 -02:00
link.py updated some documentation references in source code 2009-08-19 22:41:26 -03:00
log.py Added LOG_ENCODING setting 2010-03-24 12:13:38 -03:00
mail.py Made MailSender non IO-blocking, and improved MailSender documentation 2010-03-22 13:37:37 -03:00
shell.py spidermanager refactoring 2010-04-01 17:16:38 -03:00