RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
4,590 Commits 49 Branches 132 Tags 138 MiB
Commit Graph

4590 Commits

Author SHA1 Message Date
Adam Donahue d92914d297 Fix typo 2014-08-28 20:30:50 -04:00
yakxxx e4689556f0 SgmlLinkExtractor - fix for parsing <area> tag with Unicode present 2014-08-28 18:55:58 +02:00
Mikhail Korobov 774ab74ad2 Merge pull request #864 from younghz/master 
Duplicate comma in request-response.rst
 2014-08-28 18:52:51 +06:00
Uyounghz d49766a6ac Duplicate comma in request-response.rst 2014-08-28 19:58:58 +08:00
Mikhail Korobov c4f9e9d8e7 Merge pull request #856 from eliasdorneles/fix-embed-ipython-shell 
fix IPython shell scope issue by using IPython.embed()
 2014-08-20 00:16:33 +06:00
Pablo Hoffman 8360380db0 removed scrapy-ws.py, moved to scrapy-jsonrpc package 2014-08-19 10:30:25 -03:00
Elias Dorneles 6f50cf55a4 fix IPython shell scope issue and load IPython user config 2014-08-18 18:41:05 -03:00
Daniel Graña 841dd5f1f5 Update webservice.rst 2014-08-18 17:48:01 -03:00
Daniel Graña d684ecad7b Merge pull request #846 from rocioar/master 
fix dont_merge_cookies bad behaviour when set to false on meta
 2014-08-18 13:54:11 -03:00
Daniel Graña 94d00b2a26 Merge branch 'jsonrpc-split' 2014-08-15 23:28:26 -03:00
Daniel Graña a9292cfab7 jsonrpc webservice moved to https://github.com/scrapy/scrapy-jsonrpc repository 2014-08-15 23:28:13 -03:00
Rocio Aramberri 51b0bd281d fix dont settings on meta behaviour, add docs and tests 2014-08-15 13:47:42 -07:00
Julia Medina 6339864f95 Minor refactor in the docs and functions used in the shell command 2014-08-14 12:32:37 -03:00
Julia Medina 70f2010db1 Change error type when updating frozen settings 2014-08-14 11:59:25 -03:00
Julia Medina 3547ca6e61 Add example on running spiders outside projects 2014-08-14 11:50:33 -03:00
Julia Medina 419026615f Deprecate Crawler.spiders attribute 2014-08-14 09:19:41 -03:00
Julia Medina c90977ca98 Drop support for scrapy.project.crawler (And scrapy.stats consequently) 2014-08-12 14:02:56 -03:00
Julia Medina 9cbbfd8b04 Adjust spiders' utils to new SpiderManager API 2014-08-12 14:02:56 -03:00
Julia Medina 900a487682 Support multiple simultaneous LogObservers listening different crawlers 2014-08-12 14:02:56 -03:00
Julia Medina 89df18bd2b Fix usage of crawler_process in ScrapyCommands 2014-08-12 14:02:56 -03:00
Julia Medina d0edad4b0b Drop support for ScrapyCommand.crawler property 2014-08-12 14:02:56 -03:00
Julia Medina 870438e5f4 Update tests utils, fixing get_crawler and removing docrawl 2014-08-12 14:02:56 -03:00
Julia Medina d40273561d CrawlerProcess cleanup changes 2014-08-12 14:02:55 -03:00
Julia Medina 980e30a187 Crawler interface cleanup 2014-08-12 14:02:55 -03:00
Julia Medina d7038b2a13 SpiderManager interface cleanup 2014-08-12 14:02:55 -03:00
Julia Medina 39c6a80f9d Both getdict and getlist return copies of the requested values 2014-08-12 14:02:55 -03:00
Julia Medina 3ae971468f Add Settings.copy, freeze and frozencopy method 2014-08-12 14:02:55 -03:00
Julia Medina a995727117 Connect spider_closed signal after a crawler is bound to a Spider 2014-08-12 14:02:55 -03:00
Julia Medina eb0253e530 Update from_crawler method as well as set_crawler on CrawlSpider 2014-08-11 11:24:01 -03:00
Julia Medina 84fa004793 Add from_crawler class method to base Spider 2014-08-11 11:23:57 -03:00
Daniel Graña 8fece4b0b8 Add 0.24.4 release notes 2014-08-09 17:21:20 -03:00
Daniel Graña 02dd4a56a2 fix requirement typo 2014-08-09 00:44:48 -03:00
Daniel Graña 37787081d8 precise ships zope.interface 3.6.1 2014-08-09 00:37:08 -03:00
Daniel Graña 4badcc077d Add 0.24.3 release notes 2014-08-09 00:31:26 -03:00
Daniel Graña 0254f58763 Merge branch 'moderm-setuppy' 2014-08-08 18:09:43 -03:00
Daniel Graña 0772201ac8 Update installation docs 2014-08-08 18:07:38 -03:00
Daniel Graña 029c51acef There is a trove classifier for Scrapy framework! 
Added by https://bitbucket.org/pypa/pypi/issue/179
 2014-08-05 14:43:13 -03:00
Shane c2497e660b Merge pull request #841 from cyberplant/patch-1 
Fixed buildbot tests, after 242c085
 2014-08-05 12:31:20 +01:00
Luar Roji 5e87ed6499 Fixed buildbot tests, after 242c085 2014-08-05 04:15:25 -07:00
Daniel Graña 3e1d157b9e Merge branch 'master' of https://github.com/scrapy/scrapy 2014-08-04 15:58:13 -03:00
Daniel Graña 9fb7b36a48 Merge branch 'w3lib-warnings' 2014-08-04 15:57:13 -03:00
Daniel Graña 3b64b2449e update other places where w3lib version is mentioned 2014-08-04 15:56:41 -03:00
Pablo Hoffman 69a665eb32 Merge pull request #832 from ivannotes/master 
Bugfix for leaking Proxy-Authorization header to targeted host
 2014-08-04 15:20:51 -03:00
Daniel Graña 511a26978f Merge pull request #817 from nramirezuy/fix-startproject-project-name 
[MRG] Fix startproject project name
 2014-08-04 11:55:35 -03:00
Paul Tremberth 480cfa1994 Update w3lib requirement to 1.8.0 2014-08-04 16:01:28 +02:00
Paul Tremberth 928e7f2924 Use w3lib.html.replace_entities() (remove_entities() is deprecated) 2014-08-03 12:02:25 +02:00
Daniel Graña fcd34b6561 set zip_safe=False 2014-08-01 16:26:08 -03:00
Daniel Graña 1fc4e59cf4 do not ship tests package 2014-08-01 16:23:37 -03:00
Daniel Graña f35fac11a2 scrapy.bat is not needed anymore 2014-08-01 16:23:26 -03:00
Daniel Graña a8f45dc6dd Modernize setup.py 2014-08-01 15:43:33 -03:00