RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

Added notes from discussion with Pablo on the extensions architecture and repository

Paul Tremberth 2014-02-06 12:46:54 -08:00
parent 5b1e266657
commit dc6972ce82
1 changed files with 27 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

28
GSoC-2014.md

@ -1,12 +1,38 @@
Scrapy is hoping to participate in Google Summer of Code in 2014. This page captures some ideas for student projects and provides information on how to get involved.
# Want to get involved?
If you're interested in participating in GSoC 2014 as a student, you should join the Scrapy Developers mailing list: http://groups.google.com/group/scrapy-developers and post any questions, comments, etc. there.
You can also join the #scrapy IRC channel at Freenode to chat with other Scrapy users & developers.
# Ideas for GSoC 2014
Below is a list of potential projects for students. We've gathered these from recent discussions on the mailing lists and among core developers.
If you have another idea you'd like to propose, please send it to http://groups.google.com/group/scrapy-developers for discussion!
## Around Scrapy itself
These ideas are intended to make Scrapy easier to use, increase its performance (while we think it's already pretty good, there's still room for improvements!), and make interacting with it from the outside more straightforward.
### Better extension architecture and extensions repository
Pablo to write a new SEP document.
Scrapy provides a lot of good hooks but makes it a bit complex
to enable extensions and to list which extensions are enabled,
partly because they are scattered around middlewares, pipelines, and bare extensions.
The idea here is to simplify Scrapy extensions from a user point of view. Doing things like
scrapy extension:add httpcache
and it would take care of configuring downloader middlewares, pipelines, and whatever is needed.
And there would be a (searchable) repository of Scrapy extensions.
In other words, make it easier to plug new functionality to Scrapy projects
which should encourage more writing more (and better) extensions
**_Pablo to write a new SEP document._**
### Per-spider settings (SEP-19)
https://github.com/scrapy/scrapy/blob/master/sep/sep-019.rst