RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

Updated GSoC 2014 (markdown)

Daniel Graña 2014-02-10 11:35:07 -08:00
parent 02e090ee9b
commit 27f4031ab2
1 changed files with 12 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

12
GSoC-2014.md

@ -276,6 +276,18 @@ Current HTTP1.1 download handler depends on code shipped with Twisted that is no
The idea of this task is to depart from current Twisted code looking for a design that can cover current and future needs taking in count the goal is to deal with websites that doesn't follow standards to the letter.
### Refactor signal dispatcher
**Brief explanation**: Profile and look for alternatives to the backend of our signal dispatcher based on pydispatcher lib, Django moved out of pydispatcher by simplifying the api and improving its signal dispatching performance long time ago. [Scrapy issue #8](https://github.com/scrapy/scrapy/issues/8)
**Expected results**: Remove pydispatcher from libraries bundled with Scrapy and write a similar alternative based on Django signal dispatcher.
**Required skills**: Python
**Skill level**: Low
**Mentor**: Daniel Graña
## Around Scrapely
Scrapely is a library for extracting structured data from HTML pages. Given some example web pages and the data to be extracted, scrapely constructs a parser for all similar pages.