Scrapy, a fast high-level web crawling & scraping framework for Python.

crawlercrawlingframeworkhacktoberfestpythonscrapingweb-scrapingweb-scraping-python

Pablo Hoffman 5f0d5a1653 Big Response/Request refactoring: ... - added Response subclasses: TextResponse, HtmlResponse, XmlResponse - made Response.body a str - added Response.body_as_unicode() method - added encoding attribute for TextResponse and subclasses - added headers_encoding() and body_encoding() to TextResponse and subclasses - added ResponseTypes class to guess the Response class to use based on mimetype and other criteria - added and improved several Request/Response tests - updated request/response documetnation to reflect the changes Another changes not related to encoding: - added lixbml2debug for debugging libxml2 memory leaks, which can be enabled by a environment variable - added memoizemethod decorator (implemented using descriptors) to cache the result of methods - moved DecompressionMiddleware to contrib_exp --HG-- rename : scrapy/trunk/scrapy/tests/test_spiders/testplugin.py => scrapy/trunk/scrapy/tests/test_spiders/testspider.py extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40766		2009-01-26 02:57:03 +00:00
scrapy	Big Response/Request refactoring:	2009-01-26 02:57:03 +00:00
sites	disabled docs app (redirecting to doc.scrapy.org instead)	2009-01-04 23:28:50 +00:00
.hgignore	dummy file to shift a revision	2009-05-04 18:16:20 +00:00