Scrapy, a fast high-level web crawling & scraping framework for Python.

crawlercrawlingframeworkhacktoberfestpythonscrapingweb-scrapingweb-scraping-python

Daniel Grana b96a0c2756 core: change default priority to 0 to use balanced priorityqueue, and increase priority of redirected requests so memory doesnt hog because of redirection requests waiting for others requests to finish before they got a chance to be downloaded ... --HG-- extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%401058		2009-04-13 16:42:26 +00:00
scrapy	core: change default priority to 0 to use balanced priorityqueue, and increase priority of redirected requests so memory doesnt hog because of redirection requests waiting for others requests to finish before they got a chance to be downloaded	2009-04-13 16:42:26 +00:00
sites	updated some homepage texts	2009-04-12 10:21:00 +00:00
.hgignore	dummy file to shift a revision	2009-05-04 18:16:20 +00:00