Scrapy, a fast high-level web crawling & scraping framework for Python.

crawlercrawlingframeworkhacktoberfestpythonscrapingweb-scrapingweb-scraping-python

Pablo Hoffman 541451afb3 simplified obfuscated implementation of duplicated links removal and made it use scrapy.utils.python.unique function. also added missing 'unique' argument to docstring ... --HG-- extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40620		2009-01-02 20:45:34 +00:00
scrapy	simplified obfuscated implementation of duplicated links removal and made it use scrapy.utils.python.unique function. also added missing 'unique' argument to docstring	2009-01-02 20:45:34 +00:00
sites	minor text changes to home page	2009-01-02 20:17:40 +00:00
.hgignore	dummy file to shift a revision	2009-05-04 18:16:20 +00:00