Scrapy, a fast high-level web crawling & scraping framework for Python.

crawlercrawlingframeworkhacktoberfestpythonscrapingweb-scrapingweb-scraping-python

Daniel Grana 756cda3873 duplicatefilter: dont raise ignorerequest, but add request to filter on spider input ... --HG-- extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40885		2009-02-19 16:49:03 +00:00
scrapy	duplicatefilter: dont raise ignorerequest, but add request to filter on spider input	2009-02-19 16:49:03 +00:00
sites	disabled docs app (redirecting to doc.scrapy.org instead)	2009-01-04 23:28:50 +00:00
.hgignore	dummy file to shift a revision	2009-05-04 18:16:20 +00:00