Scrapy, a fast high-level web crawling & scraping framework for Python.

crawlercrawlingframeworkhacktoberfestpythonscrapingweb-scrapingweb-scraping-python

Daniel Grana 560dd3fd8e useragent: if spider user_agent attribute is None, use default useragent instead of not including one ... --HG-- extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%401095		2009-04-27 16:56:16 +00:00
scrapy	useragent: if spider user_agent attribute is None, use default useragent instead of not including one	2009-04-27 16:56:16 +00:00
sites	modified page <title>	2009-04-15 01:31:04 +00:00
.hgignore	dummy file to shift a revision	2009-05-04 18:16:20 +00:00