Scrapy, a fast high-level web crawling & scraping framework for Python.
Go to file
Pablo Hoffman 86498abdf1 Sorted out Link Extractors organization by moving all them to
scrapy.contrib.linkextractors.

The most relevant being:
    scrapy.link.extractors.RegexLinkExtractor

which was moved to:
    scrapy.contrib.linkextractors.sgml.SgmlLinkExtractor

The old location still works but throws a deprecation warning. It will be
removed before the 0.7 release.

Documentation and tests were also updated.

Also, in this changeset, a new regex-based link extractor was added to
scrapy.contrib.linkextractors.regex.

--HG--
rename : scrapy/tests/sample_data/link_extractor/regex_linkextractor.html => scrapy/tests/sample_data/link_extractor/sgml_linkextractor.html
rename : scrapy/tests/test_link.py => scrapy/tests/test_contrib_linkextractors.py
2009-05-18 19:19:37 -03:00
bin sorted out running of unittests: 2009-05-16 20:11:23 -03:00
docs Sorted out Link Extractors organization by moving all them to 2009-05-18 19:19:37 -03:00
examples improved configuration of middlewares using dicts and orders (closes #85) 2009-05-11 01:40:40 -03:00
extras/sql mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
profiling/priorityqueue mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
scrapy Sorted out Link Extractors organization by moving all them to 2009-05-18 19:19:37 -03:00
scripts mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
.hgignore adding .svn to hgignore to help with hg2svn autocommits 2009-05-07 17:29:30 -03:00
AUTHORS mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
INSTALL mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
LICENSE mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
README mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
setup.cfg mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
setup.py mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00

README

This is Scrapy, an opensource screen scraping framework written in Python.

For more visit the project home page at http://scrapy.org