mirror of https://github.com/scrapy/scrapy.git
dd13dfe82b
Previously, it failed silently if an ImportError was caught when trying to import the scrapy settings module. This not only happened when the scrapy settings module itself was missing, but also when it tried to import a missing module, which made the whole thing a bad idea. A side effect of this change (not required, but for simplification) is that we no longer support the default "scrapy_settings" name for the scrapy settings module, but this was never used afaik. |
||
|---|---|---|
| .travis | ||
| artwork | ||
| bin | ||
| debian | ||
| docs | ||
| extras | ||
| scrapy | ||
| scrapyd | ||
| sep | ||
| .coveragerc | ||
| .gitignore | ||
| .hgtags | ||
| .travis.yml | ||
| AUTHORS | ||
| CONTRIBUTING.md | ||
| INSTALL | ||
| LICENSE | ||
| MANIFEST.in | ||
| Makefile.buildbot | ||
| NEWS | ||
| README.rst | ||
| setup.cfg | ||
| setup.py | ||
| tox.ini | ||
README.rst
<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
<head>
</head>
</html>
Scrapy
Overview
Scrapy is a fast high-level screen scraping and web crawling framework, used to crawl websites and extract structured data from their pages. It can be used for a wide range of purposes, from data mining to monitoring and automated testing.
For more information including a list of features check the Scrapy homepage at: http://scrapy.org
Requirements
- Python 2.6 or up
- Works on Linux, Windows, Mac OSX, BSD
Install
The quick way:
pip install scrapy
For more details see the install section in the documentation: http://doc.scrapy.org/en/latest/intro/install.html
Releases
You can download the latest stable and development releases from: http://scrapy.org/download/
Documentation
Documentation is available online at http://doc.scrapy.org/ and in the docs directory.