Scrapy, a fast high-level web crawling & scraping framework for Python.
Go to file
Pablo Hoffman ed84231b60 Merge pull request #944 from JeffPaine/patch-1
Update docs copyright year range
2014-11-10 14:03:00 -02:00
artwork
…
debian
…
docs Update docs copyright year range 2014-11-09 21:08:27 -05:00
extras
…
scrapy Merge pull request #882 from ahlen/feature/csvfeed-quotechar 2014-11-04 11:32:59 -02:00
sep mark SEP-019 as Final 2014-10-02 01:17:31 -03:00
tests Merge pull request #882 from ahlen/feature/csvfeed-quotechar 2014-11-04 11:32:59 -02:00
.bumpversion.cfg
…
.coveragerc
…
.gitignore
…
.travis-workarounds.sh
…
.travis.yml
…
AUTHORS
…
CONTRIBUTING.md
…
INSTALL
…
LICENSE
…
MANIFEST.in
…
Makefile.buildbot
…
NEWS
…
README.rst
…
conftest.py
…
pytest.ini
…
requirements.txt
…
setup.cfg
…
setup.py
…
tox.ini
…

README.rst

<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en"> <head> </head>

Scrapy

https://badge.fury.io/py/Scrapy.png https://secure.travis-ci.org/scrapy/scrapy.png?branch=master Wheel Status

Overview

Scrapy is a fast high-level screen scraping and web crawling framework, used to crawl websites and extract structured data from their pages. It can be used for a wide range of purposes, from data mining to monitoring and automated testing.

For more information including a list of features check the Scrapy homepage at: http://scrapy.org

Requirements

  • Python 2.7
  • Works on Linux, Windows, Mac OSX, BSD

Install

The quick way:

pip install scrapy

For more details see the install section in the documentation: http://doc.scrapy.org/en/latest/intro/install.html

Releases

You can download the latest stable and development releases from: http://scrapy.org/download/

Documentation

Documentation is available online at http://doc.scrapy.org/ and in the docs directory.

Community (blog, twitter, mail list, IRC)

See http://scrapy.org/community/

Companies using Scrapy

See http://scrapy.org/companies/

Commercial Support

See http://scrapy.org/support/

</html>