mirror of https://github.com/scrapy/scrapy.git
added links and reformated some texts
--HG-- extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40513
This commit is contained in:
parent
e140b1e435
commit
aab5a4a7dd
|
|
@ -1,5 +1,6 @@
|
|||
.. _install:
|
||||
|
||||
=====================
|
||||
How to install Scrapy
|
||||
=====================
|
||||
|
||||
|
|
|
|||
|
|
@ -1,16 +1,18 @@
|
|||
=====================
|
||||
Setting everything up
|
||||
=====================
|
||||
.. _tutorial1:
|
||||
|
||||
| In this tutorial, we'll teach you how to scrape http://www.google.com/dirhp; Google's web directory.
|
||||
| We'll assume that you've checked and fulfilled the requirements specified in the Download page, and that Scrapy is already installed in your system.
|
||||
======================
|
||||
Creating a new project
|
||||
======================
|
||||
|
||||
In this tutorial, we'll teach you how to scrape http://www.google.com/dirhp Google's web directory.
|
||||
|
||||
We'll assume that Scrapy is already installed in your system, if not see :ref:`install`.
|
||||
|
||||
For starting a new project, enter the directory where you'd like your project to be located, and run::
|
||||
|
||||
scrapy-admin.py startproject google
|
||||
|
||||
As long as Scrapy is well installed and the path is set, this should create a directory called "google"
|
||||
containing the following files:
|
||||
As long as Scrapy is well installed and the path is set, this should create a directory called "google" containing the following files:
|
||||
|
||||
* *scrapy-ctl.py* - the project's control script. It's used for running the different tasks (like "genspider", "crawl" and "parse"). We'll talk more about this later.
|
||||
* *scrapy_settings.py* - the project's settings file.
|
||||
|
|
@ -25,5 +27,4 @@ containing the following files:
|
|||
|
||||
export PYTHONPATH=/path/to/your/project
|
||||
|
||||
|
||||
Now you can continue with the next part of the tutorial.
|
||||
Now you can continue with the next part of the tutorial: :ref:`tutorial2`.
|
||||
|
|
|
|||
|
|
@ -1,11 +1,10 @@
|
|||
.. _tutorial2:
|
||||
|
||||
================
|
||||
Our first spider
|
||||
================
|
||||
|
||||
| Ok, the time to write our first spider has come.
|
||||
| Make sure that you're standing on your project's directory and run:
|
||||
|
||||
::
|
||||
Ok, the time to write our first spider has come. Make sure that you're standing on your project's directory and run::
|
||||
|
||||
./scrapy-ctl genspider google_directory google.com
|
||||
|
||||
|
|
|
|||
Loading…
Reference in New Issue