scrapy

Scrapy, a fast high-level web crawling & scraping framework for Python.

crawler crawling framework hacktoberfest python scraping web-scraping web-scraping-python

Go to file

Pablo Hoffman b2878fbbef scrapy.utils.url_is_from_spider() - Consider spider name as possible domain for matching in scrapy.utils.url_is_from_spider()		2010-08-02 12:16:36 -03:00
bin	moved scrapy.tac to extras/	2010-06-13 23:09:08 -03:00
debian	minor fix to path name	2010-07-31 16:02:59 -03:00
docs	Scrapy logging refactoring (closes #188 ):	2010-08-02 08:49:14 -03:00
examples	Replaced default spider manager (TwistedPluginSpiderManger) with a simpler one that doesn't depend on Twisted Plugins infrastructure.	2010-07-30 17:30:32 -03:00
extras	moved sign_release.sh code to Makefile	2010-06-14 09:49:07 -03:00
profiling/priorityqueue	mv scrapy/trunk to root as part of svn2hg migration	2009-05-06 15:55:17 -03:00
scrapy	scrapy.utils.url_is_from_spider() - Consider spider name as possible domain for matching in scrapy.utils.url_is_from_spider()	2010-08-02 12:16:36 -03:00
scripts	removed python2.5 from rpm-install.sh script	2009-06-16 13:14:40 -03:00
.hgignore	ignore docs/build	2009-07-25 15:21:22 -03:00
.hgtags	Added tag 0.9 for changeset 5caf3dc10a92	2010-06-28 00:54:47 -03:00
AUTHORS	Added Ping Yin to AUTHORS	2010-06-11 11:33:02 -03:00
INSTALL	mv scrapy/trunk to root as part of svn2hg migration	2009-05-06 15:55:17 -03:00
LICENSE	mv scrapy/trunk to root as part of svn2hg migration	2009-05-06 15:55:17 -03:00
MANIFEST.in	added some missing file to MANIFEST.in	2009-09-28 23:55:00 -03:00
README	added scrapy-sqs.py to deployed scripts	2010-06-13 19:17:17 -03:00
setup.cfg	added bitmap for windows installer	2009-09-17 02:01:40 -03:00
setup.py	removed custom Makefile and version based on mercurial revision	2010-07-24 17:02:08 -03:00

README

This is Scrapy, an opensource screen scraping framework written in Python.

For more visit the project home page at http://scrapy.org