RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
Scrapy, a fast high-level web crawling & scraping framework for Python.
2,247 Commits 49 Branches 132 Tags 141 MiB
Python 99.8%
HTML 0.1%
Go to file
Pablo Hoffman 37e9c5d78e Added new Scrapy service with support for: 
* multiple projects
* uploading scrapy projects as Python eggs
* scheduling spiders using a JSON API

Documentation is added along with the code.

Closes #218.

--HG--
rename : debian/scrapy-service.default => debian/scrapyd.default
rename : debian/scrapy-service.dirs => debian/scrapyd.dirs
rename : debian/scrapy-service.install => debian/scrapyd.install
rename : debian/scrapy-service.lintian-overrides => debian/scrapyd.lintian-overrides
rename : debian/scrapy-service.postinst => debian/scrapyd.postinst
rename : debian/scrapy-service.postrm => debian/scrapyd.postrm
rename : debian/scrapy-service.upstart => debian/scrapyd.upstart
rename : extras/scrapy.tac => extras/scrapyd.tac
 		2010-09-03 15:54:42 -03:00
bin Moved scrapy-ws script to extras/ and fixed broken methods due to changes in web service API 2010-08-27 00:33:08 -03:00
debian Added new Scrapy service with support for: 2010-09-03 15:54:42 -03:00
docs Added new Scrapy service with support for: 2010-09-03 15:54:42 -03:00
examples Changed format of scrapy.cfg file to contain a [settings] section and a 'default' key inside it, instead of the other way around 2010-09-02 21:22:17 -03:00
extras Added new Scrapy service with support for: 2010-09-03 15:54:42 -03:00
profiling/priorityqueue mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
scrapy Added new Scrapy service with support for: 2010-09-03 15:54:42 -03:00
scrapyd Added new Scrapy service with support for: 2010-09-03 15:54:42 -03:00
scripts removed python2.5 from rpm-install.sh script 2009-06-16 13:14:40 -03:00
.hgignore ignore docs/build 2009-07-25 15:21:22 -03:00
.hgtags Added tag 0.9 for changeset 5caf3dc10a92 2010-06-28 00:54:47 -03:00
AUTHORS Applied documentation patch provided by Lucian Ursu (closes #207) 2010-08-21 01:26:35 -03:00
INSTALL mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
LICENSE mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
MANIFEST.in Added new Scrapy service with support for: 2010-09-03 15:54:42 -03:00
README added scrapy-sqs.py to deployed scripts 2010-06-13 19:17:17 -03:00
setup.cfg added bitmap for windows installer 2009-09-17 02:01:40 -03:00
setup.py Added new Scrapy service with support for: 2010-09-03 15:54:42 -03:00

README 

This is Scrapy, an opensource screen scraping framework written in Python.

For more visit the project home page at http://scrapy.org