RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
Scrapy, a fast high-level web crawling & scraping framework for Python.
1,751 Commits 49 Branches 132 Tags 134 MiB
Python 99.8%
HTML 0.1%
Go to file
Daniel Grana dfd35c5280 Add common javascript mimetypes to be detected as TextResponses, also improve mimetype detection to avoid querying twice classes dict 2009-09-23 14:26:58 -03:00
bin removed scrapy-admin.py command, and left only scrapy-ctl as the only scrapy command 2009-08-24 15:43:36 -03:00
docs modified doc to reflect the new spider callback return policy (lists not needed) 2009-09-22 11:25:40 -03:00
examples added first (not yet stable) revision of Crawler class, which allows to use the Scrapy crawler from stand-alone scripts 2009-09-12 19:32:23 -03:00
extras make_release.sh: added warning about broken bdist_wininst 2009-09-17 15:28:36 -03:00
profiling/priorityqueue mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
scrapy Add common javascript mimetypes to be detected as TextResponses, also improve mimetype detection to avoid querying twice classes dict 2009-09-23 14:26:58 -03:00
scripts removed python2.5 from rpm-install.sh script 2009-06-16 13:14:40 -03:00
.hgignore ignore docs/build 2009-07-25 15:21:22 -03:00
.hgtags Added tag 0.7.0-rc1 for changeset f4a14daa04e6 2009-09-18 00:52:41 -03:00
AUTHORS mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
INSTALL mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
LICENSE mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
MANIFEST.in some deployment changes in preparation for the 0.7.0 release candidate 2009-09-16 22:40:36 -03:00
README mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
setup.cfg added bitmap for windows installer 2009-09-17 02:01:40 -03:00
setup.py added pypi classifiers to setup.py 2009-09-17 11:22:48 -03:00

README 

This is Scrapy, an opensource screen scraping framework written in Python.

For more visit the project home page at http://scrapy.org