RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

Articles, books and courses sections moved to https://scrapy.org/resources/

Paul Tremberth 2017-04-27 14:01:04 +02:00
parent 23efc4113e
commit 124d4e102e
1 changed files with 4 additions and 36 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

40
Home.md

@ -6,7 +6,7 @@ If you're new to Scrapy, start by reading [Scrapy at a glance](http://doc.scrapy
## Course (Online)
* [Scrapy: Powerful Web Scraping & Crawling with Python](https://www.udemy.com/scrapy-tutorial-web-scraping-with-python/?couponCode=GITHUB-SCRAPY)
Check https://scrapy.org/resources/.
## Google Summer of Code
@ -16,43 +16,11 @@ If you're new to Scrapy, start by reading [Scrapy at a glance](http://doc.scrapy
## Articles & blog posts
These are guides contributed by the Scrapy community. If you know of any guide not included here please feel free to add it.
* [Extracting data from websites using Scrapy](https://medium.com/@kaismh/extracting-data-from-websites-using-scrapy-e1e1e357651a) - April 29, 2016
* [Scrapy Tips from the Pros series](https://blog.scrapinghub.com/category/scrapy-tips-from-the-pros/):
* [January 2016](https://blog.scrapinghub.com/2016/01/19/scrapy-tips-from-the-pros-part-1/): extracting microdata, parsing JavaScript code snippets
* [February 2016](https://blog.scrapinghub.com/2016/02/24/scrapy-tips-from-the-pros-february-2016-edition/): SitemapSpider, per-spider settings
* [March 2016](https://blog.scrapinghub.com/2016/03/23/scrapy-tips-from-the-pros-march-2016-edition/): multiple sessions with cookiejars, fallback XPath/CSS selectors
* [April 2016](https://blog.scrapinghub.com/2016/04/20/scrapy-tips-from-the-pros-april-2016-edition/): dealing with ASP.Net pages
* [May 2016](https://blog.scrapinghub.com/2016/05/18/scrapy-tips-from-the-pros-may-2016-edition/): debugging Scrapy spiders
* [Building a web crawler with Scrapy](http://blog.siliconstraits.vn/building-web-crawler-scrapy/) - September 6, 2013
* [Scrapy after the tutorials - Part 1](http://bgrva.github.io/blog/2014/03/04/scrapy-after-tutorials-part-1/) and [Part 2](https://bgrva.github.io/blog/2014/03/08/scrapy-after-tutorials-part-2/) - March 8, 2014
* [How to do basic web scraping using Scrapy on a Windows Azure virtual machine](http://sertacozercan.com/2013/08/how-to-do-basic-web-scraping-using-scrapy-on-windows-azure/) - August 19, 2013
* [Scraping iTunes Charts Using Scrapy](http://davidwalsh.name/python-scrape) - June 12, 2013
* [SearchHub: Indexing web sites in Solr with Scrapy](https://lucidworks.com/2013/06/13/indexing-web-sites-in-solr-with-python/) - June 13, 2013
* [Using Parsley extraction language with Scrapy](https://github.com/redapple/parslepy/wiki/Use-parslepy-with-scrapy) - August 2013
* [Running Scrapy on Amazon EC2](http://pabloseminario.com/2013/03/26/running-scrapy-on-amazon-ec2/) - March 26, 2013
* [How to automatically search and download torrents with Python and Scrapy](http://fuzz-box.blogspot.com/2013/03/how-to-automatically-search-download-torrent-python-scrapy.html) - March 11, 2013
* [Scraping Craigslist with Scrapy](http://mherman.org/blog/2012/11/05/scraping-web-pages-with-scrapy/) (includes video) - Nov 5, 2012
* [[How to Install Scrapy 0.14 in a 64 bit Windows 7 Environment]] - November 2012 (quite old)
* [Scrape multi-pages content with Scrapy](http://abuhijleh.net/2011/02/13/guide-scrape-multi-pages-content-with-scrapy/) - February 13, 2011
* [Calling Scrapy from a Python script](http://www.tryolabs.com/Blog/2011/09/27/calling-scrapy-python-script/) - September 27, 2011
* [Scrapy and Django](http://jonathanstreet.com/blog/django-scrapy/) (1) - February 8, 2012
* [Scrapy and Django](http://blog.just2us.com/2012/07/setting-up-django-with-scrapy/) (2) - July 27, 2012
* [Scraping Google Scholar with Scrapy and MongoDB](http://pyinsci.blogspot.com/2011/10/scrapy-google-scholar-and-mongodb.html) - October 10, 2011
* [Recursively scraping a blog with Scrapy](http://milinda.svbtle.com/recursively-scraping-a-blog-with-scrapy) - March 13, 2012
* [Setup Macports Python and Scrapy successfully](http://owenmundy.com/blog/2010/09/setup-macports-python-and-scrapy-successfully/) - September 8, 2010
* [How to use Scrapy with TOR](https://groups.google.com/forum/#!msg/scrapy-users/WqMLnKbA43I/B3N1ysvoy-4J) (scrapy-users message) - May 18, 2012
* [Convert relative paths to absolute paths](http://stackoverflow.com/questions/6499603/python-scrapy-convert-relative-paths-to-absolute-paths) - June 2011
* [How to use Scrapy, Tor with multiple user agents Part 1](http://pkmishra.github.io/blog/2013/03/18/how-to-run-scrapy-with-TOR-and-multiple-browser-agents-part-1-mac/) and [Part 2](https://pkmishra.github.io/blog/2013/04/16/scrapy-run-using-tor-and-multiple-agents-part-2-ubuntu/) - March & April, 2013
* [(Russian, 2011) Собираем данные с помощью Scrapy](http://habrahabr.ru/post/115710/)
* [How to Run Scrapy Spiders on Cloud Using Heroku and Redis](http://www.seckintozlu.com/1148-how-to-run-scrapy-spiders-on-the-cloud-using-heroku-and-redis.html) - January 2015
* [Web Scraping With Scrapy and MongoDB - Part 1](https://realpython.com/blog/python/web-scraping-with-scrapy-and-mongodb/) and [Part 2](https://realpython.com/blog/python/web-scraping-and-crawling-with-scrapy-and-mongodb/) - updated September 2015
Check https://scrapy.org/resources/.
## Books
* [Learning Scrapy](https://www.packtpub.com/big-data-and-business-intelligence/learning-scrapy) - ISBN 139781784399788, 270 pages Packt (Jan 2016)
Check https://scrapy.org/resources/.
## Videos