RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
6,739 Commits 49 Branches 132 Tags 145 MiB
Commit Graph

6739 Commits

Author SHA1 Message Date
Daniel Graña 4eaf8690b1 Twisted's unittest.Testcase assertRaiess can't be used as context manager 2018-08-15 08:54:18 -03:00
Daniel Grana a304d6b692 Workaround to pass tests/test_feedexporter.py under windows 2018-08-15 02:23:07 -07:00
Daniel Grana e7fe243c3e Fix test_crawler under windows 2018-08-15 01:09:23 -07:00
Daniel Grana 96517cb7de Fix test_command_parse under windows 2018-08-15 01:08:40 -07:00
Daniel Graña d93d960319 Fix test_utils_project under Windows 2018-08-15 01:53:20 -03:00
Jakob de Maeyer cb28175750 Fix csviter tests by explicitly using newline only 2018-08-15 01:35:01 -03:00
Daniel Graña ca53a8699a Fix presentation of template directory in startproject command 2018-08-15 01:35:01 -03:00
Daniel Graña 0e532e3dd8 Creating a connection to 0.0.0.0 fails on windows but not on linux nor mac 2018-08-15 01:35:01 -03:00
Daniel Graña ed068e59b7 Cache pip cache and do not rebuild tags on appveyor and travis 2018-08-15 01:35:01 -03:00
Daniel Graña a21abac743 fix ftp tests on windows 2018-08-15 01:35:01 -03:00
Daniel Graña fb09148c91 Fix bad merge on ParseCommandTest 2018-08-15 01:35:01 -03:00
Jakob de Maeyer 22505a34a9 Fix cmdline profiling test on Windows by using proper path composing 2018-08-15 01:35:01 -03:00
Jakob de Maeyer 034152961d Fix Feedexport test in Windows by using proper file URI 2018-08-15 01:35:01 -03:00
Daniel Graña ed8255bde0 Fix merge issues with stderr/out fixes for windows buffering 2018-08-15 01:33:38 -03:00
Jakob de Maeyer 57a1d66c61 Fix test issues caused by Windows pipe buffer filling up 2018-08-15 01:33:38 -03:00
Jakob de Maeyer 152fde70b1 Fix FTPTestCase by using Windows-friendly temporary file name 2018-08-15 01:33:38 -03:00
Daniel Graña 19ad94105f pywin32 is required to run tests under windows 2018-08-15 01:33:38 -03:00
Daniel Graña dd75297e3f Run Appveyor CI for master and release branches only, but also PRs 2018-08-15 01:33:38 -03:00
Daniel Graña 4c53957f5b Skip leveldb tests on windows 2018-08-15 01:33:38 -03:00
Daniel Graña 1d25c98eb3 Add appveyor.yml 2018-08-15 01:33:38 -03:00
Konstantin Lopuhin 8a4e51a19b
Merge pull request #3371 from StasDeep/fix/issue-3370 
[MRG+1] Fix contract errback (#3370)
 2018-08-10 17:27:45 +03:00
Stas Glubokiy 16dad81715 Fix contract errback 2018-08-09 21:07:25 +03:00
Konstantin Lopuhin c8f3d07e86
Merge pull request #3367 from testingcan/doc-tutorial-update 
[MRG+1] Updated tutorial.rst to include more and up-to-date beginner resources
 2018-08-07 10:05:44 +03:00
Raphael Wuillemier d3aa1e8666 Updated tutorial.rst to include more and up-to-date beginner resources 2018-08-06 17:40:31 +02:00
Konstantin Lopuhin eb007bafab
Merge pull request #3359 from scrapy/unused-imports 
remove unused imports from scrapy/settings/__init__.py
 2018-08-02 22:22:40 +03:00
Konstantin Lopuhin d90bdd5d86
Merge pull request #3358 from BurnzZ/fix-error-msg-feedexport-when-using-s3 
[MRG+1] provide better error message when disabling s3 exporter
 2018-08-02 22:21:23 +03:00
Daniel Graña db714f5a07
Merge pull request #3283 from CCInCharge/issue3247 
Fix #3247: Allow scrapy.FormRequest.from_response method to handle duplicate keys
 2018-08-02 14:49:14 -03:00
Mikhail Korobov c87a4f5c6f remove unused imports from scrapy/settings/__init__.py 
This is a follow-up to https://github.com/scrapy/scrapy/pull/3327
 2018-08-01 01:45:16 +05:00
Kevin Lloyd Bernal 980be4cb4b provide better error message when disabling s3 exporter 2018-07-31 19:05:04 +08:00
Daniel Graña 93afe18587
Merge pull request #2956 from elacuesta/dupefilter_from_crawler 
Add from_crawler support to dupefilters
 2018-07-26 17:02:31 -03:00
Eugenio Lacuesta 999341b60b Simplify dupefilter creation 2018-07-26 16:24:58 -03:00
Eugenio Lacuesta 9e14f8c7e4 Fix test for dupefilter 2018-07-26 16:24:58 -03:00
Eugenio Lacuesta 0089a4ab31 Add test for direct creation of dupefilter (no from_crawler/from_settings) 2018-07-26 16:24:58 -03:00
Eugenio Lacuesta d306fe30ac Test dupefilter creation by the Scheduler 2018-07-26 16:24:58 -03:00
Eugenio Lacuesta 701cd2ff9d Add from_crawler support to dupefilters 2018-07-26 16:24:58 -03:00
CCInCharge 782f866572 Fix #3247: Allow scrapy.FormRequest.from_response method to handle duplicate keys 2018-07-25 21:46:42 -07:00
Mikhail Korobov 895df937a3
Merge pull request #3350 from granadoho/master 
make amendments to grammer
 2018-07-25 23:50:06 +03:00
Mikhail Korobov 733ac6327c
Merge pull request #3347 from korigod/doc_copyright-notice 
Doc: update copyright notice
 2018-07-25 23:49:08 +03:00
Daniel Graña b6abd45926
Merge pull request #3342 from elacuesta/copy-request-flags 
[MRG+1] Include flags when copying requests
 2018-07-25 11:58:25 -03:00
Daniel Graña 732d7e1cce
Merge pull request #3348 from elacuesta/enhancement/alternate-feedexport-constructors 
[MRG+1] Add from_crawler constructor for feed exporters and storages
 2018-07-25 11:55:16 -03:00
Malcolm Granado Ho Yong Liang 48866457b3 make amendments to grammer 2018-07-25 14:38:37 +08:00
Eugenio Lacuesta 917c1fde68 Merge branch 'master' into enhancement/alternate-feedexport-constructors 2018-07-20 12:09:50 -03:00
Eugenio Lacuesta 98d74d1083 Requested changes 2018-07-20 12:08:49 -03:00
Andrei Korigodski 7020c3e452
Doc: update copyright notice 
The years are updated. The hyphen is replaced with an en dash.
 2018-07-20 14:46:57 +03:00
Eugenio Lacuesta 6a38fc39f8 Include flags when copying requests 2018-07-19 11:56:23 -03:00
Mikhail Korobov 258121db04
Merge pull request #3335 from scrapy/docs-retry-codes 
update default RETRY_HTTP_CODES on docs
 2018-07-18 19:33:50 +05:00
Valdir Stumm Junior c61e8a617f
[doc] update default RETRY_HTTP_CODES 2018-07-13 11:55:16 -07:00
Mikhail Korobov c86213317d 1.5.1 release notes 2018-07-12 02:17:08 +05:00
Daniel Graña 01e317e79b
Merge pull request #3327 from nyov/deprecations 
[MRG+1] Remove deprecated CrawlerSettings class and Settings attributes
 2018-07-11 12:01:49 -03:00
Daniel Graña f8f5f463e6
Merge pull request #3253 from rpkilby/depth-stats 
[MRG+1] Update depth middleware stats (fixes #3245)
 2018-07-11 12:00:08 -03:00