RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
8,814 Commits 49 Branches 132 Tags 155 MiB
Commit Graph

8814 Commits

Author SHA1 Message Date
Andrey Rahmatullin 44f0fde905
Simplify TLS logging for the modern pyOpenSSL. (#4822) 2020-10-01 20:21:09 +02:00
dswij 95b2e94496 fix comment error on tox and re-add cache for travis 2020-10-02 01:05:45 +07:00
dswij cc81f9ed06 add download setting for tox 2020-10-02 00:56:59 +07:00
Eugenio Lacuesta 744f352d09
Do not process cookies from headers 2020-10-01 14:52:23 -03:00
dswij c83a16898f try removing cache in travis to install pip 2020-10-01 20:59:05 +07:00
dswij 392b489a65 travis 2020-10-01 20:32:49 +07:00
dswij f7201b1427 travis and deps 2020-10-01 19:59:23 +07:00
dswij 0ea6ff1136 travis pip version and deps 2020-10-01 16:14:36 +07:00
dswij 66201737a0 fix travis and deps 2020-10-01 15:47:19 +07:00
dswij f4629fe2cc Update travis-pip and tox deps conflict for pip20.2 2020-10-01 14:58:14 +07:00
Sashreek Shankar 9661a8dcfc
removed datatype specification for *args & ** kwargs 2020-10-01 06:46:12 +05:30
Adrián Chaves 774ebe8796 Mention contributors in the README 2020-09-30 14:17:30 +02:00
Eugenio Lacuesta 894b509d7a
Crawl rule: remove deprecated code 
Remove the compatibility layer that handles 'process_request'
methods that do not receive a 'response' parameter
 2020-09-29 23:37:28 -03:00
dswij 9186e5a686 add pip 20.2 test for tox 2020-09-29 00:39:36 +07:00
Andrey Rahmatullin 5a38639359
Merge pull request #4809 from madeny/patch-1 
Correct some typos
 2020-09-28 18:26:43 +05:00
madeny eff96038c7
Correct some typos 
This won't be an issue if **your** spider doesn't rely on cookies.
 2020-09-26 22:50:38 +02:00
Adrián Chaves 6ef7c44061 Fix timezone test issue 2020-09-22 12:45:21 +02:00
GeorgeA92 c22e810658 httocompression tests added 2020-09-22 07:47:37 +03:00
Adrián Chaves 07c1d9c25b Remove boto3 as a dependency for tests 2020-09-21 23:32:55 +02:00
Adrián Chaves 8f46e84519 Fix style issues 2020-09-21 23:28:16 +02:00
Adrián Chaves c3b740f078 Use mocking for tests/test_pipeline_files.py::TestS3FilesStore::test_persist 2020-09-21 23:25:37 +02:00
Adrián Chaves 35726da434 tests/test_feedexport.py: remove unused import 2020-09-21 22:55:25 +02:00
Adrián Chaves 17e135377a Use mocking for tests/test_feedexport.py::BatchDeliveriesTest::test_s3_export 2020-09-21 22:54:39 +02:00
Adrián Chaves 56f05fb164 Use mocking for tests/test_feedexport.py::S3FeedStorageTest::test_store 2020-09-21 22:01:09 +02:00
Adrián Chaves 008cf1c75e Remove a test that has never been executed in Python 3 2020-09-21 20:45:21 +02:00
Mirwaisse Djanbaz 3989f64baa
dependecies → dependencies (#4801) 2020-09-21 14:40:00 +02:00
Mirwaisse Djanbaz 7f1e74daa2
dependencides → dependencies (#4800) 2020-09-21 14:38:16 +02:00
Georgiy Zatserklianyi 70c82d33c0
httpcompression stats added (#4797) 2020-09-20 16:24:05 +03:00
Andrey Rahmatullin 5e997587d9
Remove dead boto2 code, deprecate is_botocore() (#4776) 2020-09-20 15:06:46 +02:00
Eugenio Lacuesta 6e8d20a07a
HTTP/2: add some type hints (#4785) 2020-09-16 09:57:07 +02:00
Mikhail Korobov 85e13aff74
Merge pull request #4782 from sripriyesha/patch-1 
add mention of FTP server storage in media storage intro
 2020-09-15 01:17:46 +05:00
Adrián Chaves 4d6359df2d Mark HTTP/2 as experimental 2020-09-11 13:51:05 +02:00
drs-11 82ba7c8b52 created separate test for invalid no-proxy values 2020-09-10 20:56:39 +05:30
KAILASA's Sri Nithya Priyeshananda 7a83474cc5
add mention of FTP server storage in media storage intro 
At the beginning of this doc, in "Specifying where to store the media" feature details, FTP server storage mention was missing
 2020-09-08 17:16:31 +02:00
drs-11 959222df7e check for unparseable no_proxy values 2020-09-05 21:32:05 +05:30
Andrey Rahmatullin c1cc3f2f42
Merge pull request #4761 from Gallaecio/on-the-fly-certificates 
Generate localhost keys for tests on the fly
 2020-09-02 13:37:44 +05:00
Adrián Chaves 9731d91f34
Merge branch 'master' into fix_iternodes 2020-09-01 12:38:37 +02:00
Adrián Chaves ddc26f3f8f Revert Travis CI changes 2020-09-01 11:26:07 +02:00
Eugenio Lacuesta 307e35c664
Improve check for invalid cookie in CookiesMiddleware (#4772) 2020-09-01 11:04:00 +02:00
Ilia Sergunin d10464ca96
Update docs/topics/feed-exports.rst 
Co-authored-by: Adrián Chaves <adrian@chaves.io>
 2020-09-01 10:13:40 +03:00
Adrián Chaves 8a3ba34a75 Merge remote-tracking branch 'upstream/master' into http2 2020-08-31 16:43:32 +02:00
Adrián Chaves e6dcfd3c99
Merge pull request #4610 from adityaa30/h2-client-protocol 
Add H2ClientProtocol
 2020-08-31 16:35:35 +02:00
Jose Galdos a41c205928 Update httpstatus documentation. 2020-08-31 08:58:43 -05:00
Aditya eff33a2e79 fix(h2): Mockserver test uses H2DownloadHandler 2020-08-30 23:55:17 +05:30
maranqz 71d2c2f1a3 improve view of dict 2020-08-30 12:43:44 +03:00
maranqz fc3c66ce95 fix tests: 
* FeedExportConfigTestCase.test_feed_complete_default_values_from_settings_empty
 * FeedExportConfigTestCase.test_feed_complete_default_values_from_settings_non_empty
 2020-08-30 11:44:48 +03:00
maranqz a8e895e684 kwargs for Item exporters classes 
test
docs
 2020-08-30 10:57:22 +03:00
Mikhail Korobov be655b855d
Merge pull request #4765 from scrapy/simplify-test_crawl 
Simplify tests/test_crawl
 2020-08-29 13:31:20 +05:00
Mikhail Korobov 5e9cc3298b
Merge pull request #4324 from ammarnajjar/4307-use-f-strings 
refactor: use f-strings
 2020-08-29 13:28:38 +05:00
Ammar Najjar 90ca9350f5
Update scrapy/commands/check.py 
Co-authored-by: Mikhail Korobov <kmike84@gmail.com>
 2020-08-29 08:03:03 +00:00