Commit Graph

  • 87b90a66f8 Merge remote-tracking branch 'origin/master' into feed-path Adrian Chaves 2026-07-10 16:09:07 +0200
  • 7fc4f13b9d Sort settings Adrian Chaves 2026-07-10 16:08:01 +0200
  • b63acdcfd7
    Merge 95881ee62b into c9446931a8 Taito Horiuchi 2026-07-10 08:09:22 +0800
  • 0de9c7e2ce
    Merge 7a80c63d8f into c9446931a8 Abhijeet Sharma 2026-07-09 22:28:33 +0530
  • 89ba245f38
    Merge 70a9762d52 into c9446931a8 ankitjavalkar 2026-07-09 21:47:23 +0530
  • c9446931a8
    Use external mitmproxy. (#7720) Andrey Rakhmatullin 2026-07-09 20:02:05 +0500
  • 9d9950df69
    Fix silent data loss in CsvItemExporter (closes #4002) (#7651) Shaquon Kelley 2026-07-08 08:49:29 -0400
  • f5451d33ee Do not ignore sitemaps served with a query string max 2026-07-08 11:20:25 +0300
  • 61f99f2df1
    More granular untyped defs checking in tests. (#7712) Andrey Rakhmatullin 2026-07-08 13:05:45 +0500
  • 51410512b7 Second pass. Andrey Rakhmatullin 2026-07-08 12:54:05 +0500
  • a328260e2c Assorted docs fixes, part 2. Andrey Rakhmatullin 2026-07-07 23:54:19 +0500
  • c17b9a75fc Fix silent data loss in CsvItemExporter (closes #4002) quonkelley 2026-06-22 20:16:24 -0400
  • bdf3067935
    Assorted docs fixes, part 1. (#7710) Andrey Rakhmatullin 2026-07-07 18:39:34 +0500
  • 0499f9736a Merge branch 'master' into assorted-docs-fixes-1 Andrey Rakhmatullin 2026-07-07 18:13:08 +0500
  • c5ec881f1d
    Update tools (#7724) Adrian 2026-07-07 14:27:26 +0200
  • d743ec13f9 Update tools Adrian Chaves 2026-07-07 13:00:41 +0200
  • feb692f552 Bump version: 2.16.0 → 2.17.0 2.17.0 2.17 Adrian Chaves 2026-07-07 12:26:52 +0200
  • 9523e1ec8c
    Merge commit from fork Adrian 2026-07-07 12:25:36 +0200
  • 5ccc8dbe8a
    Release notes for 2.17.0 (#7723) Andrey Rakhmatullin 2026-07-07 14:57:42 +0500
  • c8adec0dbe Add a versionadded to the give_up_log_level docstring Adrian Chaves 2026-07-07 11:35:38 +0200
  • 40be240a92 versionadded/versionchanged improvements Adrian Chaves 2026-07-07 11:22:21 +0200
  • dcedb8d05c Cover additional deprecations introduced while improving test coverage Adrian Chaves 2026-07-07 10:10:15 +0200
  • 2ec5832a07 Minor fixes Adrian Chaves 2026-07-07 09:57:57 +0200
  • 49e836cd09 Address minor issues Adrian Chaves 2026-07-07 09:24:50 +0200
  • 96437be1b5 Address PR review feedback on docstring migration. Rishi-gdrx 2026-07-07 12:44:37 +0530
  • cb784f6c3d Fix a copypasted issue number. Andrey Rakhmatullin 2026-07-06 21:50:21 +0500
  • 2913e7db92 Cover 2.17.0 in the release notes up to dd10cb8. Andrey Rakhmatullin 2026-07-06 21:28:14 +0500
  • 19082e4576 Add a leading slash to request URLs with a host and query but no path (#6574) Fawad 2026-07-06 17:22:26 +0500
  • 8609047d37 Fix typing. Andrey Rakhmatullin 2026-07-06 12:51:26 +0500
  • a8996cecad Switch MitmProxy to choosing a free port and polling. Andrey Rakhmatullin 2026-07-06 12:33:02 +0500
  • 9bdcb760a3 Use killpg() to kill uvx. Andrey Rakhmatullin 2026-07-05 23:58:47 +0500
  • d25a95d2f4 Use external mitmproxy. Andrey Rakhmatullin 2026-07-05 23:12:10 +0500
  • 1490aaaeaa
    Merge 4eed8e2d60 into dd10cb8e9a Cyril Mouchel 2026-07-05 20:54:07 +0500
  • f0bda948aa
    Merge 1e844796c0 into dd10cb8e9a Aiman 2026-07-05 17:33:36 +0530
  • ff031ab186
    Merge f0cc534737 into dd10cb8e9a Adrián Chaves 2026-07-05 07:00:58 -0500
  • dd10cb8e9a
    LxmlLinkExtractor: add deny_attrs and deny_tags (#7679) Adrian 2026-07-05 13:46:22 +0200
  • 405e518d04 wait for start item pipelines before closing danialza 2026-07-05 02:39:11 +0100
  • bed79d0034 fix: stabilize test_start_requests_laziness race condition mayank-dev-15 2026-07-04 16:33:12 +0530
  • 78abe0013c Move module docstring content to docs and remove remaining docstrings. Rishi-gdrx 2026-07-04 13:04:02 +0530
  • 10ce3eaaf3 Remove duplicate module docstrings from utils, core, and misc modules. Rishi-gdrx 2026-07-04 13:00:16 +0530
  • cc9006a56b Remove duplicate module docstrings from spiders, items, loaders, shell, and pipelines. Rishi-gdrx 2026-07-04 12:57:22 +0530
  • 751b384b87 Remove duplicate module docstrings from middleware modules. Rishi-gdrx 2026-07-04 12:54:53 +0530
  • 224b72b5a4 Remove duplicate module docstrings from exporters, extensions, and http. Rishi-gdrx 2026-07-04 12:52:58 +0530
  • f0cc534737 throttling → throttler Adrian Chaves 2026-07-03 16:18:36 +0200
  • 70a9762d52 Lazy initialization for S3 clients since credentials expire with time ankitjavalkar 2026-06-27 23:13:37 +0530
  • 8fcb544765 Remove THROTTLING_SCOPES from the settings.py template Adrian Chaves 2026-07-03 13:17:36 +0200
  • ca8cc4630a Human review Adrian Chaves 2026-07-03 12:50:19 +0200
  • bce275c1dc Human review Adrian Chaves 2026-07-03 12:31:54 +0200
  • 7a80c63d8f make --profile actually useful Abhijeet Sharma 2026-07-03 15:54:20 +0530
  • 1fb8b09334 Remove rampup Adrian Chaves 2026-07-03 12:07:34 +0200
  • f933d73323 WIP Adrian Chaves 2026-07-03 11:15:26 +0200
  • 9fe2a229b6 Human review Adrian Chaves 2026-07-03 10:24:00 +0200
  • 9da2b1cbc4 Undo addon switch to a package Adrian Chaves 2026-07-03 07:54:54 +0200
  • b26befe4c6 Add missing files Adrian Chaves 2026-07-03 07:49:27 +0200
  • 555e8736f2 KISS Adrian Chaves 2026-07-03 07:39:00 +0200
  • c8e9fbd7a1 KISS Adrian Chaves 2026-07-03 07:13:46 +0200
  • 1f9fbee5a4 KISS Adrian Chaves 2026-07-03 06:44:28 +0200
  • 6dfbe1e30b KISS Adrian Chaves 2026-07-03 06:16:55 +0200
  • 5b276a3da1 KISS Adrian Chaves 2026-07-03 05:32:31 +0200
  • 2ae0a3ca64 Broader sweep of stale module-level docstrings (#7699) Siddhesh Kulkarni 2026-07-02 11:57:07 -0700
  • a382da4b60 Remove stale module-level docstrings pointing to docs Siddhesh Kulkarni 2026-07-02 11:12:45 -0700
  • 584462815d Improve the default warning about concurrency settings Adrian Chaves 2026-07-02 16:20:51 +0200
  • 370ff74dc9 WIP Adrian Chaves 2026-07-02 15:02:13 +0200
  • 65219c311c
    Do not treat percent-encoded characters in feed URIs as format specifiers Apoorv Darshan 2026-07-02 18:18:18 +0530
  • 3f8841efa3 WIP Adrian Chaves 2026-07-02 10:37:22 +0200
  • 27f239074c WIP Adrian Chaves 2026-07-02 10:05:47 +0200
  • 8f1f66e1eb Address backward compatibility issues, remove CONCURRENT_REQUESTS_PER_IP Adrian Chaves 2026-07-02 09:28:01 +0200
  • 7784594f7a Rederepcate PER_IP, deprecate PER_DOMAIN Adrian Chaves 2026-07-02 08:27:20 +0200
  • 8e488d837c Clarify backoff per-scope overrides Adrian Chaves 2026-07-02 06:59:52 +0200
  • e203c326c2 WIP Adrian Chaves 2026-07-02 06:48:46 +0200
  • cd5d5c4195 More granular untyped defs checking in tests. Andrey Rakhmatullin 2026-06-27 23:15:49 +0500
  • a2556ce75c Document StickyMetaParamsMiddleware in SPIDER_MIDDLEWARES_BASE default Adnan Awan 2026-07-01 19:30:48 +0500
  • f6b6974f6e Re-trigger CI Adnan Awan 2026-07-01 18:45:02 +0500
  • ed1acc295a Modernize StickyMetaParamsMiddleware and address PR #4141 review Adnan Awan 2026-07-01 18:11:03 +0500
  • 38fa7fe5d0 Merge remote-tracking branch 'origin/master' into stickymeta-spidermiddleware Adnan Awan 2026-07-01 18:04:57 +0500
  • c21f8dcfc5 WIP Adrian Chaves 2026-07-01 14:51:10 +0200
  • 81cff94b26 Assorted docs fixes, part 1. Andrey Rakhmatullin 2026-07-01 15:47:12 +0500
  • 61c9cc33ff WIP Adrian Chaves 2026-07-01 13:23:00 +0200
  • 7cae0e53fb Merge remote-tracking branch 'origin/master' into throttling Adrian Chaves 2026-07-01 12:58:53 +0200
  • fefa6b651e WIP Adrian Chaves 2026-07-01 12:43:16 +0200
  • 7ae19cc2a2 WIP Adrian Chaves 2026-07-01 12:26:53 +0200
  • 4aa7a0c523 Address feedback Adrian Chaves 2026-07-01 10:43:13 +0200
  • 074f9e567d WIP Adrian Chaves 2026-07-01 10:19:27 +0200
  • 01ce8f43cf Merge remote-tracking branch 'origin/master' into extras Adrian Chaves 2026-07-01 10:16:08 +0200
  • 870803b7fb
    fix-utf16-response-test-on-big-endian-systems (#7508) Fat-Coder-CN 2026-07-01 15:16:01 +0800
  • 46e4ffc650 Merge remote-tracking branch 'origin/master' into throttling Adrian Chaves 2026-07-01 09:14:34 +0200
  • ce35abbce7 WIP Adrian Chaves 2026-07-01 09:14:10 +0200
  • da7a6c8e29 Merge branch 'master' into py3.15 Andrey Rakhmatullin 2026-07-01 11:55:49 +0500
  • 361f689df7
    Improve test coverage for crawler.py (#7682) Adrian 2026-07-01 08:53:07 +0200
  • fc5216f156
    Clarify/cleanup Selector.type (#7704) Andrey Rakhmatullin 2026-07-01 11:50:32 +0500
  • 0448b3f346 Merge remote-tracking branch 'origin/master' into cli-post Adrian Chaves 2026-07-01 08:20:22 +0200
  • 3b2a941a1c
    Merge 9f335d3798 into a6d6a48aa6 Adrian 2026-07-01 05:33:55 +0000
  • 2709a06a8e Apply nest_asyncio for IPython with asyncio reactor Ishaan Kapur 2026-07-01 09:25:07 +0530
  • 5ddb37d28c Document additional pre-crawler settings Ishaan Kapur 2026-07-01 08:47:47 +0530
  • dfe3db69ea docs: note scrape_response output change Ishaan Kapur 2026-07-01 07:59:49 +0530
  • 6cca1670f8 Remove stale module docstrings Ishaan Kapur 2026-07-01 07:36:14 +0530
  • f7a8083f12 Fix empty URL path with query Ishaan Kapur 2026-07-01 06:21:35 +0530
  • b16c9f441c Update the docstring. Andrey Rakhmatullin 2026-06-30 23:41:12 +0500
  • 40ea6617ce Refactor/cleanup/type hint Selector. Andrey Rakhmatullin 2026-06-30 23:07:31 +0500
  • f87717e05a WIP Adrian Chaves 2026-06-30 16:45:58 +0200