Commit Graph

1984 Commits

Author SHA1 Message Date
Martin Hauser dfb99e1f69
Fixes #23125: Add missing standard REST API fields for VLAN Translation Policies and Rules (#23127) 2026-09-08 13:40:29 -05:00
Jeremy Stretch a4ff5c7c28
Restore v4.6 migration ordering (#23107) 2026-09-02 17:31:25 +02:00
Jeremy Stretch 56693d62ae Merge branch 'main' into feature
# Conflicts:
#	contrib/openapi.json
#	netbox/core/forms/filtersets.py
#	netbox/core/tests/test_openapi_schema.py
#	netbox/dcim/forms/mixins.py
#	netbox/extras/events.py
#	netbox/ipam/forms/bulk_edit.py
#	netbox/ipam/forms/model_forms.py
#	netbox/ipam/models/services.py
#	netbox/ipam/tests/test_forms.py
#	netbox/ipam/tests/test_models.py
#	netbox/ipam/tests/test_views.py
#	netbox/netbox/jobs.py
#	netbox/project-static/dist/netbox.js
#	netbox/project-static/dist/netbox.js.map
#	netbox/release.yaml
#	requirements.txt
2026-09-01 16:46:44 -04:00
bctiemann f66ce9818a
Merge pull request #23071 from netbox-community/22989-nested-schema-components
Closes #22989: Reference brief components for nested SerializedPKRelatedField
2026-09-01 08:24:26 -04:00
Martin Hauser 2b3b9e62e7
perf(api): Prefetch reverse many-to-many serializer fields (#23064)
Recognize Django's ManyToManyRel in get_prefetches_for_serializer().
Because it is a sibling of ManyToOneRel rather than a subclass, reverse
many-to-many accessors were omitted from the generated prefetch paths and
fetched once per serialized object.

Add regression coverage for both automatically generated fields and
SerializedPKRelatedField(many=True), and regenerate the affected ASN and
ObjectPermission API query-count baselines.

Fixes #23060
2026-08-31 10:15:21 -07:00
Martin Hauser 0f22d67617 fix(models): Normalize update_fields to prevent generator consumption
Introduce `normalize_update_fields()` utility to convert update_fields
to frozenset, preventing one-shot iterables from being consumed during
membership tests. Update Service, VLANGroup, and CircuitTermination
save methods to use normalized fields. Add comprehensive test coverage.

Fixes generator exhaustion when save() overrides check field membership
before persisting denormalized caches alongside their source fields.

Fixes #23078
2026-08-31 12:48:51 -04:00
Martin Hauser 60f80c8ad2 fix(forms): Assign scope before validation in ScopedForm mixin
Move scope assignment before validation to prevent stale scope values
on instances when validation fails. Refactor VLANGroupForm to inherit
from ScopedForm, removing duplicate scope handling code. Add test
coverage for scope type changes and validation errors.

Fixes #23040
2026-08-31 12:36:11 -04:00
Jeremy Stretch 443a22706f Avoid renaming existing schema components
Serializers used only in a nested context have no complete form in the schema, so
prefixing them with "Brief" renamed an existing component to no purpose and dropped
the old name entirely. Exempt serializers declaring an explicit Meta.ref_name from
the prefix, and pin the three affected names.

This narrows the schema diff to the fields the bug actually affected: no components
are removed, and the nine which are added are purely additive.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
2026-08-28 15:55:51 -04:00
Martin Hauser 2b54582cd7 fix(api): Discover nested prefetches for SerializedPKRelatedField
Teach _get_nested_serializer() to unwrap ManyRelatedField and resolve the
serializer configured on SerializedPKRelatedField. Preserve the field's
nested value so prefetch discovery follows brief_fields for nested
representations and the full field set otherwise.

Guard the recursion against reference cycles by tracking the serializer
states already being resolved on the current path. Because nested defaults
to False the target expands its full field set, so a self-referential or
mutually referential declaration would otherwise recurse without a
termination condition. The key pairs the serializer class with its
effective field set, since re-entering a serializer at a narrower depth is
finite rather than cyclic, and the states are copied per frame so a sibling
field can still expand what another one stops at.

Populate interface VDC relationships and VRF route target assignments in
the API test fixtures, update the two query count baselines, and add
coverage for direct, many-valued and non-nested serialized related fields
alongside self-referential, mutually referential, brief-depth and
sibling-reuse cases.

Fixes #22988
2026-08-28 13:36:13 -04:00
Martin Hauser 88f90dc8ca fix(forms): Fix owner field placement in PowerOutlet and Service forms
Move owner field from fieldsets to Meta.fields in PowerOutletForm and
add it to ServiceCreateForm Meta.fields. Ensures owner field appears in
forms and can be properly saved. Adds test coverage with Owner creation.

Fixes #23052
2026-08-28 08:44:02 -04:00
Martin Hauser 6437626d6d fix(ipam): Support multiple values for VLANGroup scope filters
Replace NumberFilter with MultiValueNumberFilter for VLANGroup scope
filters (Region, Site Group, Site, Location, Rack Group, Rack,
Cluster Group, Cluster). Update filter_scope method to use `__in`
lookup and add comprehensive test coverage for multi-value filtering.

Fixes #22671
2026-08-28 08:37:35 -04:00
Jeremy Stretch c89a544eac Merge branch 'main' into feature 2026-08-25 12:34:17 -04:00
bctiemann b08799860f
Merge pull request #23017 from netbox-community/22978-event-leakage-on-rollback
Fixes #22978: Discard queued events when a REST API write is rolled back
2026-08-24 16:00:23 -04:00
Jeremy Stretch 79f940f362 Fixes #22978: Discard queued events when a REST API write is rolled back
The REST API's write paths are transactional, but the in-memory events queue
is not: change logging receivers queue events eagerly (for deletions in
pre_delete, before the row is removed), and event_tracking() flushes that queue
only after the response has been rendered. Where a rolled-back write is caught
and converted into a normal response — the ProtectedError/RestrictedError and
AbortRequest handlers in NetBoxModelViewSet.dispatch(), and the
ObjectDoesNotExist to PermissionDenied conversions in the perform_*() methods —
the flush therefore dispatched events for objects that were never created,
updated, or deleted.

Backport discard_events_on_rollback() from the feature branch and enter it
inside the transaction guarding each API write: perform_create(),
perform_update(), and perform_destroy(); the SequentialBulkCreatesMixin,
BulkUpdateModelMixin, and BulkDestroyModelMixin bulk actions; and
AvailableObjectsView.post(). The context manager sends clear_events on the way
out whenever the wrapped transaction is rolled back, whether by an exception
escaping the block or by an explicit set_rollback(), which also covers the
exceptions that reach dispatch(). This mirrors what the UI views now do (#22934).

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
2026-08-24 12:41:32 -04:00
Martin Hauser 4107109472
fix(models): Remove inert clone_fields from non-CloningMixin models (#23003)
Removes clone_fields declarations from ContactAssignment,
ImageAttachment, and FHRPGroupAssignment models that don't inherit
CloningMixin.
Adds test coverage to prevent clone_fields on models without cloning
support.

Fixes #22987
2026-08-24 08:46:05 -07:00
Jeremy Stretch c2d39b12d8
Fixes #22922: Honor the saving database connection in scope propagation signals (#22928) 2026-08-18 22:40:30 +02:00
Jeremy Stretch f12fe46486 Merge branch 'main' into feature
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
2026-08-17 10:26:52 -04:00
Jeremy Stretch a148e2123b
Closes #22942: Upgrade to Django 6.1 (#22943) 2026-08-16 20:39:29 +02:00
bctiemann 3793160eba
Merge pull request #22901 from netbox-community/20054-cleanup
#20054: Pre-release QA
2026-08-14 09:00:33 -04:00
Jeremy Stretch 5a4eabacad Employ discard_events_on_rollback() under AvailableObjectsView 2026-08-14 08:30:11 -04:00
Jason Novinger 07d92c9501 #20285: Collapse consecutive ports into ranges in port_mappings_list
port_mappings_list rendered one token per port, so a service exposing a
large contiguous range (e.g. tcp/8000-8100) filled the list column and
detail panel with hundreds of tokens. Collapse consecutive ports within a
protocol into a range for display, matching the compact form the
pre-multi-protocol Service model rendered via array_to_string().
2026-08-13 11:54:38 -05:00
Jason Novinger af59d71642 #20285: Accept port ranges in the service port_mappings CSV import
The port-mappings CSV column expanded only comma-separated individual
protocol/port pairs, while the edit form's port field already accepted
hyphen ranges (e.g. tcp/8000-8010). Route the CSV column through the same
expand_port_mapping() helper so both entry paths accept identical port
syntax. Parsing uses the shared split_port_mapping() helper, and the
blank-protocol error is worded to fit every entry path rather than only the
form widget's dropdown.
2026-08-13 11:53:58 -05:00
Jason Novinger ead10f5dd6 #19821: Address review feedback on GFK QA tests
- Make the cross-content-type test select a Site pk that is not also a
  valid Region pk, rather than asserting the precondition (the two tables'
  sequences are independent and not rolled back between test classes, so
  the assertion could turn a pk collision into a spurious failure).
- Add a bulk-edit nullification test: clearing a scope via _nullify must
  null both concrete columns and must not raise the incomplete-scope
  validation error. This exercises the GenericForeignKey branch in
  BulkEditView._update_objects(), previously uncovered.
- Strengthen the malformed-input test: use an object ID which overflows
  PositiveBigIntegerField (the value that actually reaches the database)
  instead of an in-range pk, and assert the rejection lands on the scope
  field.
2026-08-11 10:28:36 -05:00
Jason Novinger eaf24f21fa #19821: Pre-release QA
Add view-layer test coverage for the GenericObjectChoiceField scope
handling introduced by #22537, covering behaviors reachable only through
a real request:

- A bulk edit which sets a scope persists the generic foreign key to
  every selected object (previously untested).
- A constrained ObjectPermission narrows the scope object selector: a
  user cannot assign a scope object they may not view, while a permitted
  object still validates. This replaces a test which simulated the
  restriction by assigning the field queryset directly.
- An object ID belonging to a content type other than the selected one
  is rejected rather than silently accepted.
- Malformed scope input (non-integer or out-of-range identifiers) is
  rejected as invalid rather than raising a server error.
2026-08-11 10:15:30 -05:00
Brian Tiemann fde10cbf22 Merge branch 'feature' into 22896-merge-main-into-feature
Resolves all conflicts between main and feature for #22896. Notable
resolutions:

- dcim/signals.py, dcim/tests/test_signals.py: main's cache_presave_scope_fields
  / sync_cached_scope_fields addition is fully superseded by feature's
  PostgreSQL-trigger-based denormalization (confirmed via feature's own
  migration docstrings); dropped in favor of feature's existing approach.
  Both files now match feature's originals exactly.

- netbox/tables/columns.py: combined main's generic get_ordering_annotation()
  protocol with feature's nulls_first-aware order() override. These two
  mechanisms cannot both apply to the same column (django-tables2 negates an
  entire order_by tuple uniformly on direction toggle, so a fixed nulls_first
  placement and multi-column sort composition are mutually exclusive for one
  column) -- preserved nulls_first (existing, wired through forms/API/GraphQL)
  and removed main's two composition-only tests for CustomFieldColumn. See the
  comment on CustomFieldColumn.order() for full reasoning.

- extras/customfields.py, extras/graphql/mixins.py: combined main's
  request-cache optimization and has_key-scoped batch updates with feature's
  resolve_selection_value() (shared select-field label resolution between
  REST and GraphQL).

- extras/events.py, extras/event_rules.py: main's "Honor Script defaults when
  triggered by Event Rules" (#22852) fix was written against the old inline
  action-type dispatch, which feature had already replaced with a pluggable
  action-provider registry (#22770). Re-applied the same two-line fix
  (notifications/job_timeout) inside ScriptAction.enqueue() in event_rules.py
  instead.

- utilities/jinja2.py: fixed a config-attribute name mismatch the raw merge
  would have introduced (main's JINJA2_FILTERS vs feature's renamed
  JINJA_FILTERS) by updating the shared _jinja2_filters() helper.

- ipam/migrations/: renumbered main's 0094_ipaddress_host_index to 0096 and
  added a merge migration, since main and feature had each independently
  added a migration numbered 0094.

- dcim/tests/query_counts.json: regenerated via UPDATE_QUERY_COUNTS=1 against
  the merged codebase rather than hand-merging counts.

Verified: manage.py check clean, full migration graph applies cleanly from
scratch, ruff clean, and full test suites pass for dcim, ipam, netbox, extras,
circuits, vpn, wireless, tenancy, virtualization, core, users, and account
(fresh databases, no state carried over between runs).
2026-08-10 16:13:01 -04:00
Jeremy Stretch b1ee8297d2 Closes #22877: Improve caching logic when retrieving custom fields via get_for_model() 2026-08-06 13:28:18 -04:00
Elliott Balsley 3d3bebcb78
Closes #22787: Improve GraphQL query efficiency when resolving assigned objects (#22792) 2026-08-04 15:28:20 -04:00
Jason Novinger a2c32f137b
Closes #22161: Rename filterset test mixin base classes to *TestMixin (#22856)
* Fixes #22161: Rename filterset test mixin base classes to *TestMixin

Completes the test-class naming standardization begun in #22097, which
renamed concrete test classes to the *TestCase suffix but deliberately
left four filterset test mixin base classes untouched because renaming
them is breaking for plugins that inherit from them.

These four are pure mixins, not concrete test cases, so they follow
NetBox's existing mixin naming convention (RQQueueTestMixin,
ComponentTraceMixin) rather than the *TestCase suffix the issue
originally proposed. The literal *TestCase names also collide with two
existing concrete classes (BaseFilterSetTestCase in
utilities/tests/test_filters.py and ChangeLoggedFilterSetTestCase in
extras/tests/test_filtersets.py).

  BaseFilterSetTests                     -> BaseFilterSetTestMixin
  ChangeLoggedFilterSetTests             -> ChangeLoggedFilterSetTestMixin
  DeviceComponentFilterSetTests          -> DeviceComponentFilterSetTestMixin
  DeviceComponentTemplateFilterSetTests  -> DeviceComponentTemplateFilterSetTestMixin

This is a breaking change for plugins whose test suites import the two
exported mixins from utilities.testing; they must update their imports.

* Fixes #22161: Update add-model skill for renamed test mixin

The add-model skill still referenced ChangeLoggedFilterSetTests in its
example filterset test. Update it to ChangeLoggedFilterSetTestMixin.
2026-08-03 13:23:02 -04:00
Jeremy Stretch 4afdb31b89
Fixes #22848: Ensure deterministic ordering for duplicate IP addresses (#22849) 2026-08-03 11:58:24 -05:00
Arthur Hanson 0270cf1495
#20285 - Support multiple protocols per application service via port mappings (#22692) 2026-08-03 10:58:01 -04:00
Jeremy Stretch aefe938c63 Closes #22823: Avoid extraneous DB queries when fetching IP/prefix family via GraphQL API 2026-07-30 13:38:47 -04:00
Martin Hauser 052506fe9c
Fixes #22738: Correct IPAM availability under constrained object permissions (#22785) 2026-07-29 17:27:09 -04:00
Jeremy Stretch d2df19790f Merge branch 'main' into feature
# Conflicts:
#	contrib/openapi.json
#	docs/release-notes/version-4.6.md
#	netbox/dcim/choices.py
#	netbox/dcim/forms/mixins.py
#	netbox/dcim/models/device_component_templates.py
#	netbox/dcim/models/device_components.py
#	netbox/extras/dashboard/widgets.py
#	netbox/extras/graphql/types.py
#	netbox/extras/models/configs.py
#	netbox/extras/tests/test_templatetags.py
#	netbox/ipam/choices.py
#	netbox/ipam/forms/model_forms.py
#	netbox/netbox/configuration_example.py
#	netbox/netbox/filtersets.py
#	netbox/netbox/tests/test_api.py
#	netbox/netbox/tests/test_scaffold.py
#	netbox/netbox/tests/test_tables.py
#	netbox/project-static/dist/netbox.js
#	netbox/project-static/dist/netbox.js.map
#	netbox/project-static/package.json
#	netbox/project-static/yarn.lock
#	netbox/release.yaml
#	netbox/translations/cs/LC_MESSAGES/django.mo
#	netbox/translations/cs/LC_MESSAGES/django.po
#	netbox/translations/da/LC_MESSAGES/django.mo
#	netbox/translations/da/LC_MESSAGES/django.po
#	netbox/translations/de/LC_MESSAGES/django.mo
#	netbox/translations/de/LC_MESSAGES/django.po
#	netbox/translations/en/LC_MESSAGES/django.po
#	netbox/translations/es/LC_MESSAGES/django.mo
#	netbox/translations/es/LC_MESSAGES/django.po
#	netbox/translations/fr/LC_MESSAGES/django.mo
#	netbox/translations/fr/LC_MESSAGES/django.po
#	netbox/translations/it/LC_MESSAGES/django.mo
#	netbox/translations/it/LC_MESSAGES/django.po
#	netbox/translations/ja/LC_MESSAGES/django.mo
#	netbox/translations/ja/LC_MESSAGES/django.po
#	netbox/translations/ko/LC_MESSAGES/django.mo
#	netbox/translations/ko/LC_MESSAGES/django.po
#	netbox/translations/lv/LC_MESSAGES/django.mo
#	netbox/translations/lv/LC_MESSAGES/django.po
#	netbox/translations/nl/LC_MESSAGES/django.mo
#	netbox/translations/nl/LC_MESSAGES/django.po
#	netbox/translations/pl/LC_MESSAGES/django.mo
#	netbox/translations/pl/LC_MESSAGES/django.po
#	netbox/translations/pt/LC_MESSAGES/django.mo
#	netbox/translations/pt/LC_MESSAGES/django.po
#	netbox/translations/ru/LC_MESSAGES/django.mo
#	netbox/translations/ru/LC_MESSAGES/django.po
#	netbox/translations/tr/LC_MESSAGES/django.mo
#	netbox/translations/tr/LC_MESSAGES/django.po
#	netbox/translations/uk/LC_MESSAGES/django.mo
#	netbox/translations/uk/LC_MESSAGES/django.po
#	netbox/translations/zh/LC_MESSAGES/django.mo
#	netbox/translations/zh/LC_MESSAGES/django.po
#	netbox/utilities/jinja2.py
#	netbox/utilities/tests/test_filters.py
#	requirements.txt
2026-07-28 14:24:24 -04:00
Martin Hauser 7d0a86ef52 fix(search): Add comments field to search indexing
Include comments field with weight 5000 in search indexes for
DeviceRole, L2VPN, MACAddress, and RouteTarget models to enable
full-text search on comment content.

Fixes #22767
2026-07-27 13:30:13 -04:00
Jeremy Stretch b62c384daf
Closes #22595: Introduce BULK_UPDATE_CHUNK_SIZE config parameter to limit max number of rows per bulk update (#22728) 2026-07-22 22:44:33 +02:00
Sri Chandraja Reddy Allala 3e3d36cc2d
Fixes #22588: Filter VLANs by Site Group scope when assigning to a prefix (#22684) 2026-07-22 12:44:09 -07:00
Martin Hauser 84a024babd
fix(ipam): Add comments field to ASN search indexing (#22739)
Include comments field in ASN search with weight 5000 to enable
full-text search on ASN comment content.

Fixes #22736
2026-07-22 11:58:48 -07:00
Jeremy Stretch a24fbb06ce Closes #22721: Enable plugins to extend core GraphQL API
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-07-22 13:16:43 -04:00
bctiemann e232ec00e3
Merge pull request #22724 from netbox-community/22719-rest-api-returns-500-instead-of-a-validation-error-for
Fixes #22719: Correct malformed IP value validation
2026-07-21 22:05:17 -04:00
Jeremy Stretch e50683fee9 Merge main into feature 2026-07-21 09:09:58 -04:00
Martin Hauser 87d396bab5 feat(ipam): Change DHCP IP address status color from green to purple
Group DHCP with SLAAC as an automatic address configuration method while
keeping it visually distinct from Active and Available.

Fixes #22623
2026-07-21 08:32:54 -04:00
Martin Hauser f9363f8688
fix(ipam): Fix format string in IP address/prefix validation errors
Add missing keyword argument to format() calls in validation error
messages. This ensures the invalid data value is properly included in
the error message returned to the user.

Fixes #22719
2026-07-21 09:41:04 +02:00
Martin Hauser 15d2cc35e0
Closes #19273: Enable selection of VLANs scoped to a Device's Cluster or Cluster Group (#22715) 2026-07-20 10:18:56 -05:00
bctiemann 0eb1fcc09c
Closes #22682: Fix CachedScopeMixin cache fields cascading on ancestor deletion (#22693)
CachedScopeMixin._region and ._site_group may cache ancestors of a
Site or Location scope. Change these relationships to SET_NULL so
deleting a Region or SiteGroup clears the cached value instead of
deleting the scoped Prefix, Cluster, or WirelessLAN.

Add reverse GenericRelation fields for Cluster and WirelessLAN on
Region and SiteGroup. This preserves the expected cascade when a
Region or SiteGroup is itself the direct scope, matching the existing
Prefix behavior.

Add migrations recording the ORM-level on_delete changes and regression
coverage for Site, Location, and direct Region/SiteGroup scopes.
2026-07-18 10:35:08 +02:00
Jeremy Stretch 036456dc54 Revert "Merge pull request #22013 from netbox-community/21988-authorization-bypass-in-nested-object-resolution-via"
This reverts commit b3489cd529, reversing
changes made to 41f792c53b.
2026-07-16 10:15:51 -04:00
Arthur Hanson 2f604551c1
Closes #22571: Migrate from django-pglocks to django-pgware (#22635) 2026-07-08 10:19:05 -05:00
Jeremy Stretch 58e8068958
#21355: Refactor trigger migrations (#22608) 2026-07-07 09:04:45 -07:00
Amir Bakar 34c21d3d69 Fixes #22539: Restore available IP display for users with constrained permissions 2026-07-07 15:15:28 +02:00
Jeremy Stretch a7be755e01 Closes #21712: Support description annotations for static choice form fields 2026-07-02 13:46:43 -04:00
Jeremy Stretch 48ce5e7e2c
Closes #22446: Add breadcrumbs support for Layouts (#22546) 2026-07-02 10:46:01 -05:00