Bug #10624: Memory leak in Unbound with Python module and DHCP lease registration active - pfSense - pfSense bugtracker

Custom queries

2.4.5-p1 - Resolved/Closed
2.5.0 - Resolved/Closed
2.5.1 - Resolved/Closed
2.5.2 - Resolved/Closed
2.6.0 - Resolved/Closed
2.7.0 - Resolved/Closed
2.7.1 - All Open Issues
2.7.1 - Resolved/Closed
2.7.2 - Resolved/Closed
2.8.0 - All Open Bugs
2.8.0 - All Open Features
2.8.0 - All Open Issues
2.8.0 - All Open Regressions
2.8.0 - Feedback
2.8.0 - Needs Attention
2.8.0 - New/Confirmed
2.8.0 - Pull Requests
2.8.0 - Regressions affecting 2.7.0
2.8.0 - Resolved/Closed
21.02.2/2.5.1 - Resolved/Closed
21.05 Plus - All Closed Issues
21.05.1 Plus Target - All Closed Issues
21.05.1 Target - All Closed Issues
22.01 Plus - All Closed Issues
22.01 Target - All Closed Issues
22.05 Plus - All Closed Issues
22.05 Target - All Closed Issues
23.01 Plus - All Closed Issues
23.01 Target - All Closed Issues
23.05 Plus - All Closed Issues
23.05 Target - All Closed Issues
23.05.1 Plus - All Closed Issues
23.05.1 Target - All Closed Issues
23.09 Plus - All Closed Issues
23.09 Target - All Closed Issues
23.09.1 Plus - All Closed Issues
23.09.1 Plus - All Open Issues
23.09.1 Target - All Closed Issues
23.09.1 Target - All Open Issues
24.03 Plus - All Closed Issues
24.03 Plus - All Open Issues
24.03 Plus - Feedback Issues
24.03 Plus - Needs Attention/Work
24.03 Plus - New/Confirmed/In Progress Issues
24.03 Plus - Pull Request Review
24.03 Plus - Waiting on Merge
24.03 Target - All Closed Issues
24.03 Target - All Open Issues
All Open Issues assigned to Me
All Open Pull Requests
Any Target - All Open Regressions
Any Target - Feedback Issues
CE-Next - All Closed Issues (Move to specific target)
CE-Next - All Open Issues
CE-Next - Feedback (Likely needs target changed)
New Issues by Category - Future Target
New Issues by Category - No Target
New Issues by Category - No Target+Future
No Target - All Open Issues (Base Only)
No Target - New Issues (Base Only)
No Target - New Issues (Base and Packages)
Release Notes - Plus Target Version (DO NOT EDIT)
Release Notes - Target Version (DO NOT EDIT)

Actions

Copy link

Bug #10624

closed

Memory leak in Unbound with Python module and DHCP lease registration active

Added by Adrien Carlyle almost 4 years ago. Updated about 1 year ago.

Status:

Resolved

Priority:

Normal

Assignee:

Christian McDonald

Category:

DNS Resolver

Target version:

2.7.0

Start date:

Due date:

% Done:

100%

Estimated time:

Plus Target Version:

23.01

Release Notes:

Default

Affected Version:

2.4.5

Affected Architecture:

All

Description

Issue reported and diagnosed on forums here: Was able to see evidence of this on SG-1100 and SG-3100.
https://forum.netgate.com/topic/154113/sg-1100-2-4-5-unbound-python-module-dhcp-lease-dns-registration-memory-leak

TLDR: When an unbound python module is configured, and the "Register DHCP leases in the DNS resolver" option is enabled. DHCP clients joining the network cause unbound memory usage to increase each time.

If I disable either the python module, or the option to register leases, things appear to function normally.

Related issues

Related to Bug #5413: Incorrect Handling of Unbound Resolver [service restarts, cache loss, DNS service interruption]

Confirmed

Christian McDonald

11/10/2015

Actions

Related to Regression #11316: Unbound crashes with signal 11 when reloading

Resolved

Christian McDonald

Actions

Issue # Delay: days Cancel

History
Notes
Property changes

Actions

Copy link

Updated by Jim Pingle almost 4 years ago

Subject changed from Unbound configuration memory leak to Unbound configuration memory leak with python module + register DHCP leases active

Actions

Copy link

Updated by Jim Pingle about 3 years ago

This would likely be fixed by also solving #5413 since it wouldn't restart in this case. Though the actual memory leak should be re-tested on unbound 1.13.1 and if it's still present, it should be reported upstream to the Unbound devs.

Actions

Copy link

Updated by Jim Pingle about 3 years ago

Related to Bug #5413: Incorrect Handling of Unbound Resolver [service restarts, cache loss, DNS service interruption] added

Actions

Copy link

Updated by Christian McDonald over 1 year ago

Assignee set to Christian McDonald

Actions

Copy link

Updated by Christian McDonald over 1 year ago

Status changed from New to Confirmed

This is confirmed.

Python3.9 and lower has some deeply rooted memory management problems. Because of the way Unbound reinitializes the Python context every time Unbound is reloaded via unbound-control reload or kill -HUP, some memory is leaked.

Moving to Python3.10+ greatly improves this situation.

Actions

Copy link

Updated by Jim Pingle over 1 year ago

Related to Regression #11316: Unbound crashes with signal 11 when reloading added

Actions

Copy link

Updated by Christian McDonald over 1 year ago

https://github.com/NLnetLabs/unbound/pull/827

We also need Unbound to quit reloading the interpreter on every SIGHUP/reload. This is unnecessary.

Actions

Copy link

Updated by Christian McDonald over 1 year ago

Target version set to 2.7.0
Plus Target Version set to 23.01
Release Notes set to Default

Actions

Copy link

Updated by Christian McDonald over 1 year ago

Affected Architecture All added
Affected Architecture deleted (~~SG-1100, SG-3100~~)

Actions

Copy link

#10

Updated by Christian McDonald over 1 year ago

Status changed from Confirmed to Feedback

https://github.com/pfsense/FreeBSD-ports/commit/190a54b5581d5a20b5f839a8a01180d201883cab

This should be significantly improved.

Test the latest snapshots

Actions

Copy link

#11

Updated by Jim Pingle about 1 year ago

Subject changed from Unbound configuration memory leak with python module + register DHCP leases active to Memory leak in Unbound with Python module and DHCP lease registration active
Start date deleted (~~06/02/2020~~)

Updating subject for release notes.

Actions

Copy link

#12