Regression #14452
open
Prometheus node_exporter generates errors with the default config
Added by Steve Wheeler over 1 year ago.
Updated about 6 hours ago.
Affected Plus Version:
23.05
Description
Installing and enabling the node exporter generates errors whenever it is queried.
Jun 5 14:47:50 node_exporter 29215 ts=2023-06-05T13:47:50.492Z caller=collector.go:169 level=error msg="collector failed" name=uname duration_seconds=1.3109e-05 err="cannot allocate memory"
This can be triggered by querying it with curl:
curl http://172.21.16.246:9100/metrics
Tested:
23.05-REL
node_exporter-1.5.0_4
pfSense-pkg-node_exporter-0.18.1_3
This was also failing in 23.01.
Files
Full metrics output attached.
Note that both 'uname' and 'os' report failure:
# TYPE node_scrape_collector_success gauge
node_scrape_collector_success{collector="boottime"} 1
node_scrape_collector_success{collector="cpu"} 1
node_scrape_collector_success{collector="exec"} 1
node_scrape_collector_success{collector="filesystem"} 1
node_scrape_collector_success{collector="loadavg"} 1
node_scrape_collector_success{collector="meminfo"} 1
node_scrape_collector_success{collector="netdev"} 1
node_scrape_collector_success{collector="os"} 0
node_scrape_collector_success{collector="textfile"} 1
node_scrape_collector_success{collector="time"} 1
node_scrape_collector_success{collector="uname"} 0
node_scrape_collector_success{collector="zfs"} 1
- Target version deleted (
2.7.0)
- Plus Target Version deleted (
23.09)
Still not working with pfSense 23.09 and node_exporter-1.5.0_6. I tested FreeBSD 14.0-RELEASE w/node_exporter-1.6.1. That works!
I enabled FreeBSD repos on 23.09 and installed node_exporter-1.6.1. Same error, does not resolve the issue.
Tested 24.03 development snapshot. Error persists.
2024-01-13T15:38:42.627092-08:00 pf100.local node_exporter 98035 - - ts=2024-01-13T23:38:42.627Z caller=collector.go:169 level=error msg="collector failed" name=uname duration_seconds=3.736e-06 err="cannot allocate memory"
The FreeBSD repos contain a newer version of node_exporter: node_exporter-1.6.1_2
I downloaded this pkg copied it to pfSense, installed and started node_exporter successfully.
Same error persists. Something in pfSense is preventing this from working.
I copied over `node_exporter-1.8.2.pkg` from the FreeBSD repos. Installed, no errors. It works!
This is resolved with 24.11-RELEASE. I don't have the ability to change the status on this one.
node_exporter-1.8.2 Prometheus exporter for machine metrics
Also available in: Atom
PDF
Updated by 
Updated by 
Updated by 
Updated by 
Updated by