Actions
Bug #6444
closed
Monitoring graphs are down after reboot
Status:
Not a Bug
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
Start date:
06/03/2016
Due date:
% Done:
0%
Estimated time:
Plus Target Version:
Release Notes:
Affected Version:
Affected Architecture:
amd64
Description
Hello.
After I reboot the pfSense VM, all monitoring graphs are down. (Status/Monitoring)
I see the graph, but everything is 0.
After I click on Settings/ Display Advanced/ Reset Graphing Data the Monitoring is back up.
2.3.1-RELEASE-p1 (amd64)
Regards
Lingo
Files
Updated by Chris Buechler about 10 years ago
- Status changed from New to Feedback
is updaterrd.sh running? any rrdtool errors in system log?
Updated by Tom - about 10 years ago
If I type in: ps -axfw | grep updaterrd.sh it is running.
Here are the rrdtool erros from system logs:
Jun 3 16:15:35 php-cgi rc.bootup: The command '/usr/bin/nice -n20 /usr/local/bin/rrdtool update /var/db/rrd/system-mbuf.rrd N:U:U:U:U' returned exit code '1', the output was 'ERROR: /var/db/rrd/system-mbuf.rrd: illegal attempt to update using time 1464963335 when last update time is 1465022664 (minimum one second step)' Jun 3 16:15:35 php-cgi rc.bootup: The command '/usr/bin/nice -n20 /usr/local/bin/rrdtool update /var/db/rrd/system-memory.rrd N:U:U:U:U:U' returned exit code '1', the output was 'ERROR: /var/db/rrd/system-memory.rrd: illegal attempt to update using time 1464963335 when last update time is 1465022664 (minimum one second step)' Jun 3 16:15:35 php-cgi rc.bootup: The command '/usr/bin/nice -n20 /usr/local/bin/rrdtool update /var/db/rrd/system-processor.rrd N:U:U:U:U:U' returned exit code '1', the output was 'ERROR: /var/db/rrd/system-processor.rrd: illegal attempt to update using time 1464963335 when last update time is 1465022664 (minimum one second step)' Jun 3 16:15:35 php-cgi rc.bootup: The command '/usr/bin/nice -n20 /usr/local/bin/rrdtool update /var/db/rrd/system-states.rrd N:U:U:U:U:U' returned exit code '1', the output was 'ERROR: /var/db/rrd/system-states.rrd: illegal attempt to update using time 1464963335 when last update time is 1465022664 (minimum one second step)' Jun 3 16:15:35 php-cgi rc.bootup: The command '/usr/bin/nice -n20 /usr/local/bin/rrdtool update /var/db/rrd/ovpns1-vpnusers.rrd N:U' returned exit code '1', the output was 'ERROR: /var/db/rrd/ovpns1-vpnusers.rrd: illegal attempt to update using time 1464963335 when last update time is 1465022664 (minimum one second step)' Jun 3 16:15:35 php-cgi rc.bootup: The command '/usr/bin/nice -n20 /usr/local/bin/rrdtool update /var/db/rrd/ovpns1-packets.rrd N:U:U:U:U:U:U:U:U' returned exit code '1', the output was 'ERROR: /var/db/rrd/ovpns1-packets.rrd: illegal attempt to update using time 1464963335 when last update time is 1465022664 (minimum one second step)' Jun 3 16:15:35 php-cgi rc.bootup: The command '/usr/bin/nice -n20 /usr/local/bin/rrdtool update /var/db/rrd/ovpns1-traffic.rrd N:U:U:U:U:U:U:U:U' returned exit code '1', the output was 'ERROR: /var/db/rrd/ovpns1-traffic.rrd: illegal attempt to update using time 1464963335 when last update time is 1465022664 (minimum one second step)' Jun 3 16:15:35 php-cgi rc.bootup: The command '/usr/bin/nice -n20 /usr/local/bin/rrdtool update /var/db/rrd/ipsec-packets.rrd N:U:U:U:U:U:U:U:U' returned exit code '1', the output was 'ERROR: /var/db/rrd/ipsec-packets.rrd: illegal attempt to update using time 1464963335 when last update time is 1465022664 (minimum one second step)' Jun 3 16:15:35 php-cgi rc.bootup: The command '/usr/bin/nice -n20 /usr/local/bin/rrdtool update /var/db/rrd/ipsec-traffic.rrd N:U:U:U:U:U:U:U:U' returned exit code '1', the output was 'ERROR: /var/db/rrd/ipsec-traffic.rrd: illegal attempt to update using time 1464963335 when last update time is 1465022664 (minimum one second step)' Jun 3 16:15:35 php-cgi rc.bootup: The command '/usr/bin/nice -n20 /usr/local/bin/rrdtool update /var/db/rrd/opt6-packets.rrd N:U:U:U:U:U:U:U:U' returned exit code '1', the output was 'ERROR: /var/db/rrd/opt6-packets.rrd: illegal attempt to update using time 1464963335 when last update time is 1465022664 (minimum one second step)' Jun 3 16:15:35 php-cgi rc.bootup: The command '/usr/bin/nice -n20 /usr/local/bin/rrdtool update /var/db/rrd/opt6-traffic.rrd N:U:U:U:U:U:U:U:U' returned exit code '1', the output was 'ERROR: /var/db/rrd/opt6-traffic.rrd: illegal attempt to update using time 1464963335 when last update time is 1465022664 (minimum one second step)' Jun 3 16:15:35 php-cgi rc.bootup: The command '/usr/bin/nice -n20 /usr/local/bin/rrdtool update /var/db/rrd/opt5-packets.rrd N:U:U:U:U:U:U:U:U' returned exit code '1', the output was 'ERROR: /var/db/rrd/opt5-packets.rrd: illegal attempt to update using time 1464963335 when last update time is 1465022664 (minimum one second step)' Jun 3 16:15:35 php-cgi rc.bootup: The command '/usr/bin/nice -n20 /usr/local/bin/rrdtool update /var/db/rrd/opt5-traffic.rrd N:U:U:U:U:U:U:U:U' returned exit code '1', the output was 'ERROR: /var/db/rrd/opt5-traffic.rrd: illegal attempt to update using time 1464963335 when last update time is 1465022664 (minimum one second step)' Jun 3 16:15:35 php-cgi rc.bootup: The command '/usr/bin/nice -n20 /usr/local/bin/rrdtool update /var/db/rrd/opt4-packets.rrd N:U:U:U:U:U:U:U:U' returned exit code '1', the output was 'ERROR: /var/db/rrd/opt4-packets.rrd: illegal attempt to update using time 1464963335 when last update time is 1465022664 (minimum one second step)' Jun 3 16:15:35 php-cgi rc.bootup: The command '/usr/bin/nice -n20 /usr/local/bin/rrdtool update /var/db/rrd/opt4-traffic.rrd N:U:U:U:U:U:U:U:U' returned exit code '1', the output was 'ERROR: /var/db/rrd/opt4-traffic.rrd: illegal attempt to update using time 1464963335 when last update time is 1465022664 (minimum one second step)' Jun 3 16:15:35 php-cgi rc.bootup: The command '/usr/bin/nice -n20 /usr/local/bin/rrdtool update /var/db/rrd/opt3-packets.rrd N:U:U:U:U:U:U:U:U' returned exit code '1', the output was 'ERROR: /var/db/rrd/opt3-packets.rrd: illegal attempt to update using time 1464963335 when last update time is 1465022664 (minimum one second step)' Jun 3 16:15:35 php-cgi rc.bootup: The command '/usr/bin/nice -n20 /usr/local/bin/rrdtool update /var/db/rrd/opt3-traffic.rrd N:U:U:U:U:U:U:U:U' returned exit code '1', the output was 'ERROR: /var/db/rrd/opt3-traffic.rrd: illegal attempt to update using time 1464963335 when last update time is 1465022664 (minimum one second step)' Jun 3 16:15:35 php-cgi rc.bootup: The command '/usr/bin/nice -n20 /usr/local/bin/rrdtool update /var/db/rrd/opt1-packets.rrd N:U:U:U:U:U:U:U:U' returned exit code '1', the output was 'ERROR: /var/db/rrd/opt1-packets.rrd: illegal attempt to update using time 1464963335 when last update time is 1465022664 (minimum one second step)' Jun 3 16:15:35 php-cgi rc.bootup: The command '/usr/bin/nice -n20 /usr/local/bin/rrdtool update /var/db/rrd/opt1-traffic.rrd N:U:U:U:U:U:U:U:U' returned exit code '1', the output was 'ERROR: /var/db/rrd/opt1-traffic.rrd: illegal attempt to update using time 1464963335 when last update time is 1465022664 (minimum one second step)' Jun 3 16:15:35 php-cgi rc.bootup: The command '/usr/bin/nice -n20 /usr/local/bin/rrdtool update /var/db/rrd/lan-packets.rrd N:U:U:U:U:U:U:U:U' returned exit code '1', the output was 'ERROR: /var/db/rrd/lan-packets.rrd: illegal attempt to update using time 1464963335 when last update time is 1465022664 (minimum one second step)' Jun 3 16:15:35 php-cgi rc.bootup: The command '/usr/bin/nice -n20 /usr/local/bin/rrdtool update /var/db/rrd/lan-traffic.rrd N:U:U:U:U:U:U:U:U' returned exit code '1', the output was 'ERROR: /var/db/rrd/lan-traffic.rrd: illegal attempt to update using time 1464963335 when last update time is 1465022664 (minimum one second step)' Jun 3 16:15:35 php-cgi rc.bootup: The command '/usr/bin/nice -n20 /usr/local/bin/rrdtool update /var/db/rrd/wan-packets.rrd N:U:U:U:U:U:U:U:U' returned exit code '1', the output was 'ERROR: /var/db/rrd/wan-packets.rrd: illegal attempt to update using time 1464963335 when last update time is 1465022664 (minimum one second step)' Jun 3 16:15:35 php-cgi rc.bootup: The command '/usr/bin/nice -n20 /usr/local/bin/rrdtool update /var/db/rrd/wan-traffic.rrd N:U:U:U:U:U:U:U:U' returned exit code '1', the output was 'ERROR: /var/db/rrd/wan-traffic.rrd: illegal attempt to update using time 1464963335 when last update time is 1465022664 (minimum one second step)'
and btw. I got after every reboot these time errors: (This VM is running Hyper-V (2012R2), I tried to fix fix this error but nothing works)
Jun 3 16:16:39 kernel calcru: runtime went backwards from 69865007 usec to 35316568 usec for pid 0 (kernel) Jun 3 16:16:39 kernel calcru: runtime went backwards from 7 usec to 3 usec for pid 0 (kernel) Jun 3 16:16:39 kernel calcru: runtime went backwards from 13 usec to 6 usec for pid 0 (kernel) Jun 3 16:16:39 kernel calcru: runtime went backwards from 1035 usec to 550 usec for pid 0 (kernel) Jun 3 16:16:39 kernel calcru: runtime went backwards from 11 usec to 5 usec for pid 0 (kernel) Jun 3 16:16:39 kernel calcru: runtime went backwards from 82346 usec to 41625 usec for pid 0 (kernel) Jun 3 16:16:39 kernel calcru: runtime went backwards from 1485 usec to 750 usec for pid 0 (kernel) Jun 3 16:16:39 kernel calcru: runtime went backwards from 84669 usec to 42880 usec for pid 0 (kernel) Jun 3 16:16:39 kernel calcru: runtime went backwards from 6796 usec to 3671 usec for pid 1 (init) Jun 3 16:16:39 kernel calcru: runtime went backwards from 6853242 usec to 3469555 usec for pid 1 (init) Jun 3 16:16:39 kernel calcru: runtime went backwards from 6796 usec to 3671 usec for pid 1 (init) Jun 3 16:16:39 kernel calcru: runtime went backwards from 82 usec to 41 usec for pid 12 (intr) Jun 3 16:16:39 kernel calcru: runtime went backwards from 11 usec to 5 usec for pid 12 (intr) Jun 3 16:16:39 kernel calcru: runtime went backwards from 36820 usec to 34598 usec for pid 12 (intr) Jun 3 16:16:39 kernel calcru: runtime went backwards from 59 usec to 30 usec for pid 12 (intr) Jun 3 16:16:39 kernel calcru: runtime went backwards from 154 usec to 78 usec for pid 12 (intr) Jun 3 16:16:39 kernel calcru: runtime went backwards from 385 usec to 194 usec for pid 13 (ng_queue) Jun 3 16:16:39 kernel calcru: runtime went backwards from 383 usec to 193 usec for pid 13 (ng_queue) Jun 3 16:16:39 kernel calcru: runtime went backwards from 17578 usec to 8885 usec for pid 14 (geom) Jun 3 16:16:39 kernel calcru: runtime went backwards from 550 usec to 278 usec for pid 14 (geom) Jun 3 16:16:39 kernel calcru: runtime went backwards from 3095 usec to 1564 usec for pid 14 (geom) Jun 3 16:16:39 kernel calcru: runtime went backwards from 21135 usec to 10683 usec for pid 14 (geom) Jun 3 16:16:39 kernel calcru: runtime went backwards from 5 usec to 2 usec for pid 2 (crypto) Jun 3 16:16:39 kernel calcru: runtime went backwards from 20 usec to 10 usec for pid 3 (crypto returns) Jun 3 16:16:39 kernel calcru: runtime went backwards from 57753 usec to 31872 usec for pid 4 (cam) Jun 3 16:16:39 kernel calcru: runtime went backwards from 218770 usec to 110587 usec for pid 4 (cam) Jun 3 16:16:39 kernel calcru: runtime went backwards from 56005 usec to 30988 usec for pid 4 (cam) Jun 3 16:16:39 kernel calcru: runtime went backwards from 11062 usec to 5802 usec for pid 5 (fdc0) Jun 3 16:16:39 kernel calcru: runtime went backwards from 10212 usec to 5372 usec for pid 5 (fdc0) Jun 3 16:16:39 kernel calcru: runtime went backwards from 69 usec to 34 usec for pid 7 (sctp_iterator) Jun 3 16:16:39 kernel calcru: runtime went backwards from 67 usec to 34 usec for pid 7 (sctp_iterator) Jun 3 16:16:39 kernel calcru: runtime went backwards from 3517 usec to 2973 usec for pid 18 (bufdaemon) Jun 3 16:16:39 kernel calcru: runtime went backwards from 3583 usec to 3143 usec for pid 18 (bufdaemon) Jun 3 16:16:39 kernel calcru: runtime went backwards from 12161 usec to 6753 usec for pid 51 (md0) Jun 3 16:16:39 kernel calcru: runtime went backwards from 12161 usec to 6753 usec for pid 51 (md0) Jun 3 16:16:39 kernel calcru: runtime went backwards from 5454 usec to 4185 usec for pid 264 (php-fpm) Jun 3 16:16:39 kernel calcru: runtime went backwards from 5454 usec to 4185 usec for pid 264 (php-fpm) Jun 3 16:16:39 kernel calcru: runtime went backwards from 252894 usec to 127837 usec for pid 265 (php-fpm) Jun 3 16:16:39 kernel calcru: runtime went backwards from 53632 usec to 27111 usec for pid 265 (php-fpm) Jun 3 16:16:39 kernel calcru: runtime went backwards from 252894 usec to 127837 usec for pid 265 (php-fpm) Jun 3 16:16:39 kernel calcru: runtime went backwards from 282245 usec to 142674 usec for pid 266 (php-fpm) Jun 3 16:16:39 kernel calcru: runtime went backwards from 45968 usec to 23236 usec for pid 266 (php-fpm) Jun 3 16:16:39 kernel calcru: runtime went backwards from 282245 usec to 142674 usec for pid 266 (php-fpm) Jun 3 16:16:39 kernel calcru: runtime went backwards from 4159 usec to 2102 usec for pid 304 (check_reload_status) Jun 3 16:16:39 kernel calcru: runtime went backwards from 4159 usec to 2102 usec for pid 304 (check_reload_status) Jun 3 16:16:39 kernel calcru: runtime went backwards from 416 usec to 210 usec for pid 306 (check_reload_status) Jun 3 16:16:39 kernel calcru: runtime went backwards from 416 usec to 210 usec for pid 306 (check_reload_status) Jun 3 16:16:39 kernel calcru: runtime went backwards from 1818 usec to 936 usec for pid 319 (devd) Jun 3 16:16:39 kernel calcru: runtime went backwards from 7660 usec to 3872 usec for pid 319 (devd) Jun 3 16:16:39 kernel calcru: runtime went backwards from 1818 usec to 936 usec for pid 319 (devd) Jun 3 16:16:39 kernel calcru: runtime went backwards from 3057 usec to 1545 usec for pid 13483 (xinetd) Jun 3 16:16:39 kernel calcru: runtime went backwards from 3057 usec to 1545 usec for pid 13483 (xinetd) Jun 3 16:16:39 kernel calcru: runtime went backwards from 764 usec to 386 usec for pid 16105 (dpinger) Jun 3 16:16:39 kernel calcru: runtime went backwards from 192 usec to 122 usec for pid 16105 (dpinger) Jun 3 16:16:39 kernel calcru: runtime went backwards from 881 usec to 445 usec for pid 21715 (nginx) Jun 3 16:16:39 kernel calcru: runtime went backwards from 881 usec to 445 usec for pid 21715 (nginx) Jun 3 16:16:39 kernel calcru: runtime went backwards from 1200 usec to 606 usec for pid 22211 (nginx) Jun 3 16:16:39 kernel calcru: runtime went backwards from 1200 usec to 606 usec for pid 22211 (nginx) Jun 3 16:16:39 kernel calcru: runtime went backwards from 3416 usec to 1743 usec for pid 22805 (cron) Jun 3 16:16:39 kernel calcru: runtime went backwards from 3416 usec to 1743 usec for pid 22805 (cron) Jun 3 16:16:39 kernel calcru: runtime went backwards from 87019 usec to 53399 usec for pid 24666 (unbound) Jun 3 16:16:39 kernel calcru: runtime went backwards from 87019 usec to 53399 usec for pid 24666 (unbound) Jun 3 16:16:39 kernel calcru: runtime went backwards from 19754 usec to 13232 usec for pid 25260 (ntpd) Jun 3 16:16:39 kernel calcru: runtime went backwards from 2466 usec to 1246 usec for pid 25260 (ntpd) Jun 3 16:16:39 kernel calcru: runtime went backwards from 22221 usec to 14479 usec for pid 25260 (ntpd) Jun 3 16:16:39 kernel calcru: runtime went backwards from 505 usec to 255 usec for pid 29587 (radvd) Jun 3 16:16:39 kernel calcru: runtime went backwards from 505 usec to 255 usec for pid 29587 (radvd) Jun 3 16:16:39 kernel calcru: runtime went backwards from 5218 usec to 3708 usec for pid 80342 (syslogd) Jun 3 16:16:39 kernel calcru: runtime went backwards from 5218 usec to 3708 usec for pid 80342 (syslogd) Jun 3 16:16:39 kernel calcru: runtime went backwards from 337 usec to 170 usec for pid 91641 (minicron) Jun 3 16:16:39 kernel calcru: runtime went backwards from 337 usec to 170 usec for pid 91641 (minicron) Jun 3 16:16:39 kernel calcru: runtime went backwards from 157 usec to 79 usec for pid 91822 (minicron) Jun 3 16:16:39 kernel calcru: runtime went backwards from 157 usec to 79 usec for pid 91822 (minicron) Jun 3 16:16:39 kernel calcru: runtime went backwards from 475 usec to 240 usec for pid 91901 (minicron) Jun 3 16:16:39 kernel calcru: runtime went backwards from 475 usec to 240 usec for pid 91901 (minicron) Jun 3 16:16:39 kernel calcru: runtime went backwards from 171 usec to 86 usec for pid 92257 (minicron) Jun 3 16:16:39 kernel calcru: runtime went backwards from 171 usec to 86 usec for pid 92257 (minicron) Jun 3 16:16:39 kernel calcru: runtime went backwards from 347 usec to 175 usec for pid 92577 (minicron) Jun 3 16:16:39 kernel calcru: runtime went backwards from 347 usec to 175 usec for pid 92577 (minicron) Jun 3 16:16:39 kernel calcru: runtime went backwards from 180 usec to 91 usec for pid 92822 (minicron) Jun 3 16:16:39 kernel calcru: runtime went backwards from 180 usec to 91 usec for pid 92822 (minicron) Jun 3 16:16:39 kernel calcru: runtime went backwards from 16 usec to 8 usec for pid 2772 (filterdns) Jun 3 16:16:39 kernel calcru: runtime went backwards from 1300 usec to 1120 usec for pid 2772 (filterdns) Jun 3 16:16:00 kernel calcru: runtime went backwards from 48232 usec to 24381 usec for pid 267 (php-fpm) Jun 3 16:16:00 kernel calcru: runtime went backwards from 102614 usec to 51882 usec for pid 267 (php-fpm)
Thanks.
Regards
Lingo
Updated by Chris Buechler about 10 years ago
- Status changed from Feedback to Not a Bug
- Affected Version deleted (
2.3.1)
your system clock was well into the future at some point. Disable Hyper-V's time sync to get rid of the runtime went backwards. there's something beyond that wrong with your time on the host or guest as well, not a bug.
Updated by Tom - about 10 years ago
Hyper-V time sync is for pfSense VM disabled.
Hyper-V Server and pfSense are both synced with the same ntp servers.
Until now I could'f found why the calcru error happens.
There are also a lot of information on google with this error, but no solution works for me.
Any idea?
Updated by Chris Buechler about 10 years ago
the "runtime went backwards" is just log spam, but it was annoying me, and I tracked down where it was fixed in newer FreeBSD versions. Merged that fix in #6446 for 2.3.2.
Unrelated to your issue though, which is that the system was running with a date of 04 June 2016 06:44 at some point before 03 June 16:16.
Please post to forum.pfsense.org if you'd like to discuss further.
Actions