Project

General

Profile

Todo #5553

Suggestion: higher default MBUF values

Added by Eduard Rozenberg over 3 years ago. Updated 7 days ago.

Status:
Resolved
Priority:
Normal
Assignee:
-
Category:
Operating System
Target version:
-
Start date:
11/30/2015
Due date:
% Done:

0%

Estimated time:

Description

At our main location we recently hit 100% MBUF usage of the default 26584, on our firewall master. The backup firewall was at 60%.

I increased the value to 1,000,000 based on advice from the tuning page for 64bit multi-GB systems:
https://doc.pfsense.org/index.php/Tuning_and_Troubleshooting_Network_Cards#mbuf_.2F_nmbclusters

Suggestions:
  • Even for 32 bit systems seems to make sense to have a higher default value shipped out-of-the-box
  • If installer detects a 64-bit system with decent RAM, installer should set a higher value for this tunable

History

#1 Updated by Eduard Rozenberg over 3 years ago

Suggestion is especially important for Intel igb/em cards (as we have on our firewalls) based on the advice further down that same tuning link.

Recently we had some interfaces go down for no obvious reason and restarted by apinger on the firewall that was at 100% MBUF's used. Maybe exhaustion of MBUF's was involved, who knows.

"Intel igb(4) and em(4) Cards

Certain intel igb cards, especially multi-port cards, can very easily exhaust mbufs and cause kernel panics, especially on amd64. The following tweak will prevent this from being an issue:
In /boot/loader.conf.local - Add the following (or create the file if it does not exist):
kern.ipc.nmbclusters="1000000"
That will increase the amount of network memory buffers, allowing the driver enough headroom for its optimal operation."

#2 Updated by Jim Pingle 7 days ago

  • Category set to Operating System
  • Status changed from New to Resolved

This has been in place for some time now for hardware we can predict. The OS is a bit smarter in other situations as well. There may be some edge cases where users need to adjust manually but I don't think we'll ever eliminate all of those.

Also available in: Atom PDF