Bug #9968
closedConfiguration of assigned interfaces is deployed to unassigned ones
0%
Description
Background:
We are running pfSense virtualized on VMware vSphere platform with 10 vmxnet3 NICs (vmx0-vmx9), hardware version 13, using it as a router for multiple networks. We have decided to move few of the networks to different router, so I've removed configuration for corresponding interfaces on pfSense and unassigned them, basically removing all configuration from them, and I've also disconnected the networks from those interfaces.
Interfaces vmx0, vmx3, vmx4, vmx7 and vmx6 were left untouched.
Interfaces vmx1, vmx2, vmx5, vmx8 and vmx9 had their configuration removed, were unassigned, disabled and had no network connected to them.
Description of the bug:
After the aforementioned change, the routing on pfSense got completely mismatched.
Here are screenshots of interface config and routing table:
As you can see, for example, destination of 10.225.0.0/24 should have netif value of vmx3, but has value of vmx1. Destination of 10.225.1.0/24 should have netif value of vmx6, but has value of vmx2 and so on.
At this point, I've tried to assign the interfaces (thinking that maybe their unassigned status is the problem) and leave them disabled with no configuration whatsoever. This helped until I did another reboot.
Routing situation remained the same, but it's cause was revealed:
Here you can see that configuration of vmx4 was deployed to vmx4 and vmx5, but vmx5 has no configuration and is disabled. Same for vmx3 etc.
One more evidence of this is here:
Here you can see that vmx2 and vmx6 has duplicate configuration, but vmx2 is not enabled in GUI, has ip config set to "none" and has status "no carrier", because there isn't a network connected to it.
I've discovered that the only thing that helps and persists through reboots is enabling those interfaces, even without any configuration.
How to reproduce the bug
I can repeat the same issue on fresh installation with 10 NICs. However, if I only add 4 NICs (2 assigned and configured, 2 unassigned), everything is working as expected.
So basically:
1) Install a pfSense machine on VMware vSphere platform
2) Configure 10 NICs to it, only assign and configure 5. Leave the rest unassigned and disabled with no connected network.
3) Reboot
Files