Bug #13206
openSG-3100 LED GPIO hangs
0%
Description
Hi,
https://forum.netgate.com/topic/165566/number-of-running-processes-increasing
We seem to be experiencing the same issue linked above with our SG-3100 pfSenses. I haven't been able to find any other threads relating to this issue, or patch notes to suggest this has been fixed in a later version.
We upgraded all of our SG-3100s to version 21.05.2 back at the start of January and since then, 8/11 of our SG-3100s have experienced this issue as of today.
We haven't been able to identify any obvious symptoms or causes prior to when the processes increasing, which seem to be occurring at random times.
Similar to the thread linked above, multiple instances of the processes below were running and continuously increasing over time.
/bin/sh /usr/local/sbin/pfSense-led.sh update
/usr/sbin/gpioctl -f /dev/gpioc2 3 duty 150
/bin/sh /etc/rc.update_pkg_metadata
Performing a clean reboot of the pfSense seems to have resolved the issue and the processes on the affected pfSenses have not started climbing since. However, one of the pfSenses which had not experienced climbing processes but did receive a clean reboot recently had the following processes start climbing, which required a second clean reboot to resolve.
Has anyone come across this issue before or have any evidence to suggest this has been fixed in a later release? I have been unable to identify any fixes in the 22.01 and 22.05 release notes to suggest this issue has been resolved.
https://docs.netgate.com/pfsense/en/latest/releases/22-01_2-6-0.html
https://docs.netgate.com/pfsense/en/latest/releases/22-05.html
Thanks
Files
Updated by Jim Pingle over 2 years ago
- Project changed from pfSense to pfSense Plus
- Subject changed from Number of running processes increasing on SG-3100 to SG-3100 LED GPIO hangs
- Category changed from Hardware / Drivers to Hardware / Drivers
- Affected Version deleted (
2.1.5)
We're already tracking this internally (NG 5882) but have yet to reliably reproduce it. We've only encountered it a very small number of times and without any reproducible circumstances it's difficult to speculate about what might be causing it to happen.
What appears to happen is that the LED GPIO hangs and so the commands to control the LEDs never complete. In some cases this can prevent the system from booting completely, in your case it appears to be getting hung up when checking for updates. Typically the only way to resolve it is to halt the system and remove/reapply power to reset the hardware (reboot isn't sufficient).
Updated by Daniel Subert over 2 years ago
Hi Jim,
Thanks for the update.
As this issue is already being tracked internally, would you happen to know if this issue has been identified to occur on releases 22.01 or 22.05?
We were looking at updating our pfSenses if there was sufficient evidence to suggest the issue has been resolved in later releases but if this is not the case we'll continue to monitor the processes until a fix is released.
I'll update the thread if the issue occurs again.
Thanks
Updated by Kris Phillips over 2 years ago
Daniel Subert wrote in #note-2:
Hi Jim,
Thanks for the update.
As this issue is already being tracked internally, would you happen to know if this issue has been identified to occur on releases 22.01 or 22.05?
We were looking at updating our pfSenses if there was sufficient evidence to suggest the issue has been resolved in later releases but if this is not the case we'll continue to monitor the processes until a fix is released.
I'll update the thread if the issue occurs again.
Thanks
Daniel,
The internal bug report does not have information stating it is fixed or otherwise in 22.05. If you would be able to test and see if the issue is resolved there, I will update the internal bug report. Since you are able to reproduce the issue, it would be most helpful and we would greatly appreciate it.
Updated by Kris Phillips about 2 years ago
Hello Daniel,
Is this issue still present for you on 22.05?
Updated by Graham Collinson about 2 years ago
I can confirm it's happening for me on a 22.01 3100 firewall.
I haven't seen it yet on other firewalls that have been updated to 22.05.
Updated by Kris Phillips almost 2 years ago
Graham Collinson wrote in #note-5:
I can confirm it's happening for me on a 22.01 3100 firewall.
I haven't seen it yet on other firewalls that have been updated to 22.05.
Hello Graham,
Thank you for the update. Please let us know if you see the issue crop up on 22.05/23.01.
Updated by Jonathan Lee 11 months ago
Have you attempted to just manually set the GPIO settings with a cron job to a different color? Would that help or make it worse?
Check out this forked GitHub the script has all the commands to run manually to try to hard set the LED to any color you want. Or use the main version for just a solid color
https://github.com/JonathanDLee24/Netgate-SG2100-scripts //script based on pfctl -vvss
states
https://github.com/luckman212/Netgate-SG2100-scripts //script has solid LEDs no pfctl
states used
Also a great reference to this
https://www.zacharyschneider.ca/2019/12/customizing-leds-netgate-sg-3100/