Project

General

Profile

Actions
Copy link

Bug #13206

open

SG-3100 LED GPIO hangs

Added by Daniel Subert almost 2 years ago. Updated 4 months ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
Hardware / Drivers
Target version:
-
Start date:
Due date:
% Done:

0%

Estimated time:
Release Notes:
Default
Affected Plus Version:
Affected Architecture:
SG-3100

Description

Hi,

https://forum.netgate.com/topic/165566/number-of-running-processes-increasing

We seem to be experiencing the same issue linked above with our SG-3100 pfSenses. I haven't been able to find any other threads relating to this issue, or patch notes to suggest this has been fixed in a later version.

We upgraded all of our SG-3100s to version 21.05.2 back at the start of January and since then, 8/11 of our SG-3100s have experienced this issue as of today.

We haven't been able to identify any obvious symptoms or causes prior to when the processes increasing, which seem to be occurring at random times.

Similar to the thread linked above, multiple instances of the processes below were running and continuously increasing over time.

/bin/sh /usr/local/sbin/pfSense-led.sh update
/usr/sbin/gpioctl -f /dev/gpioc2 3 duty 150
/bin/sh /etc/rc.update_pkg_metadata

Performing a clean reboot of the pfSense seems to have resolved the issue and the processes on the affected pfSenses have not started climbing since. However, one of the pfSenses which had not experienced climbing processes but did receive a clean reboot recently had the following processes start climbing, which required a second clean reboot to resolve.

Has anyone come across this issue before or have any evidence to suggest this has been fixed in a later release? I have been unable to identify any fixes in the 22.01 and 22.05 release notes to suggest this issue has been resolved.

https://docs.netgate.com/pfsense/en/latest/releases/22-01_2-6-0.html
https://docs.netgate.com/pfsense/en/latest/releases/22-05.html

Thanks


Files

Download all files
SI4XeTCSiu.png (184 KB) SI4XeTCSiu.png Daniel Subert, 05/24/2022 12:49 AM
SI4XeTCSit.png (57.9 KB) SI4XeTCSit.png Daniel Subert, 05/24/2022 12:49 AM
IMG_20231214_162428521.jpg (290 KB) IMG_20231214_162428521.jpg Custom LEDs set with GPIO Jonathan Lee, 12/20/2023 04:11 AM
Actions
Copy link
 #1

Updated by Jim Pingle almost 2 years ago

  • Project changed from pfSense to pfSense Plus
  • Subject changed from Number of running processes increasing on SG-3100 to SG-3100 LED GPIO hangs
  • Category changed from Hardware / Drivers to Hardware / Drivers
  • Affected Version deleted (2.1.5)

We're already tracking this internally (NG 5882) but have yet to reliably reproduce it. We've only encountered it a very small number of times and without any reproducible circumstances it's difficult to speculate about what might be causing it to happen.

What appears to happen is that the LED GPIO hangs and so the commands to control the LEDs never complete. In some cases this can prevent the system from booting completely, in your case it appears to be getting hung up when checking for updates. Typically the only way to resolve it is to halt the system and remove/reapply power to reset the hardware (reboot isn't sufficient).

Actions
Copy link
 #2

Updated by Daniel Subert almost 2 years ago

Hi Jim,

Thanks for the update.

As this issue is already being tracked internally, would you happen to know if this issue has been identified to occur on releases 22.01 or 22.05?

We were looking at updating our pfSenses if there was sufficient evidence to suggest the issue has been resolved in later releases but if this is not the case we'll continue to monitor the processes until a fix is released.

I'll update the thread if the issue occurs again.

Thanks

Actions
Copy link
 #3

Updated by Kris Phillips almost 2 years ago

Daniel Subert wrote in #note-2:

Hi Jim,

Thanks for the update.

As this issue is already being tracked internally, would you happen to know if this issue has been identified to occur on releases 22.01 or 22.05?

We were looking at updating our pfSenses if there was sufficient evidence to suggest the issue has been resolved in later releases but if this is not the case we'll continue to monitor the processes until a fix is released.

I'll update the thread if the issue occurs again.

Thanks

Daniel,

The internal bug report does not have information stating it is fixed or otherwise in 22.05. If you would be able to test and see if the issue is resolved there, I will update the internal bug report. Since you are able to reproduce the issue, it would be most helpful and we would greatly appreciate it.

Actions
Copy link
 #4

Updated by Kris Phillips over 1 year ago

Hello Daniel,

Is this issue still present for you on 22.05?

Actions
Copy link
 #5

Updated by Graham Collinson over 1 year ago

I can confirm it's happening for me on a 22.01 3100 firewall.
I haven't seen it yet on other firewalls that have been updated to 22.05.

Actions
Copy link
 #6

Updated by Kris Phillips over 1 year ago

Graham Collinson wrote in #note-5:

I can confirm it's happening for me on a 22.01 3100 firewall.
I haven't seen it yet on other firewalls that have been updated to 22.05.

Hello Graham,

Thank you for the update. Please let us know if you see the issue crop up on 22.05/23.01.

Actions
Copy link
 #7

Updated by Jonathan Lee 4 months ago

Have you attempted to just manually set the GPIO settings with a cron job to a different color? Would that help or make it worse?

Check out this forked GitHub the script has all the commands to run manually to try to hard set the LED to any color you want. Or use the main version for just a solid color

https://github.com/JonathanDLee24/Netgate-SG2100-scripts //script based on pfctl -vvss states
https://github.com/luckman212/Netgate-SG2100-scripts //script has solid LEDs no pfctl states used

Also a great reference to this
https://www.zacharyschneider.ca/2019/12/customizing-leds-netgate-sg-3100/

Actions
Copy link

Also available in: Atom PDF