Project

General

Profile

Actions

Feature #15548

closed

Add packages for Zabbix 7.0 Agent and Proxy

Added by Andrew Almond 11 months ago. Updated 18 days ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
Zabbix
Target version:
-
Start date:
Due date:
% Done:

0%

Estimated time:
Plus Target Version:

Description

Zabbix 7.0 has been released. https://www.zabbix.com/rn/rn7.0.0

This might be a good opportunity to address the Zabbix log file permission issue as well https://redmine.pfsense.org/issues/13444

Actions #1

Updated by Kris Phillips 11 months ago

  • Status changed from New to Confirmed
  • Plus Target Version set to 24.08

Confirmed not available in 24.03 or 24.08.

Actions #2

Updated by Arvid Johansson 7 months ago

Any update?

Actions #3

Updated by Andrew Almond 7 months ago

Any update on when Zabbix 7.0 packages will be available for 24.03 or 24.08?

Actions #4

Updated by Jim Pingle 7 months ago

  • Plus Target Version changed from 24.08 to 24.11
Actions #5

Updated by Jim Pingle 7 months ago

  • Plus Target Version changed from 24.11 to 25.01
Actions #6

Updated by Maurice Detmers 6 months ago

Can anyone give some insights on why it takes more than half a year to get a new zabbix version in PFSense?
When I take a look at https://redmine.pfsense.org/issues/14101, 6.4 was about 2 months after the release available, and I see some folders in the Development repository of the FreeBSD-Ports already present?
https://github.com/pfsense/FreeBSD-ports/tree/devel/net-mgmt/zabbix7-proxy

Actions #7

Updated by Christian McDonald 6 months ago

  • Status changed from Confirmed to In Progress
  • Assignee set to Christian McDonald
Actions #8

Updated by Pablo Fernando Schutz 6 months ago

Arvid Johansson wrote in #note-2:

Any update?

Any Update?

Actions #9

Updated by Wesley Sena 6 months ago

Andrew Almond wrote:

Zabbix 7.0 has been released. https://www.zabbix.com/rn/rn7.0.0

This might be a good opportunity to address the Zabbix log file permission issue as well https://redmine.pfsense.org/issues/13444

A espectativa é grande, principalmente com o lançamento do Zabbix Cloud, que está gerando uma grande ampliação do consumo da solução de monitoramento. Sou dependente da solução do pfsense para coleta via proxy, devido a complexidade de disponibilizar uma VM ou máquina física para o serviço do zabbix proxy instalado em um sistema operacional dedicado.

Actions #10

Updated by Justin w 6 months ago

Any estimate on when this will be available? We use the proxy on several units, and I really need to get these upgraded.

Actions #11

Updated by Aytek A. 6 months ago

Hello,

Could you please let us know the estimate ?

Thank you

Actions #12

Updated by J R 6 months ago

Hello,

We also would like to know the estimate, this would be really helpful.

Actions #13

Updated by Justin w 5 months ago

Justin w wrote in #note-10:

Any estimate on when this will be available? We use the proxy on several units, and I really need to get these upgraded.

Wow Target date for this basic package of 25.01 and that is into next year. No wonder so many are leaving pfsense.

Actions #14

Updated by Andrew Almond 5 months ago

I spent some time yesterday learning how to build from ports, and I was able to create Zabbix 7.0 proxy and agent binaries using a fully updated FreeBSD 14.2 VM. I didn't use Poudriere jails or anything, just ran

cd /usr/ports/net-mgmt/zabbix7-server/ && make

I copied the binaries to a pfSense 24.11 box for testing and so far they work perfectly.
This is not a proper build and testing process, but it's a good indication that Zabbix 7.0 should work fine on pfSense 24.11.

Actions #15

Updated by Maurice Detmers 5 months ago

Andrew Almond wrote in #note-14:

I spent some time yesterday learning how to build from ports, and I was able to create Zabbix 7.0 proxy and agent binaries using a fully updated FreeBSD 14.2 VM. I didn't use Poudriere jails or anything, just ran
[...]

I copied the binaries to a pfSense 24.11 box for testing and so far they work perfectly.
This is not a proper build and testing process, but it's a good indication that Zabbix 7.0 should work fine on pfSense 24.11.

I was doing the same thing, I noticed that the GUI packages where missing for Zabbix 7, so I went a bit further and created a pull request to add those packages to the devel repository:
https://github.com/pfsense/FreeBSD-ports/pull/1393

Like you, I have compiled this on a FreeBSD 15 system and tested this on a 24.11 PFSense, but without any jails.
  • I copied the devel pfsense/FreeBSD-ports repository in the FreeBSD 15 version
  • Then I made the changes like you can see in the pull request
  • For the proxy I did a "make config" to change the default MySQL to SQLite.
  • Then I did for both zabbix-agent7 and zabbix-proxy7 (and the newly created GUI packages) a:
    make package
    
  • copied the .pkg file from every directory work/pkg/ to my test PFSense and installed it using(change *** with the actual package name):
    pkg add ***.pkg
    
  • Installed every missing dependency before the successful installation.
  • Tested if I could change config files in the PFSense GUI.
Actions #16

Updated by Andrew Almond 5 months ago

@Maurice Detmers - Great work, thanks for submitting the PR!
What steps will be necessary for minor updates of 7.0, such as 7.0.7, 7.0.8 etc?

Actions #17

Updated by Maurice Detmers 5 months ago

Andrew Almond wrote in #note-16:

@Maurice Detmers - Great work, thanks for submitting the PR!
What steps will be necessary for minor updates of 7.0, such as 7.0.7, 7.0.8 etc?

I really don't know what is necessary for the minor updates (I only have submitted a PR for the GUI package, the zabbix package itself is already in the github repository). I think the version should be available in the zabbix repository and then the same changes have to be done in the pfsense/FreeBSD-ports repository like this commit:
https://github.com/pfsense/FreeBSD-ports/commit/2dae84a4699a0fee2902d8c3d1a5feb0c6ae9ef3

Actions #18

Updated by Jim Pingle 5 months ago

  • Status changed from In Progress to Closed
  • Assignee changed from Christian McDonald to Brad Davis
  • Priority changed from Normal-package to Normal
  • Plus Target Version deleted (25.01)

Brad reviewed the PR and said it looked OK, so I merged it and picked it back to 24.11 and CE 2.7.2. Should know shortly if it built OK.

Actions #19

Updated by Jim Pingle 5 months ago

CE 2.7.2 won't work since the ports themselves aren't in that branch of the tree, but 24.11 should work and it's building now.

Actions #20

Updated by Jim Pingle 5 months ago

The packages are now available on 24.11 for anyone who wants to try them.

Actions #21

Updated by Maurice Detmers 5 months ago

Jim Pingle wrote in #note-19:

CE 2.7.2 won't work since the ports themselves aren't in that branch of the tree, but 24.11 should work and it's building now.

For CE 2.7.2, is that the RELENG_2_7_2 branch, may I ask how does that work, can I also submit pull requests on that branch. Or is there another way to get those in there?

Actions #22

Updated by Jim Pingle 5 months ago

Maurice Detmers wrote in #note-21:

Jim Pingle wrote in #note-19:

CE 2.7.2 won't work since the ports themselves aren't in that branch of the tree, but 24.11 should work and it's building now.

For CE 2.7.2, is that the RELENG_2_7_2 branch, may I ask how does that work, can I also submit pull requests on that branch. Or is there another way to get those in there?

Yes, that's the branch, and PRs can be submitted there, but it's the zabbix ports themselves which are not there, not the pfSense package ports for Zabbix.

Actions #23

Updated by Maurice Detmers 5 months ago

Jim Pingle wrote in #note-20:

The packages are now available on 24.11 for anyone who wants to try them.

I have tried it, the agent looks like it works fine, but the proxy was compiled with MySQL instead of SQLite (so I got an error message that the database cannot be connected). I am currently trying to understand how it defaults to MySQL with the build options.

Anyone got any ideas where that could be located?

Actions #24

Updated by Maurice Detmers 5 months ago

Jim Pingle wrote in #note-20:

The packages are now available on 24.11 for anyone who wants to try them.

Is it possible that you build it with the SQLite database option instead of MySQL? When I try to automatically build previous versions, all are default on MySQL. But the production packages are using a SQLite database file as far as I can see.

Actions #25

Updated by Jens Galsgaard 5 months ago

Jim Pingle wrote in #note-20:

The packages are now available on 24.11 for anyone who wants to try them.

I get this in the log:

74409:20241207:155308.919 [Z3001] connection to database '/var/db/zabbix-proxy/proxy.db' failed: [2002] Can't connect to local MySQL server through socket '/tmp/mysql.sock' (2)
74409:20241207:155308.919 database is down: reconnecting in 10 seconds

as other suggests, config file assumes sqlite3

Actions #26

Updated by Maurice Detmers 5 months ago

Jim Pingle wrote in #note-20:

The packages are now available on 24.11 for anyone who wants to try them.

I see there was no force for SQLITE in the PFSense repository, I have created a pull request for that force like there is with Zabbix 6.
For this I created a pull request:
https://github.com/pfsense/pfsense/pull/4719

If this pull request is accepted, does this automatically rebuild the zabbix 7 packages?

Actions #27

Updated by Andrew Almond 5 months ago

PR 4719 isn't listed in https://redmine.pfsense.org/projects/pfsense/issues?query_id=143&sort=updated_on%3Adesc%2Cid%3Adesc
Is it still "active" somewhere now that this issue has been closed?

Actions #28

Updated by Jim Pingle 5 months ago

Andrew Almond wrote in #note-27:

PR 4719 isn't listed in https://redmine.pfsense.org/projects/pfsense/issues?query_id=143&sort=updated_on%3Adesc%2Cid%3Adesc
Is it still "active" somewhere now that this issue has been closed?

That is only relevant if there is a separate redmine just for that PR, and the PR numbers aren't in that list. The PR was linked in the comment above yours.

Actions #29

Updated by Jim Pingle 5 months ago

  • Status changed from Closed to Feedback

I updated the options for Zabbix 7 ports (and cleaned up some older ones), and bumped the package version, it should be rebuilding now with the correct options. Check back in a while and try the new package when it shows up.

Actions #30

Updated by Maurice Detmers 5 months ago

Jim Pingle wrote in #note-29:

I updated the options for Zabbix 7 ports (and cleaned up some older ones), and bumped the package version, it should be rebuilding now with the correct options. Check back in a while and try the new package when it shows up.

Thank you very much, I will test it as soon as I see the updated package.

Actions #31

Updated by Maurice Detmers 5 months ago

Jim Pingle wrote in #note-29:

I updated the options for Zabbix 7 ports (and cleaned up some older ones), and bumped the package version, it should be rebuilding now with the correct options. Check back in a while and try the new package when it shows up.

Could it be that it takes more time for the zabbix7-proxy package, I see the zabbix-proxy7 version 1.0.9_1 in the gui. But I still got the MySQL version of the zabbix proxy when I update it (also with a reinstall of both packages).

Or does the Zabbix7-Proxy (https://github.com/pfsense/FreeBSD-ports/blob/devel/net-mgmt/zabbix7-proxy/Makefile) needs to be bumped up a version to get that one recompiled/rebuild?

Another question, I see that the available version in PFSense is 7.0.4 while the zabbix7 version is allready set to 7.0.6 (https://github.com/pfsense/FreeBSD-ports/blob/devel/net-mgmt/zabbix7-server/Makefile), could this also be a port version bump?

Actions #32

Updated by Jim Pingle 5 months ago

I forgot to pick one commit to a specific branch, but it should be OK now if you uninstall and reinstall that package.

Actions #33

Updated by Maurice Detmers 5 months ago

Jim Pingle wrote in #note-32:

I forgot to pick one commit to a specific branch, but it should be OK now if you uninstall and reinstall that package.

I have now a zabbix7-proxy with a SQLite database file, I will try to fully test the proxy tomorrow. Again, thank you very much :D

May I still ask what the reason is that I see in the github page zabbix revision 7.0.6 (https://github.com/pfsense/FreeBSD-ports/blob/devel/net-mgmt/zabbix7-server/Makefile), but with the installation on pfsense it shows "Package Dependencies: zabbix7-proxy-7.0.4". 

Actions #34

Updated by Jim Pingle 5 months ago

The devel branch is for development snapshots, the 24.11 packages are built from a 24.11 branch (on a different git repo) which is not that far ahead.

If need be we can pick things back on a case-by-case basis but we don't constantly sync up the release branches to the development ports.

Actions #35

Updated by Andrew Almond 4 months ago

Both the agent and proxy are working for me on 24.11 now.

Actions #36

Updated by Maurice Detmers 4 months ago

I can also confirm that this works for me on PFSense 24.11.

For the community edition, is this also automatically picked up, or do I need to make the appropriate changes in a pull request to the RELENG_2_7_2 branch?

Actions #37

Updated by Andrew Almond 4 months ago

Jim Pingle wrote in #note-28:

Andrew Almond wrote in #note-27:

PR 4719 isn't listed in https://redmine.pfsense.org/projects/pfsense/issues?query_id=143&sort=updated_on%3Adesc%2Cid%3Adesc
Is it still "active" somewhere now that this issue has been closed?

That is only relevant if there is a separate redmine just for that PR, and the PR numbers aren't in that list. The PR was linked in the comment above yours.

Thanks for confirming. I wasn't sure if PRs were actively reviewed without an open redmine linked to them.

Actions #38

Updated by Andrew Almond 4 months ago

Maurice Detmers wrote in #note-36:

I can also confirm that this works for me on PFSense 24.11.

For the community edition, is this also automatically picked up, or do I need to make the appropriate changes in a pull request to the RELENG_2_7_2 branch?

Would it be possible to add this for 24.03 as well?

Actions #39

Updated by Kris Phillips 4 months ago

  • Status changed from Feedback to Resolved

Verified version 7 packages are on 24.11. Marking as Resolved.

Actions #40

Updated by steve pretlove 4 months ago

when will this be available on Community Edition ?

Actions #41

Updated by Gio M 4 months ago

Also looking to see this on CE RELENG_2_7_2.

I see here it was added, then removed https://redmine.pfsense.org/projects/pfsense/repository/2/revisions/ec956d343e6cd2db69caa23ba647a19d18fdbc3a

Any reason behind this/when should we expect to see it available on CE? Hoping to be able to set it up asap as zabbix6.4 is fully EOL now.

Actions #42

Updated by Arvid Johansson 4 months ago

Gio M wrote in #note-41:

Also looking to see this on CE RELENG_2_7_2.

I see here it was added, then removed https://redmine.pfsense.org/projects/pfsense/repository/2/revisions/ec956d343e6cd2db69caa23ba647a19d18fdbc3a

Any reason behind this/when should we expect to see it available on CE? Hoping to be able to set it up asap as zabbix6.4 is fully EOL now.

Same here!

Actions #43

Updated by Maurice Detmers 4 months ago

To be clear and if I am correct (please correct me if I am wrong), the Zabbix packages for PFSense are (primarily) community maintained. Which means the community should provide the appropriate pull requests for the packages to become available in the repository.

For me it was a learning curve to get to know the flow. Still figuring things out, but I do not know when exactly I have time to figure out how to copy the same stuff from the 24.11 to the 2_7_2 release.(I do not want to forget some stuff)

So if you want a quick solution, dive into the world of compiling on FreeBSD and submitting pull request in the PFSense repository :)

Actions #44

Updated by Gio M 4 months ago

Maurice Detmers wrote in #note-43:

To be clear and if I am correct (please correct me if I am wrong), the Zabbix packages for PFSense are (primarily) community maintained. Which means the community should provide the appropriate pull requests for the packages to become available in the repository.

For me it was a learning curve to get to know the flow. Still figuring things out, but I do not know when exactly I have time to figure out how to copy the same stuff from the 24.11 to the 2_7_2 release.(I do not want to forget some stuff)

So if you want a quick solution, dive into the world of compiling on FreeBSD and submitting pull request in the PFSense repository :)

Not sure if I am looking in the wrong place, but from what I could see, it appears that it is already in the packages repo..

Perhaps someone could shed some light about how exactly we go about getting zabbix 7 into the package manager on CE?

Actions #45

Updated by Jim Pingle 4 months ago

The GUI packages were picked back there but failed to build because the actual underlying Zabbix 7 ports are not in the CE ports repo. But it's not always as simple as picking those changes back, too, since there could be other dependencies that need to come with them and so on. If the ports tree in general has changed too much, it may not be viable to bring the other changes it needs back to 2.7.2. It needs someone much more familiar with the ports tree internals to check into it, try to build it, etc.

Actions #46

Updated by Maurice Detmers 3 months ago

Jim Pingle wrote in #note-45:

The GUI packages were picked back there but failed to build because the actual underlying Zabbix 7 ports are not in the CE ports repo. But it's not always as simple as picking those changes back, too, since there could be other dependencies that need to come with them and so on. If the ports tree in general has changed too much, it may not be viable to bring the other changes it needs back to 2.7.2. It needs someone much more familiar with the ports tree internals to check into it, try to build it, etc.

I have tried to compare/merge the zabbix changes in the devel branch with the RELENG_2_7_2 branch in my own fork. Then compile the versions 5,6,7, but the proxy won't start and the pfsense agent package 6 and 7 seems to want to install the zabbix agent 5, while in the pfsense zabbix package the versions are good, 6 with 6 and 7 with 7. A bit strange what happens, could this be just a error in the machine I use to compile? If anyone want's to try and compile and test them. This is the commit in my fork:
https://github.com/Maurice-De/FreeBSD-ports/commit/68e71c44898c7d383f463399bbd01d11c0a3cc0a

The fork:
https://github.com/Maurice-De/FreeBSD-ports/tree/RELENG_2_7_2

Actions #47

Updated by Steve Scotter 2 months ago

Hi,

I don't understand why this is closed if packages still aren't available for CE 2.7.2?

Zabbix 6 LTS goes EOL on 28th Feb (https://www.zabbix.com/life_cycle_and_release_policy) so I've upgraded my Zabbix server and then discovered that there's no 7.0 proxy available for pfSense.

I'm now left in a situation when I've lost performance and availability monitoring for all my assets before several pfsense hosts.

I find myself having to consider either
  • Switching all my pfsense firewalls to opnsense
  • Deploying a custom Linux VM dedicated to the task of being a zabbix proxy.

Neither option is attractive or quick.

Actions #48

Updated by Alex Diamantopulo 20 days ago

Any updates on this? Is there anything we can do to get Zabbix 7 proxy package in CE?

Actions #49

Updated by Alex Diamantopulo 18 days ago

This should not be marked as resolved, the package is not in CE...
Please fix this.

Actions

Also available in: Atom PDF