Plugin Multi-Pollerserver (Cacticluster) 0.2.2b [closed]

[optimuscream]

Hi André / der_doc
I have a running cacticluster working well.
Only one issue left. How's the backup poller mechanism work ?
I deliberately disable one of the poller , but the backup poller did not take over the polling process automatically. Should it take over the polling from failed poller automatically ?

Appreciate for any explanation.

Thanks.

[npeltier]

Hi der_doc,

Can you explain how to set up cacti with your plugin ?
What needs to be patched (for the last stable versions of cacti and spine) and configured on both servers ?

Thanks

NP

[aleyx1979]

Hi der_doc,
thx for your great work.
The Master-MultiWorkers model can improve the performance of cacti greatly, but I have another question :
if the cluster have 10+ thousands of rrd file that should be written into disk (local physical disk or remote file system such as NFS) in a very short period, the disk IO bottleneck would be a big problem.
Is it possible to changing your model to another structure below?

• 1. the workers gather a certain group of devices' info and modify/append their rrd files in local disk.
• 2. each worker is a NFS server and export their rrd files dir to master.
• 3. the master create mount points that mapping every worker's local rrdDir and read the remote rrd files for displaying & reporting.

Code: Select all

                                                                     Master
                                                                        |_____/usr/local/rrd_root
worker/poller a                                                                             |
       |_______/usr/local/poller_a/   ---------------mount------------- ./poller_a/ ________|
worker/poller b                                                                             |
       |_______/usr/local/poller_b/   ---------------mount------------- ./poller_b/ ________|
worker/poller c                                                                             |
       |_______/usr/local/poller_c/   ---------------mount------------- ./poller_c/ ________|

In my opinion, I must do some work after the event of binding host to poller in your project, such as changing the rrd file path just like cli/structure_rra_paths.php doing.
I am a newbie of cacti and I am not sure if the WriteLocal-ReadRemote model would work or not.

Any suggestions?
thx & regards

[phil25ls]

Hi,

i have a problem with install plugin multipoller 0.2.2b, my install is a install from scratch and i have the following message in cacti.log

extract of cacti.log : "The Plugin Multi-Pollerserver notifies the backup of patching files not done"

and it's impossible to create a pollerserver.

I tested install with plugins 0.2.21 and i have an other error

"3/04/2014 04:06:44 PM - POLLER: Poller[0] ERROR: The Plugin Multi-Pollerserver notifies one or more errors at updateprocess."

patching file poller.php
Reversed (or previously applied) patch detected! Skipping patch.
13 out of 13 hunks ignored -- saving rejects to file poller.php.rej

is it necessary to install previous version ? 0.2.21 => 0.2.22 => 0.2.2a

Thank for help

my configuration

rhel 6.5
cacti 0.8.8a
spine 0.8.8a
php 5.3.3-27

[phil25ls]

after investigation, I noticed that the problem was present in some version of PHP 5.3, in my case with the 5.3.3-27 release.

I downgraded my version of php to release 5.3.3-3.

best regards

[der_doc]

Hi all,

sorry that i not answerd of your posts. It will be better, pleace fogive.
So i will begin to answer your questions.

@optimuscream
http://forums.cacti.net/viewtopic.php?p=245710#p245710

In all my tests this feature work perfectly.
You must shout down one of the poller, than work the bachupfunktion. Every Backuppoller looke at his poller how is registerd als poller to backup and takes over his work if the last pollertime of his server is greather than 5min.

@npeltier
http://forums.cacti.net/viewtopic.php?p=245769#p245769

On my webpage it gives an doku, he is on german. sorry. On the feature site on the page is a picturegallery of an installation.
http://www.cacti-multipollerserver.de/i ... tures.html

I work on an doku of the installation. The big problem is my english. ;-( but if the request is sooo big the i will do my very best.

@aleyx1979
http://forums.cacti.net/viewtopic.php?p=248017#p248017
The ground idea is that not the master hold the rrd-files. The rrd files scheduled be saved at a NAS System and the NAS system mount via NFS Mountpoints on the client system.
If you will work with this structuremode all rrd files must be copyed to the other ordner if you push the device to another pollerserver. You now what i mean?

@all
I will have a look at the php version. One of the useed functions are not supported. I will fined them and make it futer-proofed.

Thank at all peaople how use the plugin.

MfG
André

[marthin]

Hi der_doc,

We are looking forward to deploy this however have run into issues when installing straight to 0.8.8b:

• -The plugin does not initialise, it get's stuck and report that it is 'Awaiting Upgrade'.
  -Getting SQL error 1091 when creating tables.

Is installing to 0.8.8b supported?

thanks for clarifying

rgds
Marthin

[der_doc]

Hi Marthin

yes cacti 0.8.8b is supported.
My testinstall is with teh reposetory form ubuntu server 12.04.
All versions of php and mysql from this reposetory are work fine.

please post the technical details from your cacti instalation.
NOTE i also tested on ubuntu! I now from some installations on Red Heat. In this winter i will update so that the plugin will run unter Red Heat.

mfg
der_doc

[Pollay]

Hey der_doc, same problem as Marthin. Just used two different fresh installs I created yesterday, using 64 Bit Ubuntu Server 14.04. Only things I added to the server on the install were LAMP, OpenSSH, and Samba. I applied all system updates and fresh kernels, then installed Cacti-Spine from Ubuntu repositories. Only addon I put in was the multipollerserver. End result is the same as Marthin: "The plugin does not initialise, it get's stuck and report that it is 'Awaiting Upgrade'."

I haven't been able to do much troubleshooting on what the issue is, but any insight you've found would be appreciated.

Thanks.

[der_doc]

Hi Pollay,

ok i will have a look and fix the problen soon as posible.
Sorry for the trouble.

mfg
Der_Doc

[Pollay]

Ok, sat down and did some troubleshooting.

In setup.php I set the version in line 43 to '0.2.2b' (was 0.2.2.a), deleted the entry for multipollerserver from the plugin_config table and was able to install and enable the plugin properly.

[marthin]

hi Pollay,

thanks for the hint! it worked as expected.

@der_doc,

I am now faced with the configuration of the plugin. Have been searching the docs and Google and could not find info relating to this error/step that I seeing.

When adding a poller server via the console menu of the plugin I get a 'Save Failed' with a SQL error produced in the logs. I have applied ALL the patches in the patches directory, not sure if that is correct but it is how I interpreted the instructions.

Here is the error:

Code: Select all

CMDPHP: Poller[0] ERROR: SQL Save Command Failed for Table 'poller_server'.  Error was 'Unknown column 'backup_poller_id' in 'field list''

when searching poller_server table this column does not appear (backup_poller_id):

Code: Select all

mysql> select * from poller_server;
+----+-----------+-----------+----------------+--------------+--------+---------------------+-------------+-----------+--------------+--------------+
| id | name      | hostname  | poller_lastrun | stats_poller | aktive | availability_method | ping_method | ping_port | ping_timeout | ping_retries |
+----+-----------+-----------+----------------+--------------+--------+---------------------+-------------+-----------+--------------+--------------+
|  2 | localhost | 127.0.0.1 |              0 | 0            | on     |                   3 |           1 |     33439 |          500 |            2 |
+----+-----------+-----------+----------------+--------------+--------+---------------------+-------------+-----------+--------------+--------------+
1 row in set (0.00 sec)

I have tried adding a poller server with and without a backup poller, however the results are the same.

Your assistance would be appreciated.

Many thanks
Marthin

[Pollay]

The problem with my suggestion is that there are a bunch of upgrade scripts that need to be parsed in that don't get parsed if following my advice.

[fbor]

Hello Pollay
I encounter the same problem but my only log.


[Mon Nov 10 12:42:25 2014] [error] [client 192.168.10.50] PHP Notice: Use of undefined constant \xe2\x80\x98weathermap\xe2\x80\x99 - assumed '\xe2\x80\x98weathermap\xe2\x80\x99' in /var/www/cacti/include/config.php on line 35, referer: http://192.168.10.56/cacti/plugins/mult ... ice_choose
[Mon Nov 10 12:42:26 2014] [error] [client 192.168.10.50] PHP Notice: Undefined index: multipollerserver.php:actions in /var/www/cacti/lib/functions.php on line 1830, referer: http://192.168.10.56/cacti/plugins/mult ... ice_choose
[Mon Nov 10 12:42:26 2014] [error] [client 192.168.10.50] PHP Notice: Undefined index: multipollerserver.php:actions in /var/www/cacti/lib/functions.php on line 1830, referer: http://192.168.10.56/cacti/plugins/mult ... ice_choose
[Mon Nov 10 12:42:26 2014] [error] [client 192.168.10.50] PHP Fatal error: Call to undefined function template_remove() in /var/www/cacti/plugins/multipollerserver/multipollerserver.php on line 68, referer: http://192.168.10.56/cacti/plugins/mult ... ice_choose


Mon Nov 10 12:44:54 2014] [error] [client 192.168.10.50] PHP Notice: Use of undefined constant \xe2\x80\x98weathermap\xe2\x80\x99 - assumed '\xe2\x80\x98weathermap\xe2\x80\x99' in /var/www/cacti/include/config.php on line 35, referer: http://192.168.10.56/cacti/plugins/mult ... ice_choose
[Mon Nov 10 12:44:54 2014] [error] [client 192.168.10.50] PHP Notice: Use of undefined constant \xe2\x80\x98weathermap\xe2\x80\x99 - assumed '\xe2\x80\x98weathermap\xe2\x80\x99' in /var/www/cacti/include/config.php on line 35, referer: http://192.168.10.56/cacti/plugins/mult ... ice_choose
[Mon Nov 10 12:44:54 2014] [error] [client 192.168.10.50] PHP Notice: Undefined index: multipollerserver.php: in /var/www/cacti/lib/functions.php on line 1830, referer: http://192.168.10.56/cacti/plugins/mult ... ice_choose
[Mon Nov 10 12:44:54 2014] [error] [client 192.168.10.50] PHP Notice: Undefined index: multipollerserver.php: in /var/www/cacti/lib/functions.php on line 1830, referer: http://192.168.10.56/cacti/plugins/mult ... ice_choose


[Mon Nov 10 12:45:28 2014] [error] [client 192.168.10.50] PHP Notice: Use of undefined constant \xe2\x80\x98weathermap\xe2\x80\x99 - assumed '\xe2\x80\x98weathermap\xe2\x80\x99' in /var/www/cacti/include/config.php on line 35, referer: http://192.168.10.56/cacti/plugins/mult ... server.php
[Mon Nov 10 12:45:28 2014] [error] [client 192.168.10.50] PHP Notice: Undefined index: multipollerserver.php:template_edit in /var/www/cacti/lib/functions.php on line 1830, referer: http://192.168.10.56/cacti/plugins/mult ... server.php
[Mon Nov 10 12:45:28 2014] [error] [client 192.168.10.50] PHP Notice: Undefined index: multipollerserver.php:template_edit in /var/www/cacti/lib/functions.php on line 1830, referer: http://192.168.10.56/cacti/plugins/mult ... server.php
[Mon Nov 10 12:45:28 2014] [error] [client 192.168.10.50] PHP Notice: Undefined index: id in /var/www/cacti/plugins/multipollerserver/multipollerserver.php on line 292, referer: http://192.168.10.56/cacti/plugins/mult ... server.php
[Mon Nov 10 12:45:28 2014] [error] [client 192.168.10.50] PHP Notice: Undefined index: name in /var/www/cacti/plugins/multipollerserver/multipollerserver.php on line 383, referer: http://192.168.10.56/cacti/plugins/mult ... server.php
[Mon Nov 10 12:45:28 2014] [error] [client 192.168.10.50] PHP Notice: Undefined index: hostname in /var/www/cacti/plugins/multipollerserver/multipollerserver.php on line 390, referer: http://192.168.10.56/cacti/plugins/mult ... server.php
[Mon Nov 10 12:45:28 2014] [error] [client 192.168.10.50] PHP Notice: Undefined index: backup_poller_id in /var/www/cacti/plugins/multipollerserver/multipollerserver.php on line 397, referer: http://192.168.10.56/cacti/plugins/mult ... server.php
[Mon Nov 10 12:45:28 2014] [error] [client 192.168.10.50] PHP Notice: Undefined index: name in /var/www/cacti/plugins/multipollerserver/multipollerserver.php on line 399, referer: http://192.168.10.56/cacti/plugins/mult ... server.php
[Mon Nov 10 12:45:28 2014] [error] [client 192.168.10.50] PHP Notice: Undefined index: aktive in /var/www/cacti/plugins/multipollerserver/multipollerserver.php on line 406, referer: http://192.168.10.56/cacti/plugins/mult ... server.php
[Mon Nov 10 12:45:28 2014] [error] [client 192.168.10.50] PHP Notice: Undefined index: availability_method in /var/www/cacti/plugins/multipollerserver/multipollerserver.php on line 417, referer: http://192.168.10.56/cacti/plugins/mult ... server.php
[Mon Nov 10 12:45:28 2014] [error] [client 192.168.10.50] PHP Notice: Undefined index: id in /var/www/cacti/plugins/multipollerserver/multipollerserver.php on line 450, referer: http://192.168.10.56/cacti/plugins/mult ... server.php
[Mon Nov 10 12:45:28 2014] [error] [client 192.168.10.50] PHP Notice: Undefined index: id in /var/www/cacti/plugins/multipollerserver/multipollerserver.php on line 454, referer: http://192.168.10.56/cacti/plugins/mult ... server.php


[Mon Nov 10 12:46:42 2014] [error] [client 192.168.10.50] PHP Notice: Use of undefined constant \xe2\x80\x98weathermap\xe2\x80\x99 - assumed '\xe2\x80\x98weathermap\xe2\x80\x99' in /var/www/cacti/include/config.php on line 35, referer: http://192.168.10.56/cacti/plugins/mult ... plate_edit
[Mon Nov 10 12:46:43 2014] [error] [client 192.168.10.50] PHP Notice: Undefined index: ping_timeout in /var/www/cacti/plugins/multipollerserver/multipollerserver.php on line 115, referer: http://192.168.10.56/cacti/plugins/mult ... plate_edit
[Mon Nov 10 12:46:43 2014] [error] [client 192.168.10.50] PHP Notice: Undefined variable: pollerserver_id in /var/www/cacti/plugins/multipollerserver/multipollerserver.php on line 124, referer: http://192.168.10.56/cacti/plugins/mult ... plate_edit
[Mon Nov 10 12:46:43 2014] [error] [client 192.168.10.50] PHP Notice: Use of undefined constant \xe2\x80\x98weathermap\xe2\x80\x99 - assumed '\xe2\x80\x98weathermap\xe2\x80\x99' in /var/www/cacti/include/config.php on line 35, referer: http://192.168.10.56/cacti/plugins/mult ... plate_edit
[Mon Nov 10 12:46:43 2014] [error] [client 192.168.10.50] PHP Notice: Undefined index: multipollerserver.php:template_edit in /var/www/cacti/lib/functions.php on line 1830, referer: http://192.168.10.56/cacti/plugins/mult ... plate_edit
[Mon Nov 10 12:46:43 2014] [error] [client 192.168.10.50] PHP Notice: Undefined index: multipollerserver.php:template_edit in /var/www/cacti/lib/functions.php on line 1830, referer: http://192.168.10.56/cacti/plugins/mult ... plate_edit
[Mon Nov 10 12:46:43 2014] [error] [client 192.168.10.50] PHP Notice: Undefined index: backup_poller_id in /var/www/cacti/plugins/multipollerserver/multipollerserver.php on line 397, referer: http://192.168.10.56/cacti/plugins/mult ... plate_edit
[Mon Nov 10 12:46:43 2014] [error] [client 192.168.10.50] PHP Notice: Undefined index: name in /var/www/cacti/plugins/multipollerserver/multipollerserver.php on line 399, referer: http://192.168.10.56/cacti/plugins/mult ... plate_edit
[Mon Nov 10 12:46:43 2014] [error] [client 192.168.10.50] PHP Notice: Undefined index: aktive in /var/www/cacti/plugins/multipollerserver/multipollerserver.php on line 406, referer: http://192.168.10.56/cacti/plugins/mult ... plate_edit
[Mon Nov 10 12:46:43 2014] [error] [client 192.168.10.50] PHP Notice: Undefined index: availability_method in /var/www/cacti/plugins/multipollerserver/multipollerserver.php on line 417, referer: http://192.168.10.56/cacti/plugins/mult ... plate_edit

[marthin]

Thanks Pollay, Have worked through the upgrade scripts and manually run the db_execute functions in the php there.

What I am now sitting with is to try and understand the overall installation and config of the plugin. Have gone through the install doc and graphics may thirty times but the penny has not dropped ... yet.

Please if it can be explained the procedure to install the plugin from a NFS/MySQL/Cacti files perspective it would really be great. Nothing too verbose, just to colour the picture a bit more would help a lot.

Specifically what I would like to understand:

• 1. What files should be shared on the master server and where should it be mounted on the (slave) poller servers?
  2. How would the poller servers connect to the master server database? Make a connection to the master MySQL via the 'include/config.php' or via the spine.conf? or both?
  3. How do you enable the master server for polling?
  4. Is it needed to install the plugin in the (slave) poller servers? or only the master?

Please excuse if the questions seem basic, I truly have been struggling with some of the details.

many thanks
Marthin