Boost 1.7 and cacti 0.8.7b issues

gninja · Post by **gninja** » Wed May 28, 2008 8:11 pm

Seeing these error messages whenever I hit a graph. Boost server is disabled, on demand update is enabled.

 05/28/2008 06:08:03 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed!, Error:'1064', SQL:"select realm_id from user_auth_realm where user_id= and realm_id=227"
05/28/2008 06:08:03 PM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1050', SQL:"CREATE TEMPORARY TABLE `rcaston` (  `local_data_id` mediumint(8) unsigned NOT NULL default '0',  `rrd_name` varchar(19) NOT NULL default '',  `time` datetime NOT NULL default '0000-00-00 00:00:00',  PRIMARY KEY  (`local_data_id`,`rrd_name`,`time`)) ENGINE=MEMORY'
05/28/2008 06:08:03 PM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1050', SQL:"CREATE TEMPORARY TABLE `rcaston` (  `local_data_id` mediumint(8) unsigned NOT NULL default '0',  `rrd_name` varchar(19) NOT NULL default '',  `time` datetime NOT NULL default '0000-00-00 00:00:00',  PRIMARY KEY  (`local_data_id`,`rrd_name`,`time`)) ENGINE=MEMORY'
05/28/2008 06:08:03 PM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1050', SQL:"CREATE TEMPORARY TABLE `rcaston` (  `local_data_id` mediumint(8) unsigned NOT NULL default '0',  `rrd_name` varchar(19) NOT NULL default '',  `time` datetime NOT NULL default '0000-00-00 00:00:00',  PRIMARY KEY  (`local_data_id`,`rrd_name`,`time`)) ENGINE=MEMORY'
05/28/2008 06:08:03 PM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1050', SQL:"CREATE TEMPORARY TABLE `rcaston` (  `local_data_id` mediumint(8) unsigned NOT NULL default '0',  `rrd_name` varchar(19) NOT NULL default '',  `time` datetime NOT NULL default '0000-00-00 00:00:00',  PRIMARY KEY  (`local_data_id`,`rrd_name`,`time`)) ENGINE=MEMORY'
05/28/2008 06:08:03 PM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1050', SQL:"CREATE TEMPORARY TABLE `rcaston` (  `local_data_id` mediumint(8) unsigned NOT NULL default '0',  `rrd_name` varchar(19) NOT NULL default '',  `time` datetime NOT NULL default '0000-00-00 00:00:00',  PRIMARY KEY  (`local_data_id`,`rrd_name`,`time`)) ENGINE=MEMORY'
05/28/2008 06:08:03 PM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1050', SQL:"CREATE TEMPORARY TABLE `rcaston` (  `local_data_id` mediumint(8) unsigned NOT NULL default '0',  `rrd_name` varchar(19) NOT NULL default '',  `time` datetime NOT NULL default '0000-00-00 00:00:00',  PRIMARY KEY  (`local_data_id`,`rrd_name`,`time`)) ENGINE=MEMORY'
05/28/2008 06:08:03 PM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1050', SQL:"CREATE TEMPORARY TABLE `rcaston` (  `local_data_id` mediumint(8) unsigned NOT NULL default '0',  `rrd_name` varchar(19) NOT NULL default '',  `time` datetime NOT NULL default '0000-00-00 00:00:00',  PRIMARY KEY  (`local_data_id`,`rrd_name`,`time`)) ENGINE=MEMORY'
05/28/2008 06:08:03 PM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1050', SQL:"CREATE TEMPORARY TABLE `rcaston` (  `local_data_id` mediumint(8) unsigned NOT NULL default '0',  `rrd_name` varchar(19) NOT NULL default '',  `time` datetime NOT NULL default '0000-00-00 00:00:00',  PRIMARY KEY  (`local_data_id`,`rrd_name`,`time`)) ENGINE=MEMORY'
05/28/2008 06:08:03 PM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1050', SQL:"CREATE TEMPORARY TABLE `rcaston` (  `local_data_id` mediumint(8) unsigned NOT NULL default '0',  `rrd_name` varchar(19) NOT NULL default '',  `time` datetime NOT NULL default '0000-00-00 00:00:00',  PRIMARY KEY  (`local_data_id`,`rrd_name`,`time`)) ENGINE=MEMORY'
05/28/2008 06:08:03 PM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1050', SQL:"CREATE TEMPORARY TABLE `rcaston` (  `local_data_id` mediumint(8) unsigned NOT NULL default '0',  `rrd_name` varchar(19) NOT NULL default '',  `time` datetime NOT NULL default '0000-00-00 00:00:00',  PRIMARY KEY  (`local_data_id`,`rrd_name`,`time`)) ENGINE=MEMORY'
05/28/2008 06:08:03 PM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1050', SQL:"CREATE TEMPORARY TABLE `rcaston` (  `local_data_id` mediumint(8) unsigned NOT NULL default '0',  `rrd_name` varchar(19) NOT NULL default '',  `time` datetime NOT NULL default '0000-00-00 00:00:00',  PRIMARY KEY  (`local_data_id`,`rrd_name`,`time`)) ENGINE=MEMORY'

Also seeing this as the link for the dump-to-csv button, which worked before installing plugins:

Code: Select all

graph_xport.php?local_graph_id=19369&rra_id=<br />
<b>Notice</b>:  Undefined index:  id in <b>/data/cacti-0.8.7b/graph.php</b> on line <b>215</b><br />
&view_type=&graph_start=1212017580&graph_end=1212022606

gninja · Post by **gninja** » Wed May 28, 2008 9:21 pm

The realm_auth issue, and the csv issue are related to killspike, if I disable that plugin, they go away. Still seeing the boost related issues.

Post by **TheWitness** » Thu May 29, 2008 8:35 pm

You must use the SVN version of Boost to have it be stable from that perspective.

TheWitness

gninja · Post by **gninja** » Fri May 30, 2008 12:26 am

Which repository? I'm only seeing spine and core cacti in the main svn repository.

gninja · Post by **gninja** » Fri May 30, 2008 4:14 pm

Ok, I found it in the viewcvs... But I still can't seem to actually check it out...

for the main cacti repository it's:

Code: Select all

svn checkout svn://svn.cacti.net/var/svnroot/cacti

But swapping cacti for plugins doesn't get me the plugins repository.

Post by **TheWitness** » Sun Jun 01, 2008 7:29 am

cvs.cacti.net/var/svnroot/cacti_plugins

deu439356 · Post by **deu439356** » Wed Oct 01, 2008 3:49 pm

Is there an updated address for this? Will boost 1.7 work with 8.7b on a Solaris platform?

Thanks!

Post by **TheWitness** » Wed Oct 01, 2008 7:48 pm

Yes, but SVN is 1.8. I need to release, but Cacti first.

TheWitness

deu439356 · Post by **deu439356** » Thu Oct 02, 2008 7:44 am

Thanks. Does that mean you are waiting to release 1.8 until the lastest version of Cati has been released? We currently have a poll time of around 270 seconds and we need to get this reduced as soon as possible so we can keep adding network devices. Would is be possible to get my hands on the new version of boost? I've tried installing 1.6 and 1.7 with no luck.

Thanks again for you help!

khufure · Post by **khufure** » Fri Oct 03, 2008 6:46 pm

deu439356 wrote:Thanks. Does that mean you are waiting to release 1.8 until the lastest version of Cati has been released? We currently have a poll time of around 270 seconds and we need to get this reduced as soon as possible so we can keep adding network devices. Would is be possible to get my hands on the new version of boost? I've tried installing 1.6 and 1.7 with no luck.

Thanks again for you help!

You can use boost from subversion.

How many datasources, and are you using spine? A decent box can scale to ~20-50k datasources without boost depending on the type of queries. I found spine with 4 processes and 40 threads scaled optimally for us.

P

deu439356 · Post by **deu439356** » Mon Oct 06, 2008 8:43 am

Do you have link to the SVN? We currently have 77,660 datasources and counting. I keep disabling devices when we get a close to a five minute poll so we can keep adding devices without wrapping the poller. With all the disable devices, we would be over 140,000 datasources. We currently use spine with 15 processes and 15 threads. Do you have boost installed on your network?

khufure · Post by **khufure** » Mon Oct 06, 2008 3:30 pm

deu439356 wrote:Do you have link to the SVN? We currently have 77,660 datasources and counting. I keep disabling devices when we get a close to a five minute poll so we can keep adding devices without wrapping the poller. With all the disable devices, we would be over 140,000 datasources. We currently use spine with 15 processes and 15 threads. Do you have boost installed on your network?

1.) Get subversion on your system.
2.) svn checkout svn://cvs.cacti.net/var/svnroot/cacti_plugins

deu439356 · Post by **deu439356** » Tue Oct 07, 2008 10:23 am

Is a new version of the poller.php supposed to come with boost? Is the poller_boost.php the replacement for the poller.php? According to the log, the poller isn't processing any rrds, but when I log into the box and watch, spine gets finished in 2.5 min, but the poller keeps running for another 1.25 min. Any suggestions?

khufure · Post by **khufure** » Mon Oct 20, 2008 2:56 pm

deu439356 wrote:Is a new version of the poller.php supposed to come with boost? Is the poller_boost.php the replacement for the poller.php? According to the log, the poller isn't processing any rrds, but when I log into the box and watch, spine gets finished in 2.5 min, but the poller keeps running for another 1.25 min. Any suggestions?

Check for bad datasources or scripts.

Regarding performance try changing the poller settings to ${1-1.5xnumber_of_cpus) processes and 40 threads. Your datasource count is approximately what I have in a similar environment. Additionally, I'd get boost & rrdtool-1.2.27 on if you haven't already.

deu439356 · Post by **deu439356** » Wed Oct 22, 2008 10:27 am

We have Boost installed with RRD 1.2.27. I haven't found any bad datasources or scripts. Would you be willing to either post or send me a personal message with your apache and mysql tuning settings? Also, if you have boost installed, do/did you get the following errors?:

10/16/2008 08:33:33 AM - BOOST SERVER: Poller[0] WARNING: Broken connection detected '127.0.0.1'
10/16/2008 08:33:32 AM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed!, Error:'2006', SQL:"SELECT * FROM poller_output_boost_processes"

Boost 1.7 and cacti 0.8.7b issues

Boost 1.7 and cacti 0.8.7b issues

Who is online