Boost Plugin v1.6 Released

Announcements concerning Plugins for Cacti

Moderators: Developers, Moderators

Locked
dononeil
Cacti User
Posts: 194
Joined: Wed Aug 06, 2008 4:45 pm

Post by dononeil »

Well....

Our DB is a separate server, and it's hightly tuned with TONS of resources (4 CPU's, 16 GB RAM, super speedy HDD's, etc...) and has been optimized as much as it can, so I don't think that's it.

As far as the poller_output_boost table, I never see anything get put in there at all.

Here's what I get in the text file from the cron entry:

09/26/2008 09:08:01 AM - SYSTEM BOOST STATS: Time:0.0142 RRDUpdates:0
09/26/2008 09:09:01 AM - SYSTEM BOOST STATS: Time:0.0333 RRDUpdates:0

It's like nothing is running at all.

Ideas?
Top
User avatar
TheWitness
Developer
Posts: 17007
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:
Contact TheWitness

Post by TheWitness »

There is obviously something wrong. What is shown in your Cacti log?

TheWitness
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages

For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
Top
dononeil
Cacti User
Posts: 194
Joined: Wed Aug 06, 2008 4:45 pm

Post by dononeil »

I re-enabled it for one cycle, and here's what I'm seeing:

From the boost poller logfile:

ERROR: illegal attempt to update using time 1222458198 when last update time is 1222716723 (minimum one second step)
09/29/2008 12:35:03 PM - BOOST: Poller[0] NOTE: Updating Local Data Id:'3791'

ERROR: Not enough arguments
09/29/2008 12:35:03 PM - BOOST: Poller[0] NOTE: Updating Local Data Id:'3808'

From the regular cacti logfile in debug mode:

09/29/2008 12:35:03 PM - BOOST: Poller[0] CACTI2RRD: /usr/bin/rrdtool update /srv/www/htdocs/cactitest/rra/ccsd-lx-noc03_cpu_user_3791.rrd --template cpu_user 1222458200:U
09/29/2008 12:35:03 PM - CMDPHP: Poller[0] DEBUG: SQL Cell: "SELECT DISTINCT rrd_path FROM poller_item WHERE local_data_id='3792'"
09/29/2008 12:35:03 PM - CMDPHP: Poller[0] DEBUG: SQL Assoc: "SELECT data_source_name FROM data_template_rrd WHERE local_data_id='3792' ORDER BY data_source_name ASC"
09/29/2008 12:35:03 PM - CMDPHP: Poller[0] DEBUG: SQL Assoc: "SELECT rrd_name FROM poller_item WHERE local_data_id=3792"
09/29/2008 12:35:03 PM - BOOST: Poller[0] NOTE: Updating Local Data Id:'3792'


09/29/2008 12:35:03 PM - BOOST: Poller[0] CACTI2RRD: /usr/bin/rrdtool update /srv/www/htdocs/cactitest/rra/ccsd-lx-noc03_handler_write_3807.rrd --template 1222458200:U
09/29/2008 12:35:03 PM - CMDPHP: Poller[0] DEBUG: SQL Cell: "SELECT DISTINCT rrd_path FROM poller_item WHERE local_data_id='3808'"
09/29/2008 12:35:03 PM - CMDPHP: Poller[0] DEBUG: SQL Assoc: "SELECT data_source_name FROM data_template_rrd WHERE local_data_id='3808' ORDER BY data_source_name ASC"
09/29/2008 12:35:03 PM - CMDPHP: Poller[0] DEBUG: SQL Assoc: "SELECT rrd_name FROM poller_item WHERE local_data_id=3808"
09/29/2008 12:35:03 PM - BOOST: Poller[0] NOTE: Updating Local Data Id:'3808'


So, it looks like it's trying, but not working correctly. I'm runnign .8.7b, not the lates SVN. Maybe I need to run the latest SVN???
Top
kokkers
Posts: 16
Joined: Thu Feb 16, 2006 6:00 am

Post by kokkers »

Just a few posts ago in this topic
khufure wrote:Use the SVN version or suffer horrible pain
Top
dononeil
Cacti User
Posts: 194
Joined: Wed Aug 06, 2008 4:45 pm

Post by dononeil »

I am using the SVN version of boost, just not the SVN version of Cacti.
Top
khufure
Cacti User
Posts: 203
Joined: Wed Oct 24, 2007 5:47 pm
Location: San Francisco, CA
Contact:
Contact khufure

Post by khufure »

dononeil wrote:I re-enabled it for one cycle, and here's what I'm seeing:
ERROR: illegal attempt to update using time 1222458198 when last update time is 1222716723 (minimum one second step)

So, it looks like it's trying, but not working correctly. I'm runnign .8.7b, not the lates SVN. Maybe I need to run the latest SVN???
If I'm reading that correctly the time is 71.8 hours difference. You're trying to update a record with a time 72 hours in the past from the current time. Did something happen on the Cacti server regarding time? Alternatively, maybe you need to truncate bad data from the *boost tables before trying again. One thing is for sure, it looks fishy and something is wrong.

One other thing maybe to try is webui -> system utilities -> technical support and post the data here.

I wouldn't suggest going to SVN-cacti. I'd imagine that would be a development / pre-.9 release. 87b should be fine.
Top
dononeil
Cacti User
Posts: 194
Joined: Wed Aug 06, 2008 4:45 pm

Post by dononeil »

Ok... I dumped the boost tables and re-imported the sql, and re-ran it for a few minutes... still not graphing, here's what I'm getting in the 2 log files:

09/30/2008 02:34:01 PM - CMDPHP: Poller[0] DEBUG: SQL Assoc: "SELECT name, file, function FROM plugin_hooks WHERE status = 1 AND hook = 'config_arrays'"
09/30/2008 02:34:01 PM - CMDPHP: Poller[0] DEBUG: SQL Assoc: "SELECT * FROM plugin_realms"
09/30/2008 02:34:01 PM - CMDPHP: Poller[0] DEBUG: SQL Assoc: "SELECT id FROM plugin_realms WHERE plugin = 'aggregate' AND file = 'aggregate_templates.php,aggregate_templates_items.php,color_templates.php,color_templates_items.php'"
09/30/2008 02:34:01 PM - CMDPHP: Poller[0] DEBUG: SQL Assoc: "SELECT name, file, function FROM plugin_hooks WHERE status = 1 AND hook = 'config_settings'"
09/30/2008 02:34:01 PM - CMDPHP: Poller[0] DEBUG: SQL Assoc: "SELECT name, file, function FROM plugin_hooks WHERE status = 1 AND hook = 'valid_host_fields'"
09/30/2008 02:34:01 PM - CMDPHP: Poller[0] DEBUG: SQL Assoc: "SELECT name, file, function FROM plugin_hooks WHERE status = 1 AND hook = 'config_form'"
09/30/2008 02:34:01 PM - CMDPHP: Poller[0] DEBUG: SQL Exec: "REPLACE INTO settings (name, value) VALUES ('boost_prev_base_time', '2008-09-30 0:00:00')"
09/30/2008 02:34:01 PM - CMDPHP: Poller[0] DEBUG: SQL Cell: "SELECT count(*) FROM poller_output_boost"
09/30/2008 02:34:01 PM - CMDPHP: Poller[0] DEBUG: SQL Exec: "REPLACE INTO settings (name, value) VALUES ('boost_last_run_time', '2008-09-30 14:34:01')"
09/30/2008 02:34:01 PM - CMDPHP: Poller[0] DEBUG: SQL Exec: "REPLACE INTO settings (name, value) VALUES ('boost_poller_status', 'running - start time:2008-09-30 14:34:01')"
09/30/2008 02:34:01 PM - CMDPHP: Poller[0] DEBUG: SQL Cell: "SELECT count(*) FROM poller_output_boost WHERE time<='2008-09-30 14:34:01'"
09/30/2008 02:34:01 PM - CMDPHP: Poller[0] DEBUG: SQL Exec: "REPLACE INTO settings (name, value) VALUES ('boost_poller_status', 'complete - end time:2008-09-30 14:34:01')"
09/30/2008 02:34:01 PM - CMDPHP: Poller[0] DEBUG: SQL Exec: "REPLACE INTO settings (name,value) VALUES ('stats_boost', 'Time:0.0167 RRDUpdates:0')"
09/30/2008 02:34:01 PM - SYSTEM BOOST STATS: Time:0.0167 RRDUpdates:0
09/30/2008 02:34:01 PM - CMDPHP: Poller[0] DEBUG: SQL Exec: "REPLACE INTO settings (name, value) VALUES ('boost_next_run_time', '2008-09-30 15:34:01')"
09/30/2008 02:35:02 PM - CMDPHP: Poller[0] DEBUG: SQL Assoc: "SELECT name, file, function FROM plugin_hooks WHERE status = 1 AND hook = 'config_arrays'"
09/30/2008 02:35:02 PM - CMDPHP: Poller[0] DEBUG: SQL Assoc: "SELECT * FROM plugin_realms"
09/30/2008 02:35:02 PM - CMDPHP: Poller[0] DEBUG: SQL Assoc: "SELECT id FROM plugin_realms WHERE plugin = 'aggregate' AND file = 'aggregate_templates.php,aggregate_templates_items.php,color_templates.php,color_templates_items.php'"
09/30/2008 02:35:02 PM - CMDPHP: Poller[0] DEBUG: SQL Assoc: "SELECT name, file, function FROM plugin_hooks WHERE status = 1 AND hook = 'config_settings'"
09/30/2008 02:35:02 PM - CMDPHP: Poller[0] DEBUG: SQL Assoc: "SELECT name, file, function FROM plugin_hooks WHERE status = 1 AND hook = 'valid_host_fields'"
09/30/2008 02:35:02 PM - CMDPHP: Poller[0] DEBUG: SQL Assoc: "SELECT name, file, function FROM plugin_hooks WHERE status = 1 AND hook = 'config_form'"
09/30/2008 02:35:02 PM - CMDPHP: Poller[0] DEBUG: SQL Exec: "REPLACE INTO settings (name, value) VALUES ('boost_prev_base_time', '2008-09-30 0:00:00')"
09/30/2008 02:35:02 PM - CMDPHP: Poller[0] DEBUG: SQL Cell: "SELECT count(*) FROM poller_output_boost"
09/30/2008 02:35:02 PM - CMDPHP: Poller[0] DEBUG: SQL Exec: "REPLACE INTO settings (name, value) VALUES ('boost_last_run_time', '2008-09-30 14:35:02')"
09/30/2008 02:35:02 PM - CMDPHP: Poller[0] DEBUG: SQL Exec: "REPLACE INTO settings (name, value) VALUES ('boost_poller_status', 'running - start time:2008-09-30 14:35:02')"
09/30/2008 02:35:02 PM - CMDPHP: Poller[0] DEBUG: SQL Cell: "SELECT count(*) FROM poller_output_boost WHERE time<='2008-09-30 14:35:02'"
09/30/2008 02:35:02 PM - CMDPHP: Poller[0] DEBUG: SQL Exec: "REPLACE INTO settings (name, value) VALUES ('boost_poller_status', 'complete - end time:2008-09-30 14:35:02')"
09/30/2008 02:35:02 PM - CMDPHP: Poller[0] DEBUG: SQL Exec: "REPLACE INTO settings (name,value) VALUES ('stats_boost', 'Time:0.0176 RRDUpdates:0')"
09/30/2008 02:35:02 PM - SYSTEM BOOST STATS: Time:0.0176 RRDUpdates:0
09/30/2008 02:35:02 PM - CMDPHP: Poller[0] DEBUG: SQL Exec: "REPLACE INTO settings (name, value) VALUES ('boost_next_run_time', '2008-09-30 15:35:02')"

09/30/2008 02:34:01 PM - SYSTEM BOOST STATS: Time:0.0167 RRDUpdates:0
09/30/2008 02:35:02 PM - SYSTEM BOOST STATS: Time:0.0176 RRDUpdates:0

It doesn't think there is anything to update, even though it's gone past the 10 minutes.....

Now, when I view a graph fresh, it tries to update the rrd:

09/30/2008 02:56:13 PM - WEBLOG: Poller[0] CACTI2RRD: /usr/bin/rrdtool graph - --imgformat=PNG --start=-33053184 --end=-300 --title="EDC-RTR-G1, ethernet1/1, Cimarron Memori" --rigid --base=1000 --height=120 --width=500 --alt-autoscale --vertical-label="Percent" --slope-mode --font TITLE:12: --font AXIS:8: --font LEGEND:10: --font UNIT:8: DEF:a="/data/cactitest/rra/edc-rtr-g1_traffic_in_3985.rrd":traffic_in:AVERAGE DEF:b="/data/cactitest/rra/edc-rtr-g1_traffic_in_3985.rrd":traffic_in:MAX DEF:c="/data/cactitest/rra/edc-rtr-g1_traffic_in_3985.rrd":traffic_out:AVERAGE DEF:d="/data/cactitest/rra/edc-rtr-g1_traffic_in_3985.rrd":traffic_out:MAX CDEF:cdefa=a,4294967295,/,100,*,8,* CDEF:cdefd=b,4294967295,/,100,*,8,* CDEF:cdefe=c,4294967295,/,100,*,8,*,-1,* CDEF:cdeff=c,4294967295,/,100,*,8,* CDEF:cdefh=d,4294967295,/,100,*,8,* AREA:cdefa#00CF00FF:"In" GPRINT:cdefa:LAST:" Cur\:%8.2lf%s" GPRINT:cdefa:AVERAGE:"Avg\:%8.2lf%s" GPRINT:cdefd:MAX:"Max\:%8.2lf%s\n" AREA:cdefe#002A97FF:"Out" GPRINT:cdeff:LAST:"Cur\:%8.2lf%s" GPRINT:cdeff:AVERAGE:"Avg\:%8.2lf%s" GPRINT:cdefh:MAX:"Max\:%8.2lf%s" HRULE:0#FFFFFFFF:""
09/30/2008 02:56:13 PM - CMDPHP: Poller[0] DEBUG: SQL Assoc: "SELECT name, file, function FROM plugin_hooks WHERE status = 1 AND hook = 'rrdtool_function_graph_set_file'"

but the graph itself never gets updated.

Any thoughts now?
Top
khufure
Cacti User
Posts: 203
Joined: Wed Oct 24, 2007 5:47 pm
Location: San Francisco, CA
Contact:
Contact khufure

Post by khufure »

dononeil wrote:but the graph itself never gets updated.

Any thoughts now?
What does your poller output say
Top
dononeil
Cacti User
Posts: 194
Joined: Wed Aug 06, 2008 4:45 pm

Post by dononeil »

As per my previous post the output from the poller is:

09/30/2008 02:34:01 PM - SYSTEM BOOST STATS: Time:0.0167 RRDUpdates:0
09/30/2008 02:35:02 PM - SYSTEM BOOST STATS: Time:0.0176 RRDUpdates:0

Quite un-interesting and gives me no help in trying to track down the issue.
Top
khufure
Cacti User
Posts: 203
Joined: Wed Oct 24, 2007 5:47 pm
Location: San Francisco, CA
Contact:
Contact khufure

Post by khufure »

dononeil wrote:As per my previous post the output from the poller is:

09/30/2008 02:34:01 PM - SYSTEM BOOST STATS: Time:0.0167 RRDUpdates:0
09/30/2008 02:35:02 PM - SYSTEM BOOST STATS: Time:0.0176 RRDUpdates:0

Quite un-interesting and gives me no help in trying to track down the issue.
Ahh. I didn't realize that's what the spacing difference was for. Plus, normally those appear in cacti.log, not poller.

BTW, in the future you can use the command truncate to empty a table.

- What are your cron entries?
- Boost server is running ok ?
/usr/bin/php -q /u/cacti/plugins/boost/boost_server.php

telnet localhost 9050
status

returns something?

- What tabs do you have selected in settings -> boost?
- Do you see any relevant sql errors|messages|whatever on your mysql server?
- What are the rowcounts & activity in your *poller* tables?
- Does it work without boost still?
Top
khufure
Cacti User
Posts: 203
Joined: Wed Oct 24, 2007 5:47 pm
Location: San Francisco, CA
Contact:
Contact khufure

Post by khufure »

Is boost supposed to do this kind of entry? 3x in a row within a second or two?

Code: Select all

10/01/2008 05:22:47 PM - SYSTEM BOOST STATS: Time:845.2368 RRDUpdates:250190
10/01/2008 05:22:49 PM - SYSTEM BOOST STATS: Time:467.6317 RRDUpdates:200755
10/01/2008 05:22:49 PM - SYSTEM BOOST STATS: Time:545.8733 RRDUpdates:200764
10/01/2008 05:45:06 PM - SYSTEM BOOST STATS: Time:652.1082 RRDUpdates:215893
10/01/2008 05:45:06 PM - SYSTEM BOOST STATS: Time:400.7808 RRDUpdates:250168
10/01/2008 05:52:39 PM - SYSTEM BOOST STATS: Time:455.0624 RRDUpdates:54312
10/01/2008 06:20:58 PM - SYSTEM BOOST STATS: Time:954.5219 RRDUpdates:210701
10/01/2008 06:21:00 PM - SYSTEM BOOST STATS: Time:744.9199 RRDUpdates:264657
10/01/2008 06:25:17 PM - SYSTEM BOOST STATS: Time:607.0796 RRDUpdates:108088
10/01/2008 06:43:25 PM - SYSTEM BOOST STATS: Time:589.9308 RRDUpdates:212267
10/01/2008 06:43:25 PM - SYSTEM BOOST STATS: Time:314.0166 RRDUpdates:245940
10/01/2008 06:52:46 PM - SYSTEM BOOST STATS: Time:462.6804 RRDUpdates:68461
10/01/2008 07:14:46 PM - SYSTEM BOOST STATS: Time:675.9943 RRDUpdates:199995
10/01/2008 07:14:46 PM - SYSTEM BOOST STATS: Time:379.5085 RRDUpdates:234520
10/01/2008 07:22:27 PM - SYSTEM BOOST STATS: Time:445.3335 RRDUpdates:54296
10/01/2008 07:44:34 PM - SYSTEM BOOST STATS: Time:662.1729 RRDUpdates:216721
10/01/2008 07:44:34 PM - SYSTEM BOOST STATS: Time:369.0405 RRDUpdates:226934
10/01/2008 07:53:06 PM - SYSTEM BOOST STATS: Time:481.1785 RRDUpdates:68087
Top
User avatar
TheWitness
Developer
Posts: 17007
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:
Contact TheWitness

Post by TheWitness »

khufure wrote:Is boost supposed to do this kind of entry? 3x in a row within a second or two?

Code: Select all

10/01/2008 05:22:47 PM - SYSTEM BOOST STATS: Time:845.2368 RRDUpdates:250190
10/01/2008 05:22:49 PM - SYSTEM BOOST STATS: Time:467.6317 RRDUpdates:200755
10/01/2008 05:22:49 PM - SYSTEM BOOST STATS: Time:545.8733 RRDUpdates:200764
10/01/2008 05:45:06 PM - SYSTEM BOOST STATS: Time:652.1082 RRDUpdates:215893
10/01/2008 05:45:06 PM - SYSTEM BOOST STATS: Time:400.7808 RRDUpdates:250168
10/01/2008 05:52:39 PM - SYSTEM BOOST STATS: Time:455.0624 RRDUpdates:54312
10/01/2008 06:20:58 PM - SYSTEM BOOST STATS: Time:954.5219 RRDUpdates:210701
10/01/2008 06:21:00 PM - SYSTEM BOOST STATS: Time:744.9199 RRDUpdates:264657
10/01/2008 06:25:17 PM - SYSTEM BOOST STATS: Time:607.0796 RRDUpdates:108088
10/01/2008 06:43:25 PM - SYSTEM BOOST STATS: Time:589.9308 RRDUpdates:212267
10/01/2008 06:43:25 PM - SYSTEM BOOST STATS: Time:314.0166 RRDUpdates:245940
10/01/2008 06:52:46 PM - SYSTEM BOOST STATS: Time:462.6804 RRDUpdates:68461
10/01/2008 07:14:46 PM - SYSTEM BOOST STATS: Time:675.9943 RRDUpdates:199995
10/01/2008 07:14:46 PM - SYSTEM BOOST STATS: Time:379.5085 RRDUpdates:234520
10/01/2008 07:22:27 PM - SYSTEM BOOST STATS: Time:445.3335 RRDUpdates:54296
10/01/2008 07:44:34 PM - SYSTEM BOOST STATS: Time:662.1729 RRDUpdates:216721
10/01/2008 07:44:34 PM - SYSTEM BOOST STATS: Time:369.0405 RRDUpdates:226934
10/01/2008 07:53:06 PM - SYSTEM BOOST STATS: Time:481.1785 RRDUpdates:68087
No. you are updating too often. The update time should be roughly 1 hour depending upon system size. So, don't event attempt to update every 10 minutes on a system this large, otherwise, you might as well just be letting poller.php do it.

TheWitness
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages

For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
Top
User avatar
TheWitness
Developer
Posts: 17007
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:
Contact TheWitness

Post by TheWitness »

You should also rename poller_boost.php to something else is you are running it out of cron anyway.

TheWitness
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages

For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
Top
dononeil
Cacti User
Posts: 194
Joined: Wed Aug 06, 2008 4:45 pm

Post by dononeil »

My settings were posted in an earlier post on the previous page of the forum here... check them out.

I'm not running the boost server as my web process is running as root and has write permissions to everything, so of course it's not running.

Here's my crontab entry:

* * * * * php /www/cactitest/plugins/boost/poller_boost.php -f -d >> /www/cactitest/log/poller_boost.txt

and the poller is set to run every minute in the settings.

Maybe my problem is that boost DOESN'T work unless you run the boost server? I don't have it selected (see the earlier post), but maybe that's a bug?
Top
khufure
Cacti User
Posts: 203
Joined: Wed Oct 24, 2007 5:47 pm
Location: San Francisco, CA
Contact:
Contact khufure

Post by khufure »

TheWitness wrote:No. you are updating too often. The update time should be roughly 1 hour depending upon system size. So, don't event attempt to update every 10 minutes on a system this large, otherwise, you might as well just be letting poller.php do it.

TheWitness
I will change it to every 2 hours or 400,000 records and see how it does. It was set lower as a fail-safe. It wasn't every 10 minutes though.

I had the force boost -> rrd/disk command running every 30 minutes. Maybe this is why it seemed to run every 10 minutes :).

Just switched it to every 4 hours:
15 */4 * * * /usr/bin/php -q /$path/cacti/plugins/boost/poller_boost.php -f -d > /dev/null 2>&1
Top
Locked

Return to “Plugin Announcements”

Who is online

Users browsing this forum: No registered users and 2 guests