Sometime recently (before this issue was encountered) I found my mysql log full of these (and lotsa dead graphs):
130225 15:02:17 [ERROR] /usr/libexec/mysqld: The table 'data_source_stats_hourly_cache' is full
... so I set this according to something I read here: max-heap-table-size = 64M
Apart from that, designing some templates and DS'es for my own stuff nothing major has changed (did a yum update at some point though)
Whats frustrating me is that all the existing graphs are fine, however when I add in a new host no matter what some of them just won't graph... In preview mode they are fine however I'm getting either nothing or complete nonsense (see screenshot, +1T physical RAM? lol ) The most important thing I use cacti for is thold alerts on disk usage.. however all my new machines can't graph certain ones anymore (using "SNMP - Get Mounted Partitions" as example)
Its also effecting other plugins/templates.. such as Advanced Ping and the fantastic net-snmpd memory usage (http://forums.cacti.net/about11376.html)..
My questions I are..
- why if I add a host do some of the graphs work?
- why would the broken ones work in preview mode?
- how can I come closer to finding where things are going wrong?
Your advice/help muchly appreciated!
See screenshots, of working and non-working graphs on a new host.. Here is the verbose query on "SNMP - Get Mounted Partitions"
Data Query Debug Information
Code: Select all
+ Running data query [1].
+ Found type = '6' [Script Query - Script Server].
+ Found data query XML file at '/var/www/html/resource/script_server/host_disk.xml'
+ XML file parsed ok.
+ <arg_num_indexes> missing in XML file, 'Index Count Changed' not supported
+ Executing script for list of indexes '"/usr/bin/php" -q /var/www/html/scripts/ss_host_disk.php 10.0.11.1 2:161:500:rocom:::::: 45 index' Index Count: 9
+ Found index: 1
+ Found index: 3
+ Found index: 6
+ Found index: 7
+ Found index: 10
+ Found index: 31
+ Found index: 35
+ Found index: 36
+ Found index: 37
+ Executing script query '"/usr/bin/php" -q /var/www/html/scripts/ss_host_disk.php 10.0.11.1 2:161:500:rocom:::::: 45 query index'
+ Found item [hrStorageIndex='1'] index: 1
+ Found item [hrStorageIndex='3'] index: 3
+ Found item [hrStorageIndex='6'] index: 6
+ Found item [hrStorageIndex='7'] index: 7
+ Found item [hrStorageIndex='10'] index: 10
+ Found item [hrStorageIndex='31'] index: 31
+ Found item [hrStorageIndex='35'] index: 35
+ Found item [hrStorageIndex='36'] index: 36
+ Found item [hrStorageIndex='37'] index: 37
+ Executing script query '"/usr/bin/php" -q /var/www/html/scripts/ss_host_disk.php 10.0.11.1 2:161:500:rocom:::::: 45 query description'
+ Found item [hrStorageDescr='Physical memory'] index: 1
+ Found item [hrStorageDescr='Virtual memory'] index: 3
+ Found item [hrStorageDescr='Memory buffers'] index: 6
+ Found item [hrStorageDescr='Cached memory'] index: 7
+ Found item [hrStorageDescr='Swap space'] index: 10
+ Found item [hrStorageDescr='/'] index: 31
+ Found item [hrStorageDescr='/dev/shm'] index: 35
+ Found item [hrStorageDescr='/boot'] index: 36
+ Found item [hrStorageDescr='/home'] index: 37
+ Executing script query '"/usr/bin/php" -q /var/www/html/scripts/ss_host_disk.php 10.0.11.1 2:161:500:rocom:::::: 45 query sau'
+ Found item [hrStorageAllocationUnits='1024 Bytes'] index: 1
+ Found item [hrStorageAllocationUnits='1024 Bytes'] index: 3
+ Found item [hrStorageAllocationUnits='1024 Bytes'] index: 6
+ Found item [hrStorageAllocationUnits='1024 Bytes'] index: 7
+ Found item [hrStorageAllocationUnits='1024 Bytes'] index: 10
+ Found item [hrStorageAllocationUnits='4096 Bytes'] index: 31
+ Found item [hrStorageAllocationUnits='4096 Bytes'] index: 35
+ Found item [hrStorageAllocationUnits='1024 Bytes'] index: 36
+ Found item [hrStorageAllocationUnits='4096 Bytes'] index: 37
+ Executing script query '"/usr/bin/php" -q /var/www/html/scripts/ss_host_disk.php 10.0.11.1 2:161:500:rocom:::::: 45 query total'
+ Found item [hrStorageTotalCache='3917700'] index: 1
+ Found item [hrStorageTotalCache='10078076'] index: 3
+ Found item [hrStorageTotalCache='3917700'] index: 6
+ Found item [hrStorageTotalCache='3060636'] index: 7
+ Found item [hrStorageTotalCache='6160376'] index: 10
+ Found item [hrStorageTotalCache='32461211'] index: 31
+ Found item [hrStorageTotalCache='489712'] index: 35
+ Found item [hrStorageTotalCache='495844'] index: 36
+ Found item [hrStorageTotalCache='1020016'] index: 37
