Log file showing garbage after upgrade

[osiris123d]

I just upgraded Cacti from 0.8.6j to 0.8.7a with very little issues. My graphing and polling is working just fine, but i noticed when i "View Cacti Log File" I am seeing just a bunch of junk like the following.


traffic_out(DS[10039]), traffic_in(DS[10040]), traffic_out(DS[10040]), traffic_in(DS[10041]), traffic_out(DS[10041]), traffic_in(DS[10042]), traffic_out(DS[10042]), traffic_in(DS[10043]), traffic_out(DS[10043]), traffic_in(DS[10044]), traffic_out(DS[10044]), traffic_in(DS[10045]), traffic_out(DS[10045]), traffic_in(DS[10046]), traffic_out(DS[10046]), traffic_in(DS[10047]), traffic_out(DS[10047]), traffic_in(DS[10048]), traffic_out(DS[10048]), traffic_in(DS[10049]), traffic_out(DS[10049]), traffic_in(DS[10050]), traffic_out(DS[10050]), traffic_in(DS[10051]), traffic_out(DS[10051]), traffic_in(DS[10052]), traffic_out(DS[10052]), traffic_in(DS[10053]), traffic_out(DS[10053]), traffic_in(DS[10054]), traffic_out(DS[10054]), traffic_in(DS[10055]), traffic_out(DS[10055]), traffic_in(DS[10056]), traffic_out(DS[10056]), traffic_in(DS[10057]), traffic_out(DS[10057]), traffic_in(DS[10058]), traffic_out(DS[10058]), traffic_in(DS[10059]), traffic_out(DS[10059]), traffic_in(DS[10060]), traffic_out(DS[10060]), traffic_in(DS[10061]), traffic_out(DS[10061]), traffic_in(DS[10062]), traffic_out(DS[10062]), traffic_in(DS[10063]), traffic_out(DS[10063]), traffic_in(DS[10064]), traffic_out(DS[10064]), traffic_in(DS[10065]), traffic_out(DS[10065]), traffic_in(DS[10066]), traffic_out(DS[10066]), traffic_in(DS[10067]), traffic_out(DS[10067]), traffic_in(DS[10068]), traffic_out(DS[10068]), traffic_in(DS[10069]), traffic_out(DS[10069]), traffic_in(DS[10070]), traffic_out(DS[10070]), traffic_in(DS[10071]), traffic_out(DS[10071]), traffic_in(DS[10072]), traffic_out(DS[10072]), traffic_in(DS[10073]), traffic_out(DS[10073]), traffic_in(DS[10074]), traffic_out(DS[10074]), traffic_in(DS[10075]), traffic_out(DS[10075]), traffic_in(DS[10076]), traffic_out(DS[10076]), traffic_in(DS[10077]), traffic_out(DS[10077]), traffic_in(DS[10078]), traffic_out(DS[10078]), traffic_in(DS[10079]), traffic_out(DS[10079]), traffic_in(DS[10080]), traffic_out(DS[10080]), traffic_in(DS[10081]), traffic_out(DS[10081]), traffic_in(DS[10082]), traffic_out(DS[10082]), traffic_in(DS[10083]), traffic_out(DS[10083]), traffic_in(DS[10084]), traffic_out(DS[10084]), traffic_in(DS[10085]), traffic_out(DS[10085]), traffic_in(DS[10086]), traffic_out(DS[10086]), traffic_in(DS[10087]), traffic_out(DS[10087]), traffic_in(DS[10088]), traffic_out(DS[10088]), traffic_in(DS[10089]), traffic_out(DS[10089]), traffic_in(DS[10090]), traffic_out(DS[10090]), traffic_in(DS[10091]), traffic_out(DS[10091]), traffic_in(DS[10092]), traffic_out(DS[10092]), traffic_in(DS[10093]), traffic_out(DS[10093]), traffic_in(DS[10094]), traffic_out(DS[10094]), traffic_in(DS[10095]), traffic_out(DS[10095]), traffic_in(DS[10096]), traffic_out(DS[10096]), traffic_in(DS[10097]), traffic_out(DS


any idea what can be causing this??


General Information
Date Thu, 03 Jan 2008 10:21:35 -0600
Cacti Version 0.8.7a
Cacti OS unix
SNMP Version net-snmp
RRDTool Version RRDTool 1.2.x
Hosts 80
Graphs 4002
Data Sources Script/Command: 33
SNMP: 309
SNMP Query: 3726
Script Query: 3
Script Query - Script Server: 41
Total: 4112
Poller Information
Interval 300
Type cmd.php
Items Action[0]: 7761
Action[1]: 39
Action[2]: 64
Total: 7864
Concurrent Processes 10
Max Threads 10
PHP Servers 1
Script Timeout 25
Max OID 10
Last Run Statistics Time:201.0651 Method:cmd.php Processes:10 Threads:N/A Hosts:81 HostsPerProcess:9 DataSources:7864 RRDsProcessed:3128
PHP Information
PHP Version 5.1.2
PHP OS Linux
PHP uname Linux Mercury 2.6.15-26-server #1 SMP Fri Sep 8 21:00:37 UTC 2006 i686
PHP SNMP Not Installed
max_execution_time 30
memory_limit 128M
MySQL Table Information
Name Rows Engine Collation Check Status
cdef 21 MyISAM latin1_swedish_ci OK
cdef_items 31 MyISAM latin1_swedish_ci OK
colors 106 MyISAM latin1_swedish_ci OK
data_input 15 MyISAM latin1_swedish_ci OK
data_input_data 36081 MyISAM latin1_swedish_ci OK
data_input_fields 56 MyISAM latin1_swedish_ci OK
data_local 4112 MyISAM latin1_swedish_ci OK
data_template 55 MyISAM latin1_swedish_ci OK
data_template_data 4167 MyISAM latin1_swedish_ci OK
data_template_data_rra 16700 MyISAM latin1_swedish_ci OK
data_template_rrd 7939 MyISAM latin1_swedish_ci OK
graph_local 4002 MyISAM latin1_swedish_ci OK
graph_template_input 97 MyISAM latin1_swedish_ci OK
graph_template_input_defs 338 MyISAM latin1_swedish_ci OK
graph_templates 43 MyISAM latin1_swedish_ci OK
graph_templates_gprint 5 MyISAM latin1_swedish_ci OK
graph_templates_graph 4045 MyISAM latin1_swedish_ci OK
graph_templates_item 31752 MyISAM latin1_swedish_ci OK
graph_tree 6 MyISAM latin1_swedish_ci OK
graph_tree_items 96 MyISAM latin1_swedish_ci OK
host 80 MyISAM latin1_swedish_ci OK
host_graph 235 MyISAM latin1_swedish_ci OK
host_snmp_cache 136045 MyISAM latin1_swedish_ci OK
host_snmp_query 98 MyISAM latin1_swedish_ci OK
host_template 12 MyISAM latin1_swedish_ci OK
host_template_graph 28 MyISAM latin1_swedish_ci OK
host_template_snmp_query 18 MyISAM latin1_swedish_ci OK
poller 0 MyISAM latin1_swedish_ci OK
poller_command 0 MyISAM latin1_swedish_ci OK
poller_item 7864 MyISAM latin1_swedish_ci OK
poller_output 8 MyISAM latin1_swedish_ci OK
poller_reindex 98 MyISAM latin1_swedish_ci OK
poller_time 2 MyISAM latin1_swedish_ci OK
rra 6 MyISAM latin1_swedish_ci OK
rra_cf 21 MyISAM latin1_swedish_ci OK
settings 63 MyISAM latin1_swedish_ci OK
settings_graphs 81 MyISAM latin1_swedish_ci OK
settings_tree 0 MyISAM latin1_swedish_ci OK
snmp_query 8 MyISAM latin1_swedish_ci OK
snmp_query_graph 19 MyISAM latin1_swedish_ci OK
snmp_query_graph_rrd 39 MyISAM latin1_swedish_ci OK
snmp_query_graph_rrd_sv 59 MyISAM latin1_swedish_ci OK
snmp_query_graph_sv 40 MyISAM latin1_swedish_ci OK
user_auth 4 MyISAM latin1_swedish_ci OK
user_auth_perms 0 MyISAM latin1_swedish_ci OK
user_auth_realm 19 MyISAM latin1_swedish_ci OK
user_log 334 MyISAM latin1_swedish_ci OK
version 1 MyISAM latin1_swedish_ci OK

PHP Module Information
apache2handler
--------------------------------------------------------------------------------

Apache Version Apache/2.0.55 (Ubuntu) PHP/5.1.2
Apache API Version 20020903
Server Administrator webmaster@localhost
Hostname:Port Mercury.hilton.com:0
User/Group www-data(33)/33
Max Requests Per Child: 0 - Keep Alive: on - Max Per Connection: 100
Timeouts Connection: 300 - Keep-Alive: 15
Virtual Server Yes
Server Root /etc/apache2
Loaded Modules core mod_access mod_auth mod_log_config mod_logio mod_env mod_setenvif prefork http_core mod_mime mod_status mod_autoindex mod_negotiation mod_dir mod_alias mod_so mod_cgi mod_php5 mod_userdir

Directive Local Value Master Value
engine 1 1
last_modified 0 0
xbithack 0 0


Apache Environment
Variable Value
HTTP_ACCEPT image/gif, image/x-xbitmap, image/jpeg, image/pjpeg, application/x-ms-application, application/vnd.ms-xpsdocument, application/xaml+xml, application/x-ms-xbap, application/vnd.ms-excel, application/vnd.ms-powerpoint, application/msword, application/x-shockwave-flash, */*
HTTP_REFERER http://mercury/cacti/utilities.php
HTTP_ACCEPT_LANGUAGE en-us
HTTP_UA_CPU x86
HTTP_ACCEPT_ENCODING gzip, deflate
HTTP_USER_AGENT Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.0; SLCC1; .NET CLR 2.0.50727; .NET CLR 3.0.04506; InfoPath.2)
HTTP_HOST mercury
HTTP_CONNECTION Keep-Alive
HTTP_COOKIE PHPSESSID=196d4a784c9966fc8c04925735aee95e; Cacti=d353d387f337c1247931db56111e301f; clickedFoldert2=1%5E7%5E160%5E2%5E3%5E198%5E199%5E203%5E204%5E206%5E210%5E272%5E273%5E277%5E280%5E284%5E; highlightedTreeviewLinkt2=204
PATH /usr/local/bin:/usr/bin:/bin
SERVER_SIGNATURE <address>Apache/2.0.55 (Ubuntu) PHP/5.1.2 Server at mercury Port 80</address>
SERVER_SOFTWARE Apache/2.0.55 (Ubuntu) PHP/5.1.2
SERVER_NAME mercury
SERVER_ADDR 10.1.11.100
SERVER_PORT 80
REMOTE_ADDR 10.9.13.10
DOCUMENT_ROOT /var/www
SERVER_ADMIN webmaster@localhost
SCRIPT_FILENAME /usr/share/cacti/utilities.php
REMOTE_PORT 49970
GATEWAY_INTERFACE CGI/1.1
SERVER_PROTOCOL HTTP/1.1
REQUEST_METHOD GET
QUERY_STRING action=view_tech
REQUEST_URI /cacti/utilities.php?action=view_tech
SCRIPT_NAME /cacti/utilities.php


HTTP Headers Information
HTTP Request Headers
HTTP Request GET /cacti/utilities.php?action=view_tech HTTP/1.1
Accept image/gif, image/x-xbitmap, image/jpeg, image/pjpeg, application/x-ms-application, application/vnd.ms-xpsdocument, application/xaml+xml, application/x-ms-xbap, application/vnd.ms-excel, application/vnd.ms-powerpoint, application/msword, application/x-shockwave-flash, */*
Referer http://mercury/cacti/utilities.php
Accept-Language en-us
UA-CPU x86
Accept-Encoding gzip, deflate
User-Agent Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.0; SLCC1; .NET CLR 2.0.50727; .NET CLR 3.0.04506; InfoPath.2)
Host mercury
Connection Keep-Alive
Cookie PHPSESSID=196d4a784c9966fc8c04925735aee95e; Cacti=d353d387f337c1247931db56111e301f; clickedFoldert2=1%5E7%5E160%5E2%5E3%5E198%5E199%5E203%5E204%5E206%5E210%5E272%5E273%5E277%5E280%5E284%5E; highlightedTreeviewLinkt2=204
HTTP Response Headers
X-Powered-By PHP/5.1.2
Expires Thu, 19 Nov 1981 08:52:00 GMT
Last-Modified Thu, 03 Jan 2008 16:21:34 GMT
Cache-Control no-store, no-cache, must-revalidate, post-check=0, pre-check=0
Pragma no-cache
Set-Cookie Cacti=d353d387f337c1247931db56111e301f; path=/


bcmath
--------------------------------------------------------------------------------

BCMath support enabled


bz2
--------------------------------------------------------------------------------

BZip2 Support Enabled
Stream Wrapper support compress.bz2://
Stream Filter support bzip2.decompress, bzip2.compress
BZip2 Version 1.0.3, 15-Feb-2005


calendar
--------------------------------------------------------------------------------

Calendar support enabled


ctype
--------------------------------------------------------------------------------

ctype functions enabled


date
--------------------------------------------------------------------------------

date/time support enabled
Timezone Database Version 2005.18
Timezone Database internal
Default timezone America/Chicago

Directive Local Value Master Value
date.default_latitude 31.7667 31.7667
date.default_longitude 35.2333 35.2333
date.sunrise_zenith 90.583333 90.583333
date.sunset_zenith 90.583333 90.583333
date.timezone no value no value


dba
--------------------------------------------------------------------------------

DBA support enabled
Supported handlers gdbm cdb cdb_make db4 inifile flatfile


dom
--------------------------------------------------------------------------------

DOM/XML enabled
DOM/XML API Version 20031129
libxml Version 2.6.24
HTML Support enabled
XPath Support enabled
XPointer Support enabled
Schema Support enabled
RelaxNG Support enabled


exif
--------------------------------------------------------------------------------

EXIF Support enabled
EXIF Version 1.4 $Id: exif.c,v 1.173.2.4 2006/01/01 12:50:06 sniper Exp $
Supported EXIF Version 0220
Supported filetypes JPEG,TIFF


ftp
--------------------------------------------------------------------------------

FTP support enabled


gettext
--------------------------------------------------------------------------------

GetText Support enabled


hash
--------------------------------------------------------------------------------

hash support enabled
Hashing Engines md4 md5 sha1 sha256 sha384 sha512 ripemd128 ripemd160 whirlpool tiger128,3 tiger160,3 tiger192,3 tiger128,4 tiger160,4 tiger192,4 snefru gost adler32 crc32 crc32b haval128,3 haval160,3 haval192,3 haval224,3 haval256,3 haval128,4 haval160,4 haval192,4 haval224,4 haval256,4 haval128,5 haval160,5 haval192,5 haval224,5 haval256,5


iconv
--------------------------------------------------------------------------------

iconv support enabled
iconv implementation glibc
iconv library version 2.3.6

Directive Local Value Master Value
iconv.input_encoding ISO-8859-1 ISO-8859-1
iconv.internal_encoding ISO-8859-1 ISO-8859-1
iconv.output_encoding ISO-8859-1 ISO-8859-1


libxml
--------------------------------------------------------------------------------

libXML support active
libXML Version 2.6.24
libXML streams enabled


mbstring
--------------------------------------------------------------------------------

Multibyte Support enabled
Multibyte string engine libmbfl
Multibyte (japanese) regex support enabled
Multibyte regex (oniguruma) version 3.7.1

mbstring extension makes use of "streamable kanji code filter and converter", which is distributed under the GNU Lesser General Public License version 2.1.

Directive Local Value Master Value
mbstring.detect_order no value no value
mbstring.encoding_translation Off Off
mbstring.func_overload 0 0
mbstring.http_input pass pass
mbstring.http_output pass pass
mbstring.internal_encoding no value no value
mbstring.language neutral neutral
mbstring.strict_detection Off Off
mbstring.substitute_character no value no value


mime_magic
--------------------------------------------------------------------------------

mime_magic support enabled

Directive Local Value Master Value
mime_magic.debug Off Off
mime_magic.magicfile /usr/share/file/magic.mime /usr/share/file/magic.mime


mysql
--------------------------------------------------------------------------------

MySQL Support enabled
Active Persistent Links 1
Active Links 1
Client API version 5.0.22
MYSQL_MODULE_TYPE external
MYSQL_SOCKET /var/run/mysqld/mysqld.sock
MYSQL_INCLUDE -I/usr/include/mysql
MYSQL_LIBS -L/usr/lib -lmysqlclient

Directive Local Value Master Value
mysql.allow_persistent On On
mysql.connect_timeout 60 60
mysql.default_host no value no value
mysql.default_password no value no value
mysql.default_port no value no value
mysql.default_socket no value no value
mysql.default_user no value no value
mysql.max_links Unlimited Unlimited
mysql.max_persistent Unlimited Unlimited
mysql.trace_mode Off Off


mysqli
--------------------------------------------------------------------------------

MysqlI Support enabled
Client API version 5.0.22
MYSQLI_SOCKET /var/run/mysqld/mysqld.sock

Directive Local Value Master Value
mysqli.default_host no value no value
mysqli.default_port 3306 3306
mysqli.default_pw no value no value
mysqli.default_socket no value no value
mysqli.default_user no value no value
mysqli.max_links Unlimited Unlimited
mysqli.reconnect Off Off


openssl
--------------------------------------------------------------------------------

OpenSSL support enabled
OpenSSL Version OpenSSL 0.9.8a 11 Oct 2005


pcre
--------------------------------------------------------------------------------

PCRE (Perl Compatible Regular Expressions) Support enabled
PCRE Library Version 6.4 05-Sep-2005


posix
--------------------------------------------------------------------------------

Revision $Revision: 1.70.2.3 $


Reflection
--------------------------------------------------------------------------------

Reflection enabled
Version $Id: php_reflection.c,v 1.164.2.17 2006/01/01 12:50:12 sniper Exp $


session
--------------------------------------------------------------------------------

Session Support enabled
Registered save handlers files user
Registered serializer handlers php php_binary wddx

Directive Local Value Master Value
session.auto_start Off Off
session.bug_compat_42 On On
session.bug_compat_warn On On
session.cache_expire 180 180
session.cache_limiter nocache nocache
session.cookie_domain no value no value
session.cookie_lifetime 0 0
session.cookie_path / /
session.cookie_secure Off Off
session.entropy_file no value no value
session.entropy_length 0 0
session.gc_divisor 100 100
session.gc_maxlifetime 1440 1440
session.gc_probability 0 0
session.hash_bits_per_character 4 4
session.hash_function 0 0
session.name Cacti PHPSESSID
session.referer_check no value no value
session.save_handler files files
session.save_path /var/lib/php5 /var/lib/php5
session.serialize_handler php php
session.use_cookies On On
session.use_only_cookies Off Off
session.use_trans_sid 0 0


shmop
--------------------------------------------------------------------------------

shmop support enabled


SimpleXML
--------------------------------------------------------------------------------

Simplexml support enabled
Revision $Revision: 1.151.2.10 $
Schema support enabled


soap
--------------------------------------------------------------------------------

Soap Client enabled
Soap Server enabled

Directive Local Value Master Value
soap.wsdl_cache_dir /tmp /tmp
soap.wsdl_cache_enabled 1 1
soap.wsdl_cache_ttl 86400 86400


sockets
--------------------------------------------------------------------------------

Sockets Support enabled


SPL
--------------------------------------------------------------------------------

SPL support enabled
Interfaces Countable, OuterIterator, RecursiveIterator, SeekableIterator, SplObserver, SplSubject
Classes AppendIterator, ArrayIterator, ArrayObject, BadFunctionCallException, BadMethodCallException, CachingIterator, DirectoryIterator, DomainException, EmptyIterator, FilterIterator, InfiniteIterator, InvalidArgumentException, IteratorIterator, LengthException, LimitIterator, LogicException, NoRewindIterator, OutOfBoundsException, OutOfRangeException, OverflowException, ParentIterator, RangeException, RecursiveArrayIterator, RecursiveCachingIterator, RecursiveDirectoryIterator, RecursiveFilterIterator, RecursiveIteratorIterator, RuntimeException, SimpleXMLIterator, SplFileInfo, SplFileObject, SplObjectStorage, SplTempFileObject, UnderflowException, UnexpectedValueException


standard
--------------------------------------------------------------------------------

Regex Library Bundled library enabled
Dynamic Library Support enabled
Path to sendmail /usr/sbin/sendmail -t -i

Directive Local Value Master Value
assert.active 1 1
assert.bail 0 0
assert.callback no value no value
assert.quiet_eval 0 0
assert.warning 1 1
auto_detect_line_endings 0 0
default_socket_timeout 60 60
safe_mode_allowed_env_vars PHP_ PHP_
safe_mode_protected_env_vars LD_LIBRARY_PATH LD_LIBRARY_PATH
url_rewriter.tags a=href,area=href,frame=src,input=src,form=,fieldset= a=href,area=href,frame=src,input=src,form=,fieldset=
user_agent no value no value


sysvmsg
--------------------------------------------------------------------------------

sysvmsg support enabled
Revision $Revision: 1.20.2.3 $


tokenizer
--------------------------------------------------------------------------------

Tokenizer Support enabled


wddx
--------------------------------------------------------------------------------

WDDX Support enabled
WDDX Session Serializer enabled


xml
--------------------------------------------------------------------------------

XML Support active
XML Namespace Support active
libxml2 Version 2.6.24


xmlreader
--------------------------------------------------------------------------------

XMLReader enabled


xmlwriter
--------------------------------------------------------------------------------

XMLWriter enabled


zlib
--------------------------------------------------------------------------------

ZLib Support enabled
Stream Wrapper support compress.zlib://
Stream Filter support zlib.inflate, zlib.deflate
Compiled Version 1.2.3
Linked Version 1.2.3

Directive Local Value Master Value
zlib.output_compression Off Off
zlib.output_compression_level -1 -1
zlib.output_handler no value no value


Additional Modules
Module Name
filepro
sysvsem
sysvshm

[gandalf]

Please give us the very first line of that stuff from cacti log
Reinhard

[osiris123d]

whoops. didn't even see that there was a first line because of all the junk

01/03/2008 01:45:01 PM - POLLER: Poller[0] WARNING: Poller Output Table not Empty. Potential Data Source Issues for Data Sources: 5min_cpu(DS[7948]), cisco_memfree(DS[7949]), cisco_memused(DS[7950]), cisco_tempcur(DS[7951]), cisco_tempthr(DS[7952]), traffic_in(DS[7953]), traffic_out(DS[7953]), traffic_in(DS[7954]), traffic_out(DS[7954]), traffic_in(DS[7955]), traffic_out(DS[7955]), traffic_in(DS[7956]), traffic_out(DS[7956]), traffic_in(DS[7957]), traffic_out(DS[7957]), traffic_in(DS[7958]), traffic_out(DS[7958]), traffic_in(DS[7959]), traffic_out(DS[7959]), traffic_in(DS[7960]), traffic_out(DS[7960]), traffic_in(DS[7961]), traffic_out(DS[7961]), traffic_in(DS[7962]), traffic_out(DS[7962]), traffic_in(DS[7963]), traffic_out(DS[7963]), traffic_in(DS[7964]), traffic_out(DS[7964]), traffic_in(DS[7965]), traffic_out(DS[7965]), traffic_in(DS[7966]), traffic_out(DS[7966]), traffic_in(DS[7967]), traffic_out(DS[7967]), traffic_in(DS[7968]), traffic_out

[gandalf]

I was expecting this. It is a new security check on each poller's run to make sure, all data of previous runs were taken off of poller_output.
Which polling interval do you use? Does the poller finish early enough?
Reinhard

[osiris123d]

I use Polling Interval = Every 5 minutes
Cron Interval = Every 5 minutes
Maximum Concurrent Poller Processes = 10
Maximum Threads per Process = 10


01/03/2008 02:23:23 PM - SYSTEM STATS: Time:202.2198 Method:cmd.php Processes:10 Threads:N/A Hosts:81 HostsPerProcess:9 DataSources:7864 RRDsProcessed:3163

[gandalf]

Well, fine. Quite a long run time. You will have to try spine soon, I suspect. BTB, did you try spine already? Same results?
More likely: Please read second link of my signature and make sure, that the double poller issue is not occuring here. Then report your findings.
Reinhard

[osiris123d]

trying to get spine installed now, but I don't know if it is just Ubuntu or what but spine doesn't install very nicely. I have another post open trying to figure that can of worms out.

http://forums.cacti.net/viewtopic.php?t=25098

[gandalf]

Saw it already. This is Larry's baby; I really can't help on this. And it's not really required now. Let's stick to the other approach
Reinhard

[osiris123d]

So far it looks like I don't have any issue with NaNs. When I do an "ls -la" in the rra folder I notice that some of my rrd files have not been modified for a while. So those rrd files aren't getting updated it looks like.

[gandalf]

So far it looks like I don't have any issue with NaNs. When I do an "ls -la" in the rra folder I notice that some of my rrd files have not been modified for a while. So those rrd files aren't getting updated it looks like.

That was not my concern. But as a generic debugging howto, there's a small bit of text dedicated to the double poller issue. Please make sure, that this is NOT your case. Then, we may try other approaches.
Reinhard

[osiris123d]

checked to make sure there is no duplicate cron jobs running the poller and I look to be good. only place I have the job specified to run is under cron.d directory with a cacti file

*/5 * * * * php /usr/share/cacti/poller.php >/dev/null 2>/usr/share/cacti/log/poller-error.log

[gandalf]

As you said, this is quite a lot of DS reporting errors. Are those graphs fine?
Reinhard

[osiris123d]

Actually now that I look at more of my devices I am noticing sporadic missing data in the graphs.

[osiris123d]

Finally got spine working. Here is what I have so far in my log. Hopefully this solved the issue. I will keep an eye on it and see what happens. Also the reason I wanted to upgrade and move to spine was because when I would issue the "top" command it would show my cpu % at like 80 or 90 %. Now it is down to an average of 50 or 62 %

01/03/2008 04:45:57 PM - SYSTEM STATS: Time:55.3689 Method:spine Processes:1 Threads:10 Hosts:81 HostsPerProcess:81 DataSources:7864 RRDsProcessed:4106
01/03/2008 04:40:32 PM - SYSTEM STATS: Time:31.2183 Method:spine Processes:10 Threads:10 Hosts:81 HostsPerProcess:9 DataSources:7864 RRDsProcessed:4110
01/03/2008 04:35:28 PM - SYSTEM STATS: Time:27.0006 Method:spine Processes:10 Threads:10 Hosts:81 HostsPerProcess:9 DataSources:7864 RRDsProcessed:4106
01/03/2008 04:35:01 PM - POLLER: Poller[0] WARNING: Poller Output Table not Empty. Potential Data Source Issues for Data Sources: traffic_in(DS[10312]), traffic_out(DS[10312]), traffic_in(DS[10313]), traffic_out(DS[10313]), traffic_in(DS[10314]), traffic_out(DS[10314]), traffic_in(DS[10315]), traffic_out(DS[10315]), traffic_in(DS[10316]), traffic_out(DS[10316]), traffic_in(DS[10317]), traffic_out(DS[10317]), traffic_in(DS[10318]), traffic_out(DS[10318]), traffic_in(DS[10319]), traffic_out(DS[10319]), traffic_in(DS[10320]), traffic_out(DS[10320]), traffic_in(DS[10321]), traffic_out(DS[10321]), traffic_in(DS[10322]), traffic_out(DS[10322]), traffic_in(DS[10323]), traffic_out(DS[10323]), traffic_in(DS[10324]), traffic_out(DS[10324]), traffic_in(DS[10325]), traffic_out(DS[10325]), traffic_in(DS[10326]), traffic_out(DS[10326]), traffic_in(DS[10327]), traffic_out(DS[10327]), traffic_in(DS[10328]), traffic_out(DS[10328]), traffic_in(DS[10329]), traffic_out(DS[10329]), traffic_in(DS[10330]), traffic_out(DS[10330]), traffic_in(DS[10331]), traffic_out(DS[10331]), traffic_in(DS[10332]), traffic_out(DS[10332]), traffic_in(DS[10333]), traffic_out(DS[10333]), traffic_in(DS[10334]), traffic_out(DS[10334]), traffic_in(DS[10335]), traffic_out(DS[10335]), traffic_in(DS[10336]), traffic_out(DS[10336]), traffic_in(DS[10337]), traffic_out(DS[10337]), traffic_in(DS[10338]), traffic_out(DS[10338]), traffic_in(DS[10339]), traffic_out(DS[10339]), traffic_in(DS[10340]), traffic_out(DS[10340]), traffic_in(DS[10810]), traffic_out(DS[10810]), cisco_memfree(DS[12214]), cisco_memused(DS[12215]), cisco_tempcur(DS[12216]), cisco_tempthr(DS[12217]), routing_memory_used(DS[12237]), routing_table_size(DS[12238]), traffic_in(DS[12253]), traffic_out(DS[12253]), traffic_in(DS[12254]), traffic_out(DS[12254])