rrd files getting -nan after migration to Centos 6.2

[dzm]

I've migrated from Centos 5.x to Centos 6.2. Everything seems to be working fine except for rrd file updates.

I'm at a loss. The old system is still happily updating its own rrd file, and if I pull them over to the new system then the graphs are drawn appropriately. On the new system, however, I get -nan in the rrd updates:

Code: Select all

1333303500: -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan
1333303800: -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan

But the exact same rrd files, with the exact same templates and data sources, work as expected on the Centos 5.x box:

Code: Select all

1333305300: 2.7100000000e+01 2.7100666667e+01 2.7199333333e+01 3.2006666667e+00 2.7953333333e+00 2.1973333333e+00 1.2069600000e+02 1.2119333333e+02 1.2069800000e+02 0.0000000000e+00 0.0000000000e+00 0.0000000000e+00 3.8630726667e+02 3.3878040000e+02 2.6521453333e+02 3.9888666667e+01 3.9092666667e+01 3.8396000000e+01 nan 1.3000000000e+01 1.2798000000e+01 9.1006666667e+01 9.0908000000e+01 9.1601333333e+01 2.1993333333e+00 1.1830866667e+03 1.1818040000e+03 1.1723134667e+03 3.9999333333e+01 3.9998000000e+01 3.9697333333e+01 1.4794666667e+01 1.4397333333e+01 1.4099333333e+01 8.2013333333e+01 8.3008666667e+01 8.3399333333e+01 2.7993333333e+00 1.2133493333e+03 1.1951000000e+03 1.1758750667e+03 4.9986666667e+00
1333305600: 2.7298000000e+01 2.7199000000e+01 2.7200000000e+01 2.2100000000e+00 2.1070000000e+00 2.2000000000e+00 1.2030400000e+02 1.2090300000e+02 1.2079900000e+02 0.0000000000e+00 0.0000000000e+00 0.0000000000e+00 2.6587580000e+02 2.5474470000e+02 2.6575780000e+02 3.9900000000e+01 3.9892000000e+01 3.8895000000e+01 nan 1.3000000000e+01 1.2998000000e+01 9.1000000000e+01 9.0999000000e+01 9.1402000000e+01 2.2990000000e+00 1.1830000000e+03 1.1829870000e+03 1.1880428000e+03 3.9010000000e+01 3.9307000000e+01 3.9700000000e+01 1.4008000000e+01 1.4202000000e+01 1.4100000000e+01 8.2990000000e+01 8.2604000000e+01 8.3400000000e+01 2.8000000000e+00 1.1625160000e+03 1.1731428000e+03 1.1759400000e+03 5.0990000000e+00

I've tried following Gandalf's troubleshooting guide. I've tried reinstalling rrdtool (including building from source). The log files don't indicate any errors (they show the rrdtool update command running, they show the SQL updates, etc).

I'd appreciate any pointers.

[gandalf]

Which rrdtool versions are used on both?
R.

[dzm]

Which rrdtool versions are used on both?
R.

1.4.5.

Though after posting this I decided to stop staring at it. When I came back the updates had started working. So - 24 hours of outage, and then - *poof!* The car will always stop misbehaving when you go to the mechanic.