Node shutdown

Question

When our node shut down during asset inserts we got this message :

ERROR: AcceptToMemoryPool : inputs already spent

 

what does it mean and how can we fix this?

Comments

more lines from same log  just before node crashed

2016-03-14 18:10:35 AddToWallet b0c9b683a2885209c27a4d83656b45dcdedff562de7f9290f1199c194219e0e1  new; Time: 0.008580
2016-03-14 18:10:35 AddToWallet aa2c4ccbe8ec16df840f0f3bf162c8060f390e343d8ea6f86f966e193d529762  new; Time: 0.008025
2016-03-14 18:10:35 CommitTransaction:
CTransaction(hash=392b4183a4, ver=1, vin.size=50, vout.size=3, nLockTime=0)
    CTxIn(COutPoint(05eb6278a2, 0), scriptSig=3045022100eb07d8476b24d1)
    CTxIn(COutPoint(05ffb93ddd, 0), scriptSig=3044022066eaf75a586344c9)
    CTxIn(COutPoint(085db8bc30, 0), scriptSig=304402204fc309f270da5e73)
    CTxIn(COutPoint(10c0c5b964, 0), scriptSig=3044022001525e2c941e81eb)
    CTxIn(COutPoint(16a16d38e2, 0), scriptSig=3045022100aa2cfa1b9f3d3d)
    CTxIn(COutPoint(2208b02dee, 0), scriptSig=304402207329aba5f43e7e46)
    CTxIn(COutPoint(2fd61ccb9b, 0), scriptSig=3044022065f687b1fa08502d)
    CTxIn(COutPoint(3ea176643b, 0), scriptSig=3044022071c7e949d27c4888)
    CTxIn(COutPoint(3f4ff4110a, 0), scriptSig=3045022100f24c216230d60b)
    CTxIn(COutPoint(3f539b929e, 0), scriptSig=3045022100e6cf936b3d5b21)
    CTxIn(COutPoint(40cc7b2b67, 0), scriptSig=304402207946bd2ae918581c)
    CTxIn(COutPoint(454a6169ab, 0), scriptSig=30440220750925d31dae5d9a)
    CTxIn(COutPoint(50ea7f8fa7, 0), scriptSig=3044022059bb0bf6f4bbb071)
    CTxIn(COutPoint(54c03d9cf1, 0), scriptSig=304402206a73616be76a8e38)
    CTxIn(COutPoint(5d91b67aaf, 0), scriptSig=304402204d0a9ab3b70bc503)
    CTxIn(COutPoint(622dca2552, 0), scriptSig=3045022100a3091f2a14ed38)
    CTxIn(COutPoint(66e81a2939, 0), scriptSig=3044022043966061e2f43ebe)
    CTxIn(COutPoint(69987d1c5a, 0), scriptSig=30450221008c6d14c62bf3d7)
    CTxIn(COutPoint(6e54c4931f, 0), scriptSig=30440220115ebb311c0b5839)
    CTxIn(COutPoint(720f5540a3, 0), scriptSig=3044022033e2ff38ebe79b2f)
    CTxIn(COutPoint(77c836508c, 0), scriptSig=3045022100ea16f89c25a879)
    CTxIn(COutPoint(7890526c87, 0), scriptSig=3045022100d12ca300a8065b)
    CTxIn(COutPoint(7f1a9e69b8, 0), scriptSig=30440220745880e27a58eab5)
    CTxIn(COutPoint(821cbc56cd, 0), scriptSig=30440220757ac9d6247dcc4c)
    CTxIn(COutPoint(8d6e8fb513, 0), scriptSig=3045022100b81b15dffb5cbc)
    CTxIn(COutPoint(8f10ce1ba8, 0), scriptSig=3045022100c022e59e4fe460)
    CTxIn(COutPoint(93839aaa96, 0), scriptSig=3045022100cfd3e04e1380b3)
    CTxIn(COutPoint(9fc2084693, 0), scriptSig=3045022100c6666904c3435e)
    CTxIn(COutPoint(a7e538f3f6, 0), scriptSig=304402205b6a1f57c94c2f5a)
    CTxIn(COutPoint(ade26de972, 0), scriptSig=304402200fa4585de6d43bbb)
    CTxIn(COutPoint(bfaab45227, 0), scriptSig=3045022100a45e7668c92c8c)
    CTxIn(COutPoint(c54f5efe14, 0), scriptSig=3044022032c2933a75ca884b)
    CTxIn(COutPoint(c5be376d6b, 0), scriptSig=30440220707208c063f4f9c9)
    CTxIn(COutPoint(c5ea675226, 0), scriptSig=30440220781d3d7696df5518)
    CTxIn(COutPoint(ccdcd99e2c, 0), scriptSig=304402201a22631efa8f4f31)
    CTxIn(COutPoint(cdff7f9389, 0), scriptSig=3044022032ce67882fd4e8f7)
    CTxIn(COutPoint(ce4dae60d5, 0), scriptSig=304402200802589deb59902e)
    CTxIn(COutPoint(ced77c647c, 0), scriptSig=3044022032431cabbd9561da)
    CTxIn(COutPoint(d04ea71ed6, 0), scriptSig=3045022100fc2d690c9e9467)
    CTxIn(COutPoint(d181213d41, 0), scriptSig=3044022004d150bb826321c9)
    CTxIn(COutPoint(dbdb71ec37, 0), scriptSig=3045022100e8edab68a2d82c)
    CTxIn(COutPoint(e10fa0aefd, 0), scriptSig=3044022061f6c5ba03518e2b)
    CTxIn(COutPoint(ee678cbf91, 0), scriptSig=3045022100c43e07e3690695)
    CTxIn(COutPoint(ef39bf1439, 0), scriptSig=304402204777ecbbb7ff2f0f)
    CTxIn(COutPoint(f0d9c94e5e, 0), scriptSig=304402207500088cf2600d13)
    CTxIn(COutPoint(f193af3c59, 0), scriptSig=3045022100811822943a3f0e)
    CTxIn(COutPoint(f348f65720, 0), scriptSig=30450221009f55d795178313)
    CTxIn(COutPoint(f54fa883ba, 0), scriptSig=3044022046428141678a1900)
    CTxIn(COutPoint(f5f8b57871, 0), scriptSig=3045022100dc6bb4383b7a66)
    CTxIn(COutPoint(fedc5dfc41, 0), scriptSig=30450221008df5932f4bbf6d)
    CTxOut(nValue=0.00000000, scriptPubKey=OP_DUP OP_HASH160 fba5db6b7fad)
    CTxOut(nValue=0.00000000, scriptPubKey=OP_DUP OP_HASH160 fba5db6b7fad)
    CTxOut(nValue=0.00000000, scriptPubKey=OP_DUP OP_HASH160 fba5db6b7fad)
2016-03-14 18:10:35 AddToWallet 392b4183a4b762cd395e30faec76b65cab3a0bd34fce2235222babe7cc971317  new; Time: 0.103536
2016-03-14 18:10:35 AddToWallet 392b4183a4b762cd395e30faec76b65cab3a0bd34fce2235222babe7cc971317  ; Time: 0.000101
2016-03-14 18:10:35 Relaying wtx 392b4183a4b762cd395e30faec76b65cab3a0bd34fce2235222babe7cc971317
2016-03-14 18:10:35 Combine transaction for address 1b1fNjtCg7CmPQYBh219Mgq9L2TTbvUd7dhjDT (50 inputs,3 outputs): 392b4183a4b762cd395e30faec76b65cab3a0bd34fce2235222babe7cc971317; Time:    0.398s
2016-03-14 18:10:36 ERROR: AcceptToMemoryPool : inputs already spent

Answer 1

This is related to MultiChain's functionality for automatically combining unspent outputs (see autocombine* settings in the runtime parameters) and it looks like the outputs it's trying to combine got spent in the meantime. This can happen legitimately but of course it shouldn't cause a crash. I'll forward to the dev team and let you know.

Answer 2

So it seems this "error" is normal and nothing to do with the crash. Are these the last log lines? Can you tell me anything about how you were using MultiChain at the time, including load, etc...?

Comments

We were inserting assets on one node into three different wallets: asset1 into wallet1, asset2 into wallet2, asset3 into wallet3, asset4 into wallet1, .... There were 3 nodes active on 3 separate servers. It crashed around 10000.

---

Thanks. Do you mean issuing assets?