| Index | Recent Threads | Unanswered Threads | Who's Active | Guidelines | Search |
 |
World Community Grid Forums
Category: Completed Research
Forum: The Clean Energy Project - Phase 2 Forum
Thread: Tasks are not checkpointing proporly |
| No member browsing this thread |
|
Thread Status: Active Total posts in this thread: 54
|
|
| Author |
|
|
I need a bath
Senior Cruncher USA Joined: Apr 12, 2007 Post Count: 347 Status: Offline Project Badges: 
|
the other interesting thing about losing so much cpu time is that newly downloaded tasks are expected to finish unrealistically quickly- according to perceived (by boinc) rather than actual cpu time. I have one that's been running for 4:21 with CPU time now at 1:02. Downloaded tasks "think" they are going to finish in 4 hours.
----------------------------------------HA!  |
||
|
|
Sekerob
Ace Cruncher Joined: Jul 24, 2005 Post Count: 20043 Status: Offline |
That is strange as from BOINC 6.4 the DCF (duration correction factor) is Elapsed time influenced. The FPOPS in the job header are science wide average, not client specific. This DCF value you can check in the project properties screen of the BM. Mine is 1.23 and the CEP2 jobs list as about 8 hours. Mind you, I receive C4CW jobs always with a Windows run time estimate, but on Linux they run 60% faster so when a few complete the DCF takes a nose dive to 0.5 0.6.
----------------------------------------Something is really wrong with your host. 4:21 elapsed with just 1:02 just does not tally. Have you set that "While processor usage % ", is LAIM really selected, better still, is Run Always selected in the Activity menu to ensure full throttle? You may have answered this before but crunching air is what seems to happen here.
WCG
Please help to make the Forums an enjoyable experience for All! |
||
|
|
I need a bath
Senior Cruncher USA Joined: Apr 12, 2007 Post Count: 347 Status: Offline Project Badges:
|
all those things are a-ok. Is the DCF influenced by all the quick HCC wus I am processing? Its running 6 of them and two CEP2 right now. Nothing wrong with the HCCs. It is flying through them.
----------------------------------------edit. sorry didn't read your post thoroughly. Yes the HCCs are what's doing it. sorry [Edit 1 times, last edit by I need a bath at Oct 5, 2010 9:40:29 PM] |
||
|
|
I need a bath
Senior Cruncher USA Joined: Apr 12, 2007 Post Count: 347 Status: Offline Project Badges:
|
okay here's what just happened
----------------------------------------at 5:39 (system clock and also local time here) cpu time at last checkpoint 4:59 cpu time 56:08 elapsed time 57:30 all a-ok THEN at 5:55 local time CPU time at last checkpoint: 9:13 cpu time:12:37 elapsed time 1:14:13 What!!!??? |
||
|
|
I need a bath
Senior Cruncher USA Joined: Apr 12, 2007 Post Count: 347 Status: Offline Project Badges:
|
now,
----------------------------------------at 6:02 local time CPU time at last checkpoint: 16:30 cpu time:18:53 elapsed time 1:21:06 |
||
|
|
I need a bath
Senior Cruncher USA Joined: Apr 12, 2007 Post Count: 347 Status: Offline Project Badges:
|
now!
----------------------------------------at 6:05 local time CPU time at last checkpoint: 19:56 cpu time: 21:12 elapsed time 1:23:41 why so many checkpoints all of a sudden? Is this normal? |
||
|
|
I need a bath
Senior Cruncher USA Joined: Apr 12, 2007 Post Count: 347 Status: Offline Project Badges:
|
And THIS job is the one I posted had at one point 4:21 elapsed with CPU time at 1:02 managed to finish in a (claimed) time of 2:05. Poor wingman will not get many points because of me, I think.
----------------------------------------One point of interest is that this one was suspended for a while and then resumed, so clock time doesn't matched elapsed. That won't be the case for the one I will document tomorrow. I will post the results from the next one tomorrow. Got to go home now or pay the price! Result Name: E200417_ 948_ A.23.C15H7N3S5.21.0.set1d06_ 0-- <core_client_version>6.10.56</core_client_version> <![CDATA[ <stderr_txt> INFO: No state to restore. Start from the beginning. [11:36:15] Number of jobs = 16 [11:36:15] Starting job 0,CPU time has been restored to 0.000000. [11:36:16] Starting new Job [11:36:16] Qink name = fldman [11:36:16] Qink name = gesman [11:36:16] Qink name = scfman [11:37:29] Qink name = anlman [11:37:30] End of Job [11:37:33] Finished Job #0 [11:37:33] Starting job 1,CPU time has been restored to 65.460091. [11:37:33] Starting new Job [11:37:33] Qink name = fldman [11:37:33] Qink name = gesman [11:37:34] Qink name = scfman [11:40:50] Qink name = anlman [11:41:08] End of Job [11:41:10] Finished Job #1 [11:41:10] Starting job 2,CPU time has been restored to 267.424713. [11:41:10] Starting new Job [11:41:10] Qink name = fldman [11:41:11] Qink name = gesman [11:41:11] Qink name = scfman [11:43:44] Qink name = anlman [11:43:44] Qink name = drvman [11:44:26] Qink name = optman [11:44:26] Qink name = fldman [11:44:26] Qink name = gesman [11:44:27] Qink name = scfman [11:48:55] Qink name = anlman [11:48:55] Qink name = drvman [11:49:38] Qink name = optman [11:49:38] Qink name = fldman [11:49:38] Qink name = gesman [11:49:38] Qink name = scfman [11:53:55] Qink name = anlman [11:53:56] Qink name = drvman [11:54:38] Qink name = optman [11:54:38] Qink name = fldman [11:54:38] Qink name = gesman [11:54:39] Qink name = scfman [11:58:50] Qink name = anlman [11:58:50] Qink name = drvman [11:59:32] Qink name = optman [11:59:32] Qink name = fldman [11:59:32] Qink name = gesman [11:59:33] Qink name = scfman [12:03:07] Qink name = anlman [12:03:07] Qink name = drvman [12:03:49] Qink name = optman [12:03:49] Qink name = fldman [12:03:49] Qink name = gesman [12:03:49] Qink name = scfman [12:07:37] Qink name = anlman [12:07:37] Qink name = drvman [12:08:19] Qink name = optman [12:08:19] Qink name = fldman [12:08:19] Qink name = gesman [12:08:19] Qink name = scfman [12:11:45] Qink name = anlman [12:11:45] Qink name = drvman [12:12:26] Qink name = optman [12:12:26] Qink name = fldman [12:12:26] Qink name = gesman [12:12:27] Qink name = scfman [12:15:58] Qink name = anlman [12:15:58] Qink name = drvman [12:16:41] Qink name = optman [12:16:41] Qink name = fldman [12:16:41] Qink name = gesman [12:16:41] Qink name = scfman [12:20:09] Qink name = anlman [12:20:09] Qink name = drvman [12:20:51] Qink name = optman [12:20:51] Qink name = fldman [12:20:51] Qink name = gesman [12:20:51] Qink name = scfman [12:24:19] Qink name = anlman [12:24:19] Qink name = drvman [12:25:01] Qink name = optman [12:25:01] Qink name = fldman [12:25:01] Qink name = gesman [12:25:01] Qink name = scfman [12:27:59] Qink name = anlman [12:27:59] Qink name = drvman [12:28:41] Qink name = optman [12:28:41] Qink name = fldman [12:28:41] Qink name = gesman [12:28:42] Qink name = scfman [12:31:38] Qink name = anlman [12:31:38] Qink name = drvman [12:32:20] Qink name = optman [12:32:20] Qink name = anlman [12:32:38] End of Job [12:32:41] Finished Job #2 [12:32:41] Starting job 3,CPU time has been restored to 521.492591. [12:32:41] Starting new Job [12:32:41] Qink name = fldman [12:32:42] Qink name = gesman [12:32:42] Qink name = scfman [12:36:45] Qink name = anlman [12:37:03] End of Job [12:37:05] Finished Job #3 [12:37:05] Starting job 4,CPU time has been restored to 767.883989. [12:37:05] Starting new Job [12:37:05] Qink name = fldman [12:37:06] Qink name = gesman [12:37:06] Qink name = scfman Quit requested: Exiting [13:56:36] Number of jobs = 16 [13:56:36] Starting job 4,CPU time has been restored to 767.883989. [13:56:37] Starting new Job [13:56:37] Qink name = fldman [13:56:38] Qink name = gesman [13:56:38] Qink name = scfman [13:59:29] Qink name = anlman [13:59:47] End of Job [13:59:50] Finished Job #4 [13:59:50] Starting job 5,CPU time has been restored to 940.726791. [13:59:50] Starting new Job [13:59:50] Qink name = fldman [13:59:50] Qink name = gesman [13:59:50] Qink name = scfman [14:02:48] Qink name = anlman [14:03:07] End of Job [14:03:10] Finished Job #5 [14:03:10] Starting job 6,CPU time has been restored to 1122.846172. [14:03:10] Starting new Job [14:03:10] Qink name = fldman [14:03:11] Qink name = gesman [14:03:11] Qink name = scfman [14:05:53] Qink name = anlman [14:06:09] End of Job [14:06:11] Finished Job #6 [14:06:11] Starting job 7,CPU time has been restored to 1293.152815. [14:06:12] Starting new Job [14:06:12] Qink name = fldman [14:06:12] Qink name = gesman [14:06:12] Qink name = scfman [14:10:35] Qink name = anlman [14:10:51] End of Job [14:10:53] Finished Job #7 [14:10:53] Starting job 8,CPU time has been restored to 1550.288885. [14:10:53] Starting new Job [14:10:53] Qink name = fldman [14:10:54] Qink name = gesman [14:10:54] Qink name = scfman [14:13:54] Qink name = anlman [14:14:11] End of Job [14:14:13] Finished Job #8 [14:14:13] Starting job 9,CPU time has been restored to 1741.108810. [14:14:14] Starting new Job [14:14:14] Qink name = fldman [14:14:14] Qink name = gesman [14:14:14] Qink name = scfman [14:17:03] Qink name = anlman [14:17:28] End of Job [14:17:31] Finished Job #9 [14:17:31] Starting job 10,CPU time has been restored to 1919.091933. [14:17:31] Starting new Job [14:17:31] Qink name = fldman [14:17:31] Qink name = gesman [14:17:31] Qink name = scfman [14:24:17] Qink name = anlman [14:24:44] End of Job [14:24:46] Finished Job #10 [14:24:46] Starting job 11,CPU time has been restored to 2176.348010. [14:24:46] Starting new Job [14:24:46] Qink name = fldman [14:24:47] Qink name = gesman [14:24:47] Qink name = scfman [14:28:25] Qink name = anlman [14:28:50] End of Job [14:28:52] Finished Job #11 [14:28:52] Starting job 12,CPU time has been restored to 2406.906419. [14:28:52] Starting new Job [14:28:53] Qink name = fldman [14:28:55] Qink name = gesman [14:28:55] Qink name = scfman [14:51:02] Qink name = anlman [14:55:33] End of Job [14:55:36] Finished Job #12 [14:55:36] Starting job 13,CPU time has been restored to 2667.410699. [14:55:36] Starting new Job [14:55:36] Qink name = fldman [14:55:38] Qink name = gesman [14:55:38] Qink name = scfman [15:56:47] Qink name = anlman [16:01:32] End of Job [16:01:35] Finished Job #13 [16:01:35] Starting job 14,CPU time has been restored to 2924.506766. [16:01:35] Starting new Job [16:01:35] Qink name = fldman [16:01:38] Qink name = gesman [16:01:38] Qink name = scfman [17:03:56] Qink name = anlman [17:09:01] End of Job [17:09:04] Finished Job #14 [17:09:04] Starting job 15,CPU time has been restored to 3182.078863. [17:09:04] Starting new Job [17:09:04] Qink name = fldman [17:09:07] Qink name = gesman [17:09:07] Qink name = scfman [18:13:49] Qink name = anlman [18:19:43] End of Job [18:19:46] Finished Job #15 called boinc_finish Exiting 0 </stderr_txt> ]]> |
||
|
|
I need a bath
Senior Cruncher USA Joined: Apr 12, 2007 Post Count: 347 Status: Offline Project Badges:
|
okay so can some tech please look at this?
----------------------------------------When job 2 finished and 3 started the cpu time was decreased from last known value of 56:08 cpu time (57:30 elapsed time) at 5:39 local time to 553 seconds (9:21 min) I didn't check the rest of the checkpoints after this. the task finished and was validated. Result Name: E200417_ 222_ A.23.C17H9NO3S2.18.0.set1d06_ 0-- <core_client_version>6.10.56</core_client_version> <![CDATA[ <stderr_txt> INFO: No state to restore. Start from the beginning. [16:41:45] Number of jobs = 16 [16:41:45] Starting job 0,CPU time has been restored to 0.000000. [16:41:45] Starting new Job [16:41:45] Qink name = fldman [16:41:45] Qink name = gesman [16:41:45] Qink name = scfman [16:43:09] Qink name = anlman [16:43:10] End of Job [16:43:13] Finished Job #0 [16:43:13] Starting job 1,CPU time has been restored to 75.464716. [16:43:13] Starting new Job [16:43:13] Qink name = fldman [16:43:14] Qink name = gesman [16:43:14] Qink name = scfman [16:46:58] Qink name = anlman [16:47:14] End of Job [16:47:16] Finished Job #1 [16:47:16] Starting job 2,CPU time has been restored to 299.350708. [16:47:16] Starting new Job [16:47:16] Qink name = fldman [16:47:17] Qink name = gesman [16:47:17] Qink name = scfman [16:50:05] Qink name = anlman [16:50:05] Qink name = drvman [16:50:50] Qink name = optman [16:50:51] Qink name = fldman [16:50:51] Qink name = gesman [16:50:51] Qink name = scfman [16:55:31] Qink name = anlman [16:55:31] Qink name = drvman [16:56:17] Qink name = optman [16:56:17] Qink name = fldman [16:56:17] Qink name = gesman [16:56:18] Qink name = scfman [17:01:18] Qink name = anlman [17:01:18] Qink name = drvman [17:02:03] Qink name = optman [17:02:03] Qink name = fldman [17:02:03] Qink name = gesman [17:02:04] Qink name = scfman [17:06:41] Qink name = anlman [17:06:41] Qink name = drvman [17:07:27] Qink name = optman [17:07:27] Qink name = fldman [17:07:27] Qink name = gesman [17:07:27] Qink name = scfman [17:11:26] Qink name = anlman [17:11:26] Qink name = drvman [17:12:12] Qink name = optman [17:12:12] Qink name = fldman [17:12:12] Qink name = gesman [17:12:12] Qink name = scfman [17:16:19] Qink name = anlman [17:16:19] Qink name = drvman [17:17:07] Qink name = optman [17:17:07] Qink name = fldman [17:17:07] Qink name = gesman [17:17:08] Qink name = scfman [17:21:15] Qink name = anlman [17:21:15] Qink name = drvman [17:22:03] Qink name = optman [17:22:03] Qink name = fldman [17:22:03] Qink name = gesman [17:22:03] Qink name = scfman [17:26:01] Qink name = anlman [17:26:01] Qink name = drvman [17:26:49] Qink name = optman [17:26:49] Qink name = fldman [17:26:49] Qink name = gesman [17:26:50] Qink name = scfman [17:30:51] Qink name = anlman [17:30:51] Qink name = drvman [17:31:39] Qink name = optman [17:31:39] Qink name = fldman [17:31:39] Qink name = gesman [17:31:39] Qink name = scfman [17:35:13] Qink name = anlman [17:35:13] Qink name = drvman [17:36:00] Qink name = optman [17:36:00] Qink name = fldman [17:36:00] Qink name = gesman [17:36:00] Qink name = scfman [17:39:22] Qink name = anlman [17:39:22] Qink name = drvman [17:40:09] Qink name = optman [17:40:09] Qink name = fldman [17:40:09] Qink name = gesman [17:40:09] Qink name = scfman [17:43:23] Qink name = anlman [17:43:23] Qink name = drvman [17:44:08] Qink name = optman [17:44:08] Qink name = fldman [17:44:08] Qink name = gesman [17:44:09] Qink name = scfman [17:47:25] Qink name = anlman [17:47:25] Qink name = drvman [17:48:11] Qink name = optman [17:48:11] Qink name = fldman [17:48:11] Qink name = gesman [17:48:11] Qink name = scfman [17:51:20] Qink name = anlman [17:51:20] Qink name = drvman [17:52:06] Qink name = optman [17:52:06] Qink name = anlman [17:52:21] End of Job [17:52:24] Finished Job #2 [17:52:24] Starting job 3,CPU time has been restored to 553.130568. [17:52:24] Starting new Job [17:52:24] Qink name = fldman [17:52:24] Qink name = gesman [17:52:25] Qink name = scfman [17:56:36] Qink name = anlman [17:56:53] End of Job [17:56:55] Finished Job #3 [17:56:55] Starting job 4,CPU time has been restored to 802.334142. [17:56:55] Starting new Job [17:56:55] Qink name = fldman [17:56:56] Qink name = gesman [17:56:56] Qink name = scfman [18:00:00] Qink name = anlman [18:00:16] End of Job [18:00:19] Finished Job #4 [18:00:19] Starting job 5,CPU time has been restored to 990.725915. [18:00:19] Starting new Job [18:00:19] Qink name = fldman [18:00:20] Qink name = gesman [18:00:20] Qink name = scfman [18:03:40] Qink name = anlman [18:03:57] End of Job [18:03:59] Finished Job #5 [18:03:59] Starting job 6,CPU time has been restored to 1196.182755. [18:03:59] Starting new Job [18:03:59] Qink name = fldman [18:04:00] Qink name = gesman [18:04:00] Qink name = scfman [18:07:02] Qink name = anlman [18:07:18] End of Job [18:07:21] Finished Job #6 [18:07:21] Starting job 7,CPU time has been restored to 1384.534526. [18:07:21] Starting new Job [18:07:21] Qink name = fldman [18:07:21] Qink name = gesman [18:07:21] Qink name = scfman [18:12:12] Qink name = anlman [18:12:27] End of Job [18:12:30] Finished Job #7 [18:12:30] Starting job 8,CPU time has been restored to 1642.298635. [18:12:31] Starting new Job [18:12:31] Qink name = fldman [18:12:31] Qink name = gesman [18:12:31] Qink name = scfman [18:15:24] Qink name = anlman [18:15:40] End of Job [18:15:42] Finished Job #8 [18:15:42] Starting job 9,CPU time has been restored to 1826.282133. [18:15:43] Starting new Job [18:15:43] Qink name = fldman [18:15:43] Qink name = gesman [18:15:43] Qink name = scfman [18:18:42] Qink name = anlman [18:19:09] End of Job [18:19:12] Finished Job #9 [18:19:12] Starting job 10,CPU time has been restored to 2023.446455. [18:19:12] Starting new Job [18:19:12] Qink name = fldman [18:19:12] Qink name = gesman [18:19:12] Qink name = scfman [18:27:41] Qink name = anlman [18:28:05] End of Job [18:28:07] Finished Job #10 [18:28:07] Starting job 11,CPU time has been restored to 2281.366574. [18:28:08] Starting new Job [18:28:08] Qink name = fldman [18:28:08] Qink name = gesman [18:28:08] Qink name = scfman [18:32:13] Qink name = anlman [18:32:42] End of Job [18:32:44] Finished Job #11 [18:32:44] Starting job 12,CPU time has been restored to 2536.246503. [18:32:44] Starting new Job [18:32:45] Qink name = fldman [18:32:47] Qink name = gesman [18:32:47] Qink name = scfman [18:57:48] Qink name = anlman [19:02:04] End of Job [19:02:07] Finished Job #12 [19:02:07] Starting job 13,CPU time has been restored to 2796.690779. [19:02:07] Starting new Job [19:02:08] Qink name = fldman [19:02:10] Qink name = gesman [19:02:10] Qink name = scfman [20:05:18] Qink name = anlman [20:09:34] End of Job [20:09:37] Finished Job #13 [20:09:37] Starting job 14,CPU time has been restored to 3053.906854. [20:09:38] Starting new Job [20:09:38] Qink name = fldman [20:09:40] Qink name = gesman [20:09:40] Qink name = scfman [21:15:40] Qink name = anlman [21:20:00] End of Job [21:20:02] Finished Job #14 [21:20:02] Starting job 15,CPU time has been restored to 3311.230935. [21:20:03] Starting new Job [21:20:03] Qink name = fldman [21:20:05] Qink name = gesman [21:20:05] Qink name = scfman [22:26:27] Qink name = anlman [22:32:57] End of Job [22:33:00] Finished Job #15 called boinc_finish Exiting 0 </stderr_txt> ]]> |
||
|
|
Sekerob
Ace Cruncher Joined: Jul 24, 2005 Post Count: 20043 Status: Offline |
Sometimes I'm looking at the forest and not seeing the trees... forget about manual time annotations... only now note that the CPU time is actually recorded with each step... a duh moment. An example of a valid job off my quad, condensed to just the job starts:
----------------------------------------<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> INFO: No state to restore. Start from the beginning. [09:07:34] Number of jobs = 16 [09:07:34] Starting job 0,CPU time has been restored to 0.000000. [09:09:17] Starting job 1,CPU time has been restored to 74.980000. [09:13:08] Starting job 2,CPU time has been restored to 280.730000. [10:30:30] Starting job 3,CPU time has been restored to 4209.920000. [10:34:52] Starting job 4,CPU time has been restored to 4447.950000. [10:38:23] Starting job 5,CPU time has been restored to 4637.010000. [10:41:54] Starting job 6,CPU time has been restored to 4829.120000. [10:45:17] Starting job 7,CPU time has been restored to 5011.970000. [10:50:06] Starting job 8,CPU time has been restored to 5275.080000. [10:53:25] Starting job 9,CPU time has been restored to 5458.690000. [10:57:11] Starting job 10,CPU time has been restored to 5655.710000. [11:05:47] Starting job 11,CPU time has been restored to 6130.760000. [11:10:30] Starting job 12,CPU time has been restored to 6372.430000. [11:37:25] Starting job 13,CPU time has been restored to 7859.190000. [12:44:26] Starting job 14,CPU time has been restored to 11504.440000. [13:55:12] Starting job 15,CPU time has been restored to 15294.880000. [15:18:50] End of Job [15:18:53] Finished Job #15 called boinc_finish Exiting 0 </stderr_txt> ]]> Unfortunately the final CPU time is not recorded, but it was 5:37:26 according BOINCTasks or 20246 seconds which compared to your job is wholly different. So why is your machine racing through the jobs, in CPU recorded time... for instance job 2 (3 really), uses about 65 minutes in wallclock, but only 254 seconds in CPU time from 299 to 553? I'll poll the techs on this. edit: spellchecked the post title :P
WCG
Please help to make the Forums an enjoyable experience for All! |
||
|
|
armstrdj
Former World Community Grid Tech Joined: Oct 21, 2004 Post Count: 695 Status: Offline Project Badges: 
|
We are looking into the issues. First let me say that Sekerob is correct the Linux version running in Production has not changed since launch. We have been testing the Windows version in Beta with code changes but the Linux build with these changes have not been tested.
There was a bug in the latest windows build that went through alpha so the beta has been delayed. We will be re running the alpha for both Linux and Windows with a new build. If all goes well the beta will start soon. Can someone who has had the issue with "Leave in Memory" checked but the application is restarting from the beginning (0%) post the result log when this occurred. Thanks, armstrdj |
||
|
|
|