Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go ยป
No member browsing this thread
Thread Status: Active
Total posts in this thread: 49
Posts: 49   Pages: 5   [ Previous Page | 1 2 3 4 5 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 10170 times and has 48 replies Next Thread
Sgt.Joe
Ace Cruncher
USA
Joined: Jul 4, 2006
Post Count: 7777
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Mapping Cancer Markers Beta Test - Version 7.28 [ Issues Thread ]

Personally, hope the techs take the time to move 7.28 to production, even this weekend. Probably they caught by far the biggest portion of the invalid problem, so what is produced after upgrade will have a whole lot less concern and wasted time, possibly years and it still would be under 5% fail rate [but on 250 years production per day that's a bunch of extra replication. More [low frequency] bugs can be fixed in a later release, with less time-pressure.

I agree. So far all the 7.28 for me are valid, even multiple restarts.
Cheers
----------------------------------------
Sgt. Joe
*Minnesota Crunchers*
[Dec 14, 2013 7:23:28 PM]   Link   Report threatening or abusive post: please login first  Go to top 
mikefinn
Cruncher
USA
Joined: Apr 27, 2007
Post Count: 43
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Mapping Cancer Markers Beta Test - Version 7.28 [ Issues Thread ]

I was able to restart every beta work unit I was given. None of them went into Pending Verification or Invalid status. However, none of the wingmen who ran these work units with me did a restart of their units; they all ran straight through. I would liked to have seen a quorum of two restarted work units validating each other.
[Dec 14, 2013 7:47:58 PM]   Link   Report threatening or abusive post: please login first  Go to top 
[VENETO] boboviz
Senior Cruncher
Joined: Aug 17, 2008
Post Count: 183
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Mapping Cancer Markers Beta Test - Version 7.28 [ Issues Thread ]

My 7.26 wus is crunched in 4 to 5 hs. This 7.28 in 14 h. Is this normal??
[Dec 14, 2013 7:59:14 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Mapping Cancer Markers Beta Test - Version 7.28 [ Issues Thread ]

The different batches and even within batches there is a wide variety of runtimes. The techs would like to, but may not be able to find a pattern to size tasks to computing weight... non-deterministic calculations, wherever the mapping matches lead on a cancer structure. Already I've seen output files going from 40KB to 1.3MB on one system. The System Requirements page indicates, the mapping files can grow to 3MB. At any rate, now got one of batch 216 that has been running for 36 hours, still making progress, and not worried with the new 7.28 resolution of the restart problem
[Dec 14, 2013 8:09:57 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Mapping Cancer Markers Beta Test - Version 7.28 [ Issues Thread ]

P.S. We're computing batches with 7.28 that have already passed production with 7.26. They will be compared in every which way possible, not anticipating any performance change. The issue was strictly to fit the pre-restart piece of the job to the post-restart of the job together properly so that quorum comparisons do not lead to failure over wrong concatenation due to failing 'resume bits'.
[Dec 14, 2013 8:14:49 PM]   Link   Report threatening or abusive post: please login first  Go to top 
uplinger
Former World Community Grid Tech
Joined: May 23, 2005
Post Count: 3952
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Mapping Cancer Markers Beta Test - Version 7.28 [ Issues Thread ]

Greetings everyone,

As Sek mentioned that with this latest version the invalids have dropped by over 99%. The last beta test had thousands of invalids where this version with 75% of the results returned has only 15 invalids. This will help reduce the number of resends required for mcm1 increasing the productivity of the grid. I will be releasing this version to production shortly.

Thanks,
-Uplinger
[Dec 14, 2013 8:18:37 PM]   Link   Report threatening or abusive post: please login first  Go to top 
yoro42
Ace Cruncher
United States
Joined: Feb 19, 2011
Post Count: 8979
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Mapping Cancer Markers Beta Test - Version 7.28 [ Issues Thread ]

Of the 46 WUs this is the only one that ended with status of Error:

BETA_ MCM1_ 0000216_ 9230_ 1-- 728 Error 12/13/13 07:48:38 12/14/13 03:37:11 11.29 391.9 / 391.9

Result Log

Result Name: BETA_ MCM1_ 0000216_ 9230_ 1--
<core_client_version>7.2.33</core_client_version>
<![CDATA[
<stderr_txt>
Commandline = projects/www.worldcommunitygrid.org/wcgrid_beta17_7.28_windows_x86_64 -SettingsFile MCM1_0000216_9230.txt -DatabaseFile dataset-17_72_SDG_v1.txt
Settings File
DateOfDesign = 11/08/2013
Designer = PMCC_OCI
WorkOrderID = 0000216_9230
DatasetID = 17_72_SDG_v1
NumberOfGenesInStartingSignature = 20
NumberOfGenesInSignatureMin = 10
NumberOfGenesInSignatureMax = 20
GroupVectorValues = {A}{B}{C}{D}{E}{F}
ExplicitStartingGeneSignatures = A B D F
StartingGeneSignatureAlgorithm = randomFixedLengthSearch
SearchAlgorithmNumberToCreate = 1
SearchAlgorithmSequentialStartPosition = 5
RunPermutationAlgorithm = 1
PermutationGroups = A
PermutationGroupsForReplacement = G
PermutationAlgorithm = replaceFromRandomlyToRandomlyGreedy
PermutationsNumIterations = 67911
OptimizationAlgorithmFrequency = 0 0 1
FBeta = 1.5
SimAnnealIMax = 20000
SimAnnealAlpha = 0.9996
NReps = 10
TrainFrac = 0.7
NFolds = 10
VMethod = LOO
ModelType = SVM
FitnessFn = 0
MinFitness = 0.61
SvmArgs = "-v 0 -c 0.1 -t 1 -d 2 -r 0"
SvmLearnLimit = 500000
RSeed = 519230


[06:10:06] Initializing
[06:10:13] Running
[06:10:13] EvaluateFitnessOfStartingGeneSignatures 1
[06:10:14]: Computing pass 0
Commandline = projects/www.worldcommunitygrid.org/wcgrid_beta17_7.28_windows_x86_64 -SettingsFile MCM1_0000216_9230.txt -DatabaseFile dataset-17_72_SDG_v1.txt
[06:21:33] Initializing
[06:21:40] Running
[06:21:40] EvaluateFitnessOfStartingGeneSignatures 1
[06:21:41]: Computing pass 0
Commandline = projects/www.worldcommunitygrid.org/wcgrid_beta17_7.28_windows_x86_64 -SettingsFile MCM1_0000216_9230.txt -DatabaseFile dataset-17_72_SDG_v1.txt
[10:44:55] Initializing
[10:45:02] Running
[10:45:02] EvaluateFitnessOfStartingGeneSignatures 1
[10:45:02]: Computing pass 0
Commandline = projects/www.worldcommunitygrid.org/wcgrid_beta17_7.28_windows_x86_64 -SettingsFile MCM1_0000216_9230.txt -DatabaseFile dataset-17_72_SDG_v1.txt
[10:57:45] Initializing
[10:57:56] Running
[10:57:56] EvaluateFitnessOfStartingGeneSignatures 1
[10:57:57]: Computing pass 0
Commandline = projects/www.worldcommunitygrid.org/wcgrid_beta17_7.28_windows_x86_64 -SettingsFile MCM1_0000216_9230.txt -DatabaseFile dataset-17_72_SDG_v1.txt
[11:44:46] Initializing
[11:44:54] Running
[11:44:54] EvaluateFitnessOfStartingGeneSignatures 1
[11:44:54]: Computing pass 0
Commandline = projects/www.worldcommunitygrid.org/wcgrid_beta17_7.28_windows_x86_64 -SettingsFile MCM1_0000216_9230.txt -DatabaseFile dataset-17_72_SDG_v1.txt
[18:22:31] Initializing
[18:22:38] Running
[18:22:38] EvaluateFitnessOfStartingGeneSignatures 1
[18:22:38]: Computing pass 0
[20:35:29] Exiting PermutateGeneSignature
[20:35:29] Writing final output
[20:35:29] Closing Output Stream
[20:35:29] Cleaning up
Result.out = 561910.000000
Run complete, CPU time: 40659.794382
20:35:29 (15836): called boinc_finish

</stderr_txt>
<message>
finish file present too long
</message>
]]>
----------------------------------------

[Dec 14, 2013 8:25:55 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Mapping Cancer Markers Beta Test - Version 7.28 [ Issues Thread ]

Kth, wanderfull, had in anticipation already started to drain the MCM buffers ... computing out the 7.26 WU's. Will be done in approximately 12 hours, then on to hyper-efficiency and more set&forget and much reduced triple eMMing.

Crunch On.
----------------------------------------
[Edit 1 times, last edit by Former Member at Dec 14, 2013 8:30:29 PM]
[Dec 14, 2013 8:28:04 PM]   Link   Report threatening or abusive post: please login first  Go to top 
NixChix
Veteran Cruncher
United States
Joined: Apr 29, 2007
Post Count: 1187
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Mapping Cancer Markers Beta Test - Version 7.28 [ Issues Thread ]

Unfortunately, this beta passed through my systems without my noticing. I was able to only restart the last one I found still processing. It is still waiting for the wingman to check in, so we'll see what happens.

Cheers coffee
----------------------------------------

[Dec 14, 2013 11:06:43 PM]   Link   Report threatening or abusive post: please login first  Go to top 
coolstream
Senior Cruncher
SCOTLAND
Joined: Nov 8, 2005
Post Count: 475
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Mapping Cancer Markers Beta Test - Version 7.28 [ Issues Thread ]

Greetings everyone,

As Sek mentioned that with this latest version the invalids have dropped by over 99%. The last beta test had thousands of invalids where this version with 75% of the results returned has only 15 invalids. This will help reduce the number of resends required for mcm1 increasing the productivity of the grid. I will be releasing this version to production shortly.

Thanks,
-Uplinger

I can confirm that my machines are now pulling in non-beta 7.28 WUs
----------------------------------------

Crunching in memory of my Mum PEGGY, cousin ROPPA and Aunt AUDREY.
[Dec 14, 2013 11:56:56 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 49   Pages: 5   [ Previous Page | 1 2 3 4 5 | Next Page ]
[ Jump to Last Post ]
Post new Thread