World Community Grid - View Thread - Extremely long completion times

World Community Grid Forums

Category: Active Research

Forum: Mapping Cancer Markers Forum

Thread: Extremely long completion times

Quick Go »

No member browsing this thread

Thread Status: Active
Total posts in this thread: 16

[ ]

Author

This topic has been viewed 4283 times and has 15 replies

saiarcot895
Cruncher
Joined: Apr 3, 2012
Post Count: 3
Status: Offline
Project Badges:

14 day badge for The Clean Energy Project - Phase 2

90 day badge for FightAIDS@Home - Phase 2

90 day badge for Microbiome Immunity Project

180 day badge for OpenPandemics - COVID-19


Extremely long completion times

Hi,

One of my MCM workunits has been running for almost 2 days, has completed 0.5%, and the remaining time is at 396 days and increasing. I have an 2.4 GHz i3-7100U processor, so it not that my CPU is slow, and I'm running Ubuntu 16.10. I've pasted the stderr.txt below:


Commandline =  ../../projects/www.worldcommunitygrid.org/wcgrid_mcm1_7.36_i686-pc-linux-gnu -SettingsFile MCM1_0129728_6010.txt -DatabaseFile dataset-curatedOvarian_EarlyLate_v1.0.txt
Settings File 
DateOfDesign = 08/05/2014
Designer = PMCC_OCI_0.1
WorkOrderID = 0129728_6010
DatasetID = curatedOvarian_EarlyLate_v1.0
NumberOfGenesInStartingSignature = 30
NumberOfGenesInSignatureMin = 30
NumberOfGenesInSignatureMax = 30
GroupVectorValues = {A}{B}{C}{D}{E}{F}
ExplicitStartingGeneSignatures = A B D F 
StartingGeneSignatureAlgorithm = randomFixedLengthSearch
SearchAlgorithmNumberToCreate = 60
SearchAlgorithmSequentialStartPosition = 5 
RunPermutationAlgorithm = 0 
PermutationGroups = A 
PermutationGroupsForReplacement = G
PermutationAlgorithm = replaceFromRandomlyToRandomlyGreedy
PermutationsNumIterations = 0 
OptimizationAlgorithmFrequency = 0 0 1 
FBeta = 1.5 
SimAnnealIMax = 20000
SimAnnealAlpha = 0.9996
FitnessFn = 0 
MinFitness = -1.0
NReps = 10
TrainFrac = 0.7 
NFolds = 10
VMethod = LOO 
ModelType = SVM 
SvmArgs = "-v 0 -c 0.1 -t 1 -d 2 -r 0"

SvmLearnLimit = 500000
RSeed = 253696011


[04:11:04] Initializing
[04:11:09] Running
[04:11:09] EvaluateFitnessOfStartingGeneSignatures 60

Is this normal? Should I wait a few days?

[Jan 24, 2017 3:35:11 PM]

Sgt.Joe
Ace Cruncher
USA
Joined: Jul 4, 2006
Post Count: 7846
Status: Offline
Project Badges:

2 year badge for Human Proteome Folding - Phase 2

14 day badge for Help Cure Muscular Dystrophy

2 year badge for Discovering Dengue Drugs - Together

2 year badge for Nutritious Rice for the World

14 day badge for The Clean Energy Project

10 year badge for Help Fight Childhood Cancer

90 day badge for Influenza Antiviral Drug Search

2 year badge for Help Cure Muscular Dystrophy - Phase 2

45 day badge for Discovering Dengue Drugs - Together - Phase 2

2 year badge for The Clean Energy Project - Phase 2

2 year badge for Computing for Clean Water

5 year badge for Drug Search for Leishmaniasis

5 year badge for GO Fight Against Malaria

2 year badge for Computing for Sustainable Water

200 year badge for Mapping Cancer Markers

5 year badge for Uncovering Genome Mysteries

20 year badge for Outsmart Ebola Together

10 year badge for FightAIDS@Home - Phase 2

100 year badge for Smash Childhood Cancer

10 year badge for Microbiome Immunity Project

2 year badge for Africa Rainfall Project

100 year badge for OpenPandemics - COVID-19


Re: Extremely long completion times

Reboot
Cheers

----------------------------------------

Sgt. Joe
*Minnesota Crunchers*

[Jan 24, 2017 4:40:13 PM]

saiarcot895
Cruncher
Joined: Apr 3, 2012
Post Count: 3
Status: Offline
Project Badges:


Re: Extremely long completion times

Sorry for the delay.

I rebooted my computer, and the tasks seemed to restart as well (there was no savepoint, I'm guessing), but it climbed again to 392 days. I've aborted the two tasks; hopefully someone else will have better luck.

[Jan 29, 2017 1:02:36 AM]

kpdenmark
Cruncher
Joined: Nov 27, 2016
Post Count: 1
Status: Offline
Project Badges:

180 day badge for Outsmart Ebola Together

180 day badge for Smash Childhood Cancer

5 year badge for Microbiome Immunity Project

90 day badge for Africa Rainfall Project

2 year badge for OpenPandemics - COVID-19


Re: Extremely long completion times

It also happens all the time whit my mappping cancer markers projects, and only them.
Rebooting the laptop doenst help.

[Feb 22, 2017 12:50:55 AM]

Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline


Re: Extremely long completion times

I'm seeing the very same issue.
It's so bad that I have opted out of MCM for now as it is simply wasted computation time which could be better spent on projects that are behaving properly.

Personally I'm using Ubuntu 16.04 64bit with an AMD Ryzen 7 1800X.

----------------------------------------
[Edit 1 times, last edit by Former Member at May 9, 2017 6:54:01 PM]

[May 9, 2017 6:52:19 PM]

Sgt.Joe
Ace Cruncher
USA
Joined: Jul 4, 2006
Post Count: 7846
Status: Offline
Project Badges:


Re: Extremely long completion times

I have completed over 150,000 MCM work units on both Windows and Linux and have never experienced this problem. I have seen it happen with some other projects and usually a simple reboot or a reset of the project would cure it. There have been some occasions when there have been malformed units, I don't remember what projects in particular, so that is a possibility. Several years ago I had a problem with the range extender in my setup which would cause the occasional work unit to hang, but, once again a reboot of both the range extender and the computer always shook loose something and let the work unit complete. That problem ceased when I upgraded the range extender.
Cheers

----------------------------------------

Sgt. Joe
*Minnesota Crunchers*

[May 9, 2017 8:12:32 PM]

cehunt
Senior Cruncher
CANADA
Joined: Oct 10, 2011
Post Count: 172
Status: Offline
Project Badges:

14 day badge for Human Proteome Folding - Phase 2

1 year badge for Help Cure Muscular Dystrophy - Phase 2

10 year badge for The Clean Energy Project - Phase 2

14 day badge for Computing for Clean Water

2 year badge for Outsmart Ebola Together

10 year badge for OpenPandemics - COVID-19


Re: Extremely long completion times

Hi:

I have returned about 10 MCM WUs today as the deadline was May 23 and there was no way I was going to get them completed by the deadline. Why invest the time if the WU are not going to be completed by deadline time. In addition, there was one WU that was finally completed after 34 hours, a far cry from the stated run time of 21 hours.

Are these workunits different than the ones before?

Clive

The cpu in my Alienware laptop is an i7-3740QM running at 2.7Ghz

[May 23, 2017 3:24:33 AM]

saiarcot895
Cruncher
Joined: Apr 3, 2012
Post Count: 3
Status: Offline
Project Badges:


Re: Extremely long completion times

I saw that I got another workunit on May 15, due May 22, and the remaining time is at 147 days and increasing. I've aborted the workunit.

I would much rather have a 50-60% increase in time needed rather than 1000%+ increase.

[May 23, 2017 4:55:25 AM]

Sgt.Joe
Ace Cruncher
USA
Joined: Jul 4, 2006
Post Count: 7846
Status: Offline
Project Badges:


Re: Extremely long completion times

I have returned about 10 MCM WUs today as the deadline was May 23 and there was no way I was going to get them completed by the deadline. Why invest the time if the WU are not going to be completed by deadline time. In addition, there was one WU that was finally completed after 34 hours, a far cry from the stated run time of 21 hours. Are these workunits different than the ones before? Clive The cpu in my Alienware laptop is an i7-3740QM running at 2.7Ghz

I saw that I got another workunit on May 15, due May 22, and the remaining time is at 147 days and increasing. I've aborted the workunit. I would much rather have a 50-60% increase in time needed rather than 1000%+ increase.

The only thing I can say to these items is they must be rogue work units. That Alienware cpu should be kicking these units out in considerably less time than 4 hours. I think you must be right to abort them.
Cheers

----------------------------------------

Sgt. Joe
*Minnesota Crunchers*

[May 23, 2017 5:18:29 AM]

cehunt
Senior Cruncher
CANADA
Joined: Oct 10, 2011
Post Count: 172
Status: Offline
Project Badges:


Re: Extremely long completion times

Hi Sgt Joe:

You say that the CPU in my Alienware laptop should be kicking these WUs out within 4 hours. I have never had a turnaround time that quick with the MCM project.

I have checked my device manager settings and everything looks good there. The WUs that I have d/l yesterday have an est run time of 28 hours.

Clive

[May 23, 2017 6:33:42 PM]

[ ]