Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 60
Posts: 60   Pages: 6   [ Previous Page | 1 2 3 4 5 6 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 11012 times and has 59 replies Next Thread
bieberj
Senior Cruncher
United States
Joined: Dec 2, 2004
Post Count: 406
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Does offline calculation results in invalids?

I got a few invalids as well.

This is ridiculous - take the system offline for a bit and it results in invalid. Maybe I should stop the whole thing before taking it offline and restart it when it is back online.
[Oct 12, 2015 3:07:28 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Skivelitis2
Advanced Cruncher
USA
Joined: Mar 21, 2015
Post Count: 113
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Does offline calculation results in invalids?

The scientists prefer full 100K tasks


Why then not just extend the deadline by a day or two and stop all this nonsense?
----------------------------------------

[Oct 12, 2015 4:55:40 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Does offline calculation results in invalids?

I got a few invalids as well.

This is ridiculous - take the system offline for a bit and it results in invalid. Maybe I should stop the whole thing before taking it offline and restart it when it is back online.


It is important to have at least one trickle reported/uploaded before going offline. Then this WU becomes valid even if finishing offline (of course only if reported before deadline is reached...).
Also, if the WU started offline, it must report all trickles/upload before completion to become valid.
Only WUs which remain offline right from the start until completion become invalid.
[Oct 12, 2015 6:14:39 PM]   Link   Report threatening or abusive post: please login first  Go to top 
SekeRob
Master Cruncher
Joined: Jan 7, 2013
Post Count: 2741
Status: Offline
Reply to this Post  Reply with Quote 
Re: Does offline calculation results in invalids?

Disconcerting. Something I think the programmers need to look into post-haste.

Somewhere uplinger wrote the Soft Stop was FTB disabled. Had several not reporting 70% at 72 hours and it was allowed to finish. My theory is [wont call it an hypothesis, a speculation at most], it is even allowed to finish the last trickle in overtime as a soft stop is a signal to finish the current 10K section. Would be nice to know if so as some get wound up over 10% loss in production [9.99% was written], when that would then be 10% of 5% as 95% is completing the full 100K per same uplinger.

Now the 'living by statistics' WCG criteria says that 10% of 5% is 0.5% [1/200th], and that is so far below the event horizon, it is candidate to end up in the 'not enough for us to get distracted' corner. Let's be optimistic though, and await a tech reply.
[Oct 12, 2015 6:32:15 PM]   Link   Report threatening or abusive post: please login first  Go to top 
uplinger
Former World Community Grid Tech
Joined: May 23, 2005
Post Count: 3952
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Does offline calculation results in invalids?

At the moment soft stops are disabled.

I think what members are noticing is that they are sending in a trickle message, but not the uploaded file and that gets them marked as invalid. At the moment, I have it set to a 3 hour window for the two. I will see about increasing that to 12 hours and see if that helps.

Thanks,
-Uplinger
[Oct 15, 2015 1:58:32 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Does offline calculation results in invalids?

That might be a reason, but it's definitely not the only one:
As I said reporting a WU which was completely offline right from the start until it finished willl inevitably result in turning invalid. This can be reproduced and I did it several times before I started this thread. According to boinc manager all trickles were sent and all intermediate files uploaded.
If I save at least the first pair of intermediate upload files (and the associated file info of the client state file) and restore it after completion of that offline WU it will turn valid. I did it for nearly a week now and had not a single invalid WU that way.
Also, it can be observed that all still locally stored intermediate upload files are changed when the WU is completed. This happens every time a WU finishes but raises no problems if the WU was online and at least one pair of intermediate files was already sent (well, they are not locally available anymore and therefore cannot be changed...). This can be reproduced easily - just disconnect in the middle of calculation and save the client state file and the upload files before the WU finishes. Then after completion comparing the intermediate upload files binary proves that they are different and their length and checksum in the client state file changes as well. So if only that changed intermediate files are uploaded the validator (or someone else) cannot cope with them and rates the WU invalid. If at least one (or more) pair(s) of intermediate files are uploaded unchanged the validator is happy and rates the WU valid.

If you need more informations please contact me. I reproduced this behaviour on four computers already.

Matthias
[Oct 16, 2015 4:45:47 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Psalm103
Cruncher
Joined: Jan 6, 2007
Post Count: 25
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Does offline calculation results in invalids?

At the moment soft stops are disabled.

I think what members are noticing is that they are sending in a trickle message, but not the uploaded file and that gets them marked as invalid. At the moment, I have it set to a 3 hour window for the two. I will see about increasing that to 12 hours and see if that helps.

Thanks,
-Uplinger


I don't think the window is the real problem. I have one machine that's only connected about once a day, 5 days a week. ALL of the weekend crunching goes Invalid. WU's completed 100% off line go Invalid. It's _NOT_ a 3-hour window issue.

Thanks,
Ed

--Edit: To clarify: all the uploads happen within a 2-3 minute period with multiple updates (all spaced at 2:00 minute intervals) to report the results and download new WUs during and after all uploads have completed. Usually there are at least 2-3 updates AFTER all uploads have completed. The whole process usually takes 10-15 minutes, nowhere near the 3 hour window limit.
----------------------------------------
[Edit 1 times, last edit by Matthew10_8 at Oct 16, 2015 8:06:14 PM]
[Oct 16, 2015 7:01:32 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Psalm103
Cruncher
Joined: Jan 6, 2007
Post Count: 25
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Does offline calculation results in invalids?

After a weekend of crunching all my WU's returned either Invalid or No Reply (despite being completed before the deadline). Off to a different project...

FAH2_ avx17684-ls_ 000069_ 0013_ 004_ wcgfahb00060000_ 0-- EVK2 Invalid 10/16/15 18:41:30 10/19/15 14:23:07 15.30 / 15.38 394.9 / 0.0
FAH2_ avx17377-ls_ 000027_ 0008_ 004_ wcgfahb00070000_ 0-- EVK2 Invalid 10/16/15 18:39:26 10/19/15 14:23:07 15.18 / 15.28 392.5 / 0.0
FAH2_ avx17377-ls_ 000006_ 0017_ 004_ wcgfahb00050000_ 0-- EVK2 Invalid 10/16/15 18:39:26 10/19/15 14:23:07 15.19 / 15.30 392.9 / 0.0
FAH2_ avx17375-ls_ 000025_ 0001_ 004_ wcgfahb00020000_ 0-- EVK2 Invalid 10/16/15 18:39:26 10/19/15 14:23:07 15.37 / 15.45 396.8 / 0.0
FAH2_ avx17286-ls_ 000080_ 0011_ 003_ wcgfahb00030000_ 0-- EVK2 Invalid 10/16/15 18:39:26 10/19/15 14:23:07 15.11 / 15.36 394.5 / 0.0
FAH2_ avx17286-ls_ 000052_ 0004_ 004_ wcgfahb00030000_ 0-- EVK2 Invalid 10/16/15 18:39:26 10/19/15 14:23:07 15.18 / 15.40 395.4 / 0.0
FAH2_ avx17286-ls_ 000046_ 0015_ 003_ wcgfahb00070000_ 0-- EVK2 Invalid 10/16/15 18:39:26 10/19/15 14:23:07 15.35 / 15.43 396.1 / 0.0
FAH2_ avx101118-ls_ 000071_ 0001_ 007_ 0-- EVK2 No Reply 10/15/15 18:35:46 10/19/15 12:38:12 0.00 / 0.00 0.0 / 0.0
FAH2_ avx101118-ls_ 000070_ 0012_ 004_ 0-- EVK2 No Reply 10/15/15 18:35:46 10/19/15 12:38:12 0.00 / 0.00 0.0 / 0.0
FAH2_ avx101118-ls_ 000045_ 0007_ 006_ 0-- EVK2 No Reply 10/15/15 18:35:46 10/19/15 12:38:12 0.00 / 0.00 0.0 / 0.0
FAH2_ avx101118-ls_ 000023_ 0008_ 006_ 0-- EVK2 No Reply 10/15/15 18:35:46 10/19/15 12:38:10 0.00 / 0.00 0.0 / 0.0
FAH2_ avx101118_ 000091_ 0038_ 008_ 0-- EVK2 No Reply 10/15/15 18:35:46 10/19/15 12:38:07 0.00 / 0.00 0.0 / 0.0
FAH2_ avx38789-ls_ 000073_ 0001_ 003_ 0-- EVK2 Invalid 10/13/15 14:15:11 10/17/15 06:35:21 15.41 / 15.53 393.4 / 387.4
[Oct 19, 2015 3:05:58 PM]   Link   Report threatening or abusive post: please login first  Go to top 
uplinger
Former World Community Grid Tech
Joined: May 23, 2005
Post Count: 3952
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Does offline calculation results in invalids?

We are looking into the issue and trying to recreate it now. We will let you know what we find about the invalid issue.

Thanks,
-Uplinger
[Oct 19, 2015 3:50:34 PM]   Link   Report threatening or abusive post: please login first  Go to top 
SekeRob
Master Cruncher
Joined: Jan 7, 2013
Post Count: 2741
Status: Offline
Reply to this Post  Reply with Quote 
Re: Does offline calculation results in invalids?

If there is scheduled online / offline periods in BOINC, the v7 client will push all reporting out from 30 minutes before going offline. Is really hard luck if a trickle request and trickle upload get separated, file uploads anyway always scheduled to go ASAP [that what passes through the Transfer view].
[Oct 19, 2015 3:58:47 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 60   Pages: 6   [ Previous Page | 1 2 3 4 5 6 | Next Page ]
[ Jump to Last Post ]
Post new Thread