Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 9
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 2766 times and has 8 replies Next Thread
jochrupp
Advanced Cruncher
Germany
Joined: Nov 17, 2004
Post Count: 58
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
process update 2011 April 29th: why such a slowdown?

Hi all,

from time to time I'm looking at the statistics of this project at:
HCMD2 Stats Page

I'm wondering why there should be such an enourmous slowdown in progress during the last 2 weeks!? Is this an error, do we have to crunch real hard stuff at the moment, or what has happended?

Cheers,
jochrupp
----------------------------------------

----------------------------------------
[Edit 1 times, last edit by jochrupp at May 1, 2011 10:36:33 PM]
[May 1, 2011 10:35:19 PM]   Link   Report threatening or abusive post: please login first  Go to top 
anhhai
Veteran Cruncher
Joined: Mar 22, 2005
Post Count: 839
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: process update 2011 April 29th: why such a slowdown?

Below is the reason for the slow-down. They (WCG) basically had some sort of problem transferring work back to the researchers so they reduced the number of WUs we were crunching for a few days.


https://secure.worldcommunitygrid.org/forums/wcg/viewthread_thread,31127
----------------------------------------

[May 1, 2011 11:03:09 PM]   Link   Report threatening or abusive post: please login first  Go to top 
jochrupp
Advanced Cruncher
Germany
Joined: Nov 17, 2004
Post Count: 58
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: process update 2011 April 29th: why such a slowdown?

I remember this thread but it seems that they have resolved this issue before April 14th and the slowdown occured between April 14th and April 29th.
----------------------------------------

[May 2, 2011 12:28:34 AM]   Link   Report threatening or abusive post: please login first  Go to top 
anhhai
Veteran Cruncher
Joined: Mar 22, 2005
Post Count: 839
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: process update 2011 April 29th: why such a slowdown?

jochrupp, The WUs we crunch today are processed by the scientist tomorrow. This means that there is always a delay from the scientist point of view on when a slowdown or speedup happens. Since it was resolved on the 13th, The scientist will start noticing it a few days later (14th - 29th analysis period)
----------------------------------------

[May 2, 2011 2:49:17 AM]   Link   Report threatening or abusive post: please login first  Go to top 
jochrupp
Advanced Cruncher
Germany
Joined: Nov 17, 2004
Post Count: 58
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: process update 2011 April 29th: why such a slowdown?

ok, that might be the reason. Thx for information. Then we'll be a lot faster the next time.
----------------------------------------

[May 2, 2011 7:27:13 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: process update 2011 April 29th: why such a slowdown?

For me, 4 inputs are used to compute a best present progress.

1: The batch we're crunching real time... the last I saw was 1599, but not participating presently, so don't know which is the last actively crunched batch. Usual one or the other poster has a current WU name in a message to reveal that.
2: Is the work parent, child, grandchild, to est. how far we're into a batch.
3: The WU total at top of this page http://graal.ens-lyon.fr/~nbard/WCGStats/ . This is the net from all quorums.
4: The WU total per the project page: http://www.worldcommunitygrid.org/stat/viewProject.do?projectShortName=hcmd2 An assumed error rate is used to derive a ''field'' net in relation to point 3 above.

This goes into the frier which throws out a ''real time'' percent progress estimate which can be found in the WCG dashboard chart (link returned in my sig).

Commonly, we're about 1.2-1.5 percent ahead of the "official" progress value, but that depends on how current the info at pages, point 3 are... could be more too.

Often times, when other sciences at WCG have an issue, it's HCMD2 that picks up a major portion of the diverted crunching contribution, and sure enough, HCMD2 is running at a 7 day average of 98 TFL, biggest contributed science at WCG. Chart 4 (WCGSHR) in the sig-link depicts this best.

--//--

edit: completed an unfinished line blushing
----------------------------------------
[Edit 1 times, last edit by Former Member at May 3, 2011 9:25:10 AM]
[May 2, 2011 7:59:39 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: process update 2011 April 29th: why such a slowdown?

1: The batch we're crunching real time... the last I saw was 1599, but not participating presently, so don't presently know which is the last actively crunched batch. Usual one or the other poster.

FYI, I got a parent WU from batch 1684 (CMD2_1684-1CIL_A.clustersOccur-2P35_B.clustersOccur_1_0) on 29 April.
[May 3, 2011 4:41:03 AM]   Link   Report threatening or abusive post: please login first  Go to top 
JmBoullier
Former Community Advisor
Normandy - France
Joined: Jan 26, 2007
Post Count: 3716
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: process update 2011 April 29th: why such a slowdown?

1704 is the highest parent I can find in my queues.
Grand-children range from a single 1596 to many 1700 and 1701.
----------------------------------------
Team--> Decrypthon -->Statistics/Join -->Thread
[May 3, 2011 4:09:16 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: process update 2011 April 29th: why such a slowdown?

Hi Jean,

Yup, seems we're quite a bit ahead at the feeders to where Nico_B has indexed the work returned. From past reading of his charts, WCG does seem to send back partial batch completions... maybe subdivided similar to what the techs do with DDDT2, to allow earlier clearing from the WCG master DB.

cheers
[May 3, 2011 4:28:04 PM]   Link   Report threatening or abusive post: please login first  Go to top 
[ Jump to Last Post ]
Post new Thread