Index | Recent Threads | Unanswered Threads | Who's Active | Guidelines | Search |
World Community Grid Forums
Category: Community Forum: Chat Room Thread: Project Status (First Post Updated) |
No member browsing this thread |
Thread Status: Active Total posts in this thread: 118
|
Author |
|
Sgt.Joe
Ace Cruncher USA Joined: Jul 4, 2006 Post Count: 7579 Status: Offline Project Badges: |
Why do I get a BOINC Manager notification that "we missed you" and when I try to get work for multiple Windows machines there is none available? Very frustrating. Getting work is sometimes hit or miss. My Windows machine is now back to a full queue after getting nothing for while. Don't know why, but glad it is back. Cheers
Sgt. Joe
*Minnesota Crunchers* |
||
|
adriverhoef
Master Cruncher The Netherlands Joined: Apr 3, 2009 Post Count: 2089 Status: Recently Active Project Badges: |
As one may know from reading the first post in this thread, there are some links in there that can be useful.
----------------------------------------I tried this one: my latest downloaded MCM1-task. It takes snapshots of workunit-IDs in steps of 1,000 for a total of 10 steps. In this case my latest downloaded MCM1-task was at 12:40 (UTC). Usually there are one, two or three minutes between 1,000 workunit-IDs. Now, this is what I saw: workunit 442393810: task MCM1_0209709_8731_0 Linux Ubuntu 2023-12-23T12:40:42 It appeared that there was one big gap between workunit 442385149 (2023-12-23T11:46:01) and workunit 442385150 (2023-12-23T12:04:04) and another substantial gap between workunit 442393357 (2023-12-23T12:16:27) and workunit 442393358 (2023-12-23T12:40:07). [Edit 1 times, last edit by adriverhoef at Dec 23, 2023 4:07:34 PM] |
||
|
adriverhoef
Master Cruncher The Netherlands Joined: Apr 3, 2009 Post Count: 2089 Status: Recently Active Project Badges: |
Having written the previous message, after doing some groceries, one can observe the same behaviour (see my former post): there are some gaps where the distribution of workunits just pauses for a while, 15, 20 or 25 minutes.
----------------------------------------workunit 442428181: task MCM1_0209686_7098_0 Linux 2023-12-23T14:59:18 Adri [Edit 1 times, last edit by adriverhoef at Dec 23, 2023 4:08:32 PM] |
||
|
Mike.Gibson
Ace Cruncher England Joined: Aug 23, 2007 Post Count: 12142 Status: Offline Project Badges: |
They appear to be loading work in batches, so it is a matter of whether you hit a batch, or miss.
But also when a machine picks up aa unit it sets the operating system for the copy. This creates another restriction. ARP is expected back in the New Year sometime which should enable a better flow of work. Currently, MCM seems to be unable to satisfy demand on its own. Mike |
||
|
Sgt.Joe
Ace Cruncher USA Joined: Jul 4, 2006 Post Count: 7579 Status: Offline Project Badges: |
Just took a look at the totals returned for MCM throughout the year. Since November 22, every succeeding day there has been just a tad fewer results returned than the day before. Over the course of that time that has been a decrease of about 162,285 work units (Nov. 22 minus Dec. 22). I believe Mike is correct in the assertion that demand for work units is exceeding supply. Probably as soon as the feeder has work units available, they are snapped up almost immediately by whichever machines are querying for work units at that time. Not knowing how the query queue is constructed this is my theory. I also don't know how fast the feeder is refilled once a batch has been exhausted, nor how many feeders may be deployed. Another factor may be the techs have slowed the release of work units to allow the backend processes to function properly - optimize operational throughput (although they seemed to be able to handle amounts in excess of a million/day in the past.)
----------------------------------------All mere speculation on my part. Edit: See clarification a couple of posts down. The last normal day over a million is Nov. 27 (1,055,437) and Dec 22 is (897,270) for difference of 158,167. Sorry about the erroneous info. Edit 2: I tried to post this correction the other day and the system crashed before I got it posted. Cheers
Sgt. Joe
----------------------------------------*Minnesota Crunchers* [Edit 2 times, last edit by Sgt.Joe at Dec 24, 2023 8:41:26 PM] |
||
|
gj82854
Advanced Cruncher Joined: Sep 26, 2022 Post Count: 67 Status: Offline Project Badges: |
Just took a look at the totals returned for MCM throughout the year. Since November 22, every succeeding day there has been just a tad fewer results returned than the day before. Where are you getting your stats from? WCG MCM stats don't seem to match up. Statistics date Total run time Points generated Results returned 12/23/2023 102:034:09:39:25 230,723,346 437,042 12/22/2023 214:268:19:29:43 472,278,034 897,270 12/21/2023 206:243:19:58:05 474,026,210 901,162 12/20/2023 201:110:11:09:09 459,380,834 869,258 12/19/2023 194:354:05:33:00 441,899,490 838,666 12/18/2023 205:188:10:19:03 454,270,505 858,917 12/17/2023 183:240:11:52:42 417,838,979 795,551 12/16/2023 172:339:09:51:54 396,988,877 751,419 12/15/2023 182:033:13:10:54 414,903,061 787,095 12/14/2023 192:058:12:57:06 427,796,254 815,261 12/13/2023 191:076:22:31:45 419,061,558 793,148 12/12/2023 189:064:13:04:08 428,790,318 820,057 12/11/2023 207:008:08:55:24 472,198,334 898,449 12/10/2023 200:081:01:28:07 457,264,643 869,560 |
||
|
Sgt.Joe
Ace Cruncher USA Joined: Jul 4, 2006 Post Count: 7579 Status: Offline Project Badges: |
Mea culpa. It is my mistake in the interpretation of my numbers. Good catch. I prepared a spreadsheet and calculated the average for each day over the previous 30 days. In my "rush to judgement" I used the wrong column - the 30 day average column - rather than the raw number column. I did this in order to smooth out the variations in the raw numbers. I will note that the raw numbers from October 22 to November 27 all show over 1 million work units returned. We have only hit that number once since that date (Dec. 5). I will continue to believe that the demand may be exceeding supply.
----------------------------------------Thank you for bringing this to my attention. Cheers
Sgt. Joe
*Minnesota Crunchers* |
||
|
gj82854
Advanced Cruncher Joined: Sep 26, 2022 Post Count: 67 Status: Offline Project Badges: |
No problem. My first assumption was that you were right and that I was looking at the wrong data or misinterpreting something. I thought your observation was interesting.
Merry Christmas and Happy Holidays |
||
|
The_Mole
Cruncher Joined: Nov 10, 2007 Post Count: 17 Status: Offline Project Badges: |
Any info from the project about the MCM status ('not enough for everybody' gets a bit stale after multiple weeks) ? My Windows machine has gone dry. The Linux machines are maintaining almost full queues. Cheers It does get stale, indeed. It's the other way around for me. Although my Linux machine still has some WUs left and isn't completely dry yet. You can add another project and set the resource share to 0, then it will only act as a filler. I did this with Einstein@home on Nov, 30th and according to BAM my monthly stats are:
Sokrates: To be is to do! Jean-Paul Sartre: To do is to be! Krembil: Do be do be do... |
||
|
Sgt.Joe
Ace Cruncher USA Joined: Jul 4, 2006 Post Count: 7579 Status: Offline Project Badges: |
Krembil: Do be do be do... Sounds like Sinatra to me. Cheers
Sgt. Joe
*Minnesota Crunchers* |
||
|
|