Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 118
Posts: 118   Pages: 12   [ Previous Page | 1 2 3 4 5 6 7 8 9 10 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 11102 times and has 117 replies Next Thread
Sgt.Joe
Ace Cruncher
USA
Joined: Jul 4, 2006
Post Count: 7579
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Project Status (First Post Updated)

Why do I get a BOINC Manager notification that "we missed you" and when I try to get work for multiple Windows machines there is none available? Very frustrating.

Getting work is sometimes hit or miss. My Windows machine is now back to a full queue after getting nothing for while. Don't know why, but glad it is back.

Cheers
----------------------------------------
Sgt. Joe
*Minnesota Crunchers*
[Dec 23, 2023 12:04:00 PM]   Link   Report threatening or abusive post: please login first  Go to top 
adriverhoef
Master Cruncher
The Netherlands
Joined: Apr 3, 2009
Post Count: 2089
Status: Recently Active
Project Badges:
Reply to this Post  Reply with Quote 
Re: Project Status (First Post Updated)

As one may know from reading the first post in this thread, there are some links in there that can be useful.
I tried this one: my latest downloaded MCM1-task.

It takes snapshots of workunit-IDs in steps of 1,000 for a total of 10 steps.
In this case my latest downloaded MCM1-task was at 12:40 (UTC).
Usually there are one, two or three minutes between 1,000 workunit-IDs. Now, this is what I saw:

workunit 442393810: task MCM1_0209709_8731_0  Linux Ubuntu  2023-12-23T12:40:42
workunit 442392810: task MCM1_0209698_8603_0 Darwin 2023-12-23T12:15:06
workunit 442391810: task MCM1_0209688_0599_0 MSWin 10 2023-12-23T12:13:37
workunit 442390810: task MCM1_0209709_8101_0 Darwin 2023-12-23T12:12:34
workunit 442389810: task MCM1_0209709_7898_0 Linuxmint 2023-12-23T12:10:43
workunit 442388810: task MCM1_0209690_0445_0 MSWin 11 2023-12-23T12:09:14
workunit 442387810: task MCM1_0209688_0087_0 MSWin 10 2023-12-23T12:08:01
workunit 442386810: task MCM1_0209690_0140_0 MSWin 8.1 2023-12-23T12:06:33
workunit 442385810: task MCM1_0209698_6889_0 MSWin 10 2023-12-23T12:04:56
workunit 442384810: task MCM1_0209698_6505_0 Linux Debian 2023-12-23T11:45:30
workunit 442383810: task MCM1_0209709_5993_0 MSWin Server 2023-12-23T11:43:48

It appeared that there was one big gap between workunit 442385149 (2023-12-23T11:46:01) and workunit 442385150 (2023-12-23T12:04:04)
and another substantial gap between workunit 442393357 (2023-12-23T12:16:27) and workunit 442393358 (2023-12-23T12:40:07).
----------------------------------------
[Edit 1 times, last edit by adriverhoef at Dec 23, 2023 4:07:34 PM]
[Dec 23, 2023 2:47:06 PM]   Link   Report threatening or abusive post: please login first  Go to top 
adriverhoef
Master Cruncher
The Netherlands
Joined: Apr 3, 2009
Post Count: 2089
Status: Recently Active
Project Badges:
Reply to this Post  Reply with Quote 
Re: Project Status (First Post Updated)

Having written the previous message, after doing some groceries, one can observe the same behaviour (see my former post): there are some gaps where the distribution of workunits just pauses for a while, 15, 20 or 25 minutes.

workunit 442428181: task MCM1_0209686_7098_0  Linux         2023-12-23T14:59:18
workunit 442427181: task MCM1_0209686_6898_0 MSWin 10 2023-12-23T14:57:50
workunit 442426181: task MCM1_0209686_6701_0 Linux 2023-12-23T14:42:03
workunit 442425181: task MCM1_0209710_6256_0 MSWin 10 2023-12-23T14:40:23
workunit 442424181: task MCM1_0209688_6417_0 Linuxmint 2023-12-23T14:38:52
workunit 442423181: task MCM1_0209690_6437_0 MSWin 10 2023-12-23T14:37:45
workunit 442422181: task MCM1_0209686_5894_0 Linux openSU 2023-12-23T14:35:56
workunit 442421181: task MCM1_0209686_5697_0 MSWin 11 2023-12-23T14:34:35
workunit 442420181: task MCM1_0209690_5836_0 MSWin 10 2023-12-23T14:33:10
workunit 442419181: task MCM1_0209710_5063_0 MSWin 11 2023-12-23T14:31:43
workunit 442418181: task MCM1_0209693_5812_0 MSWin 10 2023-12-23T14:30:10

workunit 442418602: task MCM1_0209693_5897_0 Linux Ubuntu 2023-12-23T14:30:58
workunit 442417602: task MCM1_0209688_5087_0 MSWin 10 2023-12-23T14:29:25
workunit 442416602: task MCM1_0209693_5503_0 Darwin 2023-12-23T14:12:08
workunit 442415602: task MCM1_0209693_5311_0 MSWin 10 2023-12-23T14:10:40
workunit 442414602: task MCM1_0209693_5109_0 MSWin 10 2023-12-23T14:09:30
workunit 442413602: task MCM1_0209710_3953_0 MSWin 11 2023-12-23T14:07:42
workunit 442412602: task MCM1_0209686_3968_0 MSWin 10 2023-12-23T14:06:14
workunit 442411602: task MCM1_0209690_4118_0 MSWin 11 2023-12-23T14:04:48
workunit 442410602: task MCM1_0209690_3915_0 MSWin 10 2023-12-23T14:03:20
workunit 442409602: task MCM1_0209686_3367_0 MSWin 10 2023-12-23T13:41:57
workunit 442408602: task MCM1_0209690_3521_0 Fedora Linux 2023-12-23T13:40:21

Adri
----------------------------------------
[Edit 1 times, last edit by adriverhoef at Dec 23, 2023 4:08:32 PM]
[Dec 23, 2023 3:52:45 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Mike.Gibson
Ace Cruncher
England
Joined: Aug 23, 2007
Post Count: 12142
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Project Status (First Post Updated)

They appear to be loading work in batches, so it is a matter of whether you hit a batch, or miss.

But also when a machine picks up aa unit it sets the operating system for the copy. This creates another restriction.

ARP is expected back in the New Year sometime which should enable a better flow of work. Currently, MCM seems to be unable to satisfy demand on its own.

Mike
[Dec 23, 2023 5:24:35 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Sgt.Joe
Ace Cruncher
USA
Joined: Jul 4, 2006
Post Count: 7579
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Project Status (First Post Updated)

Just took a look at the totals returned for MCM throughout the year. Since November 22, every succeeding day there has been just a tad fewer results returned than the day before. Over the course of that time that has been a decrease of about 162,285 work units (Nov. 22 minus Dec. 22). I believe Mike is correct in the assertion that demand for work units is exceeding supply. Probably as soon as the feeder has work units available, they are snapped up almost immediately by whichever machines are querying for work units at that time. Not knowing how the query queue is constructed this is my theory. I also don't know how fast the feeder is refilled once a batch has been exhausted, nor how many feeders may be deployed. Another factor may be the techs have slowed the release of work units to allow the backend processes to function properly - optimize operational throughput (although they seemed to be able to handle amounts in excess of a million/day in the past.)
All mere speculation on my part.

Edit: See clarification a couple of posts down. The last normal day over a million is Nov. 27 (1,055,437) and Dec 22 is (897,270) for difference of 158,167.
Sorry about the erroneous info.

Edit 2: I tried to post this correction the other day and the system crashed before I got it posted. sad

Cheers
----------------------------------------
Sgt. Joe
*Minnesota Crunchers*
----------------------------------------
[Edit 2 times, last edit by Sgt.Joe at Dec 24, 2023 8:41:26 PM]
[Dec 23, 2023 6:54:52 PM]   Link   Report threatening or abusive post: please login first  Go to top 
gj82854
Advanced Cruncher
Joined: Sep 26, 2022
Post Count: 67
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Project Status (First Post Updated)

Just took a look at the totals returned for MCM throughout the year. Since November 22, every succeeding day there has been just a tad fewer results returned than the day before.


Where are you getting your stats from? WCG MCM stats don't seem to match up.

Statistics date Total run time Points generated Results returned
12/23/2023 102:034:09:39:25 230,723,346 437,042
12/22/2023 214:268:19:29:43 472,278,034 897,270
12/21/2023 206:243:19:58:05 474,026,210 901,162
12/20/2023 201:110:11:09:09 459,380,834 869,258
12/19/2023 194:354:05:33:00 441,899,490 838,666
12/18/2023 205:188:10:19:03 454,270,505 858,917
12/17/2023 183:240:11:52:42 417,838,979 795,551
12/16/2023 172:339:09:51:54 396,988,877 751,419
12/15/2023 182:033:13:10:54 414,903,061 787,095
12/14/2023 192:058:12:57:06 427,796,254 815,261
12/13/2023 191:076:22:31:45 419,061,558 793,148
12/12/2023 189:064:13:04:08 428,790,318 820,057
12/11/2023 207:008:08:55:24 472,198,334 898,449
12/10/2023 200:081:01:28:07 457,264,643 869,560
[Dec 23, 2023 9:08:08 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Sgt.Joe
Ace Cruncher
USA
Joined: Jul 4, 2006
Post Count: 7579
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Project Status (First Post Updated)

Mea culpa. It is my mistake in the interpretation of my numbers. Good catch. I prepared a spreadsheet and calculated the average for each day over the previous 30 days. In my "rush to judgement" I used the wrong column - the 30 day average column - rather than the raw number column. I did this in order to smooth out the variations in the raw numbers. I will note that the raw numbers from October 22 to November 27 all show over 1 million work units returned. We have only hit that number once since that date (Dec. 5). I will continue to believe that the demand may be exceeding supply.
Thank you for bringing this to my attention.

Cheers
----------------------------------------
Sgt. Joe
*Minnesota Crunchers*
[Dec 24, 2023 1:16:26 AM]   Link   Report threatening or abusive post: please login first  Go to top 
gj82854
Advanced Cruncher
Joined: Sep 26, 2022
Post Count: 67
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Project Status (First Post Updated)

No problem. My first assumption was that you were right and that I was looking at the wrong data or misinterpreting something. I thought your observation was interesting.

Merry Christmas and Happy Holidays
[Dec 24, 2023 5:09:04 PM]   Link   Report threatening or abusive post: please login first  Go to top 
The_Mole
Cruncher
Joined: Nov 10, 2007
Post Count: 17
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Project Status (First Post Updated)

Any info from the project about the MCM status ('not enough for everybody' gets a bit stale after multiple weeks) ?

My Windows machine has gone dry. The Linux machines are maintaining almost full queues.

Cheers


It does get stale, indeed.

It's the other way around for me. Although my Linux machine still has some WUs left and isn't completely dry yet.

You can add another project and set the resource share to 0, then it will only act as a filler.

I did this with Einstein@home on Nov, 30th and according to BAM my monthly stats are:

  • WCG: 1,323,150 credits
  • Einstein: 9,429,563 credits


Sokrates: To be is to do!
Jean-Paul Sartre: To do is to be!
Krembil: Do be do be do...
----------------------------------------

[Dec 26, 2023 11:34:56 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Sgt.Joe
Ace Cruncher
USA
Joined: Jul 4, 2006
Post Count: 7579
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Project Status (First Post Updated)

Krembil: Do be do be do...


Sounds like Sinatra to me.

Cheers
----------------------------------------
Sgt. Joe
*Minnesota Crunchers*
[Dec 27, 2023 2:13:57 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 118   Pages: 12   [ Previous Page | 1 2 3 4 5 6 7 8 9 10 | Next Page ]
[ Jump to Last Post ]
Post new Thread