Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 16
Posts: 16   Pages: 2   [ 1 2 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 4564 times and has 15 replies Next Thread
NixChix
Veteran Cruncher
United States
Joined: Apr 29, 2007
Post Count: 1187
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Why Insufficient MCM Work?

It seems that the MCM feeder cannot keep the queue of work ready to be sent out filled. I believe it was able to do that before, even with MCM being the only project.

Is it just a lack of hardware at the Krembil data center, or is this the result of some other problem?

Cheers coffee
----------------------------------------

[Jan 2, 2023 1:02:36 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Sgt.Joe
Ace Cruncher
USA
Joined: Jul 4, 2006
Post Count: 7846
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Why Insufficient MCM Work?

None of my machines have had a problem getting MCM work units. They do not get work units with every query, but the the queues seem to stay full.
Cheers
----------------------------------------
Sgt. Joe
*Minnesota Crunchers*
[Jan 2, 2023 2:47:47 AM]   Link   Report threatening or abusive post: please login first  Go to top 
PMH_UK
Veteran Cruncher
UK
Joined: Apr 26, 2007
Post Count: 786
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Why Insufficient MCM Work?

I suspect the disk array is close to it's limit so not always re-filling the feeder.
The new SSD array is delayed due to shortage of SSDs.

Paul.
----------------------------------------
Paul.
[Jan 2, 2023 11:08:15 AM]   Link   Report threatening or abusive post: please login first  Go to top 
drghughes
Cruncher
Joined: Jul 5, 2007
Post Count: 26
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Why Insufficient MCM Work?

It seems that the MCM feeder cannot keep the queue of work ready to be sent out filled.

I'm seeing a similar situation. I get approximately 6 tasks each day, and after that nothing until the next day.

But if others are getting constant work, I'm guessing that there is some reason why WCG is limiting the tasks sent to me. I just don't know what it is.
[Jan 3, 2023 8:27:53 AM]   Link   Report threatening or abusive post: please login first  Go to top 
chiara.p
World Community Grid Admin, Mapping Cancer Markers Scientist
Joined: Jul 15, 2020
Post Count: 29
Status: Offline
Reply to this Post  Reply with Quote 
Re: Why Insufficient MCM Work?

Hello volunteers, and Happy New Year!

MCM is running as usual and there are plenty of workunits. As other projects are slowing down, it is possible that more volunteers are processing MCM workunits, and hence why you are receiving fewer ones.
[Jan 3, 2023 8:08:12 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Sgt.Joe
Ace Cruncher
USA
Joined: Jul 4, 2006
Post Count: 7846
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Why Insufficient MCM Work?

Hello volunteers, and Happy New Year!

MCM is running as usual and there are plenty of workunits. As other projects are slowing down, it is possible that more volunteers are processing MCM workunits, and hence why you are receiving fewer ones.

First: Thank you for the reply.
Second: Since MCM is basically the only project sending out work units, everybody who is still active are all getting MCM units.
Third: I am speculating either the feeder is maxed out on the number of units it can send out at any one time or the mechanism for keeping the feeder supplied is inadequate.

So, at this point it may be beneficial to either start a second feeder for MCM or look to see where in the pipeline the bottleneck is so it can be remedied until such time as other projects resume operations.

Cheers
----------------------------------------
Sgt. Joe
*Minnesota Crunchers*
[Jan 3, 2023 9:20:22 PM]   Link   Report threatening or abusive post: please login first  Go to top 
NixChix
Veteran Cruncher
United States
Joined: Apr 29, 2007
Post Count: 1187
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Why Insufficient MCM Work?

Hello volunteers, and Happy New Year!

MCM is running as usual and there are plenty of workunits. As other projects are slowing down, it is possible that more volunteers are processing MCM workunits, and hence why you are receiving fewer ones.
Happy New Year,
Thank you for the reply. There were significantly higher production rates of MCM during 2021. The daily processing times now compared to mid-2021 are far less due to the many volunteers that have left. Is the limitation the current hardware stack or is there some other limiting factor?

Cheers coffee
----------------------------------------

[Jan 4, 2023 6:16:44 AM]   Link   Report threatening or abusive post: please login first  Go to top 
chiara.p
World Community Grid Admin, Mapping Cancer Markers Scientist
Joined: Jul 15, 2020
Post Count: 29
Status: Offline
Reply to this Post  Reply with Quote 
Re: Why Insufficient MCM Work?

Dear NixChix
it is true that the number of batches processed per day is a bit lower than that of one year ago, but not hugely, and there are multiple reasons for it. MCM used to process, on average, 60-65 batches of workunits (where a batch is the entire group of workunits downloaded from the academia-linked servers of our research partners) per day, a number that would decrease to about 55 during the holidays. We are currently processing about 45 batches per day.
It is true that some volunteers have sadly left, and a few others joined - but the difference has not been as large as we feared and we seem to be more limited by our own hardware troubles, reduced total CPUs on the backend vs. the IBM era, and the networking issues with our cloud environment preventing a more reasonable number of concurrent connections to the WCG from users. To limit download issues experienced by volunteers while we await the fix for our network congestion, the maximum number of connections permitted through our load balancer in front of the download servers was lowered to half of what would be reasonable once we are able to use all of our bandwidth, i.e. the previous maxconn setting at which hung downloads were plaguing everybody.
Nonetheless, we will increase the number of MCM WUs in the next few days to compensate for the lack of other projects' WUs.
[Jan 5, 2023 8:55:07 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Unixchick
Veteran Cruncher
Joined: Apr 16, 2020
Post Count: 1298
Status: Recently Active
Project Badges:
Reply to this Post  Reply with Quote 
Re: Why Insufficient MCM Work?

Thank you for the fantastic update Chiara, and for trying to give us (the demanding volunteers) more WUs.
[Jan 5, 2023 9:50:03 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Sgt.Joe
Ace Cruncher
USA
Joined: Jul 4, 2006
Post Count: 7846
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Why Insufficient MCM Work?

Thank you for the informative update.
Cheers
----------------------------------------
Sgt. Joe
*Minnesota Crunchers*
[Jan 5, 2023 9:59:59 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 16   Pages: 2   [ 1 2 | Next Page ]
[ Jump to Last Post ]
Post new Thread