| Index | Recent Threads | Unanswered Threads | Who's Active | Guidelines | Search |
| World Community Grid Forums
|
| No member browsing this thread |
|
Thread Status: Active Total posts in this thread: 16
|
|
| Author |
|
|
NixChix
Veteran Cruncher United States Joined: Apr 29, 2007 Post Count: 1187 Status: Offline Project Badges:
|
It seems that the MCM feeder cannot keep the queue of work ready to be sent out filled. I believe it was able to do that before, even with MCM being the only project.
----------------------------------------Is it just a lack of hardware at the Krembil data center, or is this the result of some other problem? Cheers ![]() ![]() |
||
|
|
Sgt.Joe
Ace Cruncher USA Joined: Jul 4, 2006 Post Count: 7846 Status: Offline Project Badges:
|
None of my machines have had a problem getting MCM work units. They do not get work units with every query, but the the queues seem to stay full.
----------------------------------------Cheers
Sgt. Joe
*Minnesota Crunchers* |
||
|
|
PMH_UK
Veteran Cruncher UK Joined: Apr 26, 2007 Post Count: 786 Status: Offline Project Badges:
|
I suspect the disk array is close to it's limit so not always re-filling the feeder.
----------------------------------------The new SSD array is delayed due to shortage of SSDs. Paul.
Paul.
|
||
|
|
drghughes
Cruncher Joined: Jul 5, 2007 Post Count: 26 Status: Offline Project Badges:
|
It seems that the MCM feeder cannot keep the queue of work ready to be sent out filled. I'm seeing a similar situation. I get approximately 6 tasks each day, and after that nothing until the next day. But if others are getting constant work, I'm guessing that there is some reason why WCG is limiting the tasks sent to me. I just don't know what it is. |
||
|
|
chiara.p
World Community Grid Admin, Mapping Cancer Markers Scientist Joined: Jul 15, 2020 Post Count: 29 Status: Offline |
Hello volunteers, and Happy New Year!
MCM is running as usual and there are plenty of workunits. As other projects are slowing down, it is possible that more volunteers are processing MCM workunits, and hence why you are receiving fewer ones. |
||
|
|
Sgt.Joe
Ace Cruncher USA Joined: Jul 4, 2006 Post Count: 7846 Status: Offline Project Badges:
|
Hello volunteers, and Happy New Year! MCM is running as usual and there are plenty of workunits. As other projects are slowing down, it is possible that more volunteers are processing MCM workunits, and hence why you are receiving fewer ones. First: Thank you for the reply. Second: Since MCM is basically the only project sending out work units, everybody who is still active are all getting MCM units. Third: I am speculating either the feeder is maxed out on the number of units it can send out at any one time or the mechanism for keeping the feeder supplied is inadequate. So, at this point it may be beneficial to either start a second feeder for MCM or look to see where in the pipeline the bottleneck is so it can be remedied until such time as other projects resume operations. Cheers
Sgt. Joe
*Minnesota Crunchers* |
||
|
|
NixChix
Veteran Cruncher United States Joined: Apr 29, 2007 Post Count: 1187 Status: Offline Project Badges:
|
Hello volunteers, and Happy New Year! Happy New Year,MCM is running as usual and there are plenty of workunits. As other projects are slowing down, it is possible that more volunteers are processing MCM workunits, and hence why you are receiving fewer ones. Thank you for the reply. There were significantly higher production rates of MCM during 2021. The daily processing times now compared to mid-2021 are far less due to the many volunteers that have left. Is the limitation the current hardware stack or is there some other limiting factor? Cheers ![]() ![]() |
||
|
|
chiara.p
World Community Grid Admin, Mapping Cancer Markers Scientist Joined: Jul 15, 2020 Post Count: 29 Status: Offline |
Dear NixChix
it is true that the number of batches processed per day is a bit lower than that of one year ago, but not hugely, and there are multiple reasons for it. MCM used to process, on average, 60-65 batches of workunits (where a batch is the entire group of workunits downloaded from the academia-linked servers of our research partners) per day, a number that would decrease to about 55 during the holidays. We are currently processing about 45 batches per day. It is true that some volunteers have sadly left, and a few others joined - but the difference has not been as large as we feared and we seem to be more limited by our own hardware troubles, reduced total CPUs on the backend vs. the IBM era, and the networking issues with our cloud environment preventing a more reasonable number of concurrent connections to the WCG from users. To limit download issues experienced by volunteers while we await the fix for our network congestion, the maximum number of connections permitted through our load balancer in front of the download servers was lowered to half of what would be reasonable once we are able to use all of our bandwidth, i.e. the previous maxconn setting at which hung downloads were plaguing everybody. Nonetheless, we will increase the number of MCM WUs in the next few days to compensate for the lack of other projects' WUs. |
||
|
|
Unixchick
Veteran Cruncher Joined: Apr 16, 2020 Post Count: 1298 Status: Recently Active Project Badges:
|
Thank you for the fantastic update Chiara, and for trying to give us (the demanding volunteers) more WUs.
|
||
|
|
Sgt.Joe
Ace Cruncher USA Joined: Jul 4, 2006 Post Count: 7846 Status: Offline Project Badges:
|
Thank you for the informative update.
----------------------------------------Cheers
Sgt. Joe
*Minnesota Crunchers* |
||
|
|
|