Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 822
Posts: 822   Pages: 83   [ Previous Page | 62 63 64 65 66 67 68 69 70 71 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 1854233 times and has 821 replies Next Thread
Speedy51
Veteran Cruncher
New Zealand
Joined: Nov 4, 2005
Post Count: 1326
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work unit availability

Thank you Falconet. This probably explain why I have a higher number of pending validation units than normal (I have 4 pages I am lucky to normally have 1)
----------------------------------------

----------------------------------------
[Edit 2 times, last edit by Speedy51 at Jun 25, 2021 8:08:28 PM]
[Jun 19, 2021 4:45:27 AM]   Link   Report threatening or abusive post: please login first  Go to top 
GunZi
Senior Cruncher
Joined: Apr 1, 2020
Post Count: 160
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work unit availability

Even though I have deselected OPN as a project I want to get workunits from... I am getting some CPU workunits. That probably means the other projects (Mapping Cancer Markers, Microbiome Immunity Project, African Rainfall) don't have enough workunits?

My reasoning is I have this option checked:
If there is no work available for the project(s) I have selected above, please send me work from another project.

I am trying to follow this advice from knreed (https://www.worldcommunitygrid.org/forums/wcg...43311_offset,585#660072):
I would ask that if you are someone who has only OpenPandemics selected, please consider adding Mapping Cancer Markers and/or the African Rainfall Project in addition to OpenPandemics. OpenPandemics will continue at the same pace regardless of how much CPU power is allocated to it as the GPU side will pick up any slack left over from the CPU side.

I get CPU workunits regardless if OpenPandemics is not selected biggrin
[Jun 19, 2021 8:31:28 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Sgt.Joe
Ace Cruncher
USA
Joined: Jul 4, 2006
Post Count: 7846
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work unit availability

Even though I have deselected OPN as a project I want to get workunits from... I am getting some CPU workunits. That probably means the other projects (Mapping Cancer Markers, Microbiome Immunity Project, African Rainfall) don't have enough workunits?

The reason you still get some OPN work units is your system is querying the server at the same time when it may be serving workunits to someone else. It thus goes into its backup plan on finding something else since you have checked the "If there is no work available for the project(s)" option. If you uncheck this option you should no longer get OPN work units. There is no shortage of either MCM nor ARP work units, but with the MIP units there may be some slight shortages for the moment as that project is winding down and a number of crunchers have upped their preferences so they can make their goal before the project ends sometime in July.
I run with 1 day cache and have not run short of either MCM nor ARP. If there are not any available MCM or ARP units at any particular time, your system will re-query in a few minutes and probably get some of either. Let us know if this meets your needs.
Cheers
----------------------------------------
Sgt. Joe
*Minnesota Crunchers*
[Jun 19, 2021 4:17:09 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Dayle Diamond
Senior Cruncher
Joined: Jan 31, 2013
Post Count: 452
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work unit availability

Hooray, a push notification asking people to resubscribe to MCM!
It's always great to see the WCG team accepting feedback from its members.
And that feedback came from this thread, right here in the OPN forums ;p
[Jun 23, 2021 11:29:43 PM]   Link   Report threatening or abusive post: please login first  Go to top 
wildhagen
Veteran Cruncher
The Netherlands
Joined: Jun 5, 2009
Post Count: 1004
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work unit availability

The last few days I seem to get much more WU's for my AMD GPU, compared to a few days ago.

Has something changes in the maximum number of WU's per day?
[Jun 24, 2021 2:01:52 PM]   Link   Report threatening or abusive post: please login first  Go to top 
JWustmann
Cruncher
Joined: Mar 27, 2020
Post Count: 3
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work unit availability

Here (https://www.worldcommunitygrid.org/about_us/viewNewsArticle.do?articleId=713) it is stated, that we actually have a large backlog on GPU Work?

Current status of work units

CPU

Available for download: 6,063 batches
In progress: 2,199 batches
Completed: 51,189 batches
6,770 batches in the last 30 days
Average of 225.7 batches per day
Estimated backlog: 26.9 days
GPU

Available for download: 16,283 batches
In progress: 4,174 batches
Completed: 52,292 batches
15,366 batches in the last 30 days
Average of 512.2 per day
Estimated backlog: 31.8 days

I like the notion, that cpu work can be allocated to other projects like cancer, because the GPU efficiency is so much higher for solving open pandemics. I dont know where the bottleneck is, but i´d rather end the pandemic sonner than farm CPU time for "fairness of contribution reasons". So if the bottleneck is nontechnical, please geht rid of it.

Doing inefficient crunching while fficient is possible is like heating your home in winter by burning paper money.

Every CPU cycle, that can be spent on "CPU only projects" should optimize the output of the grid as a whole
[Jun 25, 2021 7:56:48 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Unixchick
Veteran Cruncher
Joined: Apr 16, 2020
Post Count: 1296
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work unit availability

I too was surprised to see the backlog in GPU work. The test did provide a limit of what the system can handle sending out and returning, but I don't think we are anywhere near that. They should increase how many they send out every 30 minutes and whittle away that backlog in gpu. I'm betting a little bit of a backlog is good, as if they run out then people will get cranky, but 31 days is a large backlog.
[Jun 25, 2021 3:01:46 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Acibant
Advanced Cruncher
USA
Joined: Apr 15, 2020
Post Count: 126
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work unit availability

While they do have quite a few work units built up to last a while, we've been told the researchers themselves can only process so many results per day. So the bottleneck is very much human in nature.
----------------------------------------

[Jun 25, 2021 3:28:02 PM]   Link   Report threatening or abusive post: please login first  Go to top 
yoerik
Senior Cruncher
Canada
Joined: Mar 24, 2020
Post Count: 413
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work unit availability

While they do have quite a few work units built up to last a while, we've been told the researchers themselves can only process so many results per day. So the bottleneck is very much human in nature.

^
as outlined here: https://www.worldcommunitygrid.org/forums/wcg...ead,43504_offset,0#659962
"running OpenPandemics at a higher speed will cause the research team to focus the majority of their time and energy on preparing input data sets and archiving returned data rather than performing analysis of the results and moving the interesting results to the next step in the pipeline. As a result, the project will remain at its current speed for the foreseeable future."

the #1 way to increase the GPU rate, is to reduce the WUs and batches going out to CPUs. Hence there's been appeals from WCG to turn on MCM, so that CPU capacity doesn't disappear - and lost to the grid.
----------------------------------------

[Jun 25, 2021 4:49:01 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Grumpy Swede
Master Cruncher
Svíþjóð
Joined: Apr 10, 2020
Post Count: 2498
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work unit availability

Hehe, so few GPU WU's, that I can't even keep my GTX660M fed. It takes a couple of hours to crunch these "new" GPU WU's, but that isn't enough to get new ones while crunching. I even run CPU tasks on the same computer, so there isn't any long back-offs in between requests either.

Why spend time and money developing a GPU app, when it's not used much at all?

Ah well, I save electricity at least.
[Jun 26, 2021 7:21:18 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 822   Pages: 83   [ Previous Page | 62 63 64 65 66 67 68 69 70 71 | Next Page ]
[ Jump to Last Post ]
Post new Thread