Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 27
Posts: 27   Pages: 3   [ 1 2 3 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 4759 times and has 26 replies Next Thread
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
shock Minimum RAM requirement

I would like to test your WU:s on a set of machines with less than minimum amount of RAM. These machines have previously run similar tasks successfully.

If I cannot run the WU:s on these machines, I have to load other WU:s from some other project also into a cluster of much more modern and faster machines. All the machines must run the same project.

The alternative would be to idle, or switch off, the oldest machines.

I am a bit puzzled why there is a minimum RAM requirement at all.
[Nov 14, 2011 10:21:45 PM]   Link   Report threatening or abusive post: please login first  Go to top 
uplinger
Former World Community Grid Tech
Joined: May 23, 2005
Post Count: 3952
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Minimum RAM requirement

TRNG98,

There is a minimum memory requirement as not all of our members have machines that are dedicated to crunching. Meaning they are their every day machine to check email and surf the internet. World Community Grid strives to be a low impact on a member's machine as possible.

The minimum Requirements listed on the site are what we recommend for a computer and OS installed on the machine. This is because the default BOINC settings is to use something along the lines of 75% of available memory of the computer. Thus the limit you'll see when downloading a work unit from BOINC is closer to 250MB of available RAM.

You can change your memory usage on your machines to be 100% if you'd like through the BOINC client. This is done by editing your preferences.

Work units for VINA are very intensive with the memory it uses. This means if it allocates 50MB of memory to use during it's run, ALL 50MB is used and none is allowed to go into paging. This causes other processes that are less memory intensive (but still allocate space) to send things to cache (swap space). This will cause those applications to seem sluggish or slow when attempting to use them.

Also, if you don't mind me asking, what is the memory of these older machines?

Hope this helps explain the memory requirement.
-Uplinger
[Nov 15, 2011 3:12:30 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Minimum RAM requirement

The machine have 191 MB, and it don't even run a screen saver, only the BOINC work. But the real problem is with your project policy:


On this machine I can volunteer approx 500 WU:s This is what I am willing to give you for free on this machine. But due to your RAM requirement, that is an assumption at best, you say that the performance is too low, so you don't want any of it! I shall be reminded of this every time I pass by the unit!!

Please kindly give me a minimum RAM requirement that is empirically tested to be MINIMUM; i.e. it is simply not possible to run the project WU:s on less RAM independent of operating system (version) or system setup.

We are talking about MINIMUM memory here, not the recommended amount!

Thank you for your consideration.
[Nov 15, 2011 6:58:22 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Minimum RAM requirement

As you say you do NOT want to run anything else but WCG on these machines, then just do it. Uplinger says that 50 Megs is used by WCG so as you have 191 then it should run ok.... biggrin
[Nov 15, 2011 7:38:09 AM]   Link   Report threatening or abusive post: please login first  Go to top 
JmBoullier
Former Community Advisor
Normandy - France
Joined: Jan 26, 2007
Post Count: 3715
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Minimum RAM requirement

TRNG98,
Just to give you an idea, the four WUs which are currently running in my quad use between 28.0 and 35.4 MB under Ubuntu. But since the "search box" size can be different from one job to another, even inside the same WU, probably this range will be different when I finish my post although, until now, it was generally similar.

Knowing this you have two choices:
- your machine has, say 50 MB, available for crunching and you go for it, taking the risk that a single larger need sometime in the WU throws it in error, wasting all the work which has been done before
- or you give this machine what is best for it, i.e. HCC or HCMD2 (when it resumes), and you trust WCG for balancing the whole load between projects. This way you will be sure that the work done by this machine will not be wasted.
----------------------------------------
Team--> Decrypthon -->Statistics/Join -->Thread
[Nov 15, 2011 8:55:20 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Minimum RAM requirement

The machine have 191 MB, and it don't even run a screen saver, only the BOINC work. But the real problem is with your project policy:


On this machine I can volunteer approx 500 WU:s This is what I am willing to give you for free on this machine. But due to your RAM requirement, that is an assumption at best, you say that the performance is too low, so you don't want any of it! I shall be reminded of this every time I pass by the unit!!

Please kindly give me a minimum RAM requirement that is empirically tested to be MINIMUM; i.e. it is simply not possible to run the project WU:s on less RAM independent of operating system (version) or system setup.

We are talking about MINIMUM memory here, not the recommended amount!

Thank you for your consideration.

TRN98,

Assuming you read the earlier thread in GFAM forum on System requirements and actual use, you'd seen that the *running* values are about 30-35MB and similar amount in VM. Just specify the required amount that WCG tests for, being 250MB, even though it may not be used, but could be used. Whether 250 is free is not important, but what's specified and what's physically there, logged at start of client, is. If it's less you get this:

1310 WCG 15-11-2011 09:41 Beta - Drug Search for Leishmaniasis needs 384.00 MB RAM but only 184.16 MB is available for use.
1311 WCG 15-11-2011 09:41 Beta Test - GO Fight Against Malaria needs 384.00 MB RAM but only 184.16 MB is available for use.
1312 WCG 15-11-2011 09:41 GO Fight Against Malaria needs 250.00 MB RAM but only 184.16 MB is available for use.
1313 WCG 15-11-2011 09:41 No work available for the applications you have selected. Please check your settings on the website.

We've seen this with the same science engine driven DSFL where suddenly a batch came by that *used* > 220MB of RAM. If these get to your 191MB machines, things start moving like molasses, as Uplinger explained, but if these machines arrent doing anything else, what's *your* worry? WCG's worry is the individual volunteer, it being *impossible* to specify requirements on a specific volunteer basis, so the SRs are set for *worst case*.

You can do the JDI and run with it and hope none come to you that have actual need of the full search box that is allowed to grow to 250MB at any time, without notice. You take that risk consciously. Start 1, look in properties, and presently you see this:



Each time you've got you nodes available, run a brief test, then open the gauges, that is of course if you're willing to spend a little time doing that.

All *free* CPU time is much appreciated, but the prime premise is that it does not impact the user of the computer(s)... almost like the 3 laws of robotics... impediment is harm... harm is loss of volunteer.

--//--
[Nov 15, 2011 9:03:21 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Minimum RAM requirement

The SERVER refuse to send out the work, so I am not allowed to experiment or make my own decision. The unit run dry soon, and I will then take an pre-emptive decision. My suggestion is to drop the server-side minimum RAM to very low values immediately for all projects on your grid.

Note that the above mentioned allocated RAM size or allowed RAM size, do not apply at all--- it is the physically installed RAM that is checked. If you don't have the IC:s, the server do not send out the work!

Note that it is the WCG:s active decision to refuse to accept a contribution that bugs me. This issue can also be seen as a BOINC bug; the measurement do not accurately reflect the reality intended.

Virtual memory management is no easy task, and even though you may assume that 100MB of RAM would be necessary, in practice the virtual RAM manager may find a way to make it work with less.
[Nov 15, 2011 12:26:46 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Minimum RAM requirement

There's no need to assume a shouting tone by posting enlarged and bolded text in a regular forum post. That it bugs you that WCG wont buckle is clear without.

1. The error you saw in my log of 184Mb is what I *forced*, by setting the allowed to 9% of 2GB. Yes you can set all 256 in a client preference and the servers will accept that if physically there... I did not say or infer anything else. If I set it to 100%, my client reports this:

1418 15-11-2011 13:59 max memory usage when active: 2046.18MB
1419 15-11-2011 13:59 max memory usage when idle: 2046.18MB

i.e. it is not considering that part of the memory has already been used by the OS et cetera.

2. There cant be a compromise on the RAM spec as Uplinger and I did note that the instances do come around where > 220MB was used i.e. the individual being impacted if borderline devices were to receive these.

Now, what device has 191 *physical*? 3 banks of 64K minus some overhead? In that case, that's than how it is. Do WCG jeopardize the whole for the one by removing or lowering the limit? Don't think that will be and doubt they'd be reconsidering. Testing on a *per result* or *per batch* basis to see if it fits a device is not an option. WCG has 10 projects running on multiple platforms. As it is, a serious support effort.

--//--
[Nov 15, 2011 1:18:01 PM]   Link   Report threatening or abusive post: please login first  Go to top 
etienne06
Advanced Cruncher
France
Joined: Jun 11, 2009
Post Count: 56
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Minimum RAM requirement

Good evening everybody,

I'm afraid I don't understand all your posts about the technical requirements for the GOFAM project.

So, could somebody explain me why, in a simple way, my computer seems to have downloaded a WU, since it appears in the messages, but no WU ine the tasks !!!

I can't paste a sreen view in my post... But I hope somebody may understand what I mean...

Thank you guys.
[Nov 15, 2011 8:00:25 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Minimum RAM requirement

etienne06,

Suspect to have the answer for you why you got the image files, but not any WU. I'll let the techs though answer as being opted in will, it seems, always download the permanent/persistent files for a project even if a device does not meet the requirements. The why is unknown to me.

--//--
[Nov 15, 2011 8:19:23 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 27   Pages: 3   [ 1 2 3 | Next Page ]
[ Jump to Last Post ]
Post new Thread