Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 12
Posts: 12   Pages: 2   [ 1 2 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 3543 times and has 11 replies Next Thread
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Some WUs require RAM higher than 1GB

I encountered some WUs that stopped somewhere in the middle and BOINC manager says that its waiting for memory. Most of the PCs in my little farm only have 1GB RAM. One continued after increasing the page file but most I had to add more RAM for the WUs to finish. According to the system requirements of CEP, 512MB is the minimum RAM. I havent encountered this problem before in the previous phase of the project. I guess I have to remove CEP on my systems with only 1GB to avoid this problem in the future.
[Apr 21, 2009 1:21:19 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Some WUs require RAM higher than 1GB

I think you will find your preferences are set to use at most 50% of your memory when the computer is in use.

Change your preferences.

Also, if you have a dual core computer, you must double the minimum requirements.

Average peak memory use for The Clean Energy Project is 145 MB. Average peak page file use is 429 MB.
[Apr 21, 2009 1:27:02 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Some WUs require RAM higher than 1GB

Ok, thanks for the advice. I increased the % of memory setting while the computer is in use. I will monitor it for a few days and see if the problem is solved.

I am now wondering why BOINC didnt use all the available memory and why the % of memory when idle setting didnt take effect. Those systems where running the whole night without human intervention when I noticed the problem. These systems run BOINC during the night except for a couple that are crunching 24/7. I operate an internet cafe between 10am to 11PM, restart the systems and turn on BOINC before sleeping then turn the PCs off at 8AM. So the PCs are not used during BOINC operation.

Before, I used to enable BOINC operation full time but I found out that my internet cafe software is not 100% compatible with BOINC and resulted in lots of errors especially during the startup phase of each WU. So I decided not to run BOINC anymore during business hours and since then I only encountered very few errors in these past few months.
[Apr 21, 2009 3:28:20 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
Re: Some WUs require RAM higher than 1GB

Having no doubt that BOINC regulates permitted idle/use ram level use correctly, my own observations on CEP jobs have shown quite a bit larger VM use than Didactylos and incidental larger RAM use. If thus the sum of the actual disk space use or memory is exceeded, 1 or more sciences will be paused and a smaller one will be tried.

Now, in client 6.6 a new logic is introduced and for each application BOINC is now recording the maximum encountered for each. This stops the client from trying a whole string of jobs to see if they will fit. The reason is that if LAIM (Leave Application in Memory) is on, ever more paused jobs would sit in memory. In past BOINC would just try job after job to get all cores active. This for me has a good/bad snag. If a client only runs the CEP project and it's all there is in queue/cache, with too little memory the client will not run those jobs concurrently with too tight memory constraints. What will happen is that as soon as the job that was still running finishes, the waiting in memory job will be started, and this is a guess, no second job will even be attempted to be started based on past historic maximum use record. I'm curious as how the developers will signal this in the client log.

Now Haris Dublis, can you please post the actual startup log from the stdoutdea.txt file from before your preference changes, for that will tell what the effective net memory/disk use is. The percentage can be misleading. It's what BOINC computes net off, reflected in these log lines:

21/04/2009 10:09:38 Preferences limit memory usage when active to 2302.32MB
21/04/2009 10:09:38 Preferences limit memory usage when idle to 2762.79MB
21/04/2009 10:09:38 Preferences limit disk usage to 10.00GB
----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
[Apr 21, 2009 8:41:00 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Some WUs require RAM higher than 1GB

Larger RAM use?

Actually, I'm seeing much smaller memory use for the A type (~ 30 MB), and the B type are still not significantly above the average I gave.

Are you talking about a task from a particular batch? Obviously, there is variation I cannot capture.
[Apr 21, 2009 8:54:35 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
Re: Some WUs require RAM higher than 1GB

Cant's tell which batch, just mental notes when looking at properties in the Process Explorer. Average Peak I assume is not the absolute peak which I've seen hit 490Mb and RAM near 200Mb, exceptions, but still occurring.
----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
[Apr 21, 2009 9:08:04 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Some WUs require RAM higher than 1GB

By average peak, I mean the average across a sample of tasks. I'm recording the peak value of memory and page file for each task.

Sorry, poor choice of words.

When I get a larger sample, I hope to compute variance, too.

http://wcg.wikia.com/wiki/System_requirements
[Apr 21, 2009 1:28:07 PM]   Link   Report threatening or abusive post: please login first  Go to top 
JmBoullier
Former Community Advisor
Normandy - France
Joined: Jan 26, 2007
Post Count: 3716
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Some WUs require RAM higher than 1GB

When I read your first post I had a look at a B type which was running under XP: it was using 210 MB RAM and the VM size was 487 MB. I forgot to look at the peak RAM.
But it was a big WU, it took 12 hours of runtime on the quad. Batch 485.

The A type (batch 511) which is running now (under Linux) is much smaller. Top says 20 MB RAM and 245 MB and it should run only a little more than 6 hours.

Cheers. Jean.
----------------------------------------
Team--> Decrypthon -->Statistics/Join -->Thread
[Apr 21, 2009 2:21:31 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Rickjb
Veteran Cruncher
Australia
Joined: Sep 17, 2006
Post Count: 666
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Some WUs require RAM higher than 1GB

Just a thought ... Could Haris Dublas' machines be running tasks other than BOINC that are active even occasionally, so they cause the BOINC tasks to be paged out waiting for memory? The BOINC tasks run at low priority, so they may never get a look in.
How many cores do his machines have? 1GB should be adequate for single-cores and even duals.
[Apr 21, 2009 2:45:59 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
Re: Some WUs require RAM higher than 1GB

Haris Dublas writes in the plural " I guess I have to remove CEP on my systems with only 1GB to avoid this problem in the future.". Single or dual core, with 75% memory use allowed to BOINC and enough VM to go around and disk storage space permission, it should be enough to have both continue.

As also he writes that at night they do nothing else, not likely they get paged out, and even them, they'd keep running just doing more VM swapping, long as the minimum RAM threshold is not causing the waiting in memory.

One of the pains of updating the website device profile is the necessity of the client to talk to the server to fetch the new settings. If in the middle of a longer job that could take some time and with waiting for memory even longer so hitting the Update button in the BOINC Manager project tab is always advised if wanting to force the revised profile across.
----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
[Apr 21, 2009 2:59:46 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 12   Pages: 2   [ 1 2 | Next Page ]
[ Jump to Last Post ]
Post new Thread