Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 16
Posts: 16   Pages: 2   [ Previous Page | 1 2 ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 3412 times and has 15 replies Next Thread
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
Re: What's the real story about HDC memory needs?

After a little lul with return of the 750mb WU's, putting me on the wrong foot to activate BOINC during 'work-time' again, was having a new record breaker of 902,912kb of RAM use and my 'user experience' going out the window again.....someone reading the minds of many (and probably reading many lamenting posts), here comes Rom Walton in his October 13, with The Solution in the pipeline:
BOINC Q&A -- 13/10/06

Advanced Memory Management, what is the idea/aim behind that?

Well that is a good question, the advanced memory management is more about setting boundary conditions on how much BOINC and related processes are allowed to use.

We still get a few reports of BOINC causing systems to become unresponsive or sluggish. Most of the investigations we have done revealed a machine that was paging a lot during the times BOINC was running. Paging is the process the OS uses to free up less frequently used memory to make room for active tasks by writing those pages of memory to disk. Each page of memory is roughly 4KB in size on a x86 processor.

So lets say you are running a machine with 512MB's of memory. Windows XP uses roughly 128MB of that on boot-up and will allow parts of itself to be paged out to disk. The last round of virus scanners I looked at want around 100MB of memory, the little system tray icons in the lower right part of your screen generally take about 5MB a piece, with the notable exception of the various IM clients which have bloated out to 20-60MB a piece. Any additional programs running on your machine such as a web browser or email client can take anywhere from 20MB up to 100MB.

When the OS comes under memory pressure it starts looking for chunks of memory that haven't been touched in awhile and writes them out to disk and then loads something into that chunk of memory that is more relevant.

So let us say that you are attached to Rosetta@Home and you walk away from your computer for an hour or so, during that time Rosetta@Home has used over 256MBs of memory continuously for at least 30 minutes and the OS has had to page a lot of stuff to make room for it, including itself. You start menu has to be reread from disk or whichever application you happen to be using before you left. All of that paging takes a few moments and makes your computer feel really really slow.

With the introduction of this feature we hope we can finally close one of the last remaining loopholes to user responsiveness.

Right now we have the following two settings planned:

1. Percentage of memory use while user is active.
2. Percentage of memory use while user is idle.

What should happen is that BOINC will detect how much memory is installed on the machine, and every 10 seconds or so looks at how much memory a science application is using. If a science application exceeds the total allotment BOINC will shut it down and look for another application to schedule.

I'm really looking forward to this feature since my 2GB machine uses about 1.2GB of memory without BOINC even running and I have four processors to feed. Up until the middle of last year I only had 1GB in my machine and if I had BOINC running it was pretty painful when BOINC rescheduled all the science applications on the machine while I was working.

----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
----------------------------------------
[Edit 2 times, last edit by Sekerob at Oct 16, 2006 8:01:02 AM]
[Oct 16, 2006 7:58:33 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: What's the real story about HDC memory needs?

Hi.
I have a p4 3.2ghz with 1gb of ram and a text to speech screenreader. None of the work units I have done for hdc have produced stuttering of audio or anything like that.
using xpsp2 here with the default memory settings
[Oct 18, 2006 3:25:56 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Viktors
Former World Community Grid Tech
Joined: Sep 20, 2004
Post Count: 653
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: What's the real story about HDC memory needs?

The HDC project is particularly memory hungry with a peak around 500mb, and that is why we set the minimum RAM requirement to 750mb. We keep wondering if we should raise this to 1gb, but we already have a lot of members who want to contribute, but cannot because of the current minimum, even though they are willing to suffer the paging activity that would result. However, the checkpoints are probably the worst part because they write a very large file. We put in disk I/O throttling for this where we could, but could not do this for the internals of the UD agent. As a result, there is a small period of time where disk activity is high. Defragmenting your disk drive seems to improve the situation a quite a bit, from our experience.
[Oct 19, 2006 8:39:55 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
Re: What's the real story about HDC memory needs?

One of the things is for BOINC users, besides the defragging of disk and paging file - all important -, is to set the write to disk in the device options to a large number....it does not allow for greater than 999 seconds, but at least, if sufficient RAM is available, it wont do as many disk writes (bar when u close BOINC at which time it will do).......902.912kb RAM peak though is a stretch by any measure and wonder what these demands do to those running 2 or more on dual cores.

found that bringing the MTU back up to 1400 both in router and WOS registry got rid of the straming audio stutter......a small compromise on a security advice from the "Belarc Advisor" analyzer.

ciao
----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
[Oct 21, 2006 9:47:03 AM]   Link   Report threatening or abusive post: please login first  Go to top 
EiF
Cruncher
Joined: Nov 28, 2004
Post Count: 14
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: What's the real story about HDC memory needs?

Hello,

is there any recent progress with briging a solution to the memory needs of HDC? Will there be a new release of the agent (when?) or could we at least limit the RAM used by the agent somehow?

Many thanks...
[Nov 1, 2006 9:35:22 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
smile Re: What's the real story about HDC memory needs?

Hi EiF,

I doubt that will happen.... the scientist and the programmer already had trouble enough to get it to run in a 500mb ram block, with rest in virtual memory, without it causing excessive disk swapping and slowing machines down beyond usable.....i have 1.5gb RAM and 1 WU model sneakered 928mb ram peak 1 week ago and that's a squeeze on the user for sure.

Also, i think this particular project on the TMA principle is time limited and production of WU's too....about 20,000 are send into the field daily, thus the economics is very low i.a.w. the truly dedicated accept the additional burden, or let it run by others with more powerful PCs. There is the very worthy Fighting AIDS which is much much smaller and imminently HPF2 is returning and a few new projects are entering the arena, which are all much smaller.

One thing u can do if set on HDC, is to just let it run on schedule during screensaver time or just at night if your box is on 24/7. The Device rpofile allows u to do that.

Sorry sad
----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
----------------------------------------
[Edit 1 times, last edit by Sekerob at Nov 1, 2006 10:06:29 AM]
[Nov 1, 2006 10:05:09 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 16   Pages: 2   [ Previous Page | 1 2 ]
[ Jump to Last Post ]
Post new Thread