Index | Recent Threads | Unanswered Threads | Who's Active | Guidelines | Search |
World Community Grid Forums
Category: Completed Research Forum: Help Defeat Cancer Thread: What's the real story about HDC memory needs? |
No member browsing this thread |
Thread Status: Active Total posts in this thread: 16
|
Author |
|
Sekerob
Ace Cruncher Joined: Jul 24, 2005 Post Count: 20043 Status: Offline |
After a little lul with return of the 750mb WU's, putting me on the wrong foot to activate BOINC during 'work-time' again, was having a new record breaker of 902,912kb of RAM use and my 'user experience' going out the window again.....someone reading the minds of many (and probably reading many lamenting posts), here comes Rom Walton in his October 13, with The Solution in the pipeline:
---------------------------------------- BOINC Q&A -- 13/10/06 Advanced Memory Management, what is the idea/aim behind that? Well that is a good question, the advanced memory management is more about setting boundary conditions on how much BOINC and related processes are allowed to use. We still get a few reports of BOINC causing systems to become unresponsive or sluggish. Most of the investigations we have done revealed a machine that was paging a lot during the times BOINC was running. Paging is the process the OS uses to free up less frequently used memory to make room for active tasks by writing those pages of memory to disk. Each page of memory is roughly 4KB in size on a x86 processor. So lets say you are running a machine with 512MB's of memory. Windows XP uses roughly 128MB of that on boot-up and will allow parts of itself to be paged out to disk. The last round of virus scanners I looked at want around 100MB of memory, the little system tray icons in the lower right part of your screen generally take about 5MB a piece, with the notable exception of the various IM clients which have bloated out to 20-60MB a piece. Any additional programs running on your machine such as a web browser or email client can take anywhere from 20MB up to 100MB. When the OS comes under memory pressure it starts looking for chunks of memory that haven't been touched in awhile and writes them out to disk and then loads something into that chunk of memory that is more relevant. So let us say that you are attached to Rosetta@Home and you walk away from your computer for an hour or so, during that time Rosetta@Home has used over 256MBs of memory continuously for at least 30 minutes and the OS has had to page a lot of stuff to make room for it, including itself. You start menu has to be reread from disk or whichever application you happen to be using before you left. All of that paging takes a few moments and makes your computer feel really really slow. With the introduction of this feature we hope we can finally close one of the last remaining loopholes to user responsiveness. Right now we have the following two settings planned: 1. Percentage of memory use while user is active. 2. Percentage of memory use while user is idle. What should happen is that BOINC will detect how much memory is installed on the machine, and every 10 seconds or so looks at how much memory a science application is using. If a science application exceeds the total allotment BOINC will shut it down and look for another application to schedule. I'm really looking forward to this feature since my 2GB machine uses about 1.2GB of memory without BOINC even running and I have four processors to feed. Up until the middle of last year I only had 1GB in my machine and if I had BOINC running it was pretty painful when BOINC rescheduled all the science applications on the machine while I was working.
WCG Global & Research > Make Proposal Help: Start Here!
----------------------------------------Please help to make the Forums an enjoyable experience for All! [Edit 2 times, last edit by Sekerob at Oct 16, 2006 8:01:02 AM] |
||
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
Hi.
I have a p4 3.2ghz with 1gb of ram and a text to speech screenreader. None of the work units I have done for hdc have produced stuttering of audio or anything like that. using xpsp2 here with the default memory settings |
||
|
Viktors
Former World Community Grid Tech Joined: Sep 20, 2004 Post Count: 653 Status: Offline Project Badges: |
The HDC project is particularly memory hungry with a peak around 500mb, and that is why we set the minimum RAM requirement to 750mb. We keep wondering if we should raise this to 1gb, but we already have a lot of members who want to contribute, but cannot because of the current minimum, even though they are willing to suffer the paging activity that would result. However, the checkpoints are probably the worst part because they write a very large file. We put in disk I/O throttling for this where we could, but could not do this for the internals of the UD agent. As a result, there is a small period of time where disk activity is high. Defragmenting your disk drive seems to improve the situation a quite a bit, from our experience.
|
||
|
Sekerob
Ace Cruncher Joined: Jul 24, 2005 Post Count: 20043 Status: Offline |
One of the things is for BOINC users, besides the defragging of disk and paging file - all important -, is to set the write to disk in the device options to a large number....it does not allow for greater than 999 seconds, but at least, if sufficient RAM is available, it wont do as many disk writes (bar when u close BOINC at which time it will do).......902.912kb RAM peak though is a stretch by any measure and wonder what these demands do to those running 2 or more on dual cores.
----------------------------------------found that bringing the MTU back up to 1400 both in router and WOS registry got rid of the straming audio stutter......a small compromise on a security advice from the "Belarc Advisor" analyzer. ciao
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All! |
||
|
EiF
Cruncher Joined: Nov 28, 2004 Post Count: 14 Status: Offline Project Badges: |
Hello,
is there any recent progress with briging a solution to the memory needs of HDC? Will there be a new release of the agent (when?) or could we at least limit the RAM used by the agent somehow? Many thanks... |
||
|
Sekerob
Ace Cruncher Joined: Jul 24, 2005 Post Count: 20043 Status: Offline |
Hi EiF,
----------------------------------------I doubt that will happen.... the scientist and the programmer already had trouble enough to get it to run in a 500mb ram block, with rest in virtual memory, without it causing excessive disk swapping and slowing machines down beyond usable.....i have 1.5gb RAM and 1 WU model sneakered 928mb ram peak 1 week ago and that's a squeeze on the user for sure. Also, i think this particular project on the TMA principle is time limited and production of WU's too....about 20,000 are send into the field daily, thus the economics is very low i.a.w. the truly dedicated accept the additional burden, or let it run by others with more powerful PCs. There is the very worthy Fighting AIDS which is much much smaller and imminently HPF2 is returning and a few new projects are entering the arena, which are all much smaller. One thing u can do if set on HDC, is to just let it run on schedule during screensaver time or just at night if your box is on 24/7. The Device rpofile allows u to do that. Sorry
WCG Global & Research > Make Proposal Help: Start Here!
----------------------------------------Please help to make the Forums an enjoyable experience for All! [Edit 1 times, last edit by Sekerob at Nov 1, 2006 10:06:29 AM] |
||
|
|