Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 27
Posts: 27   Pages: 3   [ Previous Page | 1 2 3 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 5069 times and has 26 replies Next Thread
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: The truth about memory / disk usage.

It simply isn't an issue for most people running HDC. Your personal experience has given you a very biased picture, which is a pity.

Personally, I think the major issues are caused by a combination of the issue mentioned, and real-time virus scanning. I would like to explore this possibility further. Perhaps you could tell us what antivirus software you use?
[Dec 2, 2006 4:22:24 AM]   Link   Report threatening or abusive post: please login first  Go to top 
davidhobbs
Senior Cruncher
England
Joined: Dec 30, 2004
Post Count: 151
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: The truth about memory / disk usage.

Actually, Didactylos, I think it is a bit of an issue.

I have just one machine that runs HDC, and at certain times I have such intensive disk activity that everything else slows down enormously, with delays of many seconds just re-painting the screen for example. As we know, this just happens at certain stages of the crunching process but there is no denying it does seriously impact (for a few minutes) on the general use of the PC.

I consider the work so important that I'm prepared to tolerate these fairly infrequent disruptions. As I mentioned in another thread, I seem to be getting many more HDC work units since the two latest projects went live so I presume there are not as many agents accepting HDC work units.

None of the other active projects disrupt normal use of the host machine, so if it is unacceptable to any individual they should simply remove HDC from their profiles and continue crunching on other worthy causes.

For the record my machine has 1GB RAM, and runs under XP-Pro with system-managed swap file size. My anti-virus software is Trend PC-Cillin Internet Security 14, and I also have Windows Defender (Beta2) running.

David.
[Dec 2, 2006 9:57:07 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
Re: The truth about memory / disk usage.

Hi DavidHobbs,

Didactylos is not denying that there are individual problems.... "It simply isn't an issue for most people running HDC"..... I had them too and started a thread on it in early HDC days.

The solution is in the next BOiNC version which a few CA's are alpha-ing, does a much better job... for instance one can set the memory use during work and during idle.... with 1gb and HDC models that are running close to 1gb, one can set it e.g. to 40% work, 90% idle. The HDC simply pauses if the ram is not available and give a 'waiting for memory' message and moves onto the next WU... with a little mix in of Genome Comparison or Fighting Aids @ Home, your machine will always be busy. With 'Keep in memory' option active, it will finish the next WU, and if ram availability returns and or idle time, it will resume the paused WU without a 'second' loss. Think we mentioned the 999 seconds write to disk possibility too several times. Often times it's some tweaking that resolves the issue.... admittedly, HDC requires more hardware and a little bit of individual optimization.

Cheers

PS, watch the projects stats (also see link graphs in my sig).... the balancing seems to have markedly improved. My BOiNC instance is set to GC+HDC and receives about a 50/50 mix.
----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
[Dec 2, 2006 10:22:46 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: The truth about memory / disk usage.

Sek, that's not entirely accurate - this issue is only a problem on UD, and is fixed simply by switching to BOINC.

davidhobbs, I agree (and believe I suggested earlier) that anyone experiencing an issue with a project should simply disable the project until a solution is found. In the case of HDC, the work supply is limited anyway. Any sort of performance degradation is unacceptable, and WCG are grateful for your reports.

I can't help noticing this is the second mention of PC-Cillin today. Is it a coincidence? Worth looking into, certainly.
[Dec 2, 2006 11:47:12 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
Re: The truth about memory / disk usage.

Let me beat my mantra if you will Didy,

BOINC 5.8:
CPU throttle, making tweaks like Threadmaster superfluous
Simplified GUI aka BSG, cum UD Agent
Work Caching (already there), like UD Monitor utility
Manageable Preferences locally, rather than on server.
Memory Management to fit personal needs
Message logging to allow problem analysis
and and and

As for UD agent... at UD Grid.org, there is also an above normal reporting on problems which point in direction of various security apps. Just reading on Grid, that uninstalling Outpost, made the UD agent continue.... similar CA 2007 had to be fixed to get UD to move again.
----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
[Dec 2, 2006 12:33:29 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: The truth about memory / disk usage.

Advice: Use BOINC


BOINC did not help on my Conroe 3,0 GHz with 1 GB of RAM. I had so many times when the system just stopped responding (like the French guy described), that I stopped using Grid alltogether for a while on the computer I use for day-to-day work. And that's not only a problem with HDC, I also had that problem with FA@H.

I recently started again, once I found out that Genome comparison does not have that problem and uses a lot less memory. I don't have the same problem with that program.
[Dec 22, 2006 2:29:23 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Robert Tusler
Cruncher
Joined: Apr 4, 2005
Post Count: 27
Status: Offline
Reply to this Post  Reply with Quote 
Re: The truth about memory / disk usage.

I ha ve had problems with my desktop machine grinding to a halt from time to time, and it is a very powerful machine. I use the UD client having had severe problems with BOINC in the past. I have now disabled Help Defeat Cancer in my machines for the time being to see if this helps. My problem is that this is the project which for me makes it worth while to keep my machines working 24/7. Will there be a general announcement when this problem is solved?

Robert
----------------------------------------
[Edit 1 times, last edit by Robert Tusler at Dec 23, 2006 1:10:35 PM]
[Dec 23, 2006 1:09:20 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: The truth about memory / disk usage.

What type of problems did you have with BOINC? I've found the BOINC 5.8.0 code for Windows to be extremely stable and I do not see the performance problems with HDC when running BOINC (I saw them with the UD agent).
[Dec 23, 2006 8:14:03 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Robert Tusler
Cruncher
Joined: Apr 4, 2005
Post Count: 27
Status: Offline
Reply to this Post  Reply with Quote 
Re: The truth about memory / disk usage.

What type of problems did you have with BOINC?


Well, I've been here for a year and a half. I did classic seti@home for a long time then switched to BOINC when it was announced. Eventually I started processing the climate prediction module. This was a total disaster and never seemed to work for long enough to find out whether or not it worked at all - job after job would fail after weeks with an error on the client computer. So when IBM told me that WCG was available I switched and apart from odd moments have had no problems since. There is no way that I would go back now to BOINC. Incidentally, since I cut out cancer research my desktop machine is performing much better so following the forums is well worth while.
[Dec 23, 2006 8:32:35 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Lighthouse
Senior Cruncher
Joined: Nov 20, 2004
Post Count: 283
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: The truth about memory / disk usage.

I have to agree with Eric-Montreal: I have noticed that my computers have slowed considerably, and I too finally tracked it down to UD/WCG agent. While the techno-geeks can discuss the work-arounds and tweaks, and using BOINC instead of UD, most, if not just about all of us, do not feel that we should have to dig into advanced settings, or install BOINC (what a nightmare - did it once - never again!).

I think Eric's point is well made: If WCG is going to promote this as a non-intrusive, background task on volunteers computers, then it should work right out of the box with the default settings. This hard drive access has made my business computers annoyingly slow to the point of being unusable at times. And since it is my business and time that is being wasted waiting for the system, I'm pulling the plug on HDC project in my office during business hours.

What's particularly insidious about this issue is that I have put HDC on my most powerful computers (due to RAM requirements), and now those powerful computers will be idle 10 hours a day.

Who would have thought that the ultimate bottleneck would be I/O-related, rather than CPU limited?
----------------------------------------

[Dec 28, 2006 8:38:40 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 27   Pages: 3   [ Previous Page | 1 2 3 | Next Page ]
[ Jump to Last Post ]
Post new Thread