Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 
World Community Grid Forums
  Category: Support
  Forum: Website Support
  Thread: System Requirements Matrix

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 56
Posts: 56   Pages: 6   [ 1 2 3 4 5 6 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 8012 times and has 55 replies Next Thread
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
System Requirements Matrix
Here's your chance to contribute to a FAQ table. Please stay strictly on the topic as I'm brewing over a few more tables like the file sizes transmitted for each project (ripping other's ideas ;>).

Input needed is:

1. Operating System
2. Agent and if BOINC, the version.
3. Project (FA@H, GC, HPF2)
4. ACTUAL MAX/PEAK RAM use by the science process (they start in taskmanager with WCG)
5. ACTUAL MAX/PEAK Swapfile(Virtual Memory Use)
6. BOINC PREFERENCE % for Busy(work) and IDLE Crunching time
7. Actual physical RAM
8. 'Leave in Memory' On or Off (really outdated as project switching is checkpoint dictated).

What you see below is what was pulled from the lengthy Systems Requirement page with a few adjustments for a few projects from recent observation.... sizes change. Footnotes will be added if more ideas come to mind.

If you ran 5 or 50 of the same project, does not matter.... I think there is some nifty tool to record the highest values, rather than staring at Task-Managers 'Peak Use' columns before a job ends. (someone will tell me)

AND, the values will be the max and not the averages as tables elsewhere have attempted to capture. These will be worst case values, with a safety margin for unexpected blips. Nothing worse than a job that runs out of space.

Apologies to the visual impaired, but it's a picture.



(And the quiz: How many times should it have been 'then' when i typed 'than'.... for the pedants if you will.... I'm one ;>).... strike as it's off-topic
----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
[Jun 20, 2007 10:24:48 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: System Requirements Matrix
Linux/BOINC 5.8.15 i686-pc-linux-gnu/FA@H/125MB/?/?/?/?
Linux/BOINC 5.8.15 i686-pc-linux-gnu/HPF2/75MB/?/?/?/?

(The ones with ? are either irrelevant and/or vary in an obvious fashion depending on the other factors. eg. A FA@H process running on a 256MB machine uses no swap space, while one running on a 128MB machine uses swap space.)

HPF2 seems to take 60-65MB most of the time, but spikes up to 75MB briefly at times.

This leads me to the obvious questions: Why does HPF2 "require" 256MB RAM and can you get that seemingly pointless restriction charged?
----------------------------------------
[Edit 1 times, last edit by Former Member at Jul 4, 2007 5:29:38 AM]
[Jul 4, 2007 4:46:40 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
Re: System Requirements Matrix
Hi Kremmen,

thanks for this contribution. Why I ask for actuals IS, so the matrix can be updated and where appropriate the techs can be asked to tweak the system parameters :D

The FA@H on Linux is very strange. Maybe because there is presently no graphics (?), it uses much less. On Windows it does 128 over 500 at times (actually saw highest of 453, but keeping it save). The more ram you have, the less VM is used IF you have set the BOINC parameters to allow that use!

PS.

Some of the specs are driven by concern over jobs taking too long and part time crunchers loosing too much progress in stop-start scenarios. The Checkpoint Save FAQ is reading material to optimize!
----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
[Jul 4, 2007 5:02:44 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: System Requirements Matrix
These are little servers that don't even have X running. They don't know what graphics is. :)

(IMHO, the whole concept of grid computing projects running graphical output is wasteful and self-defeating.)

#5 is meaningless, as it's for the whole machine and depends on what other processes are running and, worse still, on how much RAM linux feels like keeping aside for cache, which in turn depends on I/O load, etc.
#6 and #8 make no difference to anything that matters. (The maximum process size will still be the same.)
#7 makes no difference to anything except #5, which is meaningless.
[Jul 4, 2007 5:50:45 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Sgt.Joe
Ace Cruncher
USA
Joined: Jul 4, 2006
Post Count: 7849
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: System Requirements Matrix
Sekerob:

This is the message list from my slowest machine. I hope you can find it useful. The FAAH job has been running for 15 hours now and shows continuing progress, 45% done. It will be about a 34 hour job. shock So far task manager has reported a peak memory requirement of 86,444K. I will let you know if it finishes without a problem. Let me know if you would like any other info. OS is Win 2000.


07/03/2007 7:10:32 PM||Starting BOINC client version 5.4.11 for windows_intelx86
07/03/2007 7:10:32 PM||libcurl/7.15.3 OpenSSL/0.9.8a zlib/1.2.3
07/03/2007 7:10:32 PM||Data directory: C:\Program Files\BOINC
07/03/2007 7:10:32 PM||Processor: 1 GenuineIntel x86 Family 6 Model 5 Stepping 2 397MHz
07/03/2007 7:10:32 PM||Memory: 127.55 MB physical, 400.22 MB virtual
07/03/2007 7:10:32 PM||Disk: 5.99 GB total, 4.60 GB free
07/03/2007 7:10:32 PM|World Community Grid|URL: http://www.worldcommunitygrid.org/; Computer ID: 87107; location: work; project prefs: work
07/03/2007 7:10:32 PM||General prefs: from World Community Grid (last modified 2007-05-02 16:04:37)
07/03/2007 7:10:32 PM||General prefs: using separate prefs for work
07/03/2007 7:10:32 PM||Local control only allowed
07/03/2007 7:10:32 PM||Listening on port 31416
07/03/2007 7:10:32 PM|World Community Grid|Resuming task faah1824_d063n471_x2AZ9_01_0 using faah version 528
07/03/2007 11:52:37 PM||Suspending computation - running CPU benchmarks
07/03/2007 11:52:37 PM|World Community Grid|Pausing task faah1824_d063n471_x2AZ9_01_0 (removed from memory)
07/03/2007 11:52:37 PM||Suspending network activity - running CPU benchmarks
07/03/2007 11:52:39 PM||Running CPU benchmarks
07/03/2007 11:53:38 PM||Benchmark results:
07/03/2007 11:53:38 PM|| Number of CPUs: 1
07/03/2007 11:53:38 PM|| 359 floating point MIPS (Whetstone) per CPU
07/03/2007 11:53:38 PM|| 624 integer MIPS (Dhrystone) per CPU
07/03/2007 11:53:38 PM||Finished CPU benchmarks
07/03/2007 11:53:39 PM||Resuming computation
07/03/2007 11:53:39 PM||Rescheduling CPU: Resuming computation
07/03/2007 11:53:39 PM||Resuming network activity
07/03/2007 11:53:39 PM|World Community Grid|Restarting task faah1824_d063n471_x2AZ9_01_0 using faah version 528

Update: The job finished after 34.18 hours and was valid.


Cheers
----------------------------------------
Sgt. Joe
*Minnesota Crunchers*
----------------------------------------
[Edit 2 times, last edit by Sgt.Joe at Jul 5, 2007 11:27:53 PM]
[Jul 4, 2007 12:07:23 PM]   Link   Report threatening or abusive post: please login first  Go to top 
JmBoullier
Former Community Advisor
Normandy - France
Joined: Jan 26, 2007
Post Count: 3716
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: System Requirements Matrix
Let's go!
1. Operating System
2. Agent and if BOINC, the version.
3. Project (FA@H, GC, HPF2)
4. ACTUAL MAX RAM
4.1 Average RAM observed most of the time
5. Max Swapfile (Virtual Memory) observed
6. BOINC memory usage preference % for Busy(work) and Idle Crunching time
7. Actual physical RAM
8. 'Leave in Memory' On or Off 
 1     2      3     4     4.1     5       6     7   8
-- -------- ---- ---kB-- --kB-- --kB-- ------- -GB --
XP    UD    HPF2 171,000 60,000 91,000 n/a n/a 1.5 On 
XP    UD    HPF2 190,000 70,000 80,000 n/a n/a 1.5 On
XP    UD    HPF2 190,000 45,000 80,000 n/a n/a 1.5 On
XP B 5.10.7 HPF2  80,000 72,000 80,000 50% 90% 1.5 On
XP B 5.10.7 HPF2  75,000 72,000 80,000 75% 90% 1.5 On
% Busy changed from 50 to 75 during last job when seeing that it was so low. But it had no effect at all on figures shown for that job.

Thanks for starting this huge task and good luck. Jean.
----------------------------------------
Team--> Decrypthon -->Statistics/Join -->Thread
----------------------------------------
[Edit 1 times, last edit by JmBoullier at Jul 6, 2007 12:58:32 AM]
[Jul 6, 2007 12:56:58 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: System Requirements Matrix
Linux/BOINC 5.8.15 i686-pc-linux-gnu/DDDT/120MB/?/?/?/?

(seems often to spend a lot of time at around 104MB)
[Oct 18, 2007 7:34:47 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: System Requirements Matrix
Linux/BOINC 5.8.15 i686-pc-linux-gnu/AC@H/455MB/?/?/?/?

This is one nasty project, from the point of view of determining minimum requirements. It spends almost 99% of its time using 125MB or less and then sporadically uses over 3 times as much RAM for a total of just over 1% of its runtime.
[Oct 20, 2007 3:29:40 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: System Requirements Matrix
If I'm interpretending Process Explorer right, here are the results:

1. XP Pro
2. BOINC 5.10.22
3. FA@H
4. 116.088 KB max by process
5. 185.568 KB max by process
6. 100% and 100%
7. 2 GB
8. On

1. XP Pro
2. BOINC 5.10.22
3. DDDT
4. 187.036 KB max by process
5. 188.844 KB max by process
6. 100% and 100%
7. 2 GB
8. On

nerd
----------------------------------------
[Edit 5 times, last edit by Former Member at Nov 4, 2007 1:19:08 AM]
[Oct 20, 2007 1:34:35 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: System Requirements Matrix
1. XP Pro
2. BOINC 5.10.22
3. HPF2
4. 112.324 KB max by process
5. 14.960 KB max by process
6. 100% and 100%
7. 2 GB
8. On
----------------------------------------
[Edit 2 times, last edit by Former Member at Oct 26, 2007 3:10:38 PM]
[Oct 21, 2007 2:33:18 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 56   Pages: 6   [ 1 2 3 4 5 6 | Next Page ]
[ Jump to Last Post ]
Post new Thread