Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 
World Community Grid Forums
  Category: Completed Research
  Forum: FightAIDS@Home Phase 2
  Thread: Memory usage higher than requirement

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 8
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 4473 times and has 7 replies Next Thread
Crystal Pellet
Veteran Cruncher
Joined: May 21, 2008
Post Count: 1317
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Memory usage higher than requirement
The memory requirement for FightAIDS@Home - Phase 2 is 250 MB

I have just returned FAH2_002733_zinc12317682_000003_000056_018_0 which has used 537.05 MB memory and 1957.67 MB virtual memory.
----------------------------------------
[Jan 18, 2020 8:08:56 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Memory usage higher than requirement
Exceptions always confirm the rule 😉. My BOINCTasks history has some 60 since the resume and they show a VM use of < 500MB, mostly 470-490 with one going 523 and a RAM use of < 300, mostly in the 275-290MB, never below the specified 250.
[Jan 18, 2020 9:19:23 AM]   Link   Report threatening or abusive post: please login first  Go to top 
uplinger
Former World Community Grid Tech
Joined: May 23, 2005
Post Count: 3952
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Memory usage higher than requirement
Thanks for the stats guys, I will update the faqs and workunit template to show 512MB of RAM needed.

Thanks,
-Uplinger
[Jan 18, 2020 3:27:01 PM]   Link   Report threatening or abusive post: please login first  Go to top 
pvh513
Senior Cruncher
Joined: Feb 26, 2011
Post Count: 260
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Memory usage higher than requirement
I have seen FAH2 WUs go up to 1.3 GiB real memory use (on linux). I have never seen a workunit below 512 MiB.
  PID USER      PR  NI    VIRT    RES    SHR S  %CPU  %MEM     TIME+ COMMAND                        
55303 pvh       39  19 6722612 1,347g   7648 R 99,67 2,145 149:58.66 wcgrid_fahb_bed
14124 pvh       39  19 6714852 1,177g   7664 R 100,0 1,874 133:04.07 wcgrid_fahb_bed
My impression is that the amount of memory used somehow scales with the total amount of memory on the machine (and not the amount of memory per thread as it probably should be). The example above comes from a machine with 64 GiB of memory and 32 cores/64 threads. On machines with 32 GiB, the memory use would be roughly 850 MiB.

Edit: fixed memory use on 32 GiB machines.
----------------------------------------
[Edit 1 times, last edit by pvh513 at Feb 2, 2020 11:15:15 AM]
[Jan 27, 2020 11:46:10 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Memory usage higher than requirement
Maybe the logic in the science app is, to do exactly that to gain speed, but that would be uncalled for grab on the part of the programmers. How to cheese off volunteers.
[Jan 27, 2020 12:08:35 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Memory usage higher than requirement
This has been reported to the techs along with memory diag output and it was supposedly sent on to the developers.
[Jan 27, 2020 2:04:55 PM]   Link   Report threatening or abusive post: please login first  Go to top 
KerSamson
Master Cruncher
Switzerland
Joined: Jan 29, 2007
Post Count: 1671
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Memory usage higher than requirement
I can confirm. Last week-end, on Linux hosts, I had a memory use around 7.8 GB instead of less than 2.4 GB with 8 threads.
Yves
----------------------------------------

Décrypthon team progress - KerSamson's contribution
[Jan 27, 2020 4:53:51 PM]   Link   Report threatening or abusive post: please login first  Go to top 
jay_Orlando
Senior Cruncher
USA
Joined: Jan 4, 2006
Post Count: 181
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Memory usage higher than requirement
Greetings to all!

I see VM size as huge and wonder if someone can tell me why...
- 82.4 Gib for boincmgr and
- 81.9 GiB for WebKitNetworkProcess and 81.9 GiB for WebKitProcess.
The number increased if I increased the settings for memory and page/swap.

Versions
Boinc Manager: 7.16.3 (x64)
Boinc Client: 7.16.3 for x86_64-pc-linux-gnu
OS: Ubuntu 19.10 64 bit; kernel Linux 5.3.0-40-generic x86_64

system monitor shows
swap:0
Memory: 3.8GiB (32.7%) of 11.6GiB
---- So I am not sure what resource virtual memory uses.
---- Anyone feel like writing an explanation - or opinion?

ps -aux
USER       PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
jay       3911  1.4  0.8 86418128 98992 ?      Sl   10:53   0:45 boincmgr
jay       3939  0.0  0.5 85854496 71876 ?      SLl  10:53   0:01 /usr/lib/x86_64-linux-gnu/webkit2gtk-4.0/WebKitWebProcess 6 24
jay       3940  0.0  0.3 85908600 37400 ?      SLl  10:53   0:00 /usr/lib/x86_64-linux-gnu/webkit2gtk-4.0/WebKitNetworkProcess 7 24
boinc     4041 99.7  5.9 830248 726852 ?       RNl  10:56  47:07 ../../projects/www.worldcommunitygrid.org/wcgrid_arp1_wrf_7.27_x86_64-pc-linux-gnu
boinc     4048 99.6  5.9 830252 726908 ?       RNl  10:57  47:01 ../../projects/www.worldcommunitygrid.org/wcgrid_arp1_wrf_7.27_x86_64-pc-linux-gnu
boinc     4055 99.6  5.9 830256 726896 ?       RNl  10:57  46:56 ../../projects/www.worldcommunitygrid.org/wcgrid_arp1_wrf_7.27_x86_64-pc-linux-gnu


Thanks in Advance !!!

PS
1) Everything seems to be running OK.
2) Same large VM use on another machine running Ubuntu 18.04.4
----------------------------------------
[Mar 13, 2020 3:55:20 PM]   Link   Report threatening or abusive post: please login first  Go to top 
[ Jump to Last Post ]
Post new Thread