Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go ยป
No member browsing this thread
Thread Status: Active
Total posts in this thread: 7
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 1367 times and has 6 replies Next Thread
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
BOINC: What's your 'Write to Disk' setting and what efficiency you see?

This is a current topic in Beta testing a version of GFAM and DSFL that does allow the application to check if the client is allowing a write within a certain timespan [the beta does adhere to setting, but still prints the checkpoints to the log]. The [to me ancient] 60 second interval is still there from the days that we were on single processor CPU's but now 4-6-8-12-24 processors on a CPU becoming normal, running that many tasks could results in getting also that many writes to disk of progress with performance impact. Not the same for all as the storage sub-systems are not all equal.

For longer had it on 5 minutes [300 seconds] to mitigate and did see some efficiency improvement, 1 percent and better [very easily observed with BOINCTasks multiclient monitoring and managing utility]. Now have it set on my Linux 64 bit [24/7] quad to 900 seconds, and running very long DDDT2 B-Type 'pe' series of 17 hours and longer and observing another 0.1% improvement [running at 99.85%]. Not a huge amount between 5 minutes and 15 minutes, but why waste cycles when the system is only booted when there is a kernel update [less often then a blue moon]. When needing to do a system restart, planning it by switching back to 5 minutes WtD, park any CEP2 ready to start, and postpone boot until all cores are loaded with short checkpointing science apps, then do the 30-45 second restart cycle.

So, what's your setting like [even larger?] and do you observe gains? It's not a OS platform dependent consideration [works for Windows and Mac of all too]. There must be a reason why the option is still there after all these years.

--//--

P.S. In Client 7 [first alpha out] the local pref will be called "Tasks checkpoint to disk at most every xxx seconds". ('to disk' probably maintained as a generic reference though SSD's and usb memory sticks storage or not 'disks').
[Dec 3, 2011 11:37:38 AM]   Link   Report threatening or abusive post: please login first  Go to top 
sk..
Master Cruncher
http://s17.rimg.info/ccb5d62bd3e856cc0d1df9b0ee2f7f6a.gif
Joined: Mar 22, 2007
Post Count: 2324
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: BOINC: What's your 'Write to Disk' setting and what efficiency you see?

I'm probably still using default settings on most systems.
It's fair to say that the I/O performance of an average hard drive has probably not increased proportionately to the number of threads/cores in the average computer (probably 4 to 8 now). I have made suggestions to Berkeley regarding this.

On one system I have it set to 1000sec. I can't remember doing this, so unless the writing to disk was annoying me (quite possible), it came with running climate models.

I would suggest 60+ sec per core/thread be made the default, but then I also want a checkpoint and close boinc (rather than File, Exit), with an option to shut down, and a few other things :p
[Dec 3, 2011 12:30:06 PM]   Link   Report threatening or abusive post: please login first  Go to top 
GeraldRube
Master Cruncher
United States
Joined: Nov 20, 2004
Post Count: 2153
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: BOINC: What's your 'Write to Disk' setting and what efficiency you see?

My set to 120 seconds--
----------------------------------------

[Dec 3, 2011 1:13:11 PM]   Link   Report threatening or abusive post: please login first  Go to top 
nanoprobe
Master Cruncher
Classified
Joined: Aug 29, 2008
Post Count: 2998
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: BOINC: What's your 'Write to Disk' setting and what efficiency you see?

My set to 120 seconds--

Ditto
----------------------------------------
In 1969 I took an oath to defend and protect the U S Constitution against all enemies, both foreign and Domestic. There was no expiration date.


[Dec 3, 2011 2:09:03 PM]   Link   Report threatening or abusive post: please login first  Go to top 
mikey
Veteran Cruncher
Joined: May 10, 2009
Post Count: 822
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: BOINC: What's your 'Write to Disk' setting and what efficiency you see?

Mine is set to 900 seconds, 15 minutes, also. I found it is better especially on the laptop hard drives, less wear and tear and they last longer. I tend to use older hardware that was replaced in other peoples pc's by me and then I build a box for crunching with the leftover parts, so less is better for me. No money in it but rooms full of spare parts, and lots of boxes for crunching!!
----------------------------------------


----------------------------------------
[Edit 1 times, last edit by mikey159b at Dec 3, 2011 2:52:57 PM]
[Dec 3, 2011 2:52:31 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Hypernova
Master Cruncher
Audaces Fortuna Juvat ! Vaud - Switzerland
Joined: Dec 16, 2008
Post Count: 1908
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: BOINC: What's your 'Write to Disk' setting and what efficiency you see?

It was set at 180 seconds, now moving to 800 seconds, and will check if there is any improvement. If yes I will standardize it on all my rigs.
----------------------------------------

[Dec 3, 2011 3:01:19 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: BOINC: What's your 'Write to Disk' setting and what efficiency you see?

Yes, reporting observations, findings and whys, is what is sought after. Looking forward to your measurements/conclusions, Hypernova. The reason I had it on 5 minutes was also because it caused substantially less lag when actually being at the desktop doing [heavier] things. Disk I/O are the one thing that are noticeable, maybe more so to gamers and video renderers, streaming off the Internet.

--//--

[ot] Just realized that though KSplice (see "I Confez" thread) was sold to IIRC Oracle to commercialize further and stop/end support for the free version, it's still running successfully after a clean install last month and is boot-less updating the kernel with fixes. Wonder now if those were the co-cause of the same time nightly fails of CEP2 I used to have, though it is designed to absolute "industrial strength" update for zero downtime. Touch wood, this system is since 4 November on 100% score for all projects it's run since. [/ot]
[Dec 3, 2011 4:44:16 PM]   Link   Report threatening or abusive post: please login first  Go to top 
[ Jump to Last Post ]
Post new Thread