Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 81
Posts: 81   Pages: 9   [ Previous Page | 1 2 3 4 5 6 7 8 9 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 538462 times and has 80 replies Next Thread
JohnDK
Advanced Cruncher
Denmark
Joined: Feb 17, 2010
Post Count: 77
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: One terabyte written to my SSD since the stress test began

Don't know where the "Allocate Memory Dynamically" setting is located.

It is on the "Basic" tab of "Imdisk configuration" from step 4.

I'm using Linux, guess we should have a Linux thread to avoid confusion... biggrin
----------------------------------------
Intel i7-6850K / 16GB / RTX 3090 / 2x RTX 3080 Ti / RTX 3070 Ti
AMD Ryzen 9 5950X / 32GB / RTX 2080 Ti
[Apr 30, 2021 9:17:35 PM]   Link   Report threatening or abusive post: please login first  Go to top 
goben_2003
Advanced Cruncher
Joined: Jun 16, 2006
Post Count: 146
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: One terabyte written to my SSD since the stress test began

I'm using Linux, guess we should have a Linux thread to avoid confusion... biggrin

laughing Sorry about that, I thought you were asking about a problem with ImDisk ramdisk. This thread is not just for windows. I probably will make a thread with the ImDisk instructions later after I stop editing them so frequently(several edits today).
----------------------------------------

[Apr 30, 2021 10:03:59 PM]   Link   Report threatening or abusive post: please login first  Go to top 
highCon
Cruncher
Joined: Jul 19, 2009
Post Count: 8
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: One terabyte written to my SSD since the stress test began

Hi goben_2003
Thank you very much for the instructions on how to create a RAM disk. I have tried this out and it seems to be working.
It took me a little while to realise that although I had set the RAM disk to 4GB, I had also set the Computing preferences in the BOINC Manager to "Use no more than 50% of total". So I had accidentally reduced the size of the RAM disk to 2GB! (Oops!).
I wonder if it would be worth mentioning that trap in your instructions.
Cheers! smile

Hi MJH333,
You're welcome! Thank you for pointing it out to help others! I added a note about it to the instructions. smile

(But this only applies to those that put the whole BOINC folder into RAM, not to the slots-only RAMdisk users. ;-))

Thanks again goben for collecting the multitude of inputs. I'm positive that we'll have sorted out all the aspects, pitfalls, and possible use cases of 'ImDisk's RAMdisk for BOINC' soon to post in a dedicated thread.
[Apr 30, 2021 10:54:17 PM]   Link   Report threatening or abusive post: please login first  Go to top 
ksakers
Cruncher
Joined: Dec 3, 2014
Post Count: 1
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: One terabyte written to my SSD since the stress test began

I appreciate in full the concerns and motivations behind wanting to not "run up the odometer" so to speak on an SSD.

Does anyone have any real-world experience with what actually occurs when an SSD reaches the manufacturer's quoted TBW "limits"? Could this concern be much ado about not much?
[Apr 30, 2021 11:08:19 PM]   Link   Report threatening or abusive post: please login first  Go to top 
DBZMasterRace
Cruncher
Joined: Feb 11, 2018
Post Count: 1
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: One terabyte written to my SSD since the stress test began

I think there is a setting that says write to disk and number of seconds on the device profiles of world community grid. I saw that the default was every 60 seconds. I changed it to 1200 seconds (20 minutes) and it fixed the problem.
[May 1, 2021 1:45:04 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Byteball_6393265
Cruncher
Joined: May 9, 2007
Post Count: 6
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: One terabyte written to my SSD since the stress test began

Mine was set as 360 seconds all the while.
Each GPU work unit contains several dozen calculations & it finishes them extremely fast.
It seems to write every time it finishes a calculation (judging from taskmanager stats),
I believe this setting made a difference for CPU WUs but not for the GPU ones currently.
[May 1, 2021 5:21:25 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Andyman
Cruncher
Joined: Apr 9, 2021
Post Count: 17
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: One terabyte written to my SSD since the stress test began

Reguarding ImDisk:

"Dynamic ramdisks do not work properly when they are mounted on a folder instead of a drive letter, and if you don't use the TRIM commands (TRIM commands are used by default with NTFS on Windows 7 and later)." -- https://sourceforge.net/p/imdisk-toolkit/doc/Home/

Ok, I guess then there are 2 questions:

1. Do Andyman or TripleTrouble have TRIM disabled? It should be enabled for Andyman unless he disabled it since he is running Windows 10 pro.
It can be checked by opening an Administrator command prompt and running:
fsutil behavior query DisableDeleteNotify

If DisableDeleteNotify=0, then TRIM is enabled.

2. Do dynamic ramdisks sometimes have issues even if TRIM is enabled?
I am not running it as a dynamic ramdisk.

Edit: minor correction


Thank you for all the help. I checked and trim is enabled. I reinstalled lmdisk with same settings as last time except i turned off dynamic disk and now it seems to be working! Mayby that was it, my system did not like the dynamic disk setting. After that i also changed so it will only contain the slots folder. I restarted a couple of times without starting up WCG. Final test is to see if it holds up after running the WCG for a day and then restart. Should i alwas do a manual sync to be safe? Mayby even do a copy first time so i dont loose anything?
----------------------------------------
[Edit 1 times, last edit by Andyman at May 1, 2021 5:42:11 AM]
[May 1, 2021 5:41:36 AM]   Link   Report threatening or abusive post: please login first  Go to top 
goben_2003
Advanced Cruncher
Joined: Jun 16, 2006
Post Count: 146
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: One terabyte written to my SSD since the stress test began


(But this only applies to those that put the whole BOINC folder into RAM, not to the slots-only RAMdisk users. ;-))

Thanks again goben for collecting the multitude of inputs. I'm positive that we'll have sorted out all the aspects, pitfalls, and possible use cases of 'ImDisk's RAMdisk for BOINC' soon to post in a dedicated thread.

Good point, I edited the note to say that. Thank you.
You're welcome. Yes, we seem to be making progress with that. smile
----------------------------------------

[May 1, 2021 8:33:02 AM]   Link   Report threatening or abusive post: please login first  Go to top 
goben_2003
Advanced Cruncher
Joined: Jun 16, 2006
Post Count: 146
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: One terabyte written to my SSD since the stress test began

I appreciate in full the concerns and motivations behind wanting to not "run up the odometer" so to speak on an SSD.

Does anyone have any real-world experience with what actually occurs when an SSD reaches the manufacturer's quoted TBW "limits"? Could this concern be much ado about not much?

I am aware that often times SSDs last higher than the manufacture's stated TBW limit. That limit is normally(see note after the endurance experiment) for warranty purposes. Meaning that if you have exceeded the TBW limit, but not the time limit on the warranty, the drive is not covered by the warranty. I have looked into this a decent amount and concluded that it is worth it to drastically reduce the writes that happen to the drive. That was during the beta when I was running 1 unit at a time, now my nvidia card runs 10 at a time. Hopefully this post helps people understand why it is a valid concern.

Here are two things related to testing SSD endurance:

The endurance experiment :
Most of the drives lasted far longer than expected. The ones that I was able to locate the stated TBW lasted way longer than was stated. However, one of the drives went into read only mode and then on reboot did not even allow reads to take place. This is very important as you may not realize what has happened and restart only to find data recovery is no longer possible. It is not clear whether Intel is still doing that or not. (I put some of the text in bold).
Few expected a TLC SSD to last that long—and fewer still would have bet on it outlasting two MLC-based drives. Intel’s 335 Series failed much earlier, though to be fair, it pulled the trigger itself. The drive’s media wear indicator ran out shortly after 700TB, signaling that the NAND’s write tolerance had been exceeded. Intel doesn’t have confidence in the drive at that point, so the 335 Series is designed to shift into read-only mode and then to brick itself when the power is cycled. Despite suffering just one reallocated sector, our sample dutifully followed the script. Data was accessible until a reboot prompted the drive to swallow its virtual cyanide pill.


Flash Reliability in Production:
This is a large scale study from Google and the University of Toronto. It is an interesting read. The two things I will note from it are:
1. The amount of data written to the drive does matter.
2. While 1 is true, it is not the only factor. They found how old(time wise) the drive is matters too independently of 1.
----------------------------------------

[May 1, 2021 8:53:52 AM]   Link   Report threatening or abusive post: please login first  Go to top 
goben_2003
Advanced Cruncher
Joined: Jun 16, 2006
Post Count: 146
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: One terabyte written to my SSD since the stress test began

I think there is a setting that says write to disk and number of seconds on the device profiles of world community grid. I saw that the default was every 60 seconds. I changed it to 1200 seconds (20 minutes) and it fixed the problem.

This is not an enforced setting. It is only a request to the project. If the project's app can checkpoint at variable intervals, it picks the shortest one that is as long as your requested interval. However, if it has to write at the end of every job like opng does(Note: this is not the same thing as a checkpoint), it will happen regardless of that setting. Thus why I would see constant writing to the SSD even with "Write to disk at most every" X seconds set longer than the opng task would take on my nvidia card.
Mine was set as 360 seconds all the while. Each GPU work unit contains several dozen calculations & it finishes them extremely fast. It seems to write every time it finishes a calculation (judging from taskmanager stats), I believe this setting made a difference for CPU WUs but not for the GPU ones currently.

This is correct.
----------------------------------------

----------------------------------------
[Edit 1 times, last edit by goben_2003 at May 1, 2021 9:04:07 AM]
[May 1, 2021 9:03:00 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 81   Pages: 9   [ Previous Page | 1 2 3 4 5 6 7 8 9 | Next Page ]
[ Jump to Last Post ]
Post new Thread