Index | Recent Threads | Unanswered Threads | Who's Active | Guidelines | Search |
World Community Grid Forums
Category: Beta Testing Forum: Beta Test Support Forum Thread: OpenPandemics GPU Beta Test - March 26 2021 [ Issues Thread ] |
No member browsing this thread |
Thread Status: Locked Total posts in this thread: 511
|
Author |
|
ThreadRipper
Veteran Cruncher Sweden Joined: Apr 26, 2007 Post Count: 1317 Status: Offline Project Badges: |
@Threadripper and others using RAMdisks: What do you actually put into your RAMdisks? The top parts of the BOINC data directory do not have crippling write activity; the Projects directories hold the programs, images, etc, which you will want to preserve through a crash that wipes your RAMdisk. They also hold the WU files, which don't churn too much for non-volatile storage. It looks to me that it's only the Slots directories that get frequent writes, so they are the ones to go into the RAMdisk. In the event of a crash including power outage, your would lose tasks in progress. How does BOINC handle that? So ... , at BOINC startup, you would mount the RAMdisk over the Slots directory, after copying out the contents from the non-volatile version, and then restore them to the RAMdisk, before finally restarting BOINC. Have you got scripts or something to handle that? Do you have a periodic RAMdisk backup daemon running too? https://en.wikipedia.org/wiki/List_of_RAM_drive_software Hi Rickjb, I set up the RAM-disk so that it backups the folder at every shutdown and restores at bootup. This works pretty well. You can also press a button to synchronize to disk on demand. I haven't dug deep enough in ImDisk that I use to find if there is a feature to periodically sync to disk at given time intervals or not, but that would of course be a nice feature. During BOINC setup I simply point the entire BOINC data directory to be installed on the RAMDisk. In case of a crash, yes I lose some data, but if last shutdown/sync to disk was long ago, BOINC will simply mark the WUs as "aborted by project" (since the WUs stored on disk were old) and download new ones. In results status, the other "lost WUs" will be marked as Detached. Before creating a RAMDisk, I usually make sure that the system is stable by letting it run 24/7 WCG crunching. After that I create a RAMDisk. Another option would of course be to attach a 2.5" or 3.5" HDD and put the BOINC data folder there. But HDDs are slow so that's also suboptimal. A power outage will of course be bad (same as crash scenario above), but there's only one thing to do if you have frequent outages is to get a UPS for battery backup. Then you can connect it to the PC via USB and its software will then notice if the UPS loses power form the outlet and you can choose what you want for it to do. For instance, perform a clean Windows Shutdown (at which point your RAMDisk will sync to disk as well). Join The International Team: https://www.worldcommunitygrid.org/team/viewTeamInfo.do?teamId=CK9RP1BKX1 AMD TR2990WX @ PBO, 64GB Quad 3200MHz 14-17-17-17-1T, RX6900XT @ Stock AMD 3800X @ PBO AMD 2700X @ 4GHz |
||
|
Quadophile
Cruncher USA Joined: Feb 4, 2006 Post Count: 25 Status: Offline Project Badges: |
Ramdisks:
----------------------------------------While reading about the advantages and disadvantages of installing Ramdisk for crunching I was wondering how much one would lose in terms of aging of SSD if no Ramdisk was installed? Does it really matter? The reason I ask this is that I am not inclined towards installing a Ramdisk. Yes I do have a 1 TB SSD as my main drive. Thanks for any input anyone can provide. :) |
||
|
ThreadRipper
Veteran Cruncher Sweden Joined: Apr 26, 2007 Post Count: 1317 Status: Offline Project Badges: |
Ramdisks: While reading about the advantages and disadvantages of installing Ramdisk for crunching I was wondering how much one would lose in terms of aging of SSD if no Ramdisk was installed? Does it really matter? The reason I ask this is that I am not inclined towards installing a Ramdisk. Yes I do have a 1 TB SSD as my main drive. Thanks for any input anyone can provide. :) Let me just provide my two cents on why I started with RAMDisks. I have killed probably three or four SSDs on PCs doing nothing but WCG crunching on those said machines 24/7. CPU didn't die, Motherboard didn't die, PSU didn't die etc, but SSDs POOF! I have a Kingston 1TB SATA SSD in a machine built in August 2020. That machine has Not been running RAMDisk and Remaining SSD life is reported as 65%! That's a lot of writes from WU crunching only. That machine has an AMD 2700X (16 threads). The more threads you have running in parallel, the more writes will take place. On my 2990WX 64-thread, before I installed a RAMDisk, it chewed up the lifespan of a 500GB M.2 in a few months. So how do SSDs fail from writes? Well, in my cases I suddenly noticed the PC semi-locking up and then after a while locking up hard. You go "hmmm, is it the RAM, bad SATA cable, motherboard, PSU?" No, swap the SSD and PC runs fine again! So, RAMDisk or HDD is the only thing I'm putting BOINC data folder on nowadays. If you want to measure how many writes you get to your SSD, download HWInfo64 and there you can keep logging writes for a while and then extrapolate. I did, and it made me act Fast! ;) Join The International Team: https://www.worldcommunitygrid.org/team/viewTeamInfo.do?teamId=CK9RP1BKX1 AMD TR2990WX @ PBO, 64GB Quad 3200MHz 14-17-17-17-1T, RX6900XT @ Stock AMD 3800X @ PBO AMD 2700X @ 4GHz |
||
|
nanoprobe
Master Cruncher Classified Joined: Aug 29, 2008 Post Count: 2998 Status: Offline Project Badges: |
Ramdisks: While reading about the advantages and disadvantages of installing Ramdisk for crunching I was wondering how much one would lose in terms of aging of SSD if no Ramdisk was installed? Does it really matter? The reason I ask this is that I am not inclined towards installing a Ramdisk. Yes I do have a 1 TB SSD as my main drive. Thanks for any input anyone can provide. :) Let me just provide my two cents on why I started with RAMDisks. I have killed probably three or four SSDs on PCs doing nothing but WCG crunching on those said machines 24/7. CPU didn't die, Motherboard didn't die, PSU didn't die etc, but SSDs POOF! I have a Kingston 1TB SATA SSD in a machine built in August 2020. That machine has Not been running RAMDisk and Remaining SSD life is reported as 65%! That's a lot of writes from WU crunching only. That machine has an AMD 2700X (16 threads). The more threads you have running in parallel, the more writes will take place. On my 2990WX 64-thread, before I installed a RAMDisk, it chewed up the lifespan of a 500GB M.2 in a few months. So how do SSDs fail from writes? Well, in my cases I suddenly noticed the PC semi-locking up and then after a while locking up hard. You go "hmmm, is it the RAM, bad SATA cable, motherboard, PSU?" No, swap the SSD and PC runs fine again! So, RAMDisk or HDD is the only thing I'm putting BOINC data folder on nowadays. If you want to measure how many writes you get to your SSD, download HWInfo64 and there you can keep logging writes for a while and then extrapolate. I did, and it made me act Fast! ;) While I find your story on SSDs interesting and true for you I have not experienced the problems with SSDs that you have. Could it be brands or other unknowns I have no idea. What I do know is that I had 3 servers totaling 200 threads running here for years and never had any SSD issues. I sold all 3 to the same person 5 years ago and AFAIK the same SSDs are still in service running 24/7/365. Did you ever defrag your SSDs? If you did that could be part of the issue for early failures. Defragging them is a huge no no. Do you use a UPS with surge protection on your hosts? That's a must here in Fl. with our frequent lightning strikes. I had every onboard nic taken out by lightning a few years ago. That was an expensive lesson. Now all my network cables are surge protected too. Other than that maybe you just had bad luck. FWIW I only use Intel sever grade SSds. Thet aren't cheap but I"ve never had one fail.
In 1969 I took an oath to defend and protect the U S Constitution against all enemies, both foreign and Domestic. There was no expiration date.
|
||
|
Quadophile
Cruncher USA Joined: Feb 4, 2006 Post Count: 25 Status: Offline Project Badges: |
Ramdisks: While reading about the advantages and disadvantages of installing Ramdisk for crunching I was wondering how much one would lose in terms of aging of SSD if no Ramdisk was installed? Does it really matter? The reason I ask this is that I am not inclined towards installing a Ramdisk. Yes, I do have a 1 TB SSD as my main drive. Thanks for any input anyone can provide. :) Let me just provide my two cents on why I started with RAMDisks. I have killed probably three or four SSDs on PCs doing nothing but WCG crunching on those said machines 24/7. CPU didn't die, Motherboard didn't die, PSU didn't die etc, but SSDs POOF! I have a Kingston 1TB SATA SSD in a machine built in August 2020. That machine has Not been running RAMDisk and Remaining SSD life is reported as 65%! That's a lot of writes from WU crunching only. That machine has an AMD 2700X (16 threads). The more threads you have running in parallel, the more writes will take place. On my 2990WX 64-thread, before I installed a RAMDisk, it chewed up the lifespan of a 500GB M.2 in a few months. So how do SSDs fail from writes? Well, in my cases I suddenly noticed the PC semi-locking up and then after a while locking up hard. You go "hmmm, is it the RAM, bad SATA cable, motherboard, PSU?" No, swap the SSD and PC runs fine again! So, RAMDisk or HDD is the only thing I'm putting BOINC data folder on nowadays. If you want to measure how many writes you get to your SSD, download HWInfo64 and there you can keep logging writes for a while and then extrapolate. I did, and it made me act Fast! ;) @Threadripper Wow, that sums up everything anyone wanted to know about crunching and SSd's!!!! I had installed an SSD on my Desktop in August 2020 and checking it on Crystal Disk info I noticed the writes to be in excess of 6000 Gb which prompted me to do some research. I do have a normal drive on the desktop as well so maybe it would be a good idea to transfer the data file to HDD which may solve the excessive writes to SSD. Thank you very much again for your very generous help and wonderful explanation. I am sure it will help others too if they were not aware of how much wear and tear is done by crunching to the SSD's |
||
|
Quadophile
Cruncher USA Joined: Feb 4, 2006 Post Count: 25 Status: Offline Project Badges: |
@nanoprobe
----------------------------------------I missed out on your post while I was posting mine. Very interesting read I must say. Just to add to the subject of discussion, I do not have Intel drive but a Crucial MX500 if it matters. I also do not defrag my SSD but just use the provided software from Crucial to trim it. I also use SSD Fresh to take care of all the other parameters of the SSD drive. So far everything works but was wondering if I should be worried about so many writes to the SSD. Thank you for providing your point of view as well. |
||
|
Maxxina
Advanced Cruncher Joined: Jan 5, 2008 Post Count: 114 Status: Offline Project Badges: |
:) well . We are live :) Crunching data already :) so here we go : )
|
||
|
Quadophile
Cruncher USA Joined: Feb 4, 2006 Post Count: 25 Status: Offline Project Badges: |
:) well . We are live :) Crunching data already :) so here we go : ) Yes got my first WU just a minute ago. Your post prompted me to look for it! |
||
|
Maxxina
Advanced Cruncher Joined: Jan 5, 2008 Post Count: 114 Status: Offline Project Badges: |
It was propably here somewhere but Im not much of edit guy :
Is there a easier way to set up : Sometimes when it runs, GPU usage jumps really high then even moving mouse is laggy as hell . It doesnt do that when i crunch Einstein stuff .. Like somewhere to set up use max 75 percent of capacity of gpu ? |
||
|
bozz4science
Advanced Cruncher Germany Joined: May 3, 2020 Post Count: 104 Status: Offline Project Badges: |
I guess you could implement a workaround solution that would look like following. Create an app_config.xml file. Put it in your prroject folder's directory and specify to use 0.5 GPU while only allowing 1 task. Thus, you would essentially "limit" the access to your GPU resources to say 50%. You could set it to any arbitrary number and combinations. Whatever would work best for you in practice.
----------------------------------------<app_config> <app> <name>opng</name> <max_concurrent>1</max_concurrent> <gpu_versions> <gpu_usage>0.500</gpu_usage> <cpu_usage>1.000</cpu_usage> </gpu_versions> </app> <report_results_immediately/> </app_config> AMD Ryzen 3700X @ 4.0 GHz / GTX1660S Intel i5-4278U CPU @ 2.60GHz |
||
|
|