Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Locked
Total posts in this thread: 511
Posts: 511   Pages: 52   [ Previous Page | 43 44 45 46 47 48 49 50 51 52 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 486898 times and has 510 replies Next Thread
ThreadRipper
Veteran Cruncher
Sweden
Joined: Apr 26, 2007
Post Count: 1317
Status: Offline
Project Badges:
Re: OpenPandemics GPU Beta Test - March 26 2021 [ Issues Thread ]

@Threadripper and others using RAMdisks:
What do you actually put into your RAMdisks?
The top parts of the BOINC data directory do not have crippling write activity; the Projects directories hold the programs, images, etc, which you will want to preserve through a crash that wipes your RAMdisk. They also hold the WU files, which don't churn too much for non-volatile storage. It looks to me that it's only the Slots directories that get frequent writes, so they are the ones to go into the RAMdisk.
In the event of a crash including power outage, your would lose tasks in progress. How does BOINC handle that?

So ... , at BOINC startup, you would mount the RAMdisk over the Slots directory, after copying out the contents from the non-volatile version, and then restore them to the RAMdisk, before finally restarting BOINC.
Have you got scripts or something to handle that?
Do you have a periodic RAMdisk backup daemon running too?

https://en.wikipedia.org/wiki/List_of_RAM_drive_software


Hi Rickjb,
I set up the RAM-disk so that it backups the folder at every shutdown and restores at bootup. This works pretty well. You can also press a button to synchronize to disk on demand. I haven't dug deep enough in ImDisk that I use to find if there is a feature to periodically sync to disk at given time intervals or not, but that would of course be a nice feature.

During BOINC setup I simply point the entire BOINC data directory to be installed on the RAMDisk.

In case of a crash, yes I lose some data, but if last shutdown/sync to disk was long ago, BOINC will simply mark the WUs as "aborted by project" (since the WUs stored on disk were old) and download new ones. In results status, the other "lost WUs" will be marked as Detached.

Before creating a RAMDisk, I usually make sure that the system is stable by letting it run 24/7 WCG crunching. After that I create a RAMDisk.

Another option would of course be to attach a 2.5" or 3.5" HDD and put the BOINC data folder there. But HDDs are slow so that's also suboptimal.

A power outage will of course be bad (same as crash scenario above), but there's only one thing to do if you have frequent outages is to get a UPS for battery backup. Then you can connect it to the PC via USB and its software will then notice if the UPS loses power form the outlet and you can choose what you want for it to do. For instance, perform a clean Windows Shutdown (at which point your RAMDisk will sync to disk as well).
----------------------------------------

Join The International Team: https://www.worldcommunitygrid.org/team/viewTeamInfo.do?teamId=CK9RP1BKX1

AMD TR2990WX @ PBO, 64GB Quad 3200MHz 14-17-17-17-1T, RX6900XT @ Stock
AMD 3800X @ PBO
AMD 2700X @ 4GHz
[Apr 6, 2021 4:14:55 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Quadophile
Cruncher
USA
Joined: Feb 4, 2006
Post Count: 25
Status: Offline
Project Badges:
Re: OpenPandemics GPU Beta Test - March 26 2021 [ Issues Thread ]

Ramdisks:

While reading about the advantages and disadvantages of installing Ramdisk for crunching I was wondering how much one would lose in terms of aging of SSD if no Ramdisk was installed? Does it really matter?

The reason I ask this is that I am not inclined towards installing a Ramdisk. Yes I do have a 1 TB SSD as my main drive.

Thanks for any input anyone can provide. :)
----------------------------------------

[Apr 6, 2021 5:04:03 PM]   Link   Report threatening or abusive post: please login first  Go to top 
ThreadRipper
Veteran Cruncher
Sweden
Joined: Apr 26, 2007
Post Count: 1317
Status: Offline
Project Badges:
Re: OpenPandemics GPU Beta Test - March 26 2021 [ Issues Thread ]

Ramdisks:

While reading about the advantages and disadvantages of installing Ramdisk for crunching I was wondering how much one would lose in terms of aging of SSD if no Ramdisk was installed? Does it really matter?

The reason I ask this is that I am not inclined towards installing a Ramdisk. Yes I do have a 1 TB SSD as my main drive.

Thanks for any input anyone can provide. :)


Let me just provide my two cents on why I started with RAMDisks.
I have killed probably three or four SSDs on PCs doing nothing but WCG crunching on those said machines 24/7. CPU didn't die, Motherboard didn't die, PSU didn't die etc, but SSDs POOF! I have a Kingston 1TB SATA SSD in a machine built in August 2020. That machine has Not been running RAMDisk and Remaining SSD life is reported as 65%! That's a lot of writes from WU crunching only. That machine has an AMD 2700X (16 threads). The more threads you have running in parallel, the more writes will take place. On my 2990WX 64-thread, before I installed a RAMDisk, it chewed up the lifespan of a 500GB M.2 in a few months.

So how do SSDs fail from writes? Well, in my cases I suddenly noticed the PC semi-locking up and then after a while locking up hard. You go "hmmm, is it the RAM, bad SATA cable, motherboard, PSU?" No, swap the SSD and PC runs fine again!

So, RAMDisk or HDD is the only thing I'm putting BOINC data folder on nowadays.

If you want to measure how many writes you get to your SSD, download HWInfo64 and there you can keep logging writes for a while and then extrapolate. I did, and it made me act Fast! ;)
----------------------------------------

Join The International Team: https://www.worldcommunitygrid.org/team/viewTeamInfo.do?teamId=CK9RP1BKX1

AMD TR2990WX @ PBO, 64GB Quad 3200MHz 14-17-17-17-1T, RX6900XT @ Stock
AMD 3800X @ PBO
AMD 2700X @ 4GHz
[Apr 6, 2021 5:16:44 PM]   Link   Report threatening or abusive post: please login first  Go to top 
nanoprobe
Master Cruncher
Classified
Joined: Aug 29, 2008
Post Count: 2998
Status: Offline
Project Badges:
Re: OpenPandemics GPU Beta Test - March 26 2021 [ Issues Thread ]

Ramdisks:

While reading about the advantages and disadvantages of installing Ramdisk for crunching I was wondering how much one would lose in terms of aging of SSD if no Ramdisk was installed? Does it really matter?

The reason I ask this is that I am not inclined towards installing a Ramdisk. Yes I do have a 1 TB SSD as my main drive.

Thanks for any input anyone can provide. :)


Let me just provide my two cents on why I started with RAMDisks.
I have killed probably three or four SSDs on PCs doing nothing but WCG crunching on those said machines 24/7. CPU didn't die, Motherboard didn't die, PSU didn't die etc, but SSDs POOF! I have a Kingston 1TB SATA SSD in a machine built in August 2020. That machine has Not been running RAMDisk and Remaining SSD life is reported as 65%! That's a lot of writes from WU crunching only. That machine has an AMD 2700X (16 threads). The more threads you have running in parallel, the more writes will take place. On my 2990WX 64-thread, before I installed a RAMDisk, it chewed up the lifespan of a 500GB M.2 in a few months.

So how do SSDs fail from writes? Well, in my cases I suddenly noticed the PC semi-locking up and then after a while locking up hard. You go "hmmm, is it the RAM, bad SATA cable, motherboard, PSU?" No, swap the SSD and PC runs fine again!

So, RAMDisk or HDD is the only thing I'm putting BOINC data folder on nowadays.

If you want to measure how many writes you get to your SSD, download HWInfo64 and there you can keep logging writes for a while and then extrapolate. I did, and it made me act Fast! ;)

While I find your story on SSDs interesting and true for you I have not experienced the problems with SSDs that you have. Could it be brands or other unknowns I have no idea. What I do know is that I had 3 servers totaling 200 threads running here for years and never had any SSD issues. I sold all 3 to the same person 5 years ago and AFAIK the same SSDs are still in service running 24/7/365. Did you ever defrag your SSDs? If you did that could be part of the issue for early failures. Defragging them is a huge no no. Do you use a UPS with surge protection on your hosts? That's a must here in Fl. with our frequent lightning strikes. I had every onboard nic taken out by lightning a few years ago. That was an expensive lesson. Now all my network cables are surge protected too. Other than that maybe you just had bad luck. FWIW I only use Intel sever grade SSds. Thet aren't cheap but I"ve never had one fail.
----------------------------------------
In 1969 I took an oath to defend and protect the U S Constitution against all enemies, both foreign and Domestic. There was no expiration date.


[Apr 6, 2021 5:46:50 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Quadophile
Cruncher
USA
Joined: Feb 4, 2006
Post Count: 25
Status: Offline
Project Badges:
smile Re: OpenPandemics GPU Beta Test - March 26 2021 [ Issues Thread ]

Ramdisks:

While reading about the advantages and disadvantages of installing Ramdisk for crunching I was wondering how much one would lose in terms of aging of SSD if no Ramdisk was installed? Does it really matter?

The reason I ask this is that I am not inclined towards installing a Ramdisk. Yes, I do have a 1 TB SSD as my main drive.

Thanks for any input anyone can provide. :)


Let me just provide my two cents on why I started with RAMDisks.
I have killed probably three or four SSDs on PCs doing nothing but WCG crunching on those said machines 24/7. CPU didn't die, Motherboard didn't die, PSU didn't die etc, but SSDs POOF! I have a Kingston 1TB SATA SSD in a machine built in August 2020. That machine has Not been running RAMDisk and Remaining SSD life is reported as 65%! That's a lot of writes from WU crunching only. That machine has an AMD 2700X (16 threads). The more threads you have running in parallel, the more writes will take place. On my 2990WX 64-thread, before I installed a RAMDisk, it chewed up the lifespan of a 500GB M.2 in a few months.

So how do SSDs fail from writes? Well, in my cases I suddenly noticed the PC semi-locking up and then after a while locking up hard. You go "hmmm, is it the RAM, bad SATA cable, motherboard, PSU?" No, swap the SSD and PC runs fine again!

So, RAMDisk or HDD is the only thing I'm putting BOINC data folder on nowadays.

If you want to measure how many writes you get to your SSD, download HWInfo64 and there you can keep logging writes for a while and then extrapolate. I did, and it made me act Fast! ;)


@Threadripper

Wow, that sums up everything anyone wanted to know about crunching and SSd's!!!!

I had installed an SSD on my Desktop in August 2020 and checking it on Crystal Disk info I noticed the writes to be in excess of 6000 Gb which prompted me to do some research.

I do have a normal drive on the desktop as well so maybe it would be a good idea to transfer the data file to HDD which may solve the excessive writes to SSD.

Thank you very much again for your very generous help and wonderful explanation. I am sure it will help others too if they were not aware of how much wear and tear is done by crunching to the SSD's
----------------------------------------

[Apr 6, 2021 5:50:05 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Quadophile
Cruncher
USA
Joined: Feb 4, 2006
Post Count: 25
Status: Offline
Project Badges:
Re: OpenPandemics GPU Beta Test - March 26 2021 [ Issues Thread ]

@nanoprobe

I missed out on your post while I was posting mine.

Very interesting read I must say.

Just to add to the subject of discussion, I do not have Intel drive but a Crucial MX500 if it matters. I also do not defrag my SSD but just use the provided software from Crucial to trim it. I also use SSD Fresh to take care of all the other parameters of the SSD drive. So far everything works but was wondering if I should be worried about so many writes to the SSD.

Thank you for providing your point of view as well.
----------------------------------------

[Apr 6, 2021 5:56:11 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Maxxina
Advanced Cruncher
Joined: Jan 5, 2008
Post Count: 114
Status: Offline
Project Badges:
Re: OpenPandemics GPU Beta Test - March 26 2021 [ Issues Thread ]

:) well . We are live :) Crunching data already :) so here we go : )
[Apr 6, 2021 5:59:08 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Quadophile
Cruncher
USA
Joined: Feb 4, 2006
Post Count: 25
Status: Offline
Project Badges:
Re: OpenPandemics GPU Beta Test - March 26 2021 [ Issues Thread ]

:) well . We are live :) Crunching data already :) so here we go : )


Yes got my first WU just a minute ago. Your post prompted me to look for it! biggrin
biggrin biggrin
----------------------------------------

[Apr 6, 2021 6:05:45 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Maxxina
Advanced Cruncher
Joined: Jan 5, 2008
Post Count: 114
Status: Offline
Project Badges:
Re: OpenPandemics GPU Beta Test - March 26 2021 [ Issues Thread ]

It was propably here somewhere but Im not much of edit guy :

Is there a easier way to set up :

Sometimes when it runs, GPU usage jumps really high then even moving mouse is laggy as hell . It doesnt do that when i crunch Einstein stuff ..

Like somewhere to set up use max 75 percent of capacity of gpu ?
[Apr 6, 2021 6:16:09 PM]   Link   Report threatening or abusive post: please login first  Go to top 
bozz4science
Advanced Cruncher
Germany
Joined: May 3, 2020
Post Count: 104
Status: Offline
Project Badges:
Re: OpenPandemics GPU Beta Test - March 26 2021 [ Issues Thread ]

I guess you could implement a workaround solution that would look like following. Create an app_config.xml file. Put it in your prroject folder's directory and specify to use 0.5 GPU while only allowing 1 task. Thus, you would essentially "limit" the access to your GPU resources to say 50%. You could set it to any arbitrary number and combinations. Whatever would work best for you in practice.

<app_config>
<app>
<name>opng</name>
<max_concurrent>1</max_concurrent>
<gpu_versions>
<gpu_usage>0.500</gpu_usage>
<cpu_usage>1.000</cpu_usage>
</gpu_versions>
</app>
<report_results_immediately/>
</app_config>
----------------------------------------

AMD Ryzen 3700X @ 4.0 GHz / GTX1660S
Intel i5-4278U CPU @ 2.60GHz
[Apr 6, 2021 6:50:37 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 511   Pages: 52   [ Previous Page | 43 44 45 46 47 48 49 50 51 52 | Next Page ]
[ Jump to Last Post ]
Post new Thread