Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 39
Posts: 39   Pages: 4   [ Previous Page | 1 2 3 4 ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 23486 times and has 38 replies Next Thread
Sgt.Joe
Ace Cruncher
USA
Joined: Jul 4, 2006
Post Count: 7851
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Best drive for cruncher - USB Flash Drive, HDD or SSD?

I don't hate hard drives. I know they are reliable. However, I have several servers and it is easier to use a flash drive than have to hunt up a hard drive for the server. I have found the flash drives are quite reliable and I am sure they use less electricity than a hard drive, probably even less than an ssd even though they are very similar. I do use hard drives in my desktop systems. The replacement for the flash drive is under US $5.00 for a 16gb flash drive so even if/when they go belly up, they are easy and cheap to replace. The last I checked I have over 650 days on one flash drive on a 24 thread machine. So, at least for me, they do seem fairly reliable.
Cheers
----------------------------------------
Sgt. Joe
*Minnesota Crunchers*
[Dec 27, 2018 5:47:17 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Best drive for cruncher - USB Flash Drive, HDD or SSD?

...they use less electricity than a hard drive, probably even less than an ssd even though they are very similar.

Of course. Comparing to USB thumb drives, SSD is much more complicated things, and consumes more power in deed.

I have several servers and it is easier to use a flash drive than have to hunt up a hard drive for the server.

So these servers HAS NO DISK INSTALLED in fact, is it?

Maybe the reason I felt so neglect about running an OS on a thumb drive 24/365 is just out of my idea about thumb drives. I felt that thumb drives ought to be used when transferring work documents and so on(Oh of course they make good boot disks(PE, gparted, clonezilla, etc.) on emergency occasions too). But when coming to think about a real OS I won't consider that.

It's not that they can't make it(as you already know), but they're not MADE TO DO SUCH THINGS(Except those specially made for that reason). Pen drives are made to transfer small/large amount of data from one place to another, and HDD/SSDs are the one supposed to handle the whole OS.

As the design concept differs, products' characters went in the different way:
SSD/HDD implemented technologies that expand capacities,extends lifetime, and added some extras like SED, physical tamper-proof(data center/sensitive data storage), exceptional performance(gamers) and so on for those one in need.
Pen drives, on the other hand, optimized products for better performance and capacities as well, but not many factories applied life extension technologies, because they think pen drives are not supposed to be used so frequently: Several files coming in from this computer, then several files coming out to another, and stay in a drawer(or wherever) for TENS OF HOURS. They also have no support for TRIM or wear leveling algorithms, thus has no way to handle frequent write focused on a small amount of nand flash(which will lead to early end of flash module lifetime).
Also, though greatly improved, most pen drives' is still too slow to install OS on. Also, though Linux-based OSes can boot very fast, x window systems like gnome/kde/xfce/mate can cause excessive IO. Unless you do not wish to install gui for them and always manage them from your desktop computer, like this:

But, even without GUI, BOINC and the OS itself is still going to cause a lot of IO. Below are the data I got from my VM running only BOINC (I even removed rsyslog and other useless services):

BOINC caused about 60MB during the last 1 hour, I haven't download a single assignment and focuses on crunching FAHB(Fight AIDS@Home) during the hour. So that would be more than 0.5TB to your usb drive (16GB?) per year of crunching. If that pen drive really survived that, then it must be a REALLY, REALLY GOOD one.
I havn't had a usb drive that was not damaged with 0.5TB of p/e amount.
And I really hate to see broken pen drives on my desk. LOL
----------------------------------------
[Edit 2 times, last edit by Former Member at Jan 4, 2019 1:47:23 PM]
[Jan 4, 2019 1:44:57 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Sgt.Joe
Ace Cruncher
USA
Joined: Jul 4, 2006
Post Count: 7851
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Best drive for cruncher - USB Flash Drive, HDD or SSD?

Here are the the three systems I have running just on the flash drive, no hard drive. The OS is Linux Mint and BOINC is the only application running on them. The two with the most time are 24 thread machines and the other one is an 8 thread machine. They are all named the same which does not seem to cause any problem. The name is generated from the OS installation on the flash drive. I have not figured out a way to change it. the flash drives are all Sandisk 16 gb USB 2.0 units which each cost me US $4.99.

Cheers
----------------------------------------
Sgt. Joe
*Minnesota Crunchers*
----------------------------------------
[Edit 2 times, last edit by Sgt.Joe at Jan 4, 2019 7:48:05 PM]
[Jan 4, 2019 7:45:56 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Best drive for cruncher - USB Flash Drive, HDD or SSD?

They are all named the same which does not seem to cause any problem. The name is generated from the OS installation on the flash drive. I have not figured out a way to change it.
Cheers


You can change linux hostname by editing /etc/hostname and /etc/hosts together and reboot to take effect.

But by now your servers have been registered on the wcg server already, I suppose there's no way to change the name displayed on the site.

I have the same device listed more than once on my device list. Why is that?
When a device first contacts the server, the server creates a database record for the device. This record stores details like Operating System, available memory and how many times the device has communicated with the server. Each time the device communicates with the server, it compares various details about the device with its record on the server in an attempt to identify if it is the same device contacting the server. If anything appears different, the system will create a new record for the device and treat it as a new device. This prevents issues that can arise in different installation scenarious (such as in computer labs where each computer is setup identically and gets an identical installation image). Sometimes this leads to multiple entries for the same device in the website device list, but it ensures the proper functioning of the overall system.

https://www.worldcommunitygrid.org/help/viewTopic.do?shortName=devmanage#141
----------------------------------------
[Edit 1 times, last edit by Former Member at Jan 5, 2019 6:04:58 AM]
[Jan 5, 2019 5:58:54 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Best drive for cruncher - USB Flash Drive, HDD or SSD?

They are all named the same which does not seem to cause any problem. The name is generated from the OS installation on the flash drive. I have not figured out a way to change it.


I had the same problem some time ago when I used a live linux from flash drive. Changing the name never worked. Then I installed the OS from the flash drive to another one, after that it worked. Maybe the same problem as yours?
[Jan 5, 2019 7:52:16 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Sgt.Joe
Ace Cruncher
USA
Joined: Jul 4, 2006
Post Count: 7851
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Best drive for cruncher - USB Flash Drive, HDD or SSD?

They are all named the same which does not seem to cause any problem. The name is generated from the OS installation on the flash drive. I have not figured out a way to change it.


I had the same problem some time ago when I used a live linux from flash drive. Changing the name never worked. Then I installed the OS from the flash drive to another one, after that it worked. Maybe the same problem as yours?

I could try that, but since it does not cause any problems at the moment, I am just going to leave well enough alone. "If it ain't broke, don't fix it." Thanks for the suggestion though.
Cheers
----------------------------------------
Sgt. Joe
*Minnesota Crunchers*
[Jan 5, 2019 3:05:43 PM]   Link   Report threatening or abusive post: please login first  Go to top 
adriverhoef
Master Cruncher
The Netherlands
Joined: Apr 3, 2009
Post Count: 2351
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Best drive for cruncher - USB Flash Drive, HDD or SSD?

Re: changing a hostname

What happened to hostnamectl(1)?
$ man hostnamectl

[Jan 5, 2019 6:20:05 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Best drive for cruncher - USB Flash Drive, HDD or SSD?

Re: changing a hostname

What happened to hostnamectl(1)?
$ man hostnamectl


Of course that will do, too.
[Jan 6, 2019 1:07:53 AM]   Link   Report threatening or abusive post: please login first  Go to top 
l_mckeon
Senior Cruncher
Joined: Oct 20, 2007
Post Count: 439
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Best drive for cruncher - USB Flash Drive, HDD or SSD?

Re: USB wear leveling

Yes, apparently the newer models and probably larger models of USB drives do wear leveling of a sort.

https://www.pcreview.co.uk/threads/wear-level...cks-flash-drives.1941484/ Scroll down a ways.

Reply from manufacturer TwinMOS (originally in German)

Our Mobile Disk 2 USB 2.0 supports the so-called "random
writing technology" to make sure that all blocks are
be used evenly.

Kingston also say so.
Edit:I see that post is from 2003 so by now I'd expect all name brands to do it.
----------------------------------------
[Edit 1 times, last edit by l_mckeon at Jan 16, 2019 12:43:22 AM]
[Jan 16, 2019 12:36:29 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 39   Pages: 4   [ Previous Page | 1 2 3 4 ]
[ Jump to Last Post ]
Post new Thread