Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 17
Posts: 17   Pages: 2   [ 1 2 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 4649 times and has 16 replies Next Thread
w0rldtravlr
Cruncher
Canada
Joined: Nov 29, 2005
Post Count: 20
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Linux live image w/BOINC?

Hello,

I often have equipment that is passing through for various reasons and I run BOINC on this gear as I have the space, etc. to do so. Today I do this by PXE booting to a Linux install and adding a light distro to the equipment and then install BOINC.

Is anyone aware of a BOINC oriented Live linux image that allows project settings to persist, or to be set to allow automatically registering on boot? If it was possible to pop in a USB storage devices and boot into a live environment with persistent BOINC settings that would be ideal. I have tried BILD (BOINC Italy Linux Distro) but it is overkill for what I need and I've not had good luck modifying it to include the automation to register the client.

I appreciate any help or suggestions the group may have.

Thank you!
[Jun 23, 2020 2:34:01 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Sgt.Joe
Ace Cruncher
USA
Joined: Jul 4, 2006
Post Count: 7844
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Linux live image w/BOINC?

I use the Pendrive universal installer to set up a bootable USB drive with Linux. It will run BOINC without any hardrive and without actually installing on the computer. It will run as a live version. I use a 4gb persistent file on a 16gb USB. I have not tried moving it to different machines, but it might work. I may try it when I get another machine.
Cheers
----------------------------------------
Sgt. Joe
*Minnesota Crunchers*
[Jun 23, 2020 2:41:20 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Linux live image w/BOINC?

I've found that Puppy 64 is easy to setup with boinc. Puppy only uses like 200Mb of ram . The 200Mb is a complete installation of puppy64 in your ram. So far I haven't used over 2.7Gb of ram in any of my systems ( that's with 6 of 8 cores crunching 24/7). After installing puppy64 just run the puppy package manager and search for boinc. Easy as installing an app on a cell phone. Just make sure you don't pick a copy tailored to another program, it will say so in the description ).

Since there is no hard drive, you'll need a flash drive or something for boinc to do it's backups and/or swap file.

I would set the amount of work to download at like 0.1 day total so you don't get a ton of work to do downloaded. It will download the next task after the current one is finished.

On Puppy you can save your settings to the cd/dvd or flash drive. I just leave the disk in the dvd drive, it won't acess it again after setup unless the system reboots.
[Jun 23, 2020 9:52:36 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Sgt.Joe
Ace Cruncher
USA
Joined: Jul 4, 2006
Post Count: 7844
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Linux live image w/BOINC?

I've found that Puppy 64 is easy to setup with boinc. Puppy only uses like 200Mb of ram . The 200Mb is a complete installation of puppy64 in your ram. So far I haven't used over 2.7Gb of ram in any of my systems ( that's with 6 of 8 cores crunching 24/7). After installing puppy64 just run the puppy package manager and search for boinc. Easy as installing an app on a cell phone. Just make sure you don't pick a copy tailored to another program, it will say so in the description ).
Since there is no hard drive, you'll need a flash drive or something for boinc to do it's backups and/or swap file.
I would set the amount of work to download at like 0.1 day total so you don't get a ton of work to do downloaded. It will download the next task after the current one is finished.
On Puppy you can save your settings to the cd/dvd or flash drive. I just leave the disk in the dvd drive, it won't acess it again after setup unless the system reboots.

I use Linux Mint, But I agree with gta198. I tried Puppy Linux and liked it but eventually settled on Mint. But Puppy has a very small footprint and will work nicely with BOINC.
Cheers
----------------------------------------
Sgt. Joe
*Minnesota Crunchers*
[Jun 23, 2020 10:39:20 PM]   Link   Report threatening or abusive post: please login first  Go to top 
hchc
Veteran Cruncher
USA
Joined: Aug 15, 2006
Post Count: 865
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Linux live image w/BOINC?

I'm not sure how BOINC Server (such as WCG) responds to the same host ID/device ID installed in a different computer. How long do you generally keep each device if they're passing through?

Honestly, a live image with persistence seems awkward compared to just installing the OS onto the drive in the first place. As far as portability is concerned; i.e., moving from one device to a different device with different hardware config, I'm not sure if WCG will reject it and assign a new device ID.
----------------------------------------
  • i5-7500 (Kaby Lake, 4C/4T) @ 3.4 GHz
  • i5-4590 (Haswell, 4C/4T) @ 3.3 GHz
  • i5-3570 (Broadwell, 4C/4T) @ 3.4 GHz

----------------------------------------
[Edit 1 times, last edit by hchc at Jun 24, 2020 3:38:54 AM]
[Jun 24, 2020 12:33:03 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Sgt.Joe
Ace Cruncher
USA
Joined: Jul 4, 2006
Post Count: 7844
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Linux live image w/BOINC?

Honestly, I'm not sure how BOINC Server (such as WCG) responds to the same host ID/device ID installed in a different computer. How long do you generally keep each device if they're passing through?

Honestly, a live image with persistence seems awkward compared to just installing the OS onto the drive in the first place. As far as portability is concerned; i.e., moving from one device to a different device with different hardware config, I'm not sure if WCG will reject it and assign a new device ID.

Well, I did that. A while back I shut down one of my 8 core machines which had been running on a live Linux instance off of a flash drive. After I let the queue run out, I shut down the machine and move the flash drive to a new 12core/24 thread machine. It started OK, gave some messages about re-configuring memory and started BOINC. I re-enabled "Allow new tasks" and proceeded to download new tasks and it has been running ever since. As far as my machine statistics go, it shows as the same machine, with the old 8 core statistics and then with the new statistics just continuing on. Theoretically I could move it to as many machines as I want until the flash drive gives up the ghost. As far as installing it to a drive, these machines run with no hard drive installed.
Edit: Come to think of it, I did the same thing with one of my hard drives also. It was also running Linux. That first machine's power supply went belly up (it was an 8 core) and I just moved the hard drive to another machine and it took right off. I don't remember if any of the existing work units errored out or if they all finished fine. But the new machine just took over the old machines statistics as well.
Cheers
----------------------------------------
Sgt. Joe
*Minnesota Crunchers*
----------------------------------------
[Edit 1 times, last edit by Sgt.Joe at Jun 24, 2020 2:50:14 AM]
[Jun 24, 2020 2:44:28 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Linux live image w/BOINC?

I hadn't really thought about it before this, but running a system 100% cpu and 100% cpu time would be a good stress test and cooling capability test.



Be a hero
https://tinyurl.com/yaea3y7j
[Jun 24, 2020 6:42:02 AM]   Link   Report threatening or abusive post: please login first  Go to top 
w0rldtravlr
Cruncher
Canada
Joined: Nov 29, 2005
Post Count: 20
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Linux live image w/BOINC?

Thanks for all the responses.

How long do you generally keep each device if they're passing through?
It varies... Sometimes days, sometimes months, depending on what direction its going (New-> deployment; old -> re-purpose or disposal). With the supply chain issues of late some new things are sticking around for 60-90 days on the new side waiting for various things. Anything over a week is generally worth 10 min to put a quick install on it for 6-8 core hosts. For 32+ core hosts I will try to get WCG running if they will stick around for more than a weekend.

Honestly, a live image with persistence seems awkward compared to just installing the OS onto the drive in the first place. As far as portability is concerned; i.e., moving from one device to a different device with different hardware config, I'm not sure if WCG will reject it and assign a new device ID.
Sometimes these systems don't yet have drives or have a PITA RAID array, or require external DAS. For bigger boxes that might be around for a couple weeks to config, They may be running for setup in the day, but available to crunch from Friday night until Monday AM.... a good use of 64-128 cores over the weekend biggrin

BILD (Bonic Italy Linux Distro) works well, but it still required some touch, and the options set do not survive a reboot in their live image. I will check out Mint and Puppy to see if I can make that work.

I hadn't really thought about it before this, but running a system 100% cpu and 100% cpu time would be a good stress test and cooling capability test.
On new gear you quickly learn if the PSU and fans are good. Have found lots of faulty fans or shady PSUs this way. 20x 6c/12t Xeon 3.8Ghz (latest) add about 2.2kW electrical load and heat to a room so definitely need to check electrical and HVAC before doing this. I have several systems with dual EYPC 7H12 (2x 64c/128t @ 2.6Ghz) somewhere in the supply chain.... Can't wait to try those on WCG if I can find the power to feed them and room with cooling to house them.
[Jun 27, 2020 9:48:47 PM]   Link   Report threatening or abusive post: please login first  Go to top 
hchc
Veteran Cruncher
USA
Joined: Aug 15, 2006
Post Count: 865
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Linux live image w/BOINC?

Sometimes these systems don't yet have drives or have a PITA RAID array, or require external DAS. For bigger boxes that might be around for a couple weeks to config, They may be running for setup in the day, but available to crunch from Friday night until Monday AM.... a good use of 64-128 cores over the weekend biggrin

Right I was saying instead of a live image + persistence (kind of like Tails), just install Linux directly to the drive as normal. By drive, I'm not talking about HDD or SSD but the USB flash drive. That way there is no need to worry about losing all updates since the live image was created if you install it and update it.

Since you seem to PXE boot, I guess theoretically you could boot a live image from your PXE server and then have it somehow choose a hostname on a first come, first serve basis. I'm not sure how to automate that -- each device needs a unique hostname, but I guess you could re-use the same USB flash drive on a new system as long as two machines don't use the same hostname at once.

BILD (Bonic Italy Linux Distro) works well, but it still required some touch, and the options set do not survive a reboot in their live image. I will check out Mint and Puppy to see if I can make that work.

Yeah, I don't see the point of using a live image. Seems way more trouble. Just install it to the drive so it's automatically persistent.

I think of live images as more "try it before you commit to it" but not really for production systems.
----------------------------------------
  • i5-7500 (Kaby Lake, 4C/4T) @ 3.4 GHz
  • i5-4590 (Haswell, 4C/4T) @ 3.3 GHz
  • i5-3570 (Broadwell, 4C/4T) @ 3.4 GHz

[Jun 28, 2020 7:58:21 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Linux live image w/BOINC?

I have several systems with dual EYPC 7H12 (2x 64c/128t @ 2.6Ghz) somewhere in the supply chain.... Can't wait to try those on WCG if I can find the power to feed them and room with cooling to house them.

The new EPYC 7H12 has a rated TDP of 280W, and as a result the chip is being marketed for server environments that offer liquid cooled solutions only. AMD is very specific about this, especially in the market for which this CPU is aimed at.

Is that server water-cooled in the server or installed in a rack that has water cooled-doors? Should be an interesting setup. Would probably need a minimum of 256GB memory to run WCG. Might be able to squeak by with 128GB if running OPN1 only on all 256 threads not to mention the slots and swap storage required on the USB drive.
----------------------------------------
[Edit 1 times, last edit by Former Member at Jun 28, 2020 1:40:30 PM]
[Jun 28, 2020 1:39:07 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 17   Pages: 2   [ 1 2 | Next Page ]
[ Jump to Last Post ]
Post new Thread