Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 
World Community Grid Forums
  Category: Support
  Forum: BOINC Agent Support
  Thread: Run Agent on Cloud Linux VM?

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 49
Posts: 49   Pages: 5   [ Previous Page | 1 2 3 4 5 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 7682 times and has 48 replies Next Thread
supdood
Senior Cruncher
USA
Joined: Aug 6, 2015
Post Count: 333
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Run Agent on Cloud Linux VM?
Does anyone have experience with the IBM Cloud? Looks like they have a similar offer to Google Cloud, with $200 in free credit.
----------------------------------------
Crunch with BOINC team USA
www.boincusa.com
[Jun 5, 2020 6:01:19 PM]   Link   Report threatening or abusive post: please login first  Go to top 
tazzduke
Advanced Cruncher
Australia
Joined: Aug 8, 2009
Post Count: 56
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Run Agent on Cloud Linux VM?
Greetings

Myself am running the following setups with CLOUD VM, and for the short term only.

2 x 8 core - Google Cloud VM, 2 x Different Users (family), using the Google credit - Where I am location wise, 8 is Max cores allowed for each user. Credit most likely used up by 40 days.

2 x 4 core - Oracle Cloud VM, same amount of credit as Google, but only get 30 days to use it. Allowed 2 x Instances of max 4 cores each though.

Both of these setups are persistent, so no outages/resets unless I do it.

Sorry, haven't fully looked at IBM or Microsoft Azure.

If you do multiple setups, then attach to WCG via Account Manager (BAM)

Cheers
----------------------------------------

----------------------------------------
[Edit 1 times, last edit by tazzduke at Jun 6, 2020 1:49:19 AM]
[Jun 6, 2020 1:44:05 AM]   Link   Report threatening or abusive post: please login first  Go to top 
jonathandl
Advanced Cruncher
Joined: Nov 12, 2007
Post Count: 106
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Run Agent on Cloud Linux VM?
I just started my $300 free trial and have an E2-standard-4 instance. Returned first OpenPandemics job in a little over 4 hours. Let's see how long it takes to consume the $300 in free credits... Once it's all consumed I heard you can still use an f1-micro instance indefinitely, but I wonder how long that will take to return 1 workunit...

...I also created a free IBM cloud account as well, but which service do I select from the extensive catalog of services to start crunching? I see that bare-metal servers are, of course, a paid offering, and I see other items in the catalog which look like they can analyze personal data about people (health, wealth, etc.), but which of the free offerings is just straight compute?
----------------------------------------
[Edit 4 times, last edit by jonathandl at Jul 5, 2020 9:21:37 AM]
[Jul 5, 2020 8:50:25 AM]   Link   Report threatening or abusive post: please login first  Go to top 
adriverhoef
Master Cruncher
The Netherlands
Joined: Apr 3, 2009
Post Count: 2155
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Run Agent on Cloud Linux VM?
I heard you can still use an f1-micro instance indefinitely, but I wonder how long that will take to return 1 workunit...
Maybe something like this ... (It wasn't me, I'm the Fedora one)
Result Name            OS           AVN Status Sent Time         Due / Return Time  CPUh  Claimed/Granted
OPN1_0003254_05161_2-- Linux Fedora 717 Valid    7/4/20 08:43:27   7/4/20 11:46:43   2.97    89.8/93.5
OPN1_0003254_05161_1-- Linux Ubuntu 717 Valid   6/27/20 08:43:40   7/2/20 10:40:06 115.85    90.5/93.5
OPN1_0003254_05161_0-- Linux Debian 717 Valid   6/27/20 08:43:16   7/4/20 09:57:16   3.21    96.6/93.5
More than 100 hours …
	<core_client_version>7.17.0</core_client_version>
	<![CDATA[
	<stderr_txt>
	INFO:[15:04:50] Start AutoGrid...
	
	autogrid4: Successful Completion.
	INFO:[15:15:59] End AutoGrid...
	INFO:[15:16:02] Start AutoDock for ZINC000856666035-ACR3.41_RX1--6w9c_001_tyr264-HO--CYS111_wcgsplit2.dpf(Job #0)...
	INFO: In AutoDock main_autodock()
	Beginning AutoDock...
	INFO: Setting num_generations: 27000
	About to enter main loop...(dockings already completed: 0)
	INFO:[19:58:09] Finished Docking number 0
	INFO:[00:35:59] Finished Docking number 1
	INFO:[05:15:56] Finished Docking number 2
	INFO:[09:59:20] Finished Docking number 3
	INFO:[14:40:52] Finished Docking number 4
	INFO:[19:23:33] Finished Docking number 5
	INFO:[00:00:32] Finished Docking number 6
	INFO:[04:38:40] Finished Docking number 7
	INFO:[09:17:30] Finished Docking number 8
	INFO:[14:00:58] Finished Docking number 9
	INFO:[18:42:51] Finished Docking number 10
	INFO:[23:19:44] Finished Docking number 11
	INFO:[04:02:10] Finished Docking number 12
	INFO:[08:42:51] Finished Docking number 13
	INFO:[13:21:01] Finished Docking number 14
	INFO:[18:00:01] Finished Docking number 15
	INFO:[22:42:57] Finished Docking number 16
	INFO:[03:23:13] Finished Docking number 17
	INFO:[08:08:28] Finished Docking number 18
	INFO:[12:46:28] Finished Docking number 19
	INFO:[17:26:55] Finished Docking number 20
	INFO:[22:05:56] Finished Docking number 21
	INFO:[02:47:33] Finished Docking number 22
	INFO:[07:26:41] Finished Docking number 23
	INFO:[12:11:26] Finished Docking number 24
	INFO:[12:11:33] End AutoDock...
	INFO:Cpu time = 417069.756227
	12:11:39 (32977): called boinc_finish(0)
	
	</stderr_txt>
	]]>
[Jul 5, 2020 9:51:56 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Falconet
Master Cruncher
Portugal
Joined: Mar 9, 2009
Post Count: 3295
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Run Agent on Cloud Linux VM?
I've got my F1-micro on TN-Grid right now but it wasn't very bad for OPN1.
7-9 hours maybe?

If you don't mind having to check GCP once or twice a day, you can run your instances in preemptive mode, which significantly decreases your costs. I was running 2 16C/8GB custom E2 for $0,111/hour each. The drawback is they always shut down every 24 hours and sometimes randomly throughout the day. I guess on average, I have to turn it on twice a day.

Also just got three 3-Core Instances at DigitalOcean thanks to free credit! They are also running TN-Grid and Rosetta but one ran 8 OPN1 with significantly better runtimes than either Google Compute or my Ryzen 1400 (both almost always between 3-3.5 hours).
You get $100 free credit from a referral link although you do have to make 1 payment which has to be at least $5. Credit is good for 60 days. The 3 instances I'm running will use $90 in those 2 months, each costs $15/month.

DigitalOcean Intel Xeon Gold 6140 2.3 GHz, Ubuntu 20.04:

OPN1_ 0003781_ 03495_ 0-- Ubuntu-1 Pending Validation 04/07/20 10:22:43 04/07/20 12:27:12 2,02 / 2,02 80,1 / 0,0
OPN1_ 0003781_ 03427_ 0-- Ubuntu-1 Pending Validation 04/07/20 10:22:43 04/07/20 14:23:14 1,96 / 1,96 78,9 / 0,0
OPN1_ 0003763_ 01457_ 1-- Ubuntu-1 Valid 04/07/20 04:19:10 04/07/20 07:49:51 2,49 / 2,49 99,0 / 79,3
OPN1_ 0003689_ 07815_ 1-- Ubuntu-1 Pending Validation 04/07/20 04:19:10 04/07/20 11:25:05 2,61 / 3,52 137,6 / 0,0
OPN1_ 0003689_ 06180_ 0-- Ubuntu-1 Pending Validation 04/07/20 01:38:29 04/07/20 05:19:32 2,62 / 2,63 103,2 / 0,0
OPN1_ 0003718_ 11383_ 0-- Ubuntu-1 Valid 03/07/20 23:09:29 04/07/20 02:39:48 2,48 / 2,48 95,2 / 92,1
OPN1_ 0003701_ 11085_ 0-- Ubuntu-1 Valid 03/07/20 23:09:29 04/07/20 01:38:29 2,41 / 2,41 92,0 / 87,9
OPN1_ 0003709_ 06072_ 1-- Ubuntu-1 Valid 03/07/20 23:07:24 04/07/20 02:39:48 2,54 / 2,54 97,5 / 93,1
----------------------------------------


AMD Ryzen 5 1600AF 6C/12T 3.2 GHz - 85W
AMD Ryzen 5 2500U 4C/8T 2.0 GHz - 28W
AMD Ryzen 7 7730U 8C/16T 3.0 GHz
----------------------------------------
[Edit 1 times, last edit by Falconet at Jul 5, 2020 11:58:23 AM]
[Jul 5, 2020 11:20:23 AM]   Link   Report threatening or abusive post: please login first  Go to top 
jonathandl
Advanced Cruncher
Joined: Nov 12, 2007
Post Count: 106
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
crunching in Google Cloud or IBM cloud?
My Google Cloud instance has been churning out valid workunits at a nice clip, about 5 times as fast as my home computer. And it's nice that they have a web-based SSH interface to allow me to login to my VM to check on it... but there are some limitations; if I use the chromebook touchpad (or, one time when I used my laptop mouse) to scroll in my browser-based SSH window, it sends a bunch of nonsense characters instead of scrolling the screen.

Does anybody know how to setup SSH from a conventional SSH client (such as Linux "terminal") to a GCP instance? I checked the documentation and it seems the easiest method is deprecated (strongly "not recommended" and "adds unnecessary risks and complexity") and they recommend I use "OS Login" instead... but the "OS login" documentation seems to imply it's more suited more for enterprise (multiuser) use.

And I don't even know where to start with the IBM Cloud. They have a whole bunch of offerings and I don't know which of the free ones (bare metal being a paid offering, of course) is most suitable for crunching.
----------------------------------------
[Edit 3 times, last edit by jonathandl at Jul 7, 2020 10:21:05 PM]
[Jul 7, 2020 10:17:00 PM]   Link   Report threatening or abusive post: please login first  Go to top 
supdood
Senior Cruncher
USA
Joined: Aug 6, 2015
Post Count: 333
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: crunching in Google Cloud or IBM cloud?
My f1-micro instance has been returning OPN1 between 10-11 hours. And yes, the GCP browser-based SSH connection to the VM is great.

I signed up for IBM cloud but ended up emailing them to cancel my account before getting any work done. There are too many steps and third party software required for an average person to get securely connected to the VM.

Jonathan--Maybe you'll have more success than I did. You want the Virtual Server offering. With the amount of free credit and short time frame to use it, you can get some serious compute power.
----------------------------------------
Crunch with BOINC team USA
www.boincusa.com

----------------------------------------
[Edit 1 times, last edit by supdood at Jul 8, 2020 11:00:08 AM]
[Jul 8, 2020 10:59:33 AM]   Link   Report threatening or abusive post: please login first  Go to top 
sunfolk
Master Cruncher
Super Kiwi Socialistic Empire Of Jacinda
Joined: Oct 8, 2006
Post Count: 1769
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: crunching in Google Cloud or IBM cloud?
A quick recommendation for anyone new to headless linux crunching:

sudo apt install boinctui

A textual user interface that does away with all that nasty boinccmd tedium!
----------------------------------------
[Jul 8, 2020 1:59:14 PM]   Link   Report threatening or abusive post: please login first  Go to top 
zolople
Cruncher
Spain
Joined: Apr 25, 2020
Post Count: 8
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: crunching in Google Cloud or IBM cloud?
Have you tried Google Colab? you just have to copy this code, paste it in a notebook, configure the account and run
https://gist.github.com/zolople/c96d9759d2b10c0ed126dd0a61901e2d



For a permanent connection with Google Drive, you must activate Drive, before executing, by clicking on this icon:

----------------------------------------


----------------------------------------
[Edit 2 times, last edit by zolople at Aug 2, 2020 6:12:27 AM]
[Aug 1, 2020 10:33:31 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Falconet
Master Cruncher
Portugal
Joined: Mar 9, 2009
Post Count: 3295
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: crunching in Google Cloud or IBM cloud?
zolople,

033: 02-Aug-2020 12:08:23 [---] Benchmark results:
034: 02-Aug-2020 12:08:23 [---] Number of CPUs: 2
035: 02-Aug-2020 12:08:23 [---] 3362 floating point MIPS (Whetstone) per CPU
036: 02-Aug-2020 12:08:23 [---] 82197 integer MIPS (Dhrystone) per CPU


Going to try it, see how it goes.
----------------------------------------


AMD Ryzen 5 1600AF 6C/12T 3.2 GHz - 85W
AMD Ryzen 5 2500U 4C/8T 2.0 GHz - 28W
AMD Ryzen 7 7730U 8C/16T 3.0 GHz
[Aug 2, 2020 12:10:09 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 49   Pages: 5   [ Previous Page | 1 2 3 4 5 | Next Page ]
[ Jump to Last Post ]
Post new Thread