Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 133
Posts: 133   Pages: 14   [ Previous Page | 5 6 7 8 9 10 11 12 13 14 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 20949 times and has 132 replies Next Thread
gta198
Senior Cruncher
USA
Joined: Apr 8, 2020
Post Count: 309
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: WCGrid Cost-Benefit Analysis

In the Air Force I use to code machine and assembly for networked main frames ( 465L-ITT ). I use Ubuntu, Mint and still have a system using puppy.

I wasn't asking for help. I was giving an example of what people are looking for.

I believe they are looking for a live cd/usb with a stripped down OS, boinc and a version of ram drive to keep everything in ram so no drives are needed except on setup/reboot.

The only problem with science united I see is that you have to join up to ask a question to see if you want to join up.
[Apr 14, 2020 12:51:33 AM]   Link   Report threatening or abusive post: please login first  Go to top 
R.West
Cruncher
Joined: Jan 17, 2018
Post Count: 11
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: WCGrid Cost-Benefit Analysis

gta198, I recently looked at folding@home, and over there, you don't even need an account to start crunching. Ok, you won't be able to track your own efforts, but you can join the quest with almost zero configuration. Forcing accounts is also a bit egocentric, while most new people interested in grid computing (mainly due to covid-19) care less about points and way more to the overall goal of the project. Cater to them.

Things that would make ik easier for new people to join:

- Make it possible to start crunching without an account, or, create a generic account and post its details in the installation guide.
- Create a bootable CD/DVD or USB image, containing a generic OS with a BOINC client, that will start crunching as soon as a computer is booted via this device. It also prevents negative side effects from installing the client or the need for a dedicated hardware.
- Create a standard Boinc image that can be loaded into an Amazon AWS compute instance (EC2 or spot instance f.e.). You could run it on a Free Tier instance, or a paid instance, which in some cases, might even be cheaper than running it on your own hardware as residential power is often more expensive than the costs cloud providers pay. It also gives people living in areas with high energy costs a way to offload their tasks to an Amazon datacenter in a cheap power area.
[Apr 14, 2020 9:29:27 AM]   Link   Report threatening or abusive post: please login first  Go to top 
wcgridmember
Advanced Cruncher
Joined: Mar 30, 2005
Post Count: 110
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: WCGrid Cost-Benefit Analysis

So here are a couple of ideas, building on the past few posts from other users:

We want as much computing done as possible. So, while there is no other option, let's keep crunching and have our friends crunch as well. But it would be great to setup a fund whereby you could donate money for the computing to be done on a cloud computing provider, where it's cheaper. To make things easier for the user, we could show a map of countries, indicating with colors where the price of energy is higher or lower than the adopted cloud computing providers associated with the fund. Do you know who could make this happen?

Another idea: the purpose of the account is mainly, I think, for you to track your contribution, which is somewhat fun, but another option would be having the setup all done for you with just the choice of a team; I guess the focus could shift from the Cruncher to the Team; if this worked, it could make more visible and needed that you make a bigger effort for getting your friends on board (in your team). You'd need a password only if you wanted to join forums and in case you don't want to do that, you'll be fine without your own user/password account, knowing that you're making a difference to the World (which is the most important thing) and to your Team (to help this there could be perhaps regular OS notifications of the work done?). It would be much easier to setup any computer on BOINC/WCGrid like this. Do you think this could be useful? Who could make this happen?
----------------------------------------
[Edit 1 times, last edit by wcgridmember at Apr 14, 2020 9:25:19 PM]
[Apr 14, 2020 9:16:46 PM]   Link   Report threatening or abusive post: please login first  Go to top 
gta198
Senior Cruncher
USA
Joined: Apr 8, 2020
Post Count: 309
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: WCGrid Cost-Benefit Analysis

Perhaps a combination of both.
If an organization joins they could distribute a live cd/usb for members of their group. This way the members would literally have to do NO SETUP at all. The ultimate plug and play option...
[Apr 14, 2020 9:36:11 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: WCGrid Cost-Benefit Analysis

But it would be great to setup a fund whereby you could donate money for the computing to be done on a cloud computing provider, where it's cheaper. To make things easier for the user, we could show a map of countries, indicating with colors where the price of energy is higher or lower than the adopted cloud computing providers associated with the fund. Do you know who could make this happen?


This is a good idea. However, from all the data I have, cloud instances are much more expensive than setting up your own cruncher.

For example if you look at the Google Cloud Pricing calculator:
https://cloud.google.com/products/calculator

For example a c2 instance with 4 vCPU (which are basically 4 threads) costs 36.88 $ per month, when it is preemptible. Preemtible means it can be stopped at any time, if someone else needs the computing power. This is no downside for WCG, but decreases the price to roughly 1/3. So this makes 9.22 $ per thread.

If I do the math for a Ryzen 3900X and add up electricity cost at high rates (0.30 $ per kWh) and 1/3 of the hardware cost per year, I arrive at approximately 1.70 $ per thread and month, much less than the 9.22 $ for a cloud instance.

Maybe the cloud threads are a bit faster. The C2 instances are Cascade Lake Xeons with 3.8 GHz all-core turbo, the Ryzen 3900X should run at similar frequencies. But nothing will make up for the 5x higher cost.
Show me a cloud compute provider with a drastically lower price than Google Compute, I would be interested, but could find none.

I guess the reasons are the following: server hardware is much more expensive than mainstream hardware. This has certain advantages, for example higher reliability and higher memory bandwidth, but no advantages for distributed computing. At a data center you must also add the cost for the building, additional electricity for cooling (which is not always needed for a cruncher in a home, depending on the climate). And you must pay people maintaining the hardware.


Maybe an alternative would be, that WCG users with enough knowledge would set up additional machines and let others, who want to contribute but are not interested in setting up hardware, pay for it on a monthly basis. One could provide the weak account key from settings -> My Profile, which would allow the owner of the machine to run WCG under the account of the provider of the funds, without needing the login data of the account.
If someone has a serious interest in that, either by providing computing power or by renting it, maybe start a separate thread for that.
[Apr 15, 2020 8:01:05 AM]   Link   Report threatening or abusive post: please login first  Go to top 
wcgridmember
Advanced Cruncher
Joined: Mar 30, 2005
Post Count: 110
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: WCGrid Cost-Benefit Analysis

Thank you for the input, Sheridon! Looks like a good idea. While energy is so expensive in Europe, WCGrid could be much more energy efficient if european crunchers passed on some crunching to our fellow US crunchers.
[Apr 15, 2020 12:46:33 PM]   Link   Report threatening or abusive post: please login first  Go to top 
R.West
Cruncher
Joined: Jan 17, 2018
Post Count: 11
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: WCGrid Cost-Benefit Analysis

I don't see the issue of energy pricing that much, both natural gas and electricity are currently cheaper than they have been for years, and yes, I'm located in Europe. Once I start generating my own (solar) electricity, the prices per kWh will easily match corporate wholesale tarifs. Adding solar heat generation to that, and my energy bill will reach zero.

Show me a cloud compute provider with a drastically lower price than Google Compute, I would be interested, but could find none.

Amazon AWS has a free tier where you can sign up for a micro instance: https://aws.amazon.com/free/
I do know that they don't allow cryptominers on their platform, so I'm unsure if WCG is allowed. But hey, it's free :-).
As far as a paid tier for AWS goes (see: https://calculator.aws/#/createCalculator), a 4 vCPU and 8 GiB memory server instance is $ 47,- a month, or $ 525,- upfront costs and after that only $ 1,- a month. They clearly want workloads for a longer time, as that would be cheaper in this case, the longer you keep it running. Nothing as expensive as a massive datacenter with no workloads ;-).

Other than that, many employers these days own a Microsoft contract for office365 and Azure. In that Azure tier, depending on your contract, is the ability to spin up a free Azure cloud instance. 4 vCPU and 8 GiB ram, not the biggest machine, but free (read: already paid) for use.

WCG is part of IBM, so it would be nice if there are possibilities of using IBM cloud for WCG crunching efforts? I know the infrastructure is already used for certain backend tasks and storage, but to my knowledge not (yet?) for computing.
----------------------------------------
[Edit 1 times, last edit by R.West at Apr 15, 2020 2:34:30 PM]
[Apr 15, 2020 2:33:16 PM]   Link   Report threatening or abusive post: please login first  Go to top 
CurtisNewton
Cruncher
Joined: Feb 24, 2008
Post Count: 25
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: WCGrid Cost-Benefit Analysis


Other than that, many employers these days own a Microsoft contract for office365 and Azure. In that Azure tier, depending on your contract, is the ability to spin up a free Azure cloud instance. 4 vCPU and 8 GiB ram, not the biggest machine, but free (read: already paid) for use.

Many employers will not allow usage of company contracts for 'private' use. Never do this without a written statement. Also keep in mind that in some countries tax authorities will charge you additional taxes with respect to the amount you are saving when using company resources (it is treated as an additional, indirect income)


WCG is part of IBM, so it would be nice if there are possibilities of using IBM cloud for WCG crunching efforts? I know the infrastructure is already used for certain backend tasks and storage, but to my knowledge not (yet?) for computing.

I like that idea. IBM should have the knowledge and the infrastructure for running cloud computers, and contracts that provide electrical power pretty cheap.
Install a non profit organization that runs that service on top of IBM, funded by donations. Using a non profit organization will make the donations eligible for tax refunding in many countries. In my case, about 35% of the cost would be payed by tax refunding
[Apr 15, 2020 4:07:57 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 133   Pages: 14   [ Previous Page | 5 6 7 8 9 10 11 12 13 14 | Next Page ]
[ Jump to Last Post ]
Post new Thread