Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 14
Posts: 14   Pages: 2   [ 1 2 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 4327 times and has 13 replies Next Thread
Wilgard
Advanced Cruncher
Joined: Dec 15, 2005
Post Count: 83
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
WCG WorkUnit Detached

Hello,
I have 2 computers, one with internet connection and another one without internet.
So every week I download several WU for a week and I run them on the computer withtout connection.
But the problem is when I upload workunits which were crunched on the computer without internet, they all are flagged as Detached.
So could you tell me what happened about WU of WCG because for climateprediction units, I don't have any issue.



Best Regards,

Wilgard
----------------------------------------

[Nov 2, 2018 1:59:23 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: WCG WorkUnit Detached

Describe your process in steps what you do to download, process, upload to/from the not-internet connected computer.
----------------------------------------
[Edit 1 times, last edit by Former Member at Nov 2, 2018 5:23:35 PM]
[Nov 2, 2018 5:22:25 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Wilgard
Advanced Cruncher
Joined: Dec 15, 2005
Post Count: 83
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: WCG WorkUnit Detached

Hello,

Computer1 is the computer with Internet
Computer2 is the computer without Internet connection
Client1 is a boinc client (Manager) that I use on Computer1
Client2 is a boinc client (Manager) that I use on Computer2

I do the following steps :
1. I launch client2 on the Computer1. I have configure the WCG projet with 10 days of projects in cache.
2. I copy all files & folder of Boinc/ProgramData to Computer2 (using a shared folder)
3. I launch the Client2 on Computer2 and I wait that all WU are completed (100%)
4. I launch the Client1 on Computer1 all the time except when I do the 3 first steps.
5. When All tasks of Client2 are completed I stop Client2 and Client1
6. I renamed the Boinc/ProgramData of Computer1 and Boinc/ProgramDataNew
7. I copy all files & folder of Boinc/ProgramData from Computer2 to Computer1 using the same sharedFolder
8. I rename the shared folder as Boinc/ProgramData
9. I launch Client2 on Computer1 to upload all tasks and get new ones.

The main idea is to copy/paste the Boinc/ProgamData files and folder each time the tasks are completed from the computer without internet to the computer with internet.

Let me know If I am not enough precise.of if you need more information.

Best Regards
----------------------------------------

[Nov 5, 2018 8:20:51 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: WCG WorkUnit Detached

The basics seem right. Are you stopping both clients on computer 1+2 between point 1 and 2?

Clients maintain connection counters. If at any time the server has a different counter value than the client, it will consider the partnership out of whack. At that point, all work is considered out of sync in some way and is ditched.

Since you work with just 1 client on the connected host, computer 1, copying over then renaming the data folder, you might want to add taking the client 1 off-line prior to every shutdown INCLUDING before shutting down when the data folder of client 2 is active. Client 2 on Computer 2 is of course always off-line in the activity menu by selecting "suspend network activity".

Why?: When you copy over the folders, you are also copying the network status settings over. I'm guessing that when you fire up client 2 on computer 2, client 2 sometimes thinks it's still on line and tries to connect, even when there's no internet.

If computer 1 and 2 are close to each other and both have an internet card/Ethernet port, you could even share the internet connection on computer 1 with a crossed Ethernet cable. Windows is quite easy to configure doing this. No cables in this house though as all is wifi including the TV.

Note: The server sees just one computer with 1 name, that of computer 1. Should not be a problem, but it's better to set host name suppression on the configuration file.
<suppress_net_info>1</suppress_net_info>
That way, you also can see by the ID number in the result status, which of the 2 clients computed the results.
[Nov 5, 2018 9:43:14 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: WCG WorkUnit Detached

My guess would be that there is information stored in the Registry that is messing up this configuration. Do you really have two clients on the same machine? It looks like you only have one but the data is different after the copy and paste. Normally, multiple clients require separate data directories and a unique port number for each. Additionally, based on experience, you can't normally run multiple clients on one machine without setting the <allow_multiple_clients> switch in cc_config. From my experience, if you don't set that switch, the server will detach the other client's work every time you start a client. Why not create a C:\computerx\BOINC\Program Data and share that folder with the other machine and eliminate the copy/pasting. Client 1 would continue to use C:\BOINC\Program Data and client 2 would use the other directory. On LINUX, I have separate data directories for each client that runs on a machine. It's been a long time since I've run Windows, but couldn't you create 2 shortcuts and edit the properties in one to use the other directory and port number by adding the --dir and --gui_rpc_port startup options.
[Nov 5, 2018 11:17:14 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Wilgard
Advanced Cruncher
Joined: Dec 15, 2005
Post Count: 83
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: WCG WorkUnit Detached

Hello All,

Thanks lavaflow and Doneske for your answers. That is helpful.
I think is issue is like you said, is history of counter value between the client and the server, because when I check the number of task in error before uploading the completed tasks, I have for example 0 task.
But after :
- Stop client 1
- Stop client 2
- Copy ProgramData of Client 2 to ProgramDataShared of client 1
- Renaming ProgramData of Client 1 to ProgramDataNew
- Renaming ProgramDataShared to ProgramData on client 1
- Starting Client 1

Just after starting client all tasks just begin to be uploaded, in WCG web site all tasks are flags are detached. So that explains this counter value issue.

The idea of sharing the internet connection is not possible because these are computers of a compagny they are on 2 differents ActiveDirectory so 2 differents networks. The internet connection of computer 1 of network 1 is more permissive that the internet connection of network 2.
So that why I talk about a computer without internet connection. The computer as a internet connection but with to many restriction and the boinc client could not get & send workunits.

I will test to remove the <suppress_net_info>, in order to check the difference, but I think It will not change anything.
I best way will be to find the boinc file which contains the counter value. I could replace this counter file of ProgramData of client 2 by the ProgramData of client 1 and maintain the coherency between server and client.

You are right lavaflow when I restart the client 2 after getting new tasks I have to change the settings and suspend the network activity each time.

Doneske your idea seems to be great, have 2 programData :
- C:\BOINC\ProgramData and C:\Computerx\BOINC\ProgramData as shared folder.
But how to configure the client 1 in order to specific that this second folder will be computed by another computer but it must take care of sending and receiving the tasks ?

It seems to be complicated

Best regards,

Wilgard
----------------------------------------

[Nov 6, 2018 8:38:42 AM]   Link   Report threatening or abusive post: please login first  Go to top 
TonyEllis
Senior Cruncher
Australia
Joined: Jul 9, 2008
Post Count: 286
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: WCG WorkUnit Detached

Wilgard - if you have cleared what you are doing with your company IT security or similar - then ignore the warning in this append.
Why is one network more restrictive than the other, is this done on purpose? Only certain types of access permitted for company security reasons and policy? Doing this type of transfer to a restricted network at the company I worked for before I retired would have landed me in very serious hot water. Restrictive networks are usually there for a very good reason. In fact two of the group I was in "disappeared" one day. Next day we found out they had breached the company's internet security policy and were seeking alternative employment.
I'd hate for you to loose your job inadvertently...
----------------------------------------
[Nov 6, 2018 10:56:41 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Wilgard
Advanced Cruncher
Joined: Dec 15, 2005
Post Count: 83
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: WCG WorkUnit Detached

Hello TonyEllis,

Many thanks for your warning. The reason of the 2 different networks and active directory is because those are 2 differents compagnies. The big one bought the small one and we are in "transition". So in a near futrue (which I hope will be shifted as late as possible) I will have to use only the computer 2 with restricted access.

So during this lapse of time I use the internet connection without restriction to send workunits. And it is the case for almost 2 years. So if they had seen something that would have been reported to me for a long time.

This issue is only on WCG workunits not on climateprediction. So I have only the problem when climateprediction hasn't workunits to send. The Client 1 use WCG and Client 2 climateprediction (unless there is not workunit, I try WCG).

Best Regards

Wilgard
----------------------------------------

[Nov 7, 2018 9:36:17 AM]   Link   Report threatening or abusive post: please login first  Go to top 
katoda
Senior Cruncher
Poland
Joined: Apr 28, 2007
Post Count: 172
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: WCG WorkUnit Detached

You should not run WCG client on computer1 while crunching on computer2. In such case connection counters for WCG project are different, hence the detachment of workunits or sometimes even new devices will be created in your WCG account.
The solution I can invent is to have on computer1 two data folders - 1st for climate prediction AND WCG - not shared, 2nd only for WCG, to be crunched on computer2. Computer1 normally works on 1st profile. To get data for computer2 you rename 1st data folder (let's say boincdata) to something like boincdata.1st, put 2nd profile folder (normally stored as boincdata.2nd) as boincdata and download the workunits. After download you shut down Boinc client, rename boincdata back to boincdata.2nd, move to the computer2 (and there rename as necessary), rename back boincdata.1st to boincdata and continue crunching on both computers.
If you need to report data back to WCG, you shut down WCG client on both PCs, rename boincdata folder on computer1 to boincdata.1st, move boincdata folder from computer2 to computer1 and rename to boincdata if necessary. After transferring crunched workunits and downloading new data repeat the procedure from the beginning (rename to boincdata.2nd, move to computer2, rename boincdata.1st to boincdata etc.).
NEVER have the same profile running on different machines at the same time.
Should work.
EDIT: and create profile for computer2 from the scratch, to have it generated with different deviceID, otherwise the problem with detached work units will return.
----------------------------------------

----------------------------------------
[Edit 3 times, last edit by katoda at Nov 7, 2018 2:05:56 PM]
[Nov 7, 2018 12:27:04 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Wilgard
Advanced Cruncher
Joined: Dec 15, 2005
Post Count: 83
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: WCG WorkUnit Detached

Hello Katoda,

Many thanks that seems to be a good idea. But when you are talking about a 2nd Profile do you mean a 2nd WCG/BOINC account ?
I really want to keep an unique boinc account.
Unless it is possible to configure 2 differents profiles with the same WCG account and in this case I'm all ears
----------------------------------------

[Nov 8, 2018 8:54:02 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 14   Pages: 2   [ 1 2 | Next Page ]
[ Jump to Last Post ]
Post new Thread