| Index | Recent Threads | Unanswered Threads | Who's Active | Guidelines | Search |
 |
World Community Grid Forums
Category: Support
Forum: BOINC Agent Support
Thread: Cache-sharing / Work-unit pooling server? |
| No member browsing this thread |
|
Thread Status: Active Total posts in this thread: 19
|
|
| Author |
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
Much has been said in past on these and other forums about an internet connected host and 1 or more devices that are not [not allowed]. The only working solution I know is the "sneakernet" / thumbdrive method, where each non-internet connected host has it's own BOINC instance. By starting the different instances [after copying back] on the internet connected host you could get it done. Lots of effort, lots of room for fatal error [to the work that was downloaded/processed]. I've done it during the x-mas holidays for 2 weeks, but that was copying back and forth 1 client. Multiple, and it becomes seriously involved. Maybe a member who's doing it for multiple devices can lay it out for you what the fail-free steps are.
--//-- |
||
|
|
astrolabe.
Senior Cruncher Joined: May 9, 2011 Post Count: 496 Status: Offline |
The problem is not any different from someone having a computer that wants to view a web page. So while you can dump the HTML files to a thumb and sneaker-net it to a different system, the point remains the same.
Both WCG and a web browser are Internet-enabled applications. They need access to the Internet. I would never want to support someone trying to display web pages on a computer that will never have Internet access.  |
||
|
|
mikey
Veteran Cruncher Joined: May 10, 2009 Post Count: 821 Status: Offline Project Badges: 
|
I have similar issue. I personally use my laptop when I'm at home/office. My office has 6 servers 16-cores always up day and night, and they do have their own hard drives. So it's simpler than in vlankhaar's Yes we use those servers during work hours, and they just idle during the night. I surely can put BOINC on all of them in minutes using LAN since they're all connected through LAN. The only problem is that all of them are not connected to the internet. So they cannot fetch their jobs. I imagine that my computer will be the WU pool, and every 4PM, all WUs will synchronize to the pool, as soon as I get home, I'll just have to upload all finished WU. That doesn't violate anything does it? The WU I upload will be marked as valid because the WU was downloaded by the same host (my computer). Do you think a lot of people also have this kind of problem? Boinc is DESIGNED to allow ONE COMPUTER to download, crunch and then upload the EXACT SAME WORKUNIT. If one pc downloads a workunit and a DIFFERENT pc then uploads it no credits will be granted! There ARE ways around this, but Boinc is deigned for each installation to be a stand alone one. You CAN also set up Boinc to ONLY allow network communications during certain times, maybe that is a better way to do your installations? Install Boinc on each pc and then limit the connect times to the after work hours ONLY, your network folks may even limit the sites it can connect too making them happier.   |
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
Déjà Vu [repost in altered wording]?
(BOINC is not deigned, but at times does act with total disregard of the users wishes, or expectations ;). --//-- |
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
Still, seeing these cores idling every night disturbs me a lot.
Guess I can try to develop some script to copy WU from the host and merge them back to the host. I got this feeling that it can be done without copying the entire BOINC directory  |
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
E.g. BOINC maintains connect counting and inventory checking with the servers, per host... there's that pivotal client_state.xml file you'll have to convince as being 'whole' and error free. BOINC writes that from memory to disk... only at startup from disk to memory, so at the very least, the internet hosting client must be set off-line, and stopped... files/results copied back / forth, slots and all, which of course cant overlap... a major undertaking to fool the certified [hard to bribe] auditor in the client.
[We'll be at your feet, washing and ointing them for you, when succeeding and contributing it back to the more than few who want that fool proof sneakernet setup]. --//-- |
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
I have similar issue. I personally use my laptop when I'm at home/office. My office has 6 servers 16-cores always up day and night, and they do have their own hard drives. So it's simpler than in vlankhaar's Yes we use those servers during work hours, and they just idle during the night. I surely can put BOINC on all of them in minutes using LAN since they're all connected through LAN. The only problem is that all of them are not connected to the internet. So they cannot fetch their jobs. I imagine that my computer will be the WU pool, and every 4PM, all WUs will synchronize to the pool, as soon as I get home, I'll just have to upload all finished WU. That doesn't violate anything does it? The WU I upload will be marked as valid because the WU was downloaded by the same host (my computer). Do you think a lot of people also have this kind of problem? Boinc is DESIGNED to allow ONE COMPUTER to download, crunch and then upload the EXACT SAME WORKUNIT. If one pc downloads a workunit and a DIFFERENT pc then uploads it no credits will be granted! ----- I'm very aware of this (underlined), thanks for refreshing me. There ARE ways around this, but Boinc is deigned for each installation to be a stand alone one. You CAN also set up Boinc to ONLY allow network communications during certain times, maybe that is a better way to do your installations? Install Boinc on each pc and then limit the connect times to the after work hours ONLY, your network folks may even limit the sites it can connect too making them happier. ----- each pc? they're connected through LAN but no internet access remember? After work hours, I'd synchronize all finished WUs from all disconnected PCs to the pool thgrough LAN. I go home, I use the pool PC to upload the finished WU. See underlined (again). |
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
E.g. BOINC maintains connect counting and inventory checking with the servers, per host... there's that pivotal client_state.xml file you'll have to convince as being 'whole' and error free. ----- Yes, the client_state.xml is like the heart of BOINC. BOINC writes that from memory to disk... only at startup from disk to memory, ----- Not only at startup. it is updated based on your action to the manager. i.e. suspending a task, resuming a task so at the very least, the internet hosting client must be set off-line, and stopped... files/results copied back / forth, slots and all, which of course cant overlap... a major undertaking to fool the certified [hard to bribe] auditor in the client. ----- Yes, before synchronization starts, all BOINC instances (all PCs including the pool) must be set off. Slots? AFAIK, slots are only used by running/active tasks so I will not need to synch the slots. Only the unstarted tasks and the finished tasks will be synchronized. [We'll be at your feet, washing and ointing them for you, when succeeding and contributing it back to the more than few who want that fool proof sneakernet setup]. ----- I really can't wait for that. I mean the succeeding and contributing more to WCG part --//-- |
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
E.g. BOINC maintains connect counting and inventory checking with the servers, per host... there's that pivotal client_state.xml file you'll have to convince as being 'whole' and error free. ----- Yes, the client_state.xml is like the heart of BOINC. BOINC writes that from memory to disk... only at startup from disk to memory, ----- Not only at startup. it is updated based on your action to the manager. i.e. suspending a task, resuming a task so at the very least, the internet hosting client must be set off-line, and stopped... files/results copied back / forth, slots and all, which of course cant overlap... a major undertaking to fool the certified [hard to bribe] auditor in the client. ----- Yes, before synchronization starts, all BOINC instances (all PCs including the pool) must be set off. Slots? AFAIK, slots are only used by running/active tasks so I will not need to synch the slots. Only the unstarted tasks and the finished tasks will be synchronized. [We'll be at your feet, washing and ointing them for you, when succeeding and contributing it back to the more than few who want that fool proof sneakernet setup]. ----- I really can't wait for that. I mean the succeeding and contributing more to WCG part --//-- There's a fine nuance in the highlighted line that I'll qualify: ... ALWAYS from memory to disk EXCEPT at start up [or when something corrupting happens, when it pulls the client_state_prev.xml in, probably also only at start-up via a rename routine] On the slots you're right: E.g. my 8 threaded host runs offline till 10AM, it has ATM six completed tasks with files held in the transfer view. There are only 12 slots showing this moment slots\0 to slots\11 i.e. some have been recycled for use by new jobs. Good luck --//-- [Edit 1 times, last edit by Former Member at May 27, 2012 6:03:18 AM] |
||
|
|
|