| Index | Recent Threads | Unanswered Threads | Who's Active | Guidelines | Search |
| World Community Grid Forums
|
| No member browsing this thread |
|
Thread Status: Active Total posts in this thread: 18
|
|
| Author |
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
Is there a way to cleanup the clutter in the www.worldcommunitygrid.com directory without having to run the WUs dry and doing a reset of the project? There are many beta files from old beta tests dating back to 2010 and files related to dddt2 that hasn't run in many years. Some of these files are MBs in size. Examples are:
beta16.baygame.db 11,158,528 from 2012 beta11_qcaux_6.40.zip 69,377,144 from 2011 image files for cfsw, dddt2, dsfl, hpf2 etc I guess what I'm asking for is for the project to cleanup after itself. |
||
|
|
twilyth
Master Cruncher US Joined: Mar 30, 2007 Post Count: 2130 Status: Offline Project Badges:
|
Maybe it's an OS issue. I checked the data directory for WCG and the only files that aren't current seem to be applications and graphics. This machine is running W7 from several years ago.
----------------------------------------![]() ![]() |
||
|
|
Crystal Pellet
Veteran Cruncher Joined: May 21, 2008 Post Count: 1403 Status: Offline Project Badges:
|
Is there a way to cleanup the clutter in the www.worldcommunitygrid.com directory without having to run the WUs dry and doing a reset of the project? I don't think so. To speed up: Set WCG to No New Tasks and abort all not yet started tasks. After the last WCG-task returned and acknowledged, reset the project. If there are still files in the WCG directory, remove them yourself and ask new work. |
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
Newer clients are supposed to do a better 'clean-up' job. When there is no more work of an application on the client, it removes the 'sticky' stuff such as the app [and then when intermittent it re-fetches everything if there's work again... most irritating if pertaining to CEP2, so a fix had to be put in place for that not to happen, to include for dddt2].
There's a persistency flag that's set and that needs flipping, so yes, WCG has to keep that set current [uplinger knows all about the subject]. When a new version of app arrives, the old is removed automatically [it is], which with beta is kind of like never to happen. Deleting is pointless unless you edit the control files. Do project detach/add. The client will otherwise try refetching them again. It would though be wondrous if cfsw, dddt2, dsfl, hpf2 is still on the server [maybe they are to not get clients to constantly ask to re-supply?]. Stopped bothering me. Allocated a 20GB partition to BOINC. The whole of 1.34 is used. |
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
BTW, least runtime loss causing procedure is to switch to short-runtime projects, then just do the detach/add cycle. Whether you have idle threads or abort, the median lost runtime is practically the same on 4-8-16 core devices.
|
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
Thanks for all the replies. It seems to be a function of the length of time the client has been running. Admittedly, it isn't a lot of space (1.2GB currently) but I see posts of people defragging disks which means they are constantly moving this stuff. This client used to run on Windows XP for many years, was stopped, data structure was copied to flash drive, XP upgraded to Win7, Boinc re-installed and data structure copied back. So, this client is about 8 years old. What this tells me is the project doesn't cleanup as sciences end and their "old" exe, image, beta files all remain. I looked at a newer installed client an those older files don't exist so they are currently not being sent by the server. I guess those of us with older, active (run lots of sciences) clients will accumulate this plaque until we clean it out. Since sciences don't come and go all that often, it isn't so much a problem with the production stuff but it's the beta stuff that is disconcerting to me. Every time a new beta is run, stuff will accumulate. Probably wouldn't hurt to reset this client anyway.
|
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
Looking a little further into this, I that these "old" files have the "sticky" tag associated with them in the client_state.xml file. That's probably why they haven't been deleted. In addition, if one looks at the sched_request_....xml file, you will see all this old file information being sent back and forth to the server. Seems like this would have some impact on the server and network bandwidth. My particular sched_request xml file is 56KB currently and it probably grows with each subsequent beta that is run. I'm going to test removing the sticky tag in the client_state file to see if the file gets deleted with next scheduler request
|
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
Removing the "sticky" tag results in the files being deleted at client startup. No scheduler request involved. The "exe" files for the old projects don't have the "sticky" tag so those will stay regardless. Anyone know what the values mean for the "status" tag?
|
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
As I wrote in one of the replies at start "Deleting is pointless unless you edit the control files. Do project detach/add.". The latter avoids all this editing and damaging something, which causes the client to fetch the client_state_prev.xml to replace the damaged file.
In addition to completely cleaning out the project folder with the project off/on cycle, it also initiates a signal to mark all the tasks known to be on the device to get a 'detach' and reissue instruction. Not adding the client with the same ID causes those tasks to sit around until they expire. [Most everything BOINC does is 2 step]. Aborting and hitting update prior to such an action for any work on the device is being well behaved towards WCG. Heed thé, the app_config and app_info go too, i.e. make a copy before hand. |
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
I'm not deleting any files. The client is doing the deleting. I'm just editing the client_state.xml file (after making a copy of course) but to clean this mess up is a lot of editing. So far about 200 files have been deleted but underneath 1GB in size. I just remove the "sticky" tag and the client removes the rest of the XML that describes that file... I'm just experimenting while waiting for the final few WUs to complete. I just hate to think the only solution is to detach/add as that doesn't fix anything it only masks the real problem but I've been here long enough to know very few things really get fixed.....
|
||
|
|
|