Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 9
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 2970 times and has 8 replies Next Thread
wujj123456
Cruncher
Joined: Jun 9, 2010
Post Count: 40
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
How to limit the number of CEP2 tasks?

I can have 8 threads running at the same time, but due to the limited amount of RAM, tasks restart very frequently if I have 3 or more CEP2 tasks running. CEP2's checkpoint interval is 1-2 hours, and thus I'm making almost no progress on CEP2 if such restart occurs too ofen.
In addition, when CEP2 restarts, the previous one failed to exit cleanly sometimes. That process can keep running even if I quit boinc.

Maybe it's just me and CEP2 runs on my other dual core machines well. I tried reseting the project, but no help.

Does anyone know how to limit the number of CEP2 tasks I can get/run? Otherwise I have to disable CEP2 projects in profile cause I don't want to monitor boinc every hour.
[Aug 13, 2010 4:14:03 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
Re: How to limit the number of CEP2 tasks?

Yes, select a science mix with for instance HCMD2 and HFCC. Been running that combo on my quad now for a while, and temporarily changed that to HCMD2/DDDT2/CEP2, to get some of that intermittent science work (DDDT2). The more WCG sciences you pick the better chance that CEP2 will not run on too many cores concurrently.
----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
[Aug 13, 2010 4:24:07 PM]   Link   Report threatening or abusive post: please login first  Go to top 
wujj123456
Cruncher
Joined: Jun 9, 2010
Post Count: 40
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: How to limit the number of CEP2 tasks?

Thanks for the suggestion. I actually have all projects selected, but half of the tasks I'm getting are CEP2. This behavior is consistent across my other two linux hosts. I guess since CEP2 is linux only, maybe it has higher priority when issuing tasks to linux hosts.
[Aug 13, 2010 9:00:07 PM]   Link   Report threatening or abusive post: please login first  Go to top 
anhhai
Veteran Cruncher
Joined: Mar 22, 2005
Post Count: 839
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: How to limit the number of CEP2 tasks?

another option (that would require more work) is to create a buffer for the items. Once a day or so, just go in and create a list of what your computer will be working on. Set it so you will get CEP2 and make it so your work buffer setting is just a little bit more then what you currently have and hit update. Then set it to get HCC (or whatever else) and change your work buffer so you get 2 or 3 of them. Then set it to get HCMD2 and change your work buffer to get 2 or 3 of them. Then repeat process until you have enough for 1 day's worth of work. Then set your work buffer to something small.
----------------------------------------

[Aug 13, 2010 9:11:19 PM]   Link   Report threatening or abusive post: please login first  Go to top 
sk..
Master Cruncher
http://s17.rimg.info/ccb5d62bd3e856cc0d1df9b0ee2f7f6a.gif
Joined: Mar 22, 2007
Post Count: 2324
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: How to limit the number of CEP2 tasks?

Be careful not to create a very large buffer! The bigger the buffer the more tasks can be partially completed and sitting in memory waiting to run, or fail.
Might also help to set "Switch Between Applications" to a larger value (Boinc Manager, Advanced Preferences, Processor Usage).
By default you could have CEP2 unselected, and then manually pick up a few at a time (moving the system between two profiles). So if you only picked up 4, you would never have 8 to run.
----------------------------------------
[Edit 1 times, last edit by skgiven at Aug 13, 2010 11:08:05 PM]
[Aug 13, 2010 11:03:30 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
Re: How to limit the number of CEP2 tasks?

Thanks for the suggestion. I actually have all projects selected, but half of the tasks I'm getting are CEP2. This behavior is consistent across my other two linux hosts. I guess since CEP2 is linux only, maybe it has higher priority when issuing tasks to linux hosts.

wujj123456,

Don't think it's weight is set to normal, probably even lower [general work assignment is not platform specific, only the wingman are]], but as you surmise the supply only being picked up by opt-in Linux clients, there will be a relative higher offering in the mix. For my quad 2/3 is okay, and when I see 4 running I just do the 'suspend' on any Ready to Starts below that of CEP2 and then suspend a CEP2 running task(s) to force some other science to move in. When the device is not used it's not detrimental, just not optimal. Getting enough of a good mix to not having to manage the device profile constantly, just the occasional stop/start intervention remotely through BOINCTasks.
----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
[Aug 14, 2010 7:14:39 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: How to limit the number of CEP2 tasks?

[...snip] So if you only picked up 4, you would never have 8 to run.


Seems like I have noticed tasks before where once the single download finished it unpacked into a job for each core/thread.

But maybe that was only for some beta task. Like that one where the initial application (packed) was over 100MB, but then the WUs themselves were very small compared to the application.
[Aug 14, 2010 1:27:03 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
Re: How to limit the number of CEP2 tasks?

That was the last Beta (work name c4cw). HPF2 has the same 'skill' as had RICE. If sequential work requests are made and the nearest targets/folds have not been handed yet, it's a matter of flipping a switch from a short db file on your computer that comes with a list i.e. you wont see a download, but you see a line like "2 task obtained for X seconds" (if that debug log flag is on)

example:

962 World Community Grid 14-08-2010 15:13:08 Scheduler request completed: got 2 new tasks
963 World Community Grid 14-08-2010 15:13:08 [sched_op_debug] Server version 601
964 World Community Grid 14-08-2010 15:13:08 Project requested delay of 11 seconds
965 World Community Grid 14-08-2010 15:13:08 [sched_op_debug] estimated total CPU job duration: 31106 seconds.
----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
[Aug 14, 2010 1:42:01 PM]   Link   Report threatening or abusive post: please login first  Go to top 
wujj123456
Cruncher
Joined: Jun 9, 2010
Post Count: 40
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: How to limit the number of CEP2 tasks?

Thank you for all your reply.

The resume/suspend method just enlightened me! I can simply write up a script utilizing the power of boinccmd to automatically monitor/suspend/restart CEP2 tasks!
[Aug 15, 2010 1:28:32 AM]   Link   Report threatening or abusive post: please login first  Go to top 
[ Jump to Last Post ]
Post new Thread