Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 17
Posts: 17   Pages: 2   [ 1 2 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 4757 times and has 16 replies Next Thread
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Time variability

It seems to me that variability in MCM work is increasing and the long ones are getting much longer.
e.g.
MCM1_ 0002612_ 9082_ 1-- 728 Valid 3/1/14 17:35:55 3/3/14 17:34:39 33.67 397.7 / 367.4
MCM1_ 0002612_ 9082_ 0-- 728 Valid 3/1/14 17:35:15 3/4/14 03:22:15 36.21 337.0 / 367.4

Today's 6.32 hours per result vs long-term average of 5.75 hours per result shows a significant, though not huge, increase. However, 36-hour jobs can become problematic for some users.
[Mar 4, 2014 3:37:55 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Sgt.Joe
Ace Cruncher
USA
Joined: Jul 4, 2006
Post Count: 7850
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Time variability

I too have seen some pretty long ones such as the one below.
MCM1_ 0002613_ 1916_ 0-- HComputer Valid 3/1/14 18:34:37 3/4/14 03:24:42 28.05 / 28.05 321.0 / 298.0
However, I seem to recall a post by Uplinger which said something to the effect that these are hard to size properly. I do know the overall trend has been gradually increasing in size, but on average may be leveling off.
By the way, on what kind of OS and hardware were your units run ? Mine was on Win 7 Ultimate AMD 9150e at 1.8ghz. 28 hours is an exceptionally long unit for me. I think you are correct that units as long as yours may pose a problem for some crunchers so they at least need to be aware that some units may be quite lengthy. They do checkpoint regularly, so if their cache is not too big, even the slow machines should be able to handle bigger units. However, if their cache is sized for an average of 6 to 7 hours per WU and some big ones creep in, it could cause a problem and send a machine into high priority crunching (panic mode).
Cheers
----------------------------------------
Sgt. Joe
*Minnesota Crunchers*
[Mar 4, 2014 3:51:37 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Time variability

By the way, on what kind of OS and hardware were your units run ?

The one above is from a Celeron D 336 2.8GHz. Old, but getting almost as many points per hour credit as yours.
[Mar 4, 2014 4:08:05 PM]   Link   Report threatening or abusive post: please login first  Go to top 
keithhenry
Ace Cruncher
Senile old farts of the world ....uh.....uh..... nevermind
Joined: Nov 18, 2004
Post Count: 18667
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Time variability

This may or may not be related but watch out for large differences between elapsed time and CPU time. I've had two occasions now where MCM1 WUs on a WIN XP C2D box had elapsed times almost double that of the CPU time. I've found an OS reboot seems to fix that. Not sure what the source of the problem is.
----------------------------------------
Join/Website/IMODB



[Mar 4, 2014 4:36:31 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Sgt.Joe
Ace Cruncher
USA
Joined: Jul 4, 2006
Post Count: 7850
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Time variability

By the way, on what kind of OS and hardware were your units run ?

The one above is from a Celeron D 336 2.8GHz. Old, but getting almost as many points per hour credit as yours.

The AMD 9150e is no spring chicken either, vintage about 2008 or 2009 I believe. I believe the Intel cpu's do better than the AMD units of this generation on the crunching. According to the passmark rankings mine should do much better than yours, but it does just barely better. Since I use this computer for a lot of other things it does OK, but not great. Bravo to you for getting good use out of your machines, hopefully you do not see too many 30+ hour units.
Cheers
----------------------------------------
Sgt. Joe
*Minnesota Crunchers*
[Mar 4, 2014 6:22:41 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Time variability

In my experience, those huge WUs may cause the points/WU to decrease.

If my understanding is correct, the BOINC initially runs bench mark to masure the MIPS/FLOPS to calicurate the elapsed time and points/MIPS. After the initial set, the MIPS/FLOPS are adjusted by actual excution time and estimated excution time. If the actual CPU time is far grater than the estimated time, MIPS and FLOPS initially set may decreased and clamed credit by BOINC drastically decreased.

I have seen this tipe of credit slow down many times. Of couse, this is not only facter to vary the credit, you should watch carfully what is happening.

Kiyo.
----------------------------------------
[Edit 1 times, last edit by Former Member at Mar 6, 2014 11:04:59 AM]
[Mar 6, 2014 11:03:06 AM]   Link   Report threatening or abusive post: please login first  Go to top 
jonnieb-uk
Ace Cruncher
England
Joined: Nov 30, 2011
Post Count: 6105
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Time variability

This may or may not be related but watch out for large differences between elapsed time and CPU time. I've had two occasions now where MCM1 WUs on a WIN XP C2D box had elapsed times almost double that of the CPU time. I've found an OS reboot seems to fix that. Not sure what the source of the problem is.

I think you may be onto something!

Running Vista on an old Acer Laptop AMD Turion 2.0GHz only being used to crunch.

The last couple of MCM1 WUs had significant divergence between CPU & Elapsed times approaching double. Switched to FAAH and after 4 hours elapsed only 2 mins CPU & no checkpoint. Rebooted. The FAAH WU restarted at zero and it now appears to be running normally.

To my non-technical mind seems as though MCM clogged the processor which took a reboot (LAIM off) to clear. Though it could just be a quirk of an old and tired machine.
----------------------------------------

To Join follow this link: Join the UK Team All Welcome! UK Team thread
[Mar 7, 2014 3:11:00 PM]   Link   Report threatening or abusive post: please login first  Go to top 
keithhenry
Ace Cruncher
Senile old farts of the world ....uh.....uh..... nevermind
Joined: Nov 18, 2004
Post Count: 18667
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Time variability

This may or may not be related but watch out for large differences between elapsed time and CPU time. I've had two occasions now where MCM1 WUs on a WIN XP C2D box had elapsed times almost double that of the CPU time. I've found an OS reboot seems to fix that. Not sure what the source of the problem is.

I think you may be onto something!

Running Vista on an old Acer Laptop AMD Turion 2.0GHz only being used to crunch.

The last couple of MCM1 WUs had significant divergence between CPU & Elapsed times approaching double. Switched to FAAH and after 4 hours elapsed only 2 mins CPU & no checkpoint. Rebooted. The FAAH WU restarted at zero and it now appears to be running normally.

To my non-technical mind seems as though MCM clogged the processor which took a reboot (LAIM off) to clear. Though it could just be a quirk of an old and tired machine.


Reading your post must have triggered something. I have to wonder if there is a rare memory leak in the MCM1 science. That would result in increased page swapping bumping up IO big time. Since IO is so slow, you end up with lots more elapsed time for the same amount of CPU time. As memory management usually is done with OS level calls, restarting BOINC doesn't help. The OS reboot frees up the orphaned memory. Admittingly I'm speculating here. I didn't sit and watch the IO light blink steadily on my machine when this happened.
----------------------------------------
Join/Website/IMODB



[Mar 7, 2014 4:01:45 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Time variability

I have to wonder if there is a rare memory leak in the MCM1 science.
Does not appear to be the case. I see memory use of a MCM1 process that's been running for 30 hours being about 10% higher than one that's been running for 5 hours.
As memory management usually is done with OS level calls, restarting BOINC doesn't help. The OS reboot frees up the orphaned memory.
I don't know of any modern operating system that doesn't free up memory when a process terminates. Boinc itself could potentially leak memory, but the MCM1 process is separate from run to run. Anyhow, I'm running linux.

Latest biggie: Around 30 hours and still not done (around 3 hours to go) on a Core 2 Duo E6300.
[Mar 9, 2014 7:43:19 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Sgt.Joe
Ace Cruncher
USA
Joined: Jul 4, 2006
Post Count: 7850
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Time variability

I have to wonder if there is a rare memory leak in the MCM1 science.
Does not appear to be the case. I see memory use of a MCM1 process that's been running for 30 hours being about 10% higher than one that's been running for 5 hours.
As memory management usually is done with OS level calls, restarting BOINC doesn't help. The OS reboot frees up the orphaned memory.
I don't know of any modern operating system that doesn't free up memory when a process terminates. Boinc itself could potentially leak memory, but the MCM1 process is separate from run to run. Anyhow, I'm running linux.

Latest biggie: Around 30 hours and still not done (around 3 hours to go) on a Core 2 Duo E6300.

I run 3 Core 2 Duo E6610's all running MCM1 on Linux. They have completed about 2300 WU's and the longest one for them has been 22.55 hours. The shortest one has been 2.03 hours. The average time for the units is 6.04 hours. (These figures are courtesy of Piroque's WCGDAWS application.) Maybe it is just the luck of the draw that you are getting the bigger units, but at least they are completing successfully. I see no evidence of memory leaks as these systems have been running months without a reboot.
Cheers
----------------------------------------
Sgt. Joe
*Minnesota Crunchers*
[Mar 9, 2014 12:04:45 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 17   Pages: 2   [ 1 2 | Next Page ]
[ Jump to Last Post ]
Post new Thread