Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 27
Posts: 27   Pages: 3   [ Previous Page | 1 2 3 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 12559 times and has 26 replies Next Thread
astroWX
Advanced Cruncher
USA
Joined: Sep 1, 2007
Post Count: 56
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Beta: What does one expect of you?

I have to say, good post Seke. The purpose of Beta Testing is to find and work out bugs of ANY sort on the pieces etc being sent. For the point whoors who just want to grab the beta points for their next badge but not give one letter of input... thanks but no thanks.

Beta tests have a purpose BESIDES letting you brag about another badge in the forums, they are to debug apps prior to sending them to the mass public.

For those who don't want to use their machine as a test platform, or, more specifically, those who want to gobble up all the beta tasks they can, but never give any input on how they ran.... please go elsewhere.

There.... I said it, banish me to AOL.

Aaron

Points well taken, Aaron. At CPDN (my primary endeavor) there was a period of open registration on the Beta site, after a long time with an experienced core group. We continue to pay the price for that decision, in several ways, most of which you enumerate.

It would, in my opinion, be helpful if WCG's Beta award was relegated to the dust bin. (In short, I loathe "credits.")
[May 14, 2012 12:15:40 AM]   Link   Report threatening or abusive post: please login first  Go to top 
johncmacalister2010@gmail.com
Veteran Cruncher
Canada
Joined: Nov 16, 2010
Post Count: 799
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Beta: What does one expect of you?

I have to say, good post Seke. The purpose of Beta Testing is to find and work out bugs of ANY sort on the pieces etc being sent. For the point whoors who just want to grab the beta points for their next badge but not give one letter of input... thanks but no thanks.

Beta tests have a purpose BESIDES letting you brag about another badge in the forums, they are to debug apps prior to sending them to the mass public.

For those who don't want to use their machine as a test platform, or, more specifically, those who want to gobble up all the beta tasks they can, but never give any input on how they ran.... please go elsewhere.

There.... I said it, banish me to AOL.

Aaron


Hi, Aaron:

If I had received any Beta tasks other than two early received in the process on which I commented, I might be able to make some remarks...

smile
----------------------------------------


crunching, crunching, crunching.

AMD Ryzen 5 2600 6-core Processor with Windows 11 64 Pro.

AMD Ryzen 7 3700X 8-Core Processor with Windows 11 64 Pro (part time)


smile
[May 14, 2012 3:58:34 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Beta: What does one expect of you?

John, don't feel bad, many times I find out that there is a beta after I get my daily mail saying one went out, but see none hit my queue. It happens and I just wait my turn to get one. Sometimes they send out only a few hundred, other times they send out thousands.

Other times the beta may have come and gone and I didn't even see it hit, but ill try to post a note by looking through the log, saying it ran fine or errored out, though I really hate not seeing them run because it might 'appear' to run fine in the end but if it caused lags, freezing, etc, that is stuff they like to know.

Aaron
[May 14, 2012 10:14:56 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Beta: What does one expect of you?

1) Resuming after suspend, with LAIM (leave application in memory when suspended) on and off, without hanging or crashing.
2) Restarting the system to test if results will resume in proper, as per 1).
..a) do not return to the beginning (zero progress, when for instance the task was at 40%)
..b) start running without needing manual intervention, beyond what the client would schedule in order when there are other tasks in "waiting to run" state.
3) Progress is recorded in the client, and sticks after any of the above.
... (Does progress oscillate, retreating, progressing, retreating...)
4) If checkpoints are recorded at intervals set in the client (the "no more than" frequency rule)
5) If tasks run much longer, never ending.
6) If [average] CPU time use is per client settings (e.g. 100% orof spare cycles).
7) If the tasks in anyway impair use of computer (brand new "anonymous" betas in particular).
8) If the graphics window comes up (Beta does not have the full production graphics though)
9) If progress shows in 8)
10) If graphics window closes correctly
11) Any very extraneous RAM/VM/Swap file memory use, not warned for by the technicians
12) Any extraneous disk IO, not warned for by the technicians
.... (operators of e.g. Process Explorer look for Large Paging Fault delta's)
13) Any errors (not warnings) logged in the event/message log.
14) Any Result log errors, not the benign warnings that show in every task result output.
.... (close up watchers can monitor the stderr.txt file in the task slots\xx for up to the minute detail)
15) Check if the screensaver operates correctly (flicker, loads/unloads on user input etc))
16) What was the CPU load on GPU Beta designated tasks?
17) Was test causing any particular temperature increases above normal crunching?

--//--
[May 17, 2012 6:50:33 AM]   Link   Report threatening or abusive post: please login first  Go to top 
astrolabe.
Senior Cruncher
Joined: May 9, 2011
Post Count: 496
Status: Offline
Reply to this Post  Reply with Quote 
Re: Beta: What does one expect of you?

For those who don't want to use their machine as a test platform, or, more specifically, those who want to gobble up all the beta tasks they can, but never give any input on how they ran....
Are crunchers supposed to post the output files on the forums for every Beta WU? If the Techs want to analyze the output, isn't it more efficient for them to have the system upload the pertinent files to the server? Maybe I missed it, but I haven't seen anything say we are supposed to post output files. I believe WCG is better designed than that.

Is it really helpful to post: "got 17 Beta WU and they all validated"? Not really. Do you think the Techs will have no idea how to fix an Invalid/Error Beta WU unless you post the output? I hope not. My Results files are my feedback, valid or otherwise.
[May 17, 2012 12:37:48 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Beta: What does one expect of you?

Back to top, quoting techs: "Please let us know if you encounter *any* strange behaviors with this Beta within the Beta Support Forum." Common sense prevails. If someone feels to post 17 completed, all valid, no particulars... fine, scroll on. Without doubt, the techs have all output files and often set supplemental log flags so they can study issues in more detail you wont see in the Result logs we see in production, for when a beta tester does report things that are not being logged.... such as running hotter, jitter, pausing, on and on.

18)...

--//--
[May 17, 2012 12:53:36 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Beta: What does one expect of you?

1) Resuming after suspend, with LAIM (leave application in memory when suspended) on and off, without hanging or crashing.
2) Restarting the system to test if results will resume in proper, as per 1).
..a) do not return to the beginning (zero progress, when for instance the task was at 40%)
..b) start running without needing manual intervention, beyond what the client would schedule in order when there are other tasks in "waiting to run" state.
3) Progress is recorded in the client, and sticks after any of the above.
... (Does progress oscillate, retreating, progressing, retreating...)
4) If checkpoints are recorded at intervals set in the client (the "no more than" frequency rule)
5) If tasks run much longer, never ending.
6) If [average] CPU time use is per client settings (e.g. 100% orof spare cycles).
7) If the tasks in anyway impair use of computer (brand new "anonymous" betas in particular).
8) If the graphics window comes up (Beta does not have the full production graphics though)
9) If progress shows in 8)
10) If graphics window closes correctly
11) Any very extraneous RAM/VM/Swap file memory use, not warned for by the technicians
12) Any extraneous disk IO, not warned for by the technicians
.... (operators of e.g. Process Explorer look for Large Paging Fault delta's)
13) Any errors (not warnings) logged in the event/message log.
14) Any Result log errors, not the benign warnings that show in every task result output.
.... (close up watchers can monitor the stderr.txt file in the task slots\xx for up to the minute detail)
15) Check if the screensaver operates correctly (flicker, loads/unloads on user input etc))
16) What was the CPU load on GPU Beta designated tasks?
17) Was test causing any particular temperature increases above normal crunching?

18) If security software such Antivirus / Windows Defender etc are giving warnings / cause task failure.

--//--
[May 25, 2012 9:59:35 AM]   Link   Report threatening or abusive post: please login first  Go to top 
pramo
Veteran Cruncher
USA
Joined: Dec 14, 2005
Post Count: 703
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Beta: What does one expect of you?

#42) Not do this?
angry d oh sick

BETA_ SN2S_ smp005470_ 0000007_ 0242_ 3-- - In Progress 5/31/12 01:55:37 6/1/12 16:19:37 0.00 0.0 / 0.0
BETA_ SN2S_ smp005470_ 0000007_ 0242_ 2-- - No Reply 5/29/12 00:27:18 5/31/12 01:40:00 0.00 0.0 / 0.0
BETA_ SN2S_ smp005470_ 0000007_ 0242_ 0-- 620 Pending Validation 5/25/12 00:27:08 5/25/12 07:08:13 6.08 124.1 / 0.0 <Moi
BETA_ SN2S_ smp005470_ 0000007_ 0242_ 1-- - No Reply 5/25/12 00:27:08 5/29/12 00:27:08 0.00 0.0 / 0.0

Not so constructive regarding What To Test but as for the thread title....well....
----------------------------------------

[May 31, 2012 12:17:26 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Beta: What does one expect of you?

Many of the last Betas were on Fridays or just before holidays. Office hours crunchers shut down their computers...

edit: okay, my thesis has just been proven wrong blushing
----------------------------------------
[Edit 1 times, last edit by Former Member at May 31, 2012 5:35:24 PM]
[May 31, 2012 2:41:47 PM]   Link   Report threatening or abusive post: please login first  Go to top 
pramo
Veteran Cruncher
USA
Joined: Dec 14, 2005
Post Count: 703
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
shock Re: Beta: What does one expect of you?

Many of the last Betas were on Fridays or just before holidays. Office hours crunchers shut down their computers...

edit: okay, my thesis has just been proven wrong blushing


I was looking at that one and you were right, wink then probabaly the same as you, went shock at the new threads that popped out laughing
----------------------------------------

[May 31, 2012 8:05:13 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 27   Pages: 3   [ Previous Page | 1 2 3 | Next Page ]
[ Jump to Last Post ]
Post new Thread