Index | Recent Threads | Unanswered Threads | Who's Active | Guidelines | Search |
![]() |
World Community Grid Forums
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
No member browsing this thread |
Thread Status: Active Total posts in this thread: 49
|
![]() |
Author |
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
Not sure if anyone has been running with client throttle, old or new, but the >7.2.29 sub-second implementation is getting a workover [I've shied away from using it as my systems display-clock started running fast [not a joke]. The key is, if LIM [what we call LAIM], and RFM [remove from mmeory, do impact the app/task in same way, it may account e.g. for the by some observed elapsed to cpu time disparities. From the devs:
----------------------------------------
Suspended tasks can be either left in memory (LIM) or removed from memory (RFM). CPU throttling always uses LIM. Other types of suspension (e.g. user request) use LIM or RFM depending on user prefs, except that RFM is always used for GPU tasks. There was a bug: if tasks were suspended because of CPU throttling, and then the user suspended activity, GPU apps would remain LIM. They need to be RFM. edit: insert quote encapsulation. [Anyone knows how to quick indent text without resorting to the non long line wrapping [ code] BBCode? OK, simply use the 'list' code. [Edit 2 times, last edit by Former Member at Dec 13, 2013 10:12:04 PM] |
||
|
kateiacy
Veteran Cruncher USA Joined: Jan 23, 2010 Post Count: 1027 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
I managed to get several of the 728 WU suspended and restarted with LAIM turned off, and shut down one machine overnight. Eager to see whether all of these validate.
----------------------------------------![]() |
||
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
So far, all 727 and 728 Betas turned valid after memory unload.
All of the MCM1 application versions including Beta run somewhat hot, however, i had them only compared with non WCG apps (CPDN and Constellation). Probably a sign of efficient usage of processor features ;) Maybe something to keep in mind if you're intending to port to Android. |
||
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
For techs/admin.
Seeing ranges of 4KB to 1267KB in the transfer upload queue for these BETAs, only now looked hard at the System Requirement page where it says 3MB in the upload column. Maybe as for CEP2, a range is better to put there, to prevent concern. E.g. from 0.02MB - 3MB. |
||
|
yoro42
Ace Cruncher United States Joined: Feb 19, 2011 Post Count: 8979 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
Receive total of 46 WUs across 5 systems
----------------------------------------21 are currently running 25 are Valid or Pending Validation No issues/problems found running the following three tests on all 5 systems running Beta: -1- Reboot -2- Suspend & Resume WUs in groups and individually -3- Suspend & Resume WCG Project ![]() |
||
|
breathesgelatin
Advanced Cruncher Joined: Aug 5, 2006 Post Count: 117 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
Well, 7.28 doesn't seem to be solving the problem for me. I actually had at least one validate, but the rest seem to be either errors or invalids.
----------------------------------------Here's an example error: <core_client_version>7.2.33</core_client_version> <![CDATA[ <message> (unknown error) - exit code -529697949 (0xe06d7363) </message> <stderr_txt> Commandline = projects/www.worldcommunitygrid.org/wcgrid_beta17_7.28_windows_intelx86 -SettingsFile MCM1_0000216_1149.txt -DatabaseFile dataset-17_72_SDG_v1.txt Settings File DateOfDesign = 11/08/2013 Designer = PMCC_OCI WorkOrderID = 0000216_1149 DatasetID = 17_72_SDG_v1 NumberOfGenesInStartingSignature = 20 NumberOfGenesInSignatureMin = 10 NumberOfGenesInSignatureMax = 20 GroupVectorValues = {A}{B}{C}{D}{E}{F} ExplicitStartingGeneSignatures = A B D F StartingGeneSignatureAlgorithm = randomFixedLengthSearch SearchAlgorithmNumberToCreate = 1 SearchAlgorithmSequentialStartPosition = 5 RunPermutationAlgorithm = 1 PermutationGroups = A PermutationGroupsForReplacement = G PermutationAlgorithm = replaceFromRandomlyToRandomlyGreedy PermutationsNumIterations = 67911 OptimizationAlgorithmFrequency = 0 0 1 FBeta = 1.5 SimAnnealIMax = 20000 SimAnnealAlpha = 0.9996 NReps = 10 TrainFrac = 0.7 NFolds = 10 VMethod = LOO ModelType = SVM FitnessFn = 0 MinFitness = 0.61 SvmArgs = "-v 0 -c 0.1 -t 1 -d 2 -r 0" SvmLearnLimit = 500000 RSeed = 511149 [20:44:38] Initializing [20:44:45] Running [20:44:45] EvaluateFitnessOfStartingGeneSignatures 1 [20:44:45]: Computing pass 0 Commandline = projects/www.worldcommunitygrid.org/wcgrid_beta17_7.28_windows_intelx86 -SettingsFile MCM1_0000216_1149.txt -DatabaseFile dataset-17_72_SDG_v1.txt [22:45:50] Initializing Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x75EEC41F Engaging BOINC Windows Runtime Debugger... ******************** BOINC Windows Runtime Debugger Version 7.2.4 Dump Timestamp : 12/12/13 22:45:51 Install Directory : C:\Program Files (x86)\BOINC\ Data Directory : C:\ProgramData\BOINC Project Symstore : LoadLibraryA( C:\Program Files (x86)\BOINC\\dbghelp.dll ): GetLastError = 126 Loaded Library : dbghelp.dll LoadLibraryA( C:\Program Files (x86)\BOINC\\symsrv.dll ): GetLastError = 126 LoadLibraryA( symsrv.dll ): GetLastError = 126 LoadLibraryA( C:\Program Files (x86)\BOINC\\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( C:\Program Files (x86)\BOINC\\version.dll ): GetLastError = 126 Loaded Library : version.dll Debugger Engine : 4.0.5.0 Symbol Search Path: C:\ProgramData\BOINC\slots\3;C:\ProgramData\BOINC\projects\www.worldcommunitygrid.org ModLoad: 0000000000e30000 0000000000142000 C:\ProgramData\BOINC\projects\www.worldcommunitygrid.org\wcgrid_beta17_7.28_windows_intelx86 (-exported- Symbols Loaded) Linked PDB Filename : c:\projects\wcgridAustinWorkspace\scienceApps\MCM1\Release\wcgrid_mcm1_prod_32.pdb ModLoad: 0000000077130000 0000000000180000 C:\Windows\SysWOW64\ntdll.dll (6.1.7601.18247) (-exported- Symbols Loaded) Linked PDB Filename : wntdll.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7600.16385 ModLoad: 0000000075d30000 0000000000110000 C:\Windows\syswow64\kernel32.dll (6.1.7601.18229) (-exported- Symbols Loaded) Linked PDB Filename : wkernel32.pdb File Version : 6.1.7601.18015 (win7sp1_gdr.121129-1432) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.18015 ModLoad: 0000000075ee0000 0000000000047000 C:\Windows\syswow64\KERNELBASE.dll (6.1.7601.18229) (-exported- Symbols Loaded) Linked PDB Filename : wkernelbase.pdb File Version : 6.1.7601.18015 (win7sp1_gdr.121129-1432) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.18015 ModLoad: 0000000072480000 0000000000009000 C:\Windows\system32\VERSION.dll (6.1.7600.16385) (-exported- Symbols Loaded) Linked PDB Filename : version.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7600.16385 ModLoad: 0000000074db0000 00000000000ac000 C:\Windows\syswow64\msvcrt.dll (7.0.7601.17744) (-exported- Symbols Loaded) Linked PDB Filename : msvcrt.pdb File Version : 7.0.7601.17744 (win7sp1_gdr.111215-1535) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 7.0.7601.17744 ModLoad: 0000000075d20000 0000000000005000 C:\Windows\syswow64\PSAPI.DLL (6.1.7600.16385) (-exported- Symbols Loaded) Linked PDB Filename : psapi.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7600.16385 ModLoad: 0000000076240000 0000000000100000 C:\Windows\syswow64\USER32.dll (6.1.7601.17514) (-exported- Symbols Loaded) Linked PDB Filename : wuser32.pdb File Version : 6.1.7601.17514 (win7sp1_rtm.101119-1850) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.17514 ModLoad: 0000000076850000 0000000000090000 C:\Windows\syswow64\GDI32.dll (6.1.7601.18275) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32.pdb File Version : 6.1.7601.18275 (win7sp1_gdr.131002-1533) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.18275 ModLoad: 0000000077100000 000000000000a000 C:\Windows\syswow64\LPK.dll (6.1.7601.18177) (-exported- Symbols Loaded) Linked PDB Filename : wlpk.pdb File Version : 6.1.7601.18177 (win7sp1_gdr.130605-1534) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.18177 ModLoad: 0000000075e40000 000000000009d000 C:\Windows\syswow64\USP10.dll (1.626.7601.18009) (-exported- Symbols Loaded) Linked PDB Filename : usp10.pdb File Version : 1.0626.7601.18009 (win7sp1_gdr.121121-1431) Company Name : Microsoft Corporation Product Name : Microsoft(R) Uniscribe Unicode script processor Product Version : 1.0626.7601.18009 ModLoad: 00000000760d0000 00000000000a0000 C:\Windows\syswow64\ADVAPI32.dll (6.1.7601.18247) (-exported- Symbols Loaded) Linked PDB Filename : advapi32.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7600.16385 ModLoad: 0000000074e80000 0000000000019000 C:\Windows\SysWOW64\sechost.dll (6.1.7600.16385) (-exported- Symbols Loaded) Linked PDB Filename : sechost.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7600.16385 ModLoad: 0000000076340000 00000000000f0000 C:\Windows\syswow64\RPCRT4.dll (6.1.7601.18205) (-exported- Symbols Loaded) Linked PDB Filename : wrpcrt4.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7600.16385 ModLoad: 0000000074c90000 0000000000060000 C:\Windows\syswow64\SspiCli.dll (6.1.7601.18270) (-exported- Symbols Loaded) Linked PDB Filename : wsspicli.pdb File Version : 6.1.7601.18270 (win7sp1_gdr.130924-1532) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.18270 ModLoad: 0000000074c80000 000000000000c000 C:\Windows\syswow64\CRYPTBASE.dll (6.1.7600.16385) (-exported- Symbols Loaded) Linked PDB Filename : cryptbase.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7600.16385 ModLoad: 0000000074f10000 0000000000c4a000 C:\Windows\syswow64\SHELL32.dll (6.1.7601.18222) (-exported- Symbols Loaded) Linked PDB Filename : shell32.pdb File Version : 6.1.7601.17514 (win7sp1_rtm.101119-1850) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.17514 ModLoad: 0000000074d50000 0000000000057000 C:\Windows\syswow64\SHLWAPI.dll (6.1.7601.17514) (-exported- Symbols Loaded) Linked PDB Filename : shlwapi.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7600.16385 ModLoad: 0000000074eb0000 0000000000060000 C:\Windows\system32\IMM32.DLL (6.1.7601.17514) (-exported- Symbols Loaded) Linked PDB Filename : wimm32.pdb File Version : 6.1.7601.17514 (win7sp1_rtm.101119-1850) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.17514 ModLoad: 0000000076170000 00000000000cc000 C:\Windows\syswow64\MSCTF.dll (6.1.7600.16385) (-exported- Symbols Loaded) Linked PDB Filename : msctf.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7600.16385 ModLoad: 00000000723f0000 0000000000021000 C:\Windows\system32\ntmarta.dll (6.1.7600.16385) (-exported- Symbols Loaded) Linked PDB Filename : ntmarta.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7600.16385 ModLoad: 0000000074d00000 0000000000045000 C:\Windows\syswow64\WLDAP32.dll (6.1.7601.17514) (-exported- Symbols Loaded) Linked PDB Filename : wldap32.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7600.16385 ModLoad: 0000000074630000 00000000000eb000 C:\Windows\system32\dbghelp.dll (6.1.7601.17514) (-exported- Symbols Loaded) Linked PDB Filename : dbghelp.pdb File Version : 6.1.7601.17514 (win7sp1_rtm.101119-1850) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.17514 *** Dump of the Process Statistics: *** - I/O Operations Counters - Read: 0, Write: 0, Other 0 - I/O Transfers Counters - Read: 0, Write: 0, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 0, QuotaPeakPagedPoolUsage: 0 QuotaNonPagedPoolUsage: 0, QuotaPeakNonPagedPoolUsage: 0 - Virtual Memory Usage - VirtualSize: 0, PeakVirtualSize: 0 - Pagefile Usage - PagefileUsage: 0, PeakPagefileUsage: 0 - Working Set Size - WorkingSetSize: 0, PeakWorkingSetSize: 0, PageFaultCount: 0 *** Dump of thread ID 3364 (state: Initialized): *** - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x75EEC41F - Registers - eax=003ef064 ebx=000005ad ecx=00000003 edx=00000000 esi=006a8c80 edi=003f8858 eip=75eec41f esp=003ef064 ebp=003ef0b4 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000212 - Callstack - ChildEBP RetAddr Args to Child 003ef0b4 00eb3b0f e06d7363 00000001 00000003 003ef0e0 KERNELBASE!RaiseException+0x0 003ef0ec 00e61e34 003ef24c 00f1f65c 2469730c 0000000f wcgrid_beta17_7!DeleteMulticlassModel+0x0 006a8be8 375f3731 44535f32 31765f47 72615400 0000000c wcgrid_beta17_7!boost::archive::detail::iserializer<boost::archive::binary_iarchive,std::vector<bool,std::allocator<bool> > >::load_object_data+0x0 006a9478 006a8ed8 0000000a f0e0d0c0 7f41da54 8c000000 wcgrid_beta17_7!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '375f3731' 00a3d928 006a9478 ffff0000 00000001 00000002 0001003e wcgrid_beta17_7!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '006a8ed8' 00a3d92c ffff0000 00000001 00000002 0001003e 00000000 wcgrid_beta17_7!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '006a9478' 00a3d930 00000000 00000002 0001003e 00000000 00000001 wcgrid_beta17_7!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = 'ffff0000' *** Dump of thread ID 2092 (state: Initialized): *** - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Registers - eax=00ea5ed0 ebx=00000000 ecx=00000000 edx=00000000 esi=028dfe70 edi=00000000 eip=7714fd91 esp=028dfe2c ebp=028dfe94 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000246 - Callstack - ChildEBP RetAddr Args to Child 028dfe94 75ef4498 00000064 00000000 028dfeb0 00ea5ee4 ntdll!ZwDelayExecution+0x0 028dfea4 00ea5ee4 00000064 028dfebc 75d4336a 00000000 KERNELBASE!Sleep+0x0 028dfeb0 75d4336a 00000000 028dfefc 77169f72 00000000 wcgrid_beta17_7!DeleteMulticlassModel+0x0 028dfebc 77169f72 00000000 718b191d 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 028dfefc 77169f45 00ea5ed0 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 028dff14 00000000 00ea5ed0 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 *** Debug Message Dump **** *** Foreground Window Data *** Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... </stderr_txt> ]]> ![]() |
||
|
pramo
Veteran Cruncher USA Joined: Dec 14, 2005 Post Count: 711 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
Techs, hopefully you can look at my machines by account if need be-
----------------------------------------I've done multiple suspends resumes for most w/u's, 2, 3 in some cases 4 times. On this end they all appear to go back to the checkpoint and resume as they should:) XP, win7, Win2008r2 and standard is my mix. I had 5 invalids with v7.27 but none so far with these that said have ~7 pages worth of PV and in progress against 4 pages or valid at the moment between .27 and .28. Also, fistbump for all you all do- cheers... ![]() |
||
|
Rickjb
Veteran Cruncher Australia Joined: Sep 17, 2006 Post Count: 666 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
No Invalids from my many v7.28 WUs, but I think I provoked 1 Error by Suspend/Resume ...
I encountered a running WU that was about to finish, and waited with finger poised on mouse button while its Remaining counted down to zero. Then I struck, suspending it while it was still running, showing 100% Progress and "---" Remaining. When I resumed it, it reverted to about 1m50 remaining. I did not stay to see it finally finish, nor did I record the WU name. In Results Status we have 1 x Error, right device, about the right runtime: BETA_ MCM1_ 0000216_ 7351_ 1-- 728 Error 13/12/13 06:17:27 13/12/13 19:20:23 11.94 395.9 / 395.9 Interesting bits of the log: <message> finish file present too long </message> ... (4th instance of ...) Commandline = projects/www.worldcommunitygrid.org/wcgrid_beta17_7.28_windows_x86_64 -SettingsFile MCM1_0000216_7351.txt -DatabaseFile dataset-17_72_SDG_v1.txt [06:02:11] Initializing [06:02:16] Running [06:02:16] EvaluateFitnessOfStartingGeneSignatures 1 [06:02:17]: Computing pass 0 [06:04:19] Exiting PermutateGeneSignature [06:04:19] Writing final output [06:04:20] Closing Output Stream [06:04:20] Cleaning up Result.out = 4439259.000000 Run complete, CPU time: 43091.700625 06:04:20 (4708): called boinc_finish Commandline = projects/www.worldcommunitygrid.org/wcgrid_beta17_7.28_windows_x86_64 -SettingsFile MCM1_0000216_7351.txt -DatabaseFile dataset-17_72_SDG_v1.txt [06:05:11] Initializing [06:05:16] Running [06:05:16] EvaluateFitnessOfStartingGeneSignatures 1 [06:05:17]: Computing pass 0 Unhandled Exception Detected... - Unhandled Exception Record - Reason: Breakpoint Encountered (0x80000003) at address 0x0000000077EF2360 ... The "finish file too long" condition may not occur in the production WUs, which presumably will have much of the debugging output removed. It might be a good idea to check that the release candidate WUs survive such late suspend/resume action, though. |
||
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
Personally, hope the techs take the time to move 7.28 to production, even this weekend. Probably they caught by far the biggest portion of the invalid problem, so what is produced after upgrade will have a whole lot less concern and wasted time, possibly years and it still would be under 5% fail rate [but on 250 years production per day that's a bunch of extra replication. More [low frequency] bugs can be fixed in a later release, with less time-pressure.
|
||
|
branjo
Master Cruncher Slovakia Joined: Jun 29, 2012 Post Count: 1892 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
[OT]
----------------------------------------SekeRob wrote: ... edit: Maybe there's Beta fatigue developing... me clients are on a second helping of the 'only 20,000' (which I interpret a 2x20K). None of the first found a wingman yet. I am not dead yet. Just haven't issues with latest Betas - all are Valids or PVal's ![]() NI! [/OT] ![]() Crunching@Home since January 13 2000. Shrubbing@Home since January 5 2006 ![]() |
||
|
|
![]() |