| Index | Recent Threads | Unanswered Threads | Who's Active | Guidelines | Search |
 |
World Community Grid Forums
Category: Active Research
Forum: Mapping Cancer Markers Forum
Thread: Are all MCM1 assimilators running? |
| No member browsing this thread |
|
Thread Status: Active Total posts in this thread: 81
|
|
| Author |
|
|
Grumpy Swede
Master Cruncher Svíþjóð Joined: Apr 10, 2020 Post Count: 2138 Status: Offline Project Badges: 
|
One of my 2023-10-31 results have benne purged now.
|
||
|
|
Bryn Mawr
Senior Cruncher Joined: Dec 26, 2018 Post Count: 342 Status: Recently Active Project Badges: 
|
It has been at least 24 hours since assimilation restarted. Therefore purging has started now. Five results of mine that were returned by 2023-10-31 have already disappeared (down from 22 to 17 remaining) at this moment. UPDATE: 7 remaining - and the number of available pages with my valid tasks is also visibly shrinking. Adri Yes, about 150 results purged so far :-) |
||
|
|
Sgt.Joe
Ace Cruncher USA Joined: Jul 4, 2006 Post Count: 7633 Status: Offline Project Badges: 
|
It has been at least 24 hours since assimilation restarted. Therefore purging has started now. Five results of mine that were returned by 2023-10-31 have already disappeared (down from 22 to 17 remaining) at this moment. UPDATE: 7 remaining - and the number of available pages with my valid tasks is also visibly shrinking. Adri Yes, about 150 results purged so far :-) Likewise here: down about 100 units from yesterday. I do not know from where they are being purged as I still see Oct. 31, 2023 valid work units in the list. Cheers
Sgt. Joe
*Minnesota Crunchers* |
||
|
|
alanb1951
Veteran Cruncher Joined: Jan 20, 2006 Post Count: 929 Status: Offline Project Badges: 
|
As Adri noted, there was a period where it seems all [4?] assimilators were running -- however, I've not seen any more MCM1 items passing to "ready to purge" (delete state 2) in the last 24 hours. It appears that all assimilators worked from some time around 16:00 UTC on 2023-02-12 but by the early morning of 2024-02-13 only the "WU mod 4 = 1" assimilator was active and that also seems to have stopped now. Obviously, this is only my experience; others may be having better luck :-)
Evidence below using data collected at 02:00 UTC each day... Examined data collected on 2024-02-12 WUs were vanishing about 24 hours after they moved to delete state 2 (as should be the case!) It has been good to see some progress; I just hope the pause I'm seeing is temporary rather than a sign that there's a lot more to do to get a final fix... Cheers - Al. P.S. A brief note of where the tech team think they've got to regarding this issue might be nice - hint, hint :-) |
||
|
|
adriverhoef
Master Cruncher The Netherlands Joined: Apr 3, 2009 Post Count: 2145 Status: Recently Active Project Badges: 
|
Al, I'm confirming your finding - all my tasks with FileDeleteState = 2 are now gone (since 11:00 UTC). My expectation is that this was just a (short) test to see if everything went well and that the techs are closely monitoring the situation. Hopefully they can decide to run all assimilators soon and that TigerLily has some positive news, too.
Adri |
||
|
|
Speedy51
Veteran Cruncher New Zealand Joined: Nov 4, 2005 Post Count: 1271 Status: Offline Project Badges: 
|
All I know is the longer it takes my 2443 results to be removed the longer it is before I can return to crunching MCM. I am unsure how to tell if my results have gone to "deleted state 2". About 3 pages of results were removed between the 13th and 14th of February New Zealand time UTC +13
---------------------------------------- |
||
|
|
alanb1951
Veteran Cruncher Joined: Jan 20, 2006 Post Count: 929 Status: Offline Project Badges:
|
Regarding Speedy51's implied question about the file delete state, its value is not exposed to users by standard BOINC systems; however WCG have various API calls that can be used to pick up information about workunits and results and one of the older API calls that returns information on [subsets of] a user's results includes that information! When assimilation or file deletion issues have happened in the past, this value sometimes comes up in the [more technical] posts. See near the head of this thread for an example...
----------------------------------------On another note, I can confirm Sgt. Joe's observation that it doesn't seem to be clearing out everything for a given time period before advancing; that is presumably an effect of whatever the tech team have done to try to work past/around problem records, and may entail added checks to make sure that if a data fetch by the assimilator wrapper gets problem results the next fetch starts at a [carefully selected] higher workunit number to avoid a recurrence! (See upthread for TigerLily's post of some information from the Tech Team .) Also, I agree with Adri that the last day or so was probably some testing being done. In my case, it resulted in the removal of slightly more old results than I return in a typical day, not an ideal outcome, but a start... Running extra assimilators (as mentioned in that Tech Team information) will be essential for a while; if that doesn't work they may have to resort to turning MCM1 (or the entire system?) off for a while to give the assimilators extra capacity :-) Cheers - Al. [Edits to fix typos that I missed! I think an eye-test is in order :-)] [Edit 3 times, last edit by alanb1951 at Feb 14, 2024 11:21:55 PM] |
||
|
|
hchc
Veteran Cruncher USA Joined: Aug 15, 2006 Post Count: 787 Status: Offline Project Badges:
|
Still going up...
----------------------------------------And it's the weekend.
|
||
|
|
bfmorse
Senior Cruncher US Joined: Jul 26, 2009 Post Count: 295 Status: Offline Project Badges: 
|
My current scorecard of MCM1 WU's:
----------------------------------------In Progress: 227 items Error: 8 items (described previously in this thread and are still being displayed) Pending Verification: 0 items Pending Validation: 3686 items (2024-02-10 to 2024-02-19) Valid: 157532 items (2023-10-31 In Progress: 228 items (2024-02-14 to 2024-02-22) Note: all dates in () refer to date only in "Sent times" column. All my systems are Windows based. ETA: As of 2/27/2024: Valid: 168452 items (Net increase of 10920) Pending Validation: 4804 items In Progress: 245 items [Edit 1 times, last edit by bfmorse at Feb 27, 2024 5:52:21 PM] |
||
|
|
Mike.Gibson
Ace Cruncher England Joined: Aug 23, 2007 Post Count: 12309 Status: Offline Project Badges:
|
Nothing purged for weeks.
Mike |
||
|
|
|