When I did my daily download of valid work units I did notice I was finally down a net 933 work units out of about 38000. The Oct. 31, 2023 units are gone and the oldest units are now from Nov. 2, 2023. So, there is some progress, At the rate the process is moving, this will take several months. However, now that the techs seem to have a handle on the problem, they may see fit to speed it up, but as long as the number is decreasing, that is progress.

Cheers

Only 5 results purged for me, and nothing at all in the last 5 hours.

Regarding why some users don't seem to be seeing much progress...

At present, the volume of WUs which are ready to purge but are still visible will be constantly increasing because, unlike a lot of other BOINC services, only one copy of the standard BOINC db_purge can be run at a time (as it is not engineered to work on subsets of WUs...) so it may fall behind.

Under normal circumstances, individual processes such as assimilators, file deleters and db_purge will work through WUs in ascending order; users wondering why their mid-November results aren't disappearing yet should bear that in mind :-)

At present it appears that the assimilators are marking WUs ready for file deletion slightly faster than the file deleters can deal with them, and the file deleters are tidying up WUs a lot faster than the purge can get rid of them at present[1]. Given that the volume of WUs waiting to be assimilated was probably in the high tens of millions, as against the [less than a] million a day of a "normal" system, this should not come as a surprise :-) -- and it'll probably appear to get worse before it gets better :-(

For what it's worth, in the past two days about 10% of my tasks waiting for assimilation have got past assimilation and most of them have also got past file deletion; however, only about 3% of them have actually disappeared (being about half the items that were marked up on the first day...)

Cheers - Al.

[1] db_purge may not be running full time -- I'm unsure as to whether it might be turned off during statistics generation times, for instance... If it is running all the time, I think we're stuck with a long wait!

My oldest results are from 2023-11-10. About 1000 have been purged the last few days. Woohoo.

My oldest results were returned 11/13 and 11/14. (Issued 11/11). Seeing slow and steady progress. I assume the assimilators are still all running.

I'm also noticing slower validation and slower work unit generation (and thus a shortage). Are these processes running on the same servers or something? Zero sum game?