Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 161
Posts: 161   Pages: 17   [ Previous Page | 4 5 6 7 8 9 10 11 12 13 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 45302 times and has 160 replies Next Thread
Mike.Gibson
Ace Cruncher
England
Joined: Aug 23, 2007
Post Count: 12594
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Stats late...

Uplinger

The problem only seems to be with the midnight GMT/UTC stats and not the noon stats, if that helps.

Mike
[May 14, 2019 8:02:06 AM]   Link   Report threatening or abusive post: please login first  Go to top 
uplinger
Former World Community Grid Tech
Joined: May 23, 2005
Post Count: 3952
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Stats late...

I agree about it being during the midnight stats. Thus we will be capturing more stats tonight on the database. I don't believe this will cause any further of a slowdown.

Lavaflow, there was nothing changed on our servers that caused this difference. The server is a production server which requires more procedures when something changes on any of the systems. This is why we are confused what is happening. We modified a few of the settings to see if that would help within the database but it did not.

The stats we are collecting now are going back to the main support team for the database. The issue has both knreed and I confused as to what the issue is.

Thanks,
-Uplinger
[May 14, 2019 11:56:27 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Stats late...

the only difference between the midnight stats and the 6 am stats is the "team" stats.
The "team" stats are only updated at midnight and the problem is with the midnight updates. Probably only coincidence.

The only other change was that this problem began after the May 1st software update. Again probably only coincidence.

One other point that someone else pointed out is that the stats seem to be updated on time based on "BoinkStats" and the hold up is on the "My Contribution" page.
----------------------------------------
[Edit 1 times, last edit by Former Member at May 15, 2019 1:52:39 AM]
[May 15, 2019 1:37:21 AM]   Link   Report threatening or abusive post: please login first  Go to top 
uplinger
Former World Community Grid Tech
Joined: May 23, 2005
Post Count: 3952
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Stats late...

Greetings,

The stats went slow on either the Friday night or Saturday night stat runs. I have logs from the runs the nights after the updates (kernel updates), and they all ran in normal time. The stats import/exports on the database indicate some threshold was crossed when they are run in my opinion. We have collected the extra data tonight to pass along to the database support team at IBM for them to examine. I'm currently uploading the details they requested now.

The end of day stats run a few more things to populate rollup data which makes the website faster to view and access for the members. This is the import/exports mentioned above.

Initially the thought was that the indexes for the tables had become out of sync and needed to be reorganized, but doing that didn't help. We also changed settings that appeared would assist in the problem, but that didn't help either. We have also checked to see if our queries can be optimized but those statements haven't been helpful either.

Thanks,
-Uplinger
[May 15, 2019 2:58:16 AM]   Link   Report threatening or abusive post: please login first  Go to top 
hchc
Veteran Cruncher
USA
Joined: Aug 15, 2006
Post Count: 865
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Stats late...

Is there a backup or snapshot job that kicks off at midnight UTC (7:00 PM Central Daylight Time) that might be interfering? I've seen that in the past in a past job's environment. Same with enterprise antivirus running on the server that slowed it to a stop. I'm wondering if CPU utilization or disk I/O on the database is competing with other processes instead of letting the scheduled jobs run.
----------------------------------------
  • i5-7500 (Kaby Lake, 4C/4T) @ 3.4 GHz
  • i5-4590 (Haswell, 4C/4T) @ 3.3 GHz
  • i5-3570 (Broadwell, 4C/4T) @ 3.4 GHz

[May 15, 2019 3:07:19 AM]   Link   Report threatening or abusive post: please login first  Go to top 
JmBoullier
Former Community Advisor
Normandy - France
Joined: Jan 26, 2007
Post Count: 3716
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Team stats maybe ?...

Hi Keith.
A new event this morning seems to confirm that team stats might be involved in the accident. wink

Although numbers have been computed and tallied correctly in Team Statistics History and in the By Team lists they have not been updated in My Contribution and in My Team. These two pages are still showing numbers from the May 13 stats.
----------------------------------------
Team--> Decrypthon -->Statistics/Join -->Thread
----------------------------------------
[Edit 1 times, last edit by JmBoullier at May 15, 2019 6:37:47 AM]
[May 15, 2019 6:17:19 AM]   Link   Report threatening or abusive post: please login first  Go to top 
uplinger
Former World Community Grid Tech
Joined: May 23, 2005
Post Count: 3952
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Team stats maybe ?...

Greetings,

We have done some analysis on the results of the scan from last night. We have made some additional changes to the database to hopefully see a performance gain. With that said, we are going to run another scan on the system tonight during the stats run to see if it makes the changes we need.

Thanks,
-Uplinger
[May 15, 2019 8:55:02 PM]   Link   Report threatening or abusive post: please login first  Go to top 
BladeD
Ace Cruncher
USA
Joined: Nov 17, 2004
Post Count: 28976
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Team stats maybe ?...



The page you requested is currently unavailable because the statistics are being updated.

The statistics update will finish in about 0 minutes 0 seconds .

...and the wait begins...

BTW, is it just me...it's making me login more often!
----------------------------------------
----------------------------------------
[Edit 1 times, last edit by BladeD at May 17, 2019 4:47:53 AM]
[May 17, 2019 3:19:08 AM]   Link   Report threatening or abusive post: please login first  Go to top 
JmBoullier
Former Community Advisor
Normandy - France
Joined: Jan 26, 2007
Post Count: 3716
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Team stats maybe ?...

BTW, is it just me...it's making me login more often!

No, it's not just you... wink
----------------------------------------
Team--> Decrypthon -->Statistics/Join -->Thread
[May 17, 2019 5:07:35 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Jean-David Beyer
Senior Cruncher
USA
Joined: Oct 2, 2007
Post Count: 339
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Team stats maybe ?...

It is now Friday May 17 01:27:29. I normally get the new results at 9PM local time when I am on daylight savings time, and 8PM when on "God's time." So about 4 1/2 hours late.

The page you requested is currently unavailable because the statistics are being updated. The statistics update will finish in about 0 minutes 0 seconds .

----------------------------------------

[May 17, 2019 5:30:35 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 161   Pages: 17   [ Previous Page | 4 5 6 7 8 9 10 11 12 13 | Next Page ]
[ Jump to Last Post ]
Post new Thread