Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 9
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 2352 times and has 8 replies Next Thread
foxfire
Advanced Cruncher
United States
Joined: Sep 1, 2007
Post Count: 121
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
API Returning Different ReportDeadline Dates

The API is returning ReportDeadline dates that are different from the first and last time pulled. The status of the following changed from In-Progress and Pending Verification to Valid between pulls and the ReportDeadline changed. This is not occurring for all WUs that change status to valid between pulls (654 status changed, 12 ReportDeadline different).
WorkunitId	ResultId	First ReportDeadline	Last ReportDeadline
2097417259 1455582110 05/23/17 13:54:34 05/25/17 13:54:34
2097418124 1455583104 05/23/17 13:54:34 05/25/17 13:54:34
2099008888 1457909575 05/24/17 6:32:42 05/26/17 6:32:42
2099009281 1457909955 05/24/17 6:34:50 05/26/17 6:34:50
2099009569 1457910256 05/24/17 6:36:11 05/26/17 6:36:11
2099010038 1457910819 05/24/17 6:36:11 05/26/17 6:36:11
2099011228 1457912170 05/24/17 6:36:11 05/26/17 6:36:11
2099014540 1457915829 05/24/17 6:45:27 05/26/17 6:45:27
2099021711 1457923834 05/24/17 6:59:44 05/26/17 6:59:44
2098963623 1457858266 05/24/17 4:45:36 05/26/17 4:45:36
2098970956 1457866773 05/24/17 5:01:00 05/26/17 5:01:00
2099048250 1457953785 05/24/17 8:06:00 05/26/17 8:06:00

----------------------------------------

[May 19, 2017 2:48:04 AM]   Link   Report threatening or abusive post: please login first  Go to top 
TonyEllis
Senior Cruncher
Australia
Joined: Jul 9, 2008
Post Count: 286
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: API Returning Different ReportDeadline Dates

Exactly two days... Possibly as a resullt of this?
knreed wrote in the thread "World Community Grid Moves to IBM Cloud"

One of our first steps in our cut-over plan is to "Extend report deadline for all in progress results by 2 days".

This will address any issues with results that might become overdue while clients are unable to access the website.

----------------------------------------
[May 19, 2017 4:09:57 AM]   Link   Report threatening or abusive post: please login first  Go to top 
foxfire
Advanced Cruncher
United States
Joined: Sep 1, 2007
Post Count: 121
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: API Returning Different ReportDeadline Dates

The two days seems to be luck of the draw for the pull I referenced. I have seen times when the ReportDeadline is less the SentTime and others when the difference is hours, or more or less than the 2 days.
----------------------------------------

[May 19, 2017 12:38:32 PM]   Link   Report threatening or abusive post: please login first  Go to top 
SekeRob
Master Cruncher
Joined: Jan 7, 2013
Post Count: 2741
Status: Offline
Reply to this Post  Reply with Quote 
Re: API Returning Different ReportDeadline Dates

Think you had a reply [someone recently] had a reply from armstrdj on the matter of seeming random changes of sent times, some turning [temporarily] to be later than the received time and some such [without any consequence as it would return to correct later on... suspecting some array that is not cleared before next read-in pass.
[May 19, 2017 1:00:54 PM]   Link   Report threatening or abusive post: please login first  Go to top 
knreed
Former World Community Grid Tech
Joined: Nov 8, 2004
Post Count: 4504
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: API Returning Different ReportDeadline Dates

I have seen times when the ReportDeadline is less the SentTime.

Have you seen this in the past couple of days (i.e. since the migration) or is this comment based on previous experience before the migration?

I'd like to get a list of oddities (we have captured some of the reported issues, but I want to make sure we have the all) in the API because we should be able to dive into looking at this in the next few weeks now that the migration is done. However, I'd like to make sure that we are only discussing things observed since the migration and not before since there are a lot of changes there were part of the migration.
[May 19, 2017 1:22:25 PM]   Link   Report threatening or abusive post: please login first  Go to top 
adriverhoef
Master Cruncher
The Netherlands
Joined: Apr 3, 2009
Post Count: 2346
Status: Recently Active
Project Badges:
Reply to this Post  Reply with Quote 
Re: API Returning Different ReportDeadline Dates

I did a quick search and found 7 peculiarities since the migration in my API results:
ResultId   WorkunitId ModTime    Exit Outc SentTime            ReceivedTime        Name
1469075340 2107042667 1495064788 0 1 2017-05-17T22:36:14 2017-05-16T07:24:39 FAHV_1001445_3j3y-cO-P1_2772_0
1469247666 2107099199 1495071837 0 1 2017-05-17T23:32:21 2017-05-16T12:18:57 FAHV_1001446_3j3y-cO-P1_24830_0
1469353153 2107194657 1495072036 0 1 2017-05-18T00:30:47 2017-05-16T13:26:30 FAHV_1001447_3j3y-cO-P1_23789_0
1468755505 2106771186 1495049902 0 1 2017-05-26T05:39:06 2017-05-17T19:38:10 FAHV_1001441_3j3y-cO-P1_1703_0
1469573951 2107390598 1495078262 0 1 2017-05-26T14:24:25 2017-05-18T03:30:45 FAHV_1001449_3j3y-cO-P1_25782_0
1469567470 2107384972 1495081719 0 1 2017-05-25T22:50:48 2017-05-18T04:28:28 FAHV_1001449_3j3y-cO-P1_23279_0
1469245126 2107097044 1495069794 0 1 2017-05-17T23:30:10 2017-05-26T14:28:38 FAHV_1001446_3j3y-cO-P1_24134_0

[May 19, 2017 3:15:12 PM]   Link   Report threatening or abusive post: please login first  Go to top 
foxfire
Advanced Cruncher
United States
Joined: Sep 1, 2007
Post Count: 121
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: API Returning Different ReportDeadline Dates

As an add to adriverhoef post, yes, I've seen ReportDeadline change to less than SentTime since the migration and have also seen changes to SentTime as well (both types in app oet1).

When I first encountered it I thought the problem was in my pull program and it took me a couple of days to determine it was in the API data. Because of that I will have to compile the doc going forward.

I'll post what I see to this thread.

Thank you for the response
----------------------------------------

[May 19, 2017 6:30:36 PM]   Link   Report threatening or abusive post: please login first  Go to top 
foxfire
Advanced Cruncher
United States
Joined: Sep 1, 2007
Post Count: 121
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: API Returning Different ReportDeadline Dates

I have seen times when the ReportDeadline is less the SentTime.

Have you seen this in the past couple of days (i.e. since the migration) or is this comment based on previous experience before the migration?

I'd like to get a list of oddities (we have captured some of the reported issues, but I want to make sure we have the all) in the API because we should be able to dive into looking at this in the next few weeks now that the migration is done. However, I'd like to make sure that we are only discussing things observed since the migration and not before since there are a lot of changes there were part of the migration.

The night of 05/25/2017 140 records were returned with different SentTime, ReportDeadline and/or ReceivedTime values. For the next 5 nights there were no differences. Tonight 90 records were returned with different values. In addition, 6 WUs were returned with ReportDeadline empty.

WU's mossing Report Deadline:
OET1_0004730_x4O6HchD_rig_93136_1
OET1_0004729_x4O6HchD_rig_31611_0
OET1_0004729_x4O6HchD_rig_28421_0
OET1_0004730_x4O6HchD_rig_82901_0
OET1_0004730_x4O6HchD_rig_84875_0

Examples of different SentTime, ReportDeadline and/or ReceivedTime values:
WorkunitId	ResultId	DiffList	fSent	fDue	fRtn	sSent	sDue	sRtn
53509353 1492348579 Due,Rtn 05/31/17 09:25:35 05/29/17 22:13:23 05/08/17 22:13:23 05/31/17 09:25:35 06/10/17 09:25:35 05/31/17 19:09:30
53509496 1492348960 Due,Rtn 05/31/17 09:26:09 05/29/17 22:13:23 05/08/17 22:13:23 05/31/17 09:26:09 06/10/17 09:26:09 05/31/17 20:55:17
53509714 1492349352 Sent 05/31/17 09:28:16 06/10/17 09:28:16 05/31/17 20:45:02 05/31/17 09:28:23 06/10/17 09:28:16 05/31/17 20:45:02
53509899 1492349377 Sent,Due,Rtn 05/29/17 22:13:23 06/08/17 22:13:23 05/31/17 21:43:58 05/31/17 09:27:52 06/10/17 09:27:52 05/31/17 21:51:09
53510106 1492349725 Sent 05/01/17 00:03:43 06/10/17 09:29:16 05/31/17 19:45:27 05/31/17 09:29:16 06/10/17 09:29:16 05/31/17 19:45:27
53511015 1492350520 Sent 05/31/17 09:32:30 06/10/17 09:32:30 05/31/17 19:42:37 05/31/17 09:43:58 06/10/17 09:32:30 05/31/17 19:42:37
53512052 1492351276 Sent 05/01/17 00:03:43 06/10/17 09:33:22 05/31/17 20:08:44 05/31/17 09:33:22 06/10/17 09:33:22 05/31/17 20:08:44
53512575 1492352153 Sent,Due 05/08/17 22:35:03 05/31/17 20:55:01 05/31/17 21:20:23 05/31/17 09:36:46 06/10/17 09:36:46 05/31/17 21:20:23
53512577 1492352115 Sent,Due,Rtn 05/31/17 09:35:03 06/08/17 22:35:03 05/31/17 22:50:30 05/31/17 09:36:46 06/10/17 09:36:46 05/31/17 20:36:12
53512699 1492352252 Sent 05/31/17 09:36:46 06/10/17 09:36:46 05/31/17 20:36:12 06/08/17 22:35:03 06/10/17 09:36:46 05/31/17 20:36:12
53512921 1492352385 Sent,Due 05/08/17 22:13:23 06/01/17 01:11:22 05/31/17 19:45:47 05/31/17 09:36:44 06/10/17 09:36:44 05/31/17 19:45:47
53513217 1492352600 Sent,Due 05/08/17 22:35:03 05/31/17 21:46:53 05/31/17 22:09:42 05/31/17 09:36:46 06/10/17 09:36:46 05/31/17 22:09:42
53513396 1492353123 Due,Rtn 05/31/17 09:36:46 06/10/17 09:36:46 05/31/17 22:09:42 05/31/17 09:36:46 06/29/17 22:35:03 05/31/17 22:35:03
53513493 1492352799 Rtn 05/31/17 09:36:46 06/10/17 09:36:46 05/31/17 21:05:00 05/31/17 09:36:46 06/10/17 09:36:46 05/31/17 21:05:42
53513575 1492352907 Due,Rtn 05/31/17 09:36:46 06/10/17 09:36:46 05/31/17 21:10:07 05/31/17 09:36:46 06/29/17 22:35:03 05/31/17 21:10:03
53513756 1492353219 Sent,Due 05/08/17 22:57:13 06/01/17 00:36:35 05/31/17 22:34:36 05/31/17 09:43:08 06/10/17 09:43:08 05/31/17 22:34:36
53514323 1492353883 Due 05/31/17 09:40:55 06/10/17 09:40:03 05/31/17 20:02:23 05/31/17 09:40:55 06/10/17 09:40:55 05/31/17 20:02:23
53514368 1492353503 Sent,Due 05/08/17 22:35:03 05/31/17 20:50:09 05/31/17 21:49:40 05/31/17 09:42:20 06/10/17 09:42:20 05/31/17 21:49:40
54300847 1493313402 Rtn 05/31/17 09:39:40 06/10/17 09:39:40 05/31/17 20:12:01 05/31/17 09:39:40 06/10/17 09:39:40 05/31/17 20:12:03
54300953 1493313353 Sent,Due,Rtn 05/29/17 23:36:48 06/10/17 09:36:48 05/31/17 21:06:43 05/31/17 09:46:45 06/10/17 09:46:45 05/31/17 21:11:33
54301006 1493313258 Sent,Due,Rtn 05/29/17 22:35:03 06/08/17 22:35:03 05/31/17 22:50:30 05/31/17 09:41:59 06/10/17 09:41:59 05/31/17 21:30:13
54301194 1493313309 Sent,Due,Rtn 05/29/17 22:57:13 06/08/17 22:57:13 05/31/17 23:17:16 05/31/17 09:42:49 06/10/17 09:42:49 05/31/17 21:35:55
54301749 1493314208 Sent 05/08/17 23:36:48 06/10/17 09:47:37 05/31/17 20:38:16 05/31/17 09:47:37 06/10/17 09:47:37 05/31/17 20:38:16
54302018 1493314132 Rtn 05/31/17 09:49:44 06/10/17 09:49:44 05/29/17 23:36:48 05/31/17 09:49:44 06/10/17 09:49:44 05/31/17 21:10:00
54302368 1493314762 Rtn 05/31/17 10:06:25 06/10/17 10:06:25 05/08/17 23:49:07 05/31/17 10:06:25 06/10/17 10:06:25 05/31/17 22:04:40
54302498 1493314951 Rtn 05/31/17 09:55:52 06/10/17 09:55:52 05/31/17 21:23:57 05/31/17 09:55:52 06/10/17 09:55:52 05/31/17 23:36:48
54302762 1506112423 Sent,Due,Rtn 05/29/17 23:36:48 06/08/17 23:36:48 06/01/17 01:06:43 05/31/17 09:55:03 06/10/17 09:55:03 05/31/17 22:32:14

Hope this helps!
----------------------------------------

[Jun 1, 2017 2:22:45 AM]   Link   Report threatening or abusive post: please login first  Go to top 
ErikaT
Former World Community Grid Admin
USA
Joined: Apr 27, 2009
Post Count: 912
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: API Returning Different ReportDeadline Dates

The night of 05/25/2017 140 records were returned with different SentTime, ReportDeadline and/or ReceivedTime values. For the next 5 nights there were no differences. Tonight 90 records were returned with different values. In addition, 6 WUs were returned with ReportDeadline empty.

We are aware of this issue, and the work to fix it is on our backlog at this time.

Thank you for your support,
ErikaT
[Jun 1, 2017 2:58:50 PM]   Link   Report threatening or abusive post: please login first  Go to top 
[ Jump to Last Post ]
Post new Thread