Rating not updating?

Previous topic - Next topic

BazookaJoe

I played a bunch of rated games but on the leaderboard it still shows my games played at a constant 15 and my level never changes.  Any idea what causes this?  Thanks

Ingix

1) The leaderboard is only updated once a day, starting at 0:00 UTC.
2) Due to the current performance problems, Stef thought about not doing the update for a 1 or 2 days. I'm not sure if he actually did that, but it might explain your ratings not updating even if you played yesterday (based on UTC time).

From your time of posting the update (if it ran) might have actually just started, so now you might have your results counted.

JohannRibert

It seems the problem still persists. My score is frozen despite playing a few games for at least 2 days. Is there some new information on this topic?

Best regards,
JR

Ingix

The ratings haven't been updated since the last time I posted. I'll ask Stef if he has an ETA for the calculations coming back.

jacobpb

Hello.

I am wondering about the updating as well.  I just played a bunch of games and it's 00:40 UTC right now and there has been no update.  Thanks for any news on this!



Quote from: Ingix on 30 March 2020, 08:14:59 AM
1) The leaderboard is only updated once a day, starting at 0:00 UTC.
2) Due to the current performance problems, Stef thought about not doing the update for a 1 or 2 days. I'm not sure if he actually did that, but it might explain your ratings not updating even if you played yesterday (based on UTC time).

From your time of posting the update (if it ran) might have actually just started, so now you might have your results counted.

Ingix

The ratings update process has not be run since 6-7 days. At the time of the prvious posting, it was assumed that would be fixed soon, but it hasn't, as other problems have crept up (other reasons for lag in-game, people not being able to login, etc.).

It's still unsure when the next ratings update runs as of now.

jacobpb

Great, thank you for the update.

Gold Subscrptn Chick

@Ingix Thank you for the explanations. Being in IT myself, I'm slightly worried about the massive load to the system to update a couple of weeks worth (if not more) of game logs, when 1 day's game log was already causing such slowness supposedly. And I would definitely not be happy if these couple of weeks' game logs are NOT uploaded...

HennesIX

@Gold

That's what I thought.

But... I guess (and ofc I'm only guessing) the problem is a too complex calculation with no optimization (which wasn't necessary before the world wide lockdown)


So I'm pretty optimistic with some optimization or a changed calculation method the ratings will be back.

Gold Subscrptn Chick

Quote from: HennesIX on 12 April 2020, 11:24:42 AM
@Gold

That's what I thought.

But... I guess (and ofc I'm only guessing) the problem is a too complex calculation with no optimization (which wasn't necessary before the world wide lockdown)


So I'm pretty optimistic with some optimization or a changed calculation method the ratings will be back.

+1

dane

I could be wrong, but I think the calculation of ratings isn't simply a case of adding in the new games.  I think the calculation has to start from the very beginning every time, which would certainly explain why it's a major overhead.  It's been stated that resigning against someone who is deliberately playing very slowly will have no effect on one's rating once that player is banned and their games expunged from the database.  That can surely only be true if the calculation of ratings is done ab initio every time.

HennesIX

According to the PDF file one step of the calculation is an iterative method. This might be time consuming.
It is not rocket science and for a CPU this should be not too challengeing. I mean I don't expect billions of ppl playing dominion on this platform ;)

But at the end we are all just guessing. Let's hope for the leaderboard to be updated very soon.

markus

Yes, the ratings were always updated from day 1. So it became more over time but adding e.g. one month now would not be different from having it run each day for the past month.

Gold Subscrptn Chick

I believe it is NOT the same running the last several weeks' worth as a batch at once vs. having it run everyday.

Your previous score factors into the rating change. So running it once as a batch you're making one update using your previous score, whereas having it run everyday your previous score changes every time.

So, if we run the update tonight, your score after the batch update would be different than it would be if updates were run every night previous to tonight. Thee difference might not be much, but it'll be different.

LordGek

Color me confused, so are NO rankings updates happening currently or are they just processed in big batches at the end of the day?

Ingix

The ratings updated used to be done every day around midnight UTC, but at the moment they are not done, so all player's ratings are unchanged since 2+ weeks.

jacobpb

No updates are being posted at this time.

andylatto

It would be nice to have an update on when ratings will be recalculated. I'm new to the site (as I'm sure a lot of other quarantined people are), low-rated, and winning 80% of my matched games. It would be really nice to be able to use the matcher to play other strong players, but I can't do that until my rating goes up.

Ingix

The problem is we don't know. We are testing as we speak, but we need to be sure that the new method is not doing strange things sometimes, which it currently does.

Angst

I hope you can fix the problem quickly. Without ratings, the game is only half the fun  :(

Stef

Quote from: Angst on 23 April 2020, 07:18:04 PM
I hope you can fix the problem quickly. Without ratings, the game is only half the fun  :(

well... I'm certainly not going to claim I managed to fix this quickly, but it was pretty quickly after you posted this message :)

ben latraverse

Hi

Since the new version is in place, I played 2 games (in the last 4 hours) and I won.

But when I logged in 5 minutes ago, my 2 games has disappeared. ???

Did you restore a database ?

Thanks.

Ingix

No database was restored and the new midnight calculation was 1h after your posting (and seemed to have worked well).

I belieive you that samething strange may have happpened, but because of the ratings reboot some tools (like dombot, but could also be the in-game leaderbord) may be not showing the correct data.

So if possible please tell me what information exactly causes you to come to that conclusion? The number of played games in the leaderboard jumped back? Dombot listet no or not enough games for yesterday's date? Or something else?

ben latraverse

Hi,

I just verified this morning, no my 2 games are not there.

At my first logon yesterday with the new version, I saw my rating. (first time in the last 3 weeks)

1. 5311 games with 52.87 (at my first logon)
2. 5312 games with 52.97 (my first game with a win at 12:15 PM EST)
3. 5313 games with 53.05 (my second game with a win at 15:50 PM EST)
4. And when I logon in at 17:45 PM EST, I was back at 5311 games and with my rating at 52.87.

So, this morning, I'm still at 5311 games with 52.87.

Could you check again please ? I'm sure it's happen something when the "big job" is starting at 00:00 UTC.

Thanks.

Ingix

Are you sure that the number of games played shown is 5311? Because dombot says you played 5316 games and have rating 52.87 and it also says you haven't played any game today (which whould of course make the rating different from before).

I'll forward this to Stef, maybe he can make more sense of it and with your timing data it should hopefully be possible to identify the games.

Ingix

First, you did not see ghosts!  ;D
The effect is happening right now as well (for me, for example).

Explanation is most likely as follows:

There are actually 2 of each server, so Stef can switch between them in case one needs to be serviced. That happened yesterday and today with the server that "distributes the ratings" (metaserver). They have your rating from the update (UTC midnight) and the games you played today, so they can calculate your current rating.

Now, if a server get's switched, the new one still gets your rating from the update from the database, but they don't get told the games you played today before that time. They are still saved, but the "shortcut" to send them to the metaserver doesn't work anymore, becase they got sent to the "old" metaserver that is now offline.

That means to the new metaserver it looked like you didn't play any games today, which is exactly what you saw.

That bug will need to be fixed, of course. But it seems to explain what happened.

ben latraverse

Hi,

Is it normal, I think the rating is not updating after each game ?

Thanks

Ingix

Yes, there was a problem this (Eurpean) morning. Stef says he fixed it a few minutes ago, so it should work now (probably after the next rated game you play).

Stevenonego

That is impressive

ben latraverse

Hi,

In the past, when a player didn't play a game during one day, his rating was going down slightly, like maybe 0.05 by day.

But since the new version is in place with the rating update after each game, it's like if the rating is going down slightly even if I play a lot of games during one day.

For me in example, I'm playing between 5 and 20 games by day, and when I come back the day after, I always lost between 0.05 and 0.08 of rating, like if I didn't play a game the day before.

Is it because with the new feature, the server doesn't know that I played a game or more during last day ?

I know, it's not a big thing, but it's not very funny to lost always 0.05 by day.

Thanks.

Ingix

Your observation is right.

Glicko-2, the rating system used, is still based on a ratings period (of one day for Dominion) and all the games during that rating period are processed "at the same time" (meaning it doesn't matter for your next rating in which order you played your rated games in the ratings period).

Before the ratings update, what was shown in the game client was your calculated rating during the last update, so basically your rating from last European midnight.

After the ratings update, what is shown in the client is the answer to the question: "If you don't play any more rated games during this ratings period, what will your rating be at the next update?"

That explains your observation. You play some games on day X and the client will show you what your rating will be at the ratings update between day X and day X+1. For me some days ago that was 49.51, so I got a "50" in the list.

Then, during that ratings update between day X and day X+1, my rating to be used for day X+1 was calculated as 49.51. But when I looked at my rating the next morning, it was 49.49. That's because I hadn't played a games that day yet, and the client told me what my rating would be if I didn't play any rated games this day. Naturally, it would decrease a bit.

I understand that players want to know "What is my rating right now?" Unfortunaetly, that concept doesn't exist for Glicko-2. You only have ratings at the end of ratings periods. Before the ratings update, that was what was shown, your rating at the last update. Now, what is shown is your rating at the next update, as predicted under the assumption that you don't play more games until that time.

Gold Subscrptn Chick

Quote from: Ingix on 19 May 2020, 09:41:25 AM
Your observation is right.

Glicko-2, the rating system used, is still based on a ratings period (of one day for Dominion) and all the games during that rating period are processed "at the same time" (meaning it doesn't matter for your next rating in which order you played your rated games in the ratings period).

Before the ratings update, what was shown in the game client was your calculated rating during the last update, so basically your rating from last European midnight.

After the ratings update, what is shown in the client is the answer to the question: "If you don't play any more rated games during this ratings period, what will your rating be at the next update?"

That explains your observation. You play some games on day X and the client will show you what your rating will be at the ratings update between day X and day X+1. For me some days ago that was 49.51, so I got a "50" in the list.

Then, during that ratings update between day X and day X+1, my rating to be used for day X+1 was calculated as 49.51. But when I looked at my rating the next morning, it was 49.49. That's because I hadn't played a games that day yet, and the client told me what my rating would be if I didn't play any rated games this day. Naturally, it would decrease a bit.

I understand that players want to know "What is my rating right now?" Unfortunaetly, that concept doesn't exist for Glicko-2. You only have ratings at the end of ratings periods. Before the ratings update, that was what was shown, your rating at the last update. Now, what is shown is your rating at the next update, as predicted under the assumption that you don't play more games until that time.

I'm slightly confused by the above. The ratings are updating after every game it seems. So there's an additional daily update on top of the post-every-game updates?

Ingix

As I said: The "real" ratings update happens still once at midnight UTC. It will take into account all the games you played during the last time that update was made (so usually the last 24h). That didn't change principally, but the method used is now much faster and has less strain on the servers which in parallel needs to handle the games going on at that time and the results coming in.

What you see in the updated rating is a "preview": This is what your rating will be during the next midnight ratings update under the assumption you don't play more games.

So before the big ratings overhaul, you were shown the "past", your rating from the last update. Now you are shown the "future" (your rating from the next update) which has certain uncertainties, of course.