The Paradox that is Skill Level

[digitaldreamer]

I was thinking about skill level when I was looking for challenges on challenge central and I began to think, what is skill level? One would assume that it is the knowledge and ability of a player about the game of chess. But how can we possibly measure knowledge and ability? Do we measure it through numbers and ratings? Or can we ourselves determine our own skill level based on our experience with the game? It appears that there is no concrete answer to what is skill level? As it is now (at Stans), it is up to an honor system where a player ranks his or her own skill. At this point I rank myself a 3. This got me to thinking, well my rating according to the old and new rating system would put me at a skill level of 4. Thus, am I wrong to assess myself as a 3 or is it that rating cannot be accurately used to determine skill level. I see two glaring arguments in either case. On the one hand, my assessment of my own skill could be limited to a small number of games or opponents. The law of relativity comes into play here. If I only play a few different people and win most of my games, I may honestly believe that I am a stronger player than I actually am. On the other hand, If rating is tied to skill level, you have a similar problem with who the opponents are of the player. For all we know, I could be placed at a skill level of an expert in terms of rating, but the only players I have played against are beginners. So does that really make me an expert, or does it just mean I am an expert of the Beginners? Of course, there is the other extreme where I could have a very low rating but it is only because my only opponents are against the top 3% of all players. So does this mean that I am not a skilled player or that I am just not as skilled as the upper echelon? Clearly these are extreme cases but there are always instances of these. One would assume that Skill level and rating would be connected because, as a player increases rating, they will play other opponents with an equivalent rating. As a result, a player will eventually level off for a given time and settle into a rating range or, in escense, a skill level. This skill level will remain until the player has gained enough experience and knowledge to push them into a new rating range, at which time we say they have reached a higher skill level. Obviously this is one of those issues that cannot always be defined in a clear cut manner. We must do the best we can and hope that the law of averages provides us with a "good enough" answer. This is a rather random issue but again I wonder... what is skill level?

Now that I have rambled on and on about that (which was kind of fun to think about and put into words), I remember hearing that skill level might actually be tied to the new rating system and was wondering when or if this was going to happen?

-Digital

[Stan Steliga]

Yes - the skill level will be tied to the new system. Players will be able to set their skill level when they first register, but after that the rating system will automatically set their skill level and the play will not be able to change it. I don't know when it will hapen. We have been making excellent progress lately behind the scenes.

[perseus]

I do not know about skill level, but "experience" level is an interesting concept. How many games have you played ever?

This ignores the prodigy (not a born talent? but how did he learn so quickly?) and people who who forget their previous mistakes.

[savin]

Digitaldreamer,

In the new rating system "Level" is a very different concept than it is in the current rating system:

1) Level does not mean much until you have recieved an established rating. This happens when you have completed 25 games against players that already have established ratings.

2) Level is used primarily in organizing tournaments.

3) Level is based upon a players highest attained rating at the site. This means that a Category 2 player could lose 15 games in a row and drop their rating down 150 points and they would still be a Category 2 player.

A good way to look at the new rating system is this:

You should be able to have a good gamne against a player who has the same level as you. You have a slight chance to draw or win against a player rated one level above you. It is highly unlikely that you will beat a player that is two levels above you. The levels are from low to high:

1) Category 4
2) Category 3
3) Category 2
4) Category 1
5) Expert

However, keep in mind that Category 4 has a large spread of ratings. We even considered having some sub levels in here. The same

[beck15]

a rating is a statistical tool used to assess(or guess) the strength of a chessplayer. having said that, as all other statistical tools, it also requires a rather large pool of data to accurately assess the required parameter(ie, playing strength of a player). hence, rating based on only a handful games can be largely deviated from the true rating but a rating based on a large number of games is fairly accurate.i think that's the reason why the new rating system requires atleast 5 completed games against other established players to calculate a rating.

[yassen]

admin said:

Yes - the skill level will be tied to the new system. Players will be able to set their skill level when they first register, but after that the rating system will automatically set their skill level and the play will not be able to change it.

Stan,

I wonder, why would this initial setting of a skill level by the player himself, be necessary? I would suggest to not show any skill level in the new rating system until the player becomes established. I agree with DD that there is no clear cut answer to the question "what is skill level?" or "how should skill level be determined?". So, there should be nothing wrong in removing the burden of judgmentally setting a player's own skill level.....

[Stan Steliga]

I think it is best to have some indication of skill level. However, your post makes me think that we should make it clear that the skill level shown was set by the player. Maybe an asterisk next to it wherever it is shown.

[savin]

The new rating system actually uses the player's original "estimate" of their own ability. There is even a tiny advantage to players who make a good estimate of their initial rating. The advantage being that they will start off with the correct level. A player who significantly over estimates their original level might end up with a level too high and since levels are never lost once you are established it might place them in a category too high for tournaments.

[zooty]

Ratings aren't really important. Just play the best you can and enjoy the game. To much is made of ones rating here at Stans. I've played thousands of games on the net. Stans makes the biggest deal about ratings. Just chill out and play.