The Judge's Chamber - DPChallenge Forums

Canon EF 70-200mm f/4.0L USM

04/30/2004 12:22:04 AM · #1

I've given this some thought for a few days Not sure if it's a good idea, a bad idea, but at minimum an interesting one to ponder. A few weeks ago another person introduced a similar idea.

If you're like me, when someone leaves a comment during a challenge, outside of "great pic" or "this sucks"; if you're not familiar with the person leaving the comment you start examining their work and possibly comments they left on other photographers photos.

I think this idea helps to make that process easier.

What about creating a way of rewarding judges who vote in a manner that is consistent with the average of the other judges? Specifically, taking the average of the sum of the difference (absolute) between the judge's vote and the average vote for each photograph of which the judge casts a vote. The most consistent judges would be those with a value close to zero.

Since I'm not very good at writing here's an example of what I'm thinking.

5 Photos labeled A - E, 5 Judges labeled 1-5, Votes at intersect

Photos________________A____B____C____D____E_____Judge's
Judges____________________________________________Avg
___1__________________6____3____7____5____9_______6.0
___2__________________7____4____8____7____10______7.2
___3__________________5____10___6____6____2_______5.8
___4__________________8____4____7____8____7_______6.8
___5__________________7____2____4____4____8_______5.0

Photo_Avg____________6.6__4.6__6.4__6.0__7.2

Difference between the Judge's vote and the photograph's average

_________________________________________________________Score
Judges____________________________________________Total__(Avg)
___1__________________.6__1.6___.6__1____2.2______6.0____1.20
___2_________________1.6___.6__1.6__1____3.2______8.0____1.60
___3_________________1.6__5.4___.4__0____5.2_____12.6____2.52
___4_________________1.4___.6___.6__2_____.2______4.8_____.96
___5__________________.4__2.6__2.4__2_____.8______8.2____1.64

Note: I spent a lot of time formatting, the math may not be correct but the example should still convey my thinking

Although the example is simple and DPC challenges are much more complex, I think it still works as a starting point. In commenting on photographs Judge #4 with a score of .96 would carry much more weight than Judge #3 with a score of 2.52. Judges 1, 2, and 5 carry pretty much equal weight.

Message edited by author 2004-04-30 00:48:40.

karmat

Apple iPhone 7

04/30/2004 12:29:26 AM · #2

I'd offer an opinion, but as it is, you have made my head spin. ;-)

(Math/statistics/such as this was never my strong suite!)

04/30/2004 12:33:02 AM · #3

Sorry if I sound confusing Karma. If there is any interest I can try to put another example together... it was pretty hard to put this one together (formatting), but maybe I could take more time in trying to explain the result as I see it.

Aaron

Fujifilm FinePix S602Z

04/30/2004 12:39:02 AM · #4

Yeah Karma me too. So if I understand this right. The value of the voters vote is dependent upon how close he is to the average vote on that photo?

04/30/2004 12:39:47 AM · #5

Nevermind.... I can see I made a mess of this.... going to delete it so I don't confuse others