| Author | Thread |
|
|
06/21/2010 07:39:16 AM · #1 |
My recent scores (generally between 5 and 6) have led me to evaluate scores as follows.
10- Absolutely Fantasticly Brilliant
9- Brilliant
8-Fantastic
7-Very Good
6-Good
5-Average
4-Below Average
3-Bad
2-Very Bad
1-Terrible, Extremely Bad
|
|
|
|
06/21/2010 07:41:22 AM · #2 |
That's about how I rate them. Of course, when I get a mid 6 average I am VERY happy.
|
|
|
|
06/21/2010 07:42:06 AM · #3 |
| i agree with you, this is also my evaluation of the scores... |
|
|
|
06/21/2010 08:25:07 AM · #4 |
| You mean on a scale of 1 to 10, 1 is terrible, 10 is awesome and 5 is middle of the road?? You get a 10 for that analysis! |
|
|
|
06/21/2010 08:39:02 AM · #5 |
My take...
10-Absolutely Fantastically Unachievably Brilliant
9-See ten
8-Out standing, the moon landing of photography
7-Something to boast about to everyone you meet
6-Enough encouragement to upgrade your camera and to try again for the next 2 years
5-Average
4-Soul wrenching, even 4.999 is still a 4
3-a misunderstood 4
2-See 1
1-Absolutely Disgracefully Unachievably Bad |
|
|
|
06/21/2010 08:42:20 AM · #6 |
Originally posted by Shadowi6:
My take...
4-Soul wrenching, even 4.999 is still a 4
3-a misunderstood 4
|
LOL!!!! |
|
|
|
06/21/2010 08:44:13 AM · #7 |
| About the same as my scale, though I think many of us differ somewhat on what we consider to fall into each category and for what reasons. |
|
|
|
06/21/2010 09:44:38 AM · #8 |
Originally posted by ThingFish:
My recent scores (generally between 5 and 6) have led me to evaluate scores as follows.
10- Absolutely Fantasticly Brilliant
9- Brilliant
8-Fantastic
7-Very Good
6-Good
5-Average
4-Below Average
3-Bad
2-Very Bad
1-Terrible, Extremely Bad |
Pretty close with a distribution along the lines of:
10 - Very rare
9 - Uncommon
8 - A little more common
7 - Most of the best shots of the challenges end up here.
6 - Most of the good shots of the challenges end up here.
5 - Met the challenge, some flaw in lighting, noise, composition.
4 - Aunt Gertie with her Polaroid could achieve the same snapshot quality.
3 - Makes Aunt Gertie look like Uncle Ansel (rare)
2 - Rare
1 - Rare -- except for DNMC.
That's it really for the quality score. I tend to penalize with a -1 or -2 in addition if they either met the challenge barely or technically, but dishonored the clear spirit of the challenge.
|
|
|
|
06/21/2010 10:40:38 AM · #9 |
Originally posted by Yo_Spiff:
.....though I think many of us differ somewhat on what we consider to fall into each category and for what reasons. |
I agree on that Steve and my scoring system is the same but, what I may see as an 8, others may see as a 2. It depends on what each individual views as "bad/fabulous" and everything in between those values. At least, there is a "system" that people use vs a voter who looks at a shot and it doesn't "thrill" them so, it gets an automatic 3 or lower and ONLY when one thrills them, does it get considered for another value LOL. I've seen people openly say that is the way that they vote. That's their system and it works for them I guess....but, for everyone else....????
ETA: 1 to 3 vote for me has to be either a total DNMC or blatantly (in my mind) a snub to the challenge...or deliberate attempt at a Brown (I'll oblige and give them what they want :) I try to be thoughtful. :P
Message edited by author 2010-06-21 10:45:42. |
|
|
|
06/21/2010 10:55:08 AM · #10 |
| A standard distribution of votes, in a bell-shaped curve, works for me. Images don't have to be "perfect" or "rare" to get 8, 9 or 10 from me. Images do have to be irritating to me to get a 1 or 2. I think it's helpful when members vote a full array of scores. Those who vote in a very narrow range unfairly penalize outstanding images and unfairly reward weak images. If everything is a 5, then nothing is a 5. One suggestion I have for DPC is to display more than the average vote cast. A lot of detail is lost in the multi-year average. It would be helpful to review a bar chart of vote distribution over the last year for each member. |
|
|
|
06/21/2010 03:15:05 PM · #11 |
10- Very Serious Commercial Potential
9- Great Commercial Potential (Stock, Someone Sold Their Soul)
8-Commercial w/Artistic tendencies (Alamy w/guarantted multiple download potential)
7-Very Cool
6-Thought Provoking
5-Takes Time To Digest (not for the average consumer)
4-Wow...I never would have thought of that(?) and thanks Don for pointing that one out...
3-1x Worthy
2-No Commercial Potential, Original
1-Avant Garde
Message edited by author 2010-06-21 15:24:23. |
|
|
|
06/21/2010 03:19:28 PM · #12 |
Originally posted by pawdrix:
10- Very Serious Commercial Potential
9- Great Commercial Potential (Stock)
8-Commercial w/Artistic tendencies (Alamy w/guarantted multiple download potential)
7-Very Cool
6-Thought Provoking
5-Takes Time To Digest (not for the average consumer)
4-Wow...I never would have thought of that(?) and thanks Don for pointing that one out...
3-1x Worthy
2-No Commercial Potential, Original
1-Avant Garde |
LOL. Love it! |
|
|
|
06/21/2010 03:23:47 PM · #13 |
I'm relatively new to this, and am finding the suggestions good. Thanks y'all!
I split the 1-10 scale into a few smaller scales. It kinda varies for the photo, but I give about 2/3 for suitability to challenge, 4/5 for overall image quality, and the rest for... And the rest are for filler (effort, use of technique, wow factor, originality, colour, tones, detail, etc).
Personally I don't think that one scale is really enough. Or maybe I'm not good enough to use only one yet :)
|
|
|
|
06/21/2010 03:29:29 PM · #14 |
Originally posted by Shadowi6:
My take...
10-Absolutely Fantastically Unachievably Brilliant
9-See ten
8-Out standing, the moon landing of photography
7-Something to boast about to everyone you meet
6-Enough encouragement to upgrade your camera and to try again for the next 2 years
5-Average
4-Soul wrenching, even 4.999 is still a 4
3-a misunderstood 4
2-See 1
1-Absolutely Disgracefully Unachievably Bad |
LMFAO!!! Love it!!!
|
|
|
|
06/21/2010 03:42:18 PM · #15 |
Originally posted by pawdrix:
10- Very Serious Commercial Potential
9- Great Commercial Potential (Stock, Someone Sold Their Soul)
8-Commercial w/Artistic tendencies (Alamy w/guarantted multiple download potential)
7-Very Cool
6-Thought Provoking
5-Takes Time To Digest (not for the average consumer)
4-Wow...I never would have thought of that(?) and thanks Don for pointing that one out...
3-1x Worthy
2-No Commercial Potential, Original
1-Avant Garde |
zactly |
|
|
|
06/21/2010 04:12:45 PM · #16 |
| I think a fair scale is based on the field of entries. The best gets a 10, the worst gets a 1 and everything else is distributed according to where they fall on that scale. This requires going through the entries once to determine the range and then again to vote with the scale in mind. I think these other standards are much too stiff and not based on what is being presented. |
|
|
|
06/21/2010 04:19:23 PM · #17 |
Ah, but that's fitting a competition to a curve, which reminds me of hearing about universities fitting grades to a curve. Which I completely disagree with.
I vote from the heard :P
Or the hip.
|
|
|
|
06/21/2010 04:24:10 PM · #18 |
Originally posted by Quintus:
I think a fair scale is based on the field of entries. The best gets a 10, the worst gets a 1 and everything else is distributed according to where they fall on that scale. |
Many do use it as a ranking system, which means that the vote an entry receives is not based on how good it is, but on it's relationship to everything else. Using this system, a pretty good shot can rate a 4 if everything else is wowee eye candy.
I prefer to consider a 5 a 5 and a 6 a 6 regardless of the challenge. If there are 5 entries that I feel deserve a 10, or none, then so be it. Besides, I don't have time to evaluate each challenge a second time. Others opinions will serve to counterbalance my own. |
|
|
|
06/21/2010 04:33:57 PM · #19 |
| "5 is a5 and a 6 is a 6", based on what scale? Depending on how you define that scale everyone here could rate a 10 or a 1. |
|
|
|
06/21/2010 04:38:20 PM · #20 |
Yo_Spiff was good enough to PM me this before when I asked the same question. It'd've taken from the topic in that thread, but it fits the bill here.
How I vote:
1-totally sucks, blurry grainy, unidentifiable. I usually only give a 1 for something that is clearly an effort to get the brown.
2- brown ribbon for sure. Grainy, blurry, lots of artifacts, shadows and blown highlights. lousy snapshot
3- The average snapshot someone takes if they don't know anything about photography.
4- basic exposure and composition is ok and shows effort and some knowledge. Still lacking somehow compared to other DPC stuff.
5- A good shot, but nothing that stands out over the rest. No shame in getting a 5. Something that averages in the high 5's will probably get wowed over elsewhere.
6- Like it, though it's not wowing me.
7- Really good stuff.
8- Getting into "WOW" territory. 50% chance I will fave this.
9- How to you do it? Do you have a life outside photography?
10- I am in awe.
Other factors:
-If I feel the entry does not meet the challenge topic (a.k.a. a "shoehorn" entry) I will rate it on the quality of the shot, but then deduct 1-3 points depending on how far off base I think it is. If I am the only one that feels that way, then my slightly lower vote won't hurt it much.
-Sometimes an extra point for an outstandingly creative idea, but an average shot.
-I often give a lower vote for visible compression artifacts that could have been easily avoided. If there are visible artifacts and a small file size, I will ding you. I have often low voted high scoring images for this when everyone else wows over it. If I ding you on this, I will leave a comment about it, so that you know why it got that low vote from me.
-Although personal taste is part of the process, I try to rate on the quality of the photo. If I don't personally care for it, but still think it is good work, I won't low vote it.
Due to the compression of opinions, I feel the final averages are a little different:
<3 Pretty bad snapshot, extremely out of the box, or an intentional effort at last place (Known as a "Brown Ribbon", or "Brownie")
4-4.5 Pretty poor, or extremely misunderstood and under appreciated.
4.5-5.0 a good effort that shows some knowledge, but still lacking in some major way.
5.0-5.5 A decent effort that just did not blow people over. No shame in a 5
5.5-6.0 A good shot that appealed to the majority of people, or had very strong appeal for a smaller group. Despite people moaning about scores in this range, it is doing well and is usually a mid-pack or higher placement in most challenges.
6.0-6.5 A really good shot with broad appeal.
6.5+ Killer shot, this getting into ribbon territory.
|
|
|
|
06/21/2010 04:42:40 PM · #21 |
Originally posted by Quintus:
"5 is a5 and a 6 is a 6", based on what scale? Depending on how you define that scale everyone here could rate a 10 or a 1. |
Based on my scale. Someone else might give a 5 to the same quality of image I give a 6 to. It's all very subjective, even if you try to use a ranking scale, it is still a subjective judgment as to which entries are "better" and which are "worse". It all averages out at rollover. |
|
|
|
06/21/2010 05:08:47 PM · #22 |
There are curves and then there are curves. Curves are a natural statistic that grows from the samples. I don't mean that I make everyone fit a predetermined curve like the schools have done. Even if you do not use the field as your basis you are still grading on a curve. It is inevitable. What I do is take the best to be a 10. The worst to be a 1. There is then a gradient. You could theoretically have 99% with 10s and 1% with 1, or visa-versa. I use the 10 and 1 as the theoretical limits. In practice there is usually a bell curve but it is not artificial, it is just how they tend to fall out. I gave one 10 in one competition and 8 or 9 in another. But there tended to be a natural curve just as in the totaling of the votes there is always a curve.
You could vote only 1's and 10's but when taken as a group of competitions thus graded a curve will emerge. You can't beat math. It just is. |
|
|
|
06/21/2010 05:38:36 PM · #23 |
[01] WTF? Where's the button to vote a [00]?
[02] It still sucks, but I can at least look at it for more than 1 second without going blind.
[03] Hmmm. I can see what you were trying. But sorry, didn't work here.
[04] Good try. But I just saw another image that did this better.
[05] Now it's getting interesting. You put a serious effort into it. Some flaws, but I respect the work!
[06] Oui... you just woke me up! ((takes hand away from the keypad and starts to observe the image))
[07] Shites! Why did I not think of that?? You've got talent!
[08] Hubadabahubadaba.... yayayayayayyeyeyeyey. Suweeeetttt!!!
[09] Crazzy!!! You know you are a 10. but I gotta respect this other dude(ette) for being creative and following his/her gut and nailing it. You MAY ribbon, but my heart is with someone else, who gets a 10 from me:-)
[10] AAaahhhhhhh (( Tears in my eyes ))... I can't wait for the voting to be over so I can fav you, your picture, your camera, your style, go to your portfolio, do a google search on you, read through what you pen in the forums, and talk about your picture with my friends and colleagues and show it to my love. You MAY NOT ribbon, but you touched at least one heart. You rock! :-):-)
ETA: If I gave you a 10, and your image was B&W, and you behave in the forums, it goes without saying: "Make me your photography b!tch and teach me please!" :-)
Message edited by author 2010-06-21 17:43:59. |
|
|
|
06/21/2010 05:43:36 PM · #24 |
These are all interesting voting approaches, but I really thought DPC already had a voting scheme
(bad) 1 2 3 4 5 6 7 8 9 10 (good)
|
|
|
|
06/21/2010 05:52:19 PM · #25 |
Originally posted by Prash:
[01] WTF? Where's the button to vote a [00]?
[02] It still sucks, but I can at least look at it for more than 1 second without going blind.
[03] Hmmm. I can see what you were trying. But sorry, didn't work here.
[04] Good try. But I just saw another image that did this better.
[05] Now it's getting interesting. You put a serious effort into it. Some flaws, but I respect the work!
[06] Oui... you just woke me up! ((takes hand away from the keypad and starts to observe the image))
[07] Shites! Why did I not think of that?? You've got talent!
[08] Hubadabahubadaba.... yayayayayayyeyeyeyey. Suweeeetttt!!!
[09] Crazzy!!! You know you are a 10. but I gotta respect this other dude(ette) for being creative and following his/her gut and nailing it. You MAY ribbon, but my heart is with someone else, who gets a 10 from me:-)
[10] AAaahhhhhhh (( Tears in my eyes ))... I can't wait for the voting to be over so I can fav you, your picture, your camera, your style, go to your portfolio, do a google search on you, read through what you pen in the forums, and talk about your picture with my friends and colleagues and show it to my love. You MAY NOT ribbon, but you touched at least one heart. You rock! :-):-)
ETA: If I gave you a 10, and your image was B&W, and you behave in the forums, it goes without saying: "Make me your photography b!tch and teach me please!" :-) |
OMG thats hilarious!! especially the ETA!~
|
|
Home -
Challenges -
Community -
League -
Photos -
Cameras -
Lenses -
Learn -
Prints! -
Help -
Terms of Use -
Privacy -
Top ^
DPChallenge, and website content and design, Copyright © 2001-2024 Challenging Technologies, LLC.
All digital photo copyrights belong to the photographers and may not be used without permission.
Current Server Time: 04/19/2024 11:31:44 PM EDT.
