A témához tartozó oldalak:   < [1 2 3] >
Entries in the qualification round can be "ruled out", a few more adjustments are on the way
Téma indítója: Jared Tabor

Katalin Horváth McClure  Identity Verified
Egyesült Államok
Local time: 14:39
Tag (2002 óta)
angol - magyar
+ ...
@Jose - did you misunderstand? Sep 18, 2014

Jose,
Could you explain how what you are talking about relates to what I was talking about, because I don't see it. Perhaps you misunderstood what I wrote?
Let me paraphrase it.
I would like to see a button next to the 5-star scale that says "pure garbage" or along those lines, so that we could indicate immediately, with one click, that the entry does not even worth a detailed feedback.
Entries that receive several of those would be the first candidates for ruling out by
... See more
Jose,
Could you explain how what you are talking about relates to what I was talking about, because I don't see it. Perhaps you misunderstood what I wrote?
Let me paraphrase it.
I would like to see a button next to the 5-star scale that says "pure garbage" or along those lines, so that we could indicate immediately, with one click, that the entry does not even worth a detailed feedback.
Entries that receive several of those would be the first candidates for ruling out by staff.
Katalin
Collapse


 

Erik Freitag  Identity Verified
Németország
Local time: 20:39
Tag (2006 óta)
holland - német
+ ...
There already is a "pure garbage" button (but it isn't labelled as such) Sep 18, 2014

Katalin Horváth McClure wrote:
I would like to see a button next to the 5-star scale that says "pure garbage" or along those lines, so that we could indicate immediately, with one click, that the entry does not even worth a detailed feedback.



I agree that a button labelled "pure garbage" would be a good idea, but in practice, as far as I can see, we already have that (by rating an entry with 1 star). You don't need to give any detailed feedback (tagging) anyway.

The problem might be the following: People tend to think that giving a rating of 1 star does the entry more good than not rating it at all (staff have already said that this is not the case). Giving 1 star will lower the ranking of an entry, not rating it at all will not alter the ranking.

[Bearbeitet am 2014-09-18 09:11 GMT]


 

José Henrique Lamensdorf  Identity Verified
Brazília
Local time: 16:39
angol - portugál
+ ...
Az Ő emlékére:
I got the idea, but it's too late to fix it Sep 18, 2014

Katalin Horváth McClure wrote:

Jose,
Could you explain how what you are talking about relates to what I was talking about, because I don't see it. Perhaps you misunderstood what I wrote?
Let me paraphrase it.
I would like to see a button next to the 5-star scale that says "pure garbage" or along those lines, so that we could indicate immediately, with one click, that the entry does not even worth a detailed feedback.
Entries that receive several of those would be the first candidates for ruling out by staff.
Katalin


Katalin,

If you know anything about cars, the situation is comparable to what I see in most cars fitted with a DSG gearshift manufactured in Brazil: they have no "Park" position! In case of brakes failure, the only way to keep them stopped on a slope is by putting a brick behind one of the tires. So, for safety, the owner of such a car (e.g. my wife) should keep one such "brick" (actually a wedge) available within the vehicle.

So our "brick" here would be the "1" rating. It means that someone DID evaluate that submission and rated it as "junk". If that entry was indeed checked by a certain number of people AND more than, say, 60% of them gave it a "1", the system should bin it.

This would be a provisional solution (until the next contest) that would avoid having to fuss with programming while the contest is under way.

[Edited at 2014-09-18 21:47 GMT]


 

Maria Llovera  Identity Verified
Mexikó
Local time: 13:39
Tag (2008 óta)
angol - spanyol
+ ...
I like the contest! Sep 22, 2014

I'm happy with the contest; in the end, that is what we do all the time, translate. I don't feel I wasted any time at all, it is really very short. I have been "ruled out", but I still hope to get my translation back with comments or highlights so I can learn something from the exercise. I will also like to read the winning translation, that's for sure.
Maria J. Llovera


 

Vanessa Di Stefano  Identity Verified
Egyesült Királyság
Local time: 19:39
Tag (2014 óta)
olasz - angol
Still not clear on how the ruling out is decided... Sep 22, 2014

I don't really understand (still) how the ruling out is decided. In my language pair 13 entries have been ruled out, including mine, and yet I see entries that are still in the running but with many more dislikes than I had (for example) and no likes (which I did have). I'm not raising this issue because I feel bitter about being ruled out, after all I can always learn something from the comments made and besides, preferences in writing/translating styles and choices are extremely subjective (ev... See more
I don't really understand (still) how the ruling out is decided. In my language pair 13 entries have been ruled out, including mine, and yet I see entries that are still in the running but with many more dislikes than I had (for example) and no likes (which I did have). I'm not raising this issue because I feel bitter about being ruled out, after all I can always learn something from the comments made and besides, preferences in writing/translating styles and choices are extremely subjective (even the best writers/translators are vilified by some readers), but it would be good to understand on what basis the ruling out is decided.

[Edited at 2014-09-27 13:53 GMT]
Collapse


 

Lotfi Abdolhaleem  Identity Verified
Egyiptom
Local time: 21:39
arab
+ ...
Unfair screening out mechanism. Sep 23, 2014

I felt sad for the precious time and efforts I spend professionally criticizing the contests for this to end up with unfair measures of ruling out I never thought of.
I believe that criticizing the contests by the contestants is OK, but the voting/evaluating phase should not be done by the contestants too, since honesty and subjectivity cannot be guaranteed.

I definitely wasted my time twice: Once when I participated (for the first time), and the second when I helped reviewing
... See more
I felt sad for the precious time and efforts I spend professionally criticizing the contests for this to end up with unfair measures of ruling out I never thought of.
I believe that criticizing the contests by the contestants is OK, but the voting/evaluating phase should not be done by the contestants too, since honesty and subjectivity cannot be guaranteed.

I definitely wasted my time twice: Once when I participated (for the first time), and the second when I helped reviewing the contests (for the last time).


[Edited at 2014-09-23 08:51 GMT]
Collapse


 

Elizabeth Tamblin  Identity Verified
Egyesült Királyság
Local time: 19:39
Tag (2012 óta)
francia - angol
@ Vanessa Sep 23, 2014

I think it's based on the star ratings, and nothing to do with the likes or dislikes.

 

Lotfi Abdolhaleem  Identity Verified
Egyiptom
Local time: 21:39
arab
+ ...
Vanessa Sep 23, 2014

Elizabeth Tamblin wrote:

I think it's based on the star ratings, and nothing to do with the likes or dislikes.


Wonderful diagnosis!


 

souila7
Tunézia
Local time: 20:39
angol - arab
+ ...
UNFAIR RULE Sep 23, 2014

Hi Jared

First I thank Proz on this contest.

But, I really encourage you to change the way how to determine who are to be rules out. If you said it Rating, I got 14 Likes, and there is another entry who got the same likes, but we are both out. And if it is the N° of "Dislikes" who determine , I have to say that, personally, I have participated in rating, and I only give my "Dislikes" for the good translation contestors, not to lose my time with bad ones. So I think, yo
... See more
Hi Jared

First I thank Proz on this contest.

But, I really encourage you to change the way how to determine who are to be rules out. If you said it Rating, I got 14 Likes, and there is another entry who got the same likes, but we are both out. And if it is the N° of "Dislikes" who determine , I have to say that, personally, I have participated in rating, and I only give my "Dislikes" for the good translation contestors, not to lose my time with bad ones. So I think, you have to rethink about this UNFAIR RULE
Collapse


 

Jared Tabor
Local time: 16:39
MUNKATÁRS
TÉMAINDÍTÓ
Ratings determine which entries move forward, not like and dislike tags Sep 23, 2014

Ratings for "Quality of writing" and "Accuracy of translation" are what determine which entries move forward in the contest, and which entries are ruled out during the qualification round. These ratings are on a scale of 1-5, and appear next to an entry like this:



Likes and dislikes on an entry (the red
... See more
Ratings for "Quality of writing" and "Accuracy of translation" are what determine which entries move forward in the contest, and which entries are ruled out during the qualification round. These ratings are on a scale of 1-5, and appear next to an entry like this:



Likes and dislikes on an entry (the red and green tags) do not determine whether an entry moves forward or is ruled out.
Collapse


 

Rachel Fell  Identity Verified
Egyesült Királyság
Local time: 19:39
francia - angol
+ ...
? Sep 24, 2014

When a term has e.g. a disagreement, I can't see how to add a separate/additional disagreement concerning another aspect of the term.

 

FrancoisP
Franciaország
Local time: 20:39
angol - francia
+ ...
Easy Sep 25, 2014

Rachel Fell wrote:

When a term has e.g. a disagreement, I can't see how to add a separate/additional disagreement concerning another aspect of the term.


You just have to click on the word again to add another dislike (if that's what you mean when talking about disagreement).


 

FrancoisP
Franciaország
Local time: 20:39
angol - francia
+ ...
Ruling out idea Sep 25, 2014

Maybe you could add a buttton called "Substandard text" to evaluate submissions.

Once a rater has clicked on it, the text would be flagged for other raters who could then validate or not the ruling out.

Thus, bad translations would probably be discarded faster and raters would lose less time rating them.


 

José Henrique Lamensdorf  Identity Verified
Brazília
Local time: 16:39
angol - portugál
+ ...
Az Ő emlékére:
The halo effect Sep 25, 2014

FrancoisP wrote:

Maybe you could add a buttton called "Substandard text" to evaluate submissions.

Once a rater has clicked on it, the text would be flagged for other raters who could then validate or not the ruling out.

Thus, bad translations would probably be discarded faster and raters would lose less time rating them.


I think it shouldn't be so wide open.

This flag would create a prompt, a nudge, or whatever you'd like to call it for other reviewers to discard that entry without reading.

I'd suggest it be automated. After, say, 10% of the number of entries have checked it for binning, it would be automatically removed.

Example:
Pair: from Kardashian to Lower Slobovian
Entries: 43

When 4 evaluators check it as "substandard", it goes out automatically.

To make it transparent, there should be an option (for more patient raters) to "see discarded entries". Then they can recycle it by clicking on "I don't think this entry is substandard".


 

Anochko
Belarusz
francia - orosz
+ ...
How are rated entries? Sep 25, 2014

Sorry for my bad English, it isn't my working language.

I don't understand how are rated entries

If an entry recieves 5 stars from a voter, 4 stars from another voter and 3 stars from the third voter how is the final rating?

(3+4+5)/3 = 4

or

3+4+5 = 12



[Edited at 2014-09-25 18:42 GMT]


 
A témához tartozó oldalak:   < [1 2 3] >


To report site rules violations or get help, contact a site moderator:

A fórum moderátora(i)
Jared Tabor[Call to this topic]

You can also contact site staff by submitting a support request »

Entries in the qualification round can be "ruled out", a few more adjustments are on the way

Advanced search






TM-Town
Manage your TMs and Terms ... and boost your translation business

Are you ready for something fresh in the industry? TM-Town is a unique new site for you -- the freelance translator -- to store, manage and share translation memories (TMs) and glossaries...and potentially meet new clients on the basis of your prior work.

More info »
PerfectIt consistency checker
Faster Checking, Greater Accuracy

PerfectIt helps deliver error-free documents. It improves consistency, ensures quality and helps to enforce style guides. It’s a powerful tool for pro users, and comes with the assurance of a 30-day money back guarantee.

More info »



Forums
  • All of ProZ.com
  • Terminológiai keresés
  • Munkák
  • Fórumok
  • Multiple search