Contributors   |   Messages   |   Polls   |   Resources   |  
Comments
Newest First | Oldest First | Threaded View
<<   <   Page 2 / 16   >   >>
Ariella
Ariella
12/21/2016 3:27:59 PM
User Rank
Author
Re: Winner
@Joe interesting, I wonder if they will be transparent about the extent of the impact.

50%
50%
Joe Stanganelli
Joe Stanganelli
12/21/2016 1:12:51 PM
User Rank
Author
Re: Winner
@mhh: I'm aware of/familiar with the AMZN Mechanical Turks but have not participated in or contracted with the program.  (Some critiques I've seen here (link) and here (link)).

That said, because of the grueling workload of an active participant -- who typically gets paid pennies per pop ($0.02 to $0.10) -- I tend to think you may, for some especially topical cartoons, face a certain barrier in finding enough participants who are familiar enough with the subject matter of the vertical, replete with background and subtleties.  (We are a rather niche community, after all, are we not?)

Or, to put it another way, I humbly posit that you get what you pay for.

But you seem to be much more familiar with it?  What has your experience been?  Would you say that my gut reaction is too ignorant/cynical?  I'd like to learn more.

50%
50%
Joe Stanganelli
Joe Stanganelli
12/21/2016 1:02:25 PM
User Rank
Author
Re: Winner
@Mike: Granted, I'm a contributor to this very issue, but it's worth considering that she sheer *volume* of entries makes asking community members to vote fairly, judiciously, and equitably on what may be close to 100 entries inherently problematic, in my estimation.

For this reason, I reiterate my suggestion of a judge or judging panel that at least unilaterally decides a shortlist for voting -- if not decides the winners outright.

(What about tossing the artist -- since it is his work, after all -- a couple extra bucks to have to read all the entries (anonymized, if that is deemed helpful) and create a shortlist?  (J. Klossner did this on at least one occasion, yes?)  Then you as the judge, or a judging panel, or the voters would have a MUCH easier and more realistic task at hand.

50%
50%
Joe Stanganelli
Joe Stanganelli
12/21/2016 12:55:36 PM
User Rank
Author
Re: Winner
> What about a similar requirement that if you put in an entry you also have to vote?

This could go either way.  It could result in better results.  Or it could result in 9-way ties among subpar entries as people "waste" their required vote.

(Disclaimer, incidentally: I stand by every vote I've made as a vote for a caption that genuinely made me laugh.  As a lawyer, I'm just naturally inclined to see perverse incentives and risks that exist in proposals.)

50%
50%
Joe Stanganelli
Joe Stanganelli
12/21/2016 12:52:26 PM
User Rank
Author
Re: Winner
@Ariella: Relatedly, the New Yorker Cartoon Caption Contest recently started inviting people to "assess"/vote on captions before the three finalists, asking them to weigh whether a caption is "funny" or "not funny".  I am given to believe that this taken into some degree of consideration in selecting the finalists, although I am not sure what that degree is, exactly.

50%
50%
Joe Stanganelli
Joe Stanganelli
12/21/2016 12:50:48 PM
User Rank
Author
Re: Winner
@Mike: In theory, the thumbs up/thumbs down mechanism is a great way to do this.

In theory.

In practice: I am aware of a site that has a mechanism and uses users' upvotes/downvotes on its own contests.  Inevitably, trolls et alia thumb everything down.  In my experience, it is very rare to see an entry older than a day or two that ranks above a 33%.

Not that that would necessarily happen here -- but it is a risk that one opens oneself up to.

50%
50%
Ariella
Ariella
12/21/2016 9:53:51 AM
User Rank
Author
Re: Winner
@Mike I know the thumbs up and down are already in place, but I'd think you coul probably swap out a stars ranking for the captions to allow more gradations and a range of numbers to be added up rather than a single positive or negative for each vote.

50%
50%
Mike Robuck
Mike Robuck
12/21/2016 9:35:01 AM
User Rank
Author
Re: Winner
@Ariella, I think someone mentioned using the "thumbs up" and "thumbs down" as a way to determine the caption winners. Ideally we would come up with something that doesn't cost a lot, or take up a bunch of time. 

50%
50%
Ariella
Ariella
12/20/2016 2:03:42 PM
User Rank
Author
Re: Winner
@Mike I wonder if it's possible to get the voting done by having people who are active members of the community rank the captions on a system of 1 -5 or 1-10, and the one with the highest number at the end of a couple of weeks wins.

50%
50%
dmendyk
dmendyk
12/20/2016 11:40:31 AM
User Rank
Platinum
Re: Winner
And we're told elections can't be hacked. Put this one up with Boaty McBoatface as Exhibits A and B.

100%
0%
<<   <   Page 2 / 16   >   >>


Latest Articles
Italy's 5G auction could exceed a government target of raising €2.5 billion ($2.9 billion) after attracting interest from companies outside the mobile market.
The emerging-markets operator is focusing on the humdrum business of connectivity and keeping quiet about some of its ill-fated 'digitalization' efforts.
Three UK has picked Huawei over existing radio access network suppliers Nokia and Samsung to build its 5G network.
Vendor says that it's its biggest 5G deal to date.
Verizon skates where the puck is going by waiting for standards-based 5G devices to launch its mobile service in 2019.
On-the-Air Thursdays Digital Audio
Orange has been one of the leading proponents of SDN and NFV. In this Telco Transformation radio show, Orange's John Isch provides some perspective on his company's NFV/SDN journey.
Special Huawei Video
10/16/2017
Huawei Network Transformation Seminar
The adoption of virtualization technology and cloud architectures by telecom network operators is now well underway but there is still a long way to go before the transition to an era of Network Functions Cloudification (NFC) is complete.
Video
The Small Cell Forum's CEO Sue Monahan says that small cells will be crucial for indoor 5G coverage, but challenges around business models, siting ...
People, strategy, a strong technology roadmap and new business processes are the key underpinnings of Telstra's digital transformation, COO Robyn ...
Eric Bozich, vice president of products and marketing at CenturyLink, talks about the challenges and opportunities of integrating Level 3 into ...
Epsilon's Mark Daley, director of digital strategy and business development, talks about digital transformation from a wholesale service provider ...
Bill Walker, CenturyLink's director of network architecture, shares his insights on why training isn't enough for IT employees and traditional ...
All Videos
Telco Transformation
About Us     Contact Us     Help     Register     Twitter     Facebook     RSS
Copyright © 2024 Light Reading, part of Informa Tech,
a division of Informa PLC. All rights reserved. Privacy Policy | Cookie Policy | Terms of Use
in partnership with