opportunity__cost

http://live.prokhorenko.us
Nov 6 2010

Three Lessons From Using Mechanical Turk

Conclusion

Lastly, we found that in order to get these fairly high quality numbers, we had to run the same gig with three workers.  I.e. have three workers categorize each dress.  We took the majority "vote" of the categories and found this to improve our quality significantly (as opposed to having just one worker do each gig).  $3 for a good categorization of 100 dresses is great!  Takeaways: run a gig 3 times, pay as little as possible, and be super clear in creating your gig.

Pretty interesting write up of using Amazon's Mechanical Turk for making people sort out some data, that is still expensive or too inaccurate to be sorted automatically.

In addition to this blog, I also run a Startup Product newsletter.

To subscribe, enter your email address:      

Delivered by TinyLetter

About Olexandr Prokhorenko

My name is Olexandr Prokhorenko. I am passionate about building products that users *love*.

My LinkedIn profile is www.linkedin.com/in/white.


TwitterFacebookLinkedInFriendfeedPicasaFlickrYoutubeVimeoDeliciousLivejournalBloggerScribd

Search Blog

@iwhite   

Tags