How Crowdsourcable is Your Task?
Carsten Eickhoff and Arjen de Vries. CSDM'11. https://www.ischool.utexas.edu/~ml/restricted/csdm2011_eickhoff.pdf
Browse Popular Ideas
-
This idea is active.Papers to Read »6 comments
-
This idea is active.Papers to Read »
Using Crowdsourcing and Active Learning to Track Sentiment in On
20 commentsBrew, A. and Green, D. Using Crowdsourcing and Active Learning to Track Sentiment in Online Media. In Proc. of PAIS 2010, pages 1-11. IOS Press, 2010. http://irserver.ucd.ie/dspace/bitstream/10197/2028/1/PAIS-2010-Open.pdf
-
This idea is active.Papers to Read »
Guidelines for Designing Crowdsourcing-based Relevance Experiments
1 commentO.Alonso. SIGIR 2009 Workshop on Future of Search Evaluation (poster)
-
This idea is active.
-
This idea is active.Papers to Read »
The Labor Economics of Paid Crowdsourcing
John Horton, Lydia Chilton Crowdsourcing is a form of "peer production" in which work traditionally performed by an employee is outsourced to an "undefined, generally large group of people in the form of an open call." We present a model of workers supplying labor to paid crowdsourcing projects. We also introduce a novel method for estimating a worker's reservation wage--the smallest wage a worker is willing to accept ...more »
2 commentsJohn Horton, Lydia Chilton
Crowdsourcing is a form of "peer production" in which work traditionally performed by an employee is outsourced to an "undefined, generally large group of people in the form of an open call." We present a model of workers supplying labor to paid crowdsourcing projects. We also introduce a novel method for estimating a worker's reservation wage--the smallest wage a worker is willing to accept for a task and the key parameter in our labor supply model. It shows that the reservation wages of a sample of workers from Amazon's Mechanical Turk (AMT) are approximately log normally distributed, with a median wage of $1.38/hour. At the median wage, the point elasticity of extensive labor supply is 0.43. We discuss how to use our calibrated model to make predictions in applied work. Two experimental tests of the model show that many workers respond rationally to offered incentives. However, a non-trivial fraction of subjects appear to set earnings targets. These "target earners" consider not just the offered wage--which is what the rational model predicts--but also their proximity to earnings goals. Interestingly, a number of workers clearly prefer earning total amounts evenly divisible by 5, presumably because these amounts make good targets.
http://arxiv.org/pdf/1001.0627v1
« less full details »
-
This idea is active.Papers to Read »
Annotating Named Entities in Twitter Data with Crowdsourcing
3 commentsTim Finin,Will Murnane, Anand Karandikar, Nicholas Keller and Justin Martineau
Proceedings of the NAACL Workshop on Creating Speech and Text Language Data With Amazon's Mechanical Turk 2010
-
This idea is active.Papers to Read »
Soylent: A Word Processor with a Crowd Inside
16 commentsBernstein, M., Little, G., Miller, R.C., Hartmann, B., Ackerman, M., Karger, D.R., Crowell, D., and Panovich, K. UIST 2010. ACM Press. Best Student Paper award. http://groups.csail.mit.edu/uid/other-pubs/soylent.pdf http://projects.csail.mit.edu/soylent/
-
This idea is active.Papers to Read »
Crowdsourcing for Usability
8 commentsCrowdsourcing for Usability. Kittur et al. http://www.clickadvisor.com/downloads/Kittur_2009_Crowdsourcing_for_Usability.pdf
-
This idea is active.Papers to Read »
Crowdsourcing and language studies
3 commentsMunro, R. and Bethard, S. and Kuperman, V. and Lai, V.T. and Melnick, R. and Potts, C. and Schnoebelen, T. and Tily, H. NAACL Workshop on Creating Speech and Language Data With Amazon’s Mechanical Turk
http://www.stanford.edu/~cgpotts/papers/munro-etal-mturk2010.pdf
-
This idea is active.Papers to Read »
Design and Implementation of Relevance Assessments using Crowdso
Add your commentO Alonso and R. Baeza-Yates. To appear at ECIR'11. https://www.ischool.utexas.edu/~ml/restricted/csdm2011_alonso.pdf (restricted access; do not distribute)
-
This idea is active.Papers to Read »
Crowd-Sourced Sensing and Collaboration Using Twitter
3 commentsMurat Demirbas, Murat Ali Bayir, Cuneyt G Akcora, Yavuz Yilmaz, Hakan Ferhatosmanoglu
IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks (WoWMoM 2010)
http://www.cse.ohio-state.edu/~hakan/publications/CrowdTwitter.pdf
-
This idea is active.Papers to Read »
Active Learning and Crowd-Sourcing for Machine Translation
3 commentsVamshi Ambati, Stephan Vogel and Jaime Carbonell
Proceedings of the Seventh conference on International Language Resources and Evaluation (LREC'10)
-
This idea is active.Papers to Read »
Labeling images with a computer game
2 commentsLuis Von Ahn, Laura Dabbish
Proceedings of the SIGCHI conference on Human
factors in computing systems
-
This idea is active.Papers to Read »
Moving the crowd at iStockphoto
2 commentsDaren C. Brabham. First Monday, Volume 13 Number 6 - 2 June 2008.
http://firstmonday.org/htbin/cgiwrap/bin/ojs/index.php/fm/article/viewArticle/2159/1969
-
This idea is active.Papers to Read »
Learning from crowds
Add your commentVikas C. Raykar, Shipeng Yu, Linda H. Zhao, Gerardo Valadez, Charles Florin, Luca Bogoni, and Linda Moy, Journal of Machine Learning Research, 11(Apr):1297−1322, 2010
http://www.umiacs.umd.edu/~vikas/publications/raykar_JMLR_2010_crowds.pdf
-
This idea is active.
-
This idea is active.Papers to Read »
CrowdSearch: exploiting crowds for accurate real-time image sear
16 comments@conference{yan2010crowdsearch,
title={{CrowdSearch: exploiting crowds for accurate real-time image search on mobile phones}},
author={Yan, T. and Kumar, V. and Ganesan, D.},
booktitle={Proceedings of the 8th international conference on Mobile systems, applications, and services},
pages={77--90},
year={2010},
organization={ACM}
}
-
This idea is active.Papers to Read »
reCAPTCHA: Human-Based Character Recognition via Web Security Me
1 commentvon Ahn, L., Maurer, B., McMillen, C., Abraham, D., and Blum, M. (2008)
Science, September 12, 2008. Pages 1465-1468
-
This idea is active.Papers to Read »
Who are the Crowdworkers?: Shifting Demographics in Amazon Mecha
17 commentsRoss, J., Irani, I., Silberman, M. Six, Zaldivar, A., and Tomlinson, B. (2010). In: CHI EA 2010. (2863-2872). http://portal.acm.org/citation.cfm?id=1753873
-
This idea is active.Papers to Read »
Shirky and Sanger, or the cost of crowdsourcing
3 commentsO'Neil, M., 2010: Shirky and Sanger, or the cost of crowdsourcing. Journal of Science Communication 09(01) C04. PDF attached.
An examination of two approaches to encylopedic knowledge (expert and amateur) and the relative costs (in terms of production as well as value).
-
This idea is active.Papers to Read »
Crowdsourcing: How and Why Should Libraries Do It?
17 commentsRose Holley
National Library of Australia
D-Lib Magazine
March/April 2010
Volume 16, Number 3/4
-
This idea is active.Papers to Read »
Crowdsourcing and the Question of Expertise.
1 commentRoman, David
Communications of the ACM; Dec2009, Vol. 52 Issue 12, p12-12, 2/3p, 1 Color Photograph
-
This idea is active.Papers to Read »
Crowdsourcing the Indexing of Film and Television Media
15 commentsUT-Gary Geisler, Geoff Willard, and Eryn Whitworth
-
This idea is active.Papers to Read »
Crowdsourcing Assessments for XML Ranked Retrieval
Add your comment@article{alonso2010crowdsourcing,
title={{Crowdsourcing Assessments for XML Ranked Retrieval}},
author={Alonso, O. and Schenkel, R. and Theobald, M.},
journal={Advances in Information Retrieval},
pages={602--606},
year={2010},
publisher={Springer}
}
-
This idea is active.Papers to Read »
Modeling Annotator Accuracies for Supervised Learning.
3 commentsAbhimanu Kumar and Matthew Lease. CSDM'11. https://www.ischool.utexas.edu/~ml/restricted/csdm2011_kumar.pdf
Social Web