social science experiments on Mechanical Turk
There’s a neat blog up called Experimental Turk whose purpose is:
reporting evidence concerning the reliability of Amazon Mechanical Turk as an online subject pool for experiments in economics, psychology, and social sciences in general.
The authors have been running classic experiments from social science on Turk (e.g., some of Kahneman & Tversky’s classic work on judgment heuristics and biases) and posting to the blog with the result, comparing the Mechanical Turk results to known effects found in the laboratory. This is a great way to start getting a better sense of data reliability on Turk, and they encourage other researchers to collaborate. Take a look!