Cheating on Amazon Mechanical Turk

I frequently use Amazon Mechanical Turk for research. One of the common questions I’ve been asked about the use of MTurk is with regards to the quality of data. Some have voiced concern that the data provided by MTurk workers is noisy since the MTurk workers tend to act unethically if given the right incentive, and because they’re [...] [...]

Running Experiments with Amazon Mechanical Turk

I’ll start by saying that I think Amazon Mechanical Turk (MTurk) and online markets offer no less than a revolution in experimental psychology. By now, I’ve already ran over fifty successful experiments on MTurk and have come to consider it as one of the most important tools available to me as an experimental social psychologist. [...] [...]

Quick Qualtrics Tricks #3 : Scale results calculation

There are time when you’re running a Quatrics survey and would like to calculate the results during survey run on the fly and present this back to the user. Even if it’s not as straight forward there is an advanced way to do this with Qualtrics.   The most basic way to do this it [...] [...]

Quick Qualtrics Tricks #1

To collect survey data and run survey based manipulations I use Qualtrics. Even if all you need is run a survey, I would still generally recommend to administer that to your participants in a computer lab using a computerized survey. In the time that I’ve been using Qualitrics I’ve learned a few neat tips and [...] [...]

Data Collection : Survey Websites & Social Web

It’s a relatively new way to look at data collection and participant engagement. Rather than pursuing potential participants to fill out your surveys, a few online project are using social media to attract participants to fill out the surveys for their own benefits, possibly creating some of the most comprehensive datasets available for those scales. [...] [...]

Implicit Measurements of Personal Values

In the 90s the personal values research domain led by Rokeach (1968, 1970) has gained a significant momentum with Schwartz’s work identifying ten cross-cultural value categories falling into two dimensions on a circumplex : self-enhancement vs. self-transcendence and conservation vs. openness to change. Most of the research in this domain followed value measurement using the [...] [...]

Implicit Association Test Experiment Software

Implicit Association Test (IAT) is a psychological measure aimed at tapping into a person’s implicit mental attitudes towards a certain concept or issue. Greenwald, McGhee and Schwartz (1998) have led the way to the method that has now become widely used in many domains in social psychology and cognition. The general basic IAT procedure is [...] [...]