Research methods

Running Experiments with Amazon Mechanical Turk

I’ll start by saying that I think Amazon Mechanical Turk (MTurk) and online markets offer no less than a revolution in experimental psychology. By now, I’ve already ran half a dozen successful experiments on MTurk and have come to consider it as one of the most important tools available to me as an experimental social [...] [...]

Quick Qualtrics Tricks #3 : Scale results calculation

There are time when you’re running a Quatrics survey and would like to calculate the results during survey run on the fly and present this back to the user. Even if it’s not as straight forward there is an advanced way to do this with Qualtrics. The most basic way to do this it [...] [...]

Quick Qualtrics Tricks #2 : Signup forms

It’s very easy to setup Qualtrics as a signup form, and I’ve found this to be a far more efficient method than many of the other participant signup systems out there. I often use Qualtrics when asking participants to sign up for experiment sessions and it works terrific. The secret ingredient for signup forms with [...] [...]

Quick Qualtrics Tricks #1

To collect survey data and run survey based manipulations I use Qualtrics. Even if all you need is run a survey, I would still generally recommend to administer that to your participants in a computer lab using a computerized survey. In the time that I’ve been using Qualitrics I’ve learned a few neat tips and [...] [...]

Data Collection : Survey Websites & Social Web

It’s a relatively new way to look at data collection and participant engagement. Rather than pursuing potential participants to fill out your surveys, a few online project are using social media to attract participants to fill out the surveys for their own benefits, possibly creating some of the most comprehensive datasets available for those scales. [...] [...]

Implicit Measurements of Personal Values

In the 90s the personal values research domain led by Rokeach (1968, 1970) has gained a significant momentum with Schwartz’s work identifying ten cross-cultural value categories falling into two dimensions on a circumplex : self-enhancement vs. self-transcendence and conservation vs. openness to change. Most of the research in this domain followed value measurement using the [...] [...]

Implicit Association Test Experiment Software

Implicit Association Test (IAT) is a psychological measure aimed at tapping into a person’s implicit mental attitudes towards a certain concept or issue. Greenwald, McGhee and Schwartz (1998) have led the way to the method that has now become widely used in many domains in social psychology and cognition. The general basic IAT procedure is [...] [...]

Questionnaires & Experiments with Coupon-Paid Participants

Lots of missing data and failed manipulations are just some of the issues you may encounter while running questionnaires or experiments with coupon based or paid participants, especially students, especially undergrad students. They lack motivation & they want to finish the pain as soon as possible, so getting them to actually read the questions and [...] [...]

Resources on Conducting a Meta-Analysis

If you’re looking for some good resources on meta-analysis – what it is, how to run it, and how to evaluate it – then following is a list of resources I found helpful on the topic : David Wilson’s page on “Meta analysis stuff” – terrific Powerpoint presentation slides as well as SPSS/STATA/SAS/Excel macros and [...] [...]

Free Concordance / Keyword Frequency Text Analysis Tools

Doing qualitative research that involves text analysis for either keyword frequency or concordance context related review? I complied a list of a few free basic software packages that might help you with that. You should be able to do a simple keyword frequency lookup, keyword search, context concordance viewing of occurrences, with basic import and [...] [...]

Gilad Feldman