To collect survey data and run survey based manipulations I use Qualtrics. Even if all you need is run a survey, I would still generally recommend to administer that to your participants in a computer lab using a computerized survey. In the time that I’ve been using Qualitrics I’ve learned a few neat tips and tricks through trail and error and correspondence with the very helpful support team. I figured I might as well add those here, since I’m not sure where – if at all – this info can be found.
Controlling survey run
When running experiments using Qualtrics surveys in the classroom you would sometimes like to limit the participants to only be able to answer the questionnaire and not be able to open any other windows or tabs or to browse the web. Is there a way to limit the computer functionality while running the Qualtrics survey?
2. You could set up the web browser settings to be in full screen mode so that the respondent cannot see anything on the computer but can only see the Qualtrics survey web page. I know that this can be done on a Mac by selecting Shift+Command, then "F".
Getting the user to indicate agreement
Sometime you might need the users to sign not to disclose experiment related information by writing down something like "I AGREE" to indicate that they’re read and agreed to the terms . You would then need Qualtrics to validate the text.
There is a way of doing this using Custom Validation. First click the text "Custom Validation" on the right sidebar. Then set up validation like is shown below:
Then choose to create a custom message:
Qualtrics can run all the surveys on SSL, if you’re in need of secure sessions, say, for a Facebook App (guidelines starting October 1st 2011 enforce this). Just change the address to HTTPS instead of the default HTTP.
The randomizer randomizing between conditions (questions) sometimes creates a strong bias for more participants in one of the conditions. Is there a way to set it so that number of participants for each condition would be fixed?
You might consider setting up your conditions in separate blocks. If you do the randomization within your Survey Flow rather than using the question randomizer, you’ll see that there’s an option to "Present Elements Evenly". When this option is turned on, individual conditions will automatically be prevented from being displayed more than other conditions (each condition can only be displayed one more time than another).
This is to help administer the exact same questionnaire randomly assigned in two languages. So, basically, we have two sets of questionnaires, one complete in language 1 (Chinese) and one complete in language 2 (English) and then randomly assign (evenly distributed, if possible) the subjects between those questionnaires with an indication of which of the groups they were assigned to. Both the questions and the general outline (like “next question” button and background) will all be consistently in the same language.
Create two separate surveys. Create the survey in one language first (English), then copy it any translate it into the other language (Chinese). Make sure you make the surveys identical. Now, create a third survey that is the "randomizing" survey. Include only a randomizer in the Survey Flow that chooses one of two survey links (your other two surveys). You can click Customize on the End of Survey elements to add the modified forwarding behavior to redirect to one of your two surveys. Be sure to add the following (without the quotations) to the end of your two survey links: "&Q_lang=EN" for the English survey and "&Q_lang=ZH" for the Chinese survey. This will force the instructions and error messages to appear in the proper language.
Passing variables to Qualtrics
You can run Qualtrics together with a HTML/PHP and pass variables (USERNAME or ID) from Qualtrics to the PHP software and vice versa.
Typically, if you’d like to pass a unique identifier from Qualtrics to a secondary web application, you would redirect from the Qualtrics survey to the secondary application while appending the unique ID to the URL as a GET parameter. Piped text can be utilized in the URL redirect to pass this unique data.
In the survey options you’ll specify the end of survey redirects to a URL and specify the URL like this:
The ResponseID variable is defined for every Qualtrics response and is available without any further customization.
If you’re looking to do the other way around, here are some good tutorials:
- Pass data to a Qualtrics survey and display it in the survey and reports
- Save information from a URL
BTW, University of Michigan has a good wiki on some pretty advanced Qualtrics usage.
Hope that helps. Know any other neat tricks? Let us know in the comments.