Randomize Questions

Survey researchers frequently use randomization as a tool to combat survey bias. Randomizing the order of questions, pages, and/or answer options in your survey prevents bias introduced by order and/or survey fatigue. Within Alchemer you can randomize questions, pages and answer options!

To shuffle the order of all questions on a page

1. Click the page title to edit. (Randomizing the order of questions must be set up on each page.)
2. Go to the Logic tab.
3. Under Randomize Questions choose the option Shuffle the order of the questions on this page for each participant.
4. Save Page.

Display a given question in the same position when shuffling is enabled

1. Edit the question and go to the Logic tab.
2. Under Randomization Logic select The position of this question will not be changed when question shuffling is enabled on this page.
3. Save question.

To show a random set (you specify the number) on a page

1. Click the page title to edit. (Randomizing the order of questions must be set up on each page.)
2. Go to the Logic tab.
3. Under Randomize Questions choose the option Show a random set of questions on this page to each participant.
4. Enter the number of questions per set you wish to display.
5. Save Page.

Always show a given question when a random selection is shown

1. Edit the question and go to the Logic tab.
2. Under Randomization Logic select Always include this question when showing a random selection of questions on this page.
3. Save question.

What should I know about randomization?

• All built-in randomization features in Alchemer utilize true randomization, meaning it will not ensure even representation of elements. Our Programming Services team can assist with balanced customization if you wish!
• Randomization only affects what respondents see while they are taking your survey. The collected data will still show up in reports and exports in the order you have specified in the Build tab.
• Please use extra care when using randomization combined with logic in your surveys. If not set up properly, pages/questions used in logic statements may not be present for logic conditions. If you choose to use randomization in combination with logic we recommend testing thoroughly to ensure the survey is behaving as you intended.
• The specific order in which randomized questions were displayed to the respondent is not available.