Pilot survey with a small sample
Source:vignettes/articles/templates/pilot-survey-small-sample.Rmd
pilot-survey-small-sample.RmdA pilot with 18 participants that answers the main study’s questions with methods suited to a small sample: a rank-based comparison, an exact test and a penalised logistic regression. surveyframe gives you the questionnaire, the pre-analysis plan and the report.
Preview the questionnaire
This is the questionnaire as respondents see it. It is a preview to try, and it stores no answers. Open the Pilot survey with a small sample preview in a new tab.
The example analysis plan
Before any data is collected, surveyframe writes the pre-analysis plan: the study, the questionnaire, each research question with its hypotheses, method and decision rule, and the fields a preregistration still asks you to complete. Read the Pilot survey with a small sample plan, or download the Pilot survey with a small sample instrument (.sframe) to adapt it.
Methods it declares: Mann-Whitney U test, Fisher’s exact test, Firth logistic regression.
Open this instrument in SurveyStudio
- Set up R, RStudio and surveyframe as Get started shows.
- To explore the example with its demonstration responses, open
RStudio’s Addins menu, choose surveyframe: Try
a demo and pick
small_sample, which opens this template’s study. - To make it your own study, download the instrument above, choose surveyframe: Open analysis workspace from the Addins menu, then Open Instrument in SurveyStudio’s left menu, and select the file.
- Adapt the questions on the Design screen and the research questions under Plan, press Save to Studio, then press Download copy on the Report screen to save your study.
Questions
Which tests suit fewer than 30 participants?
The example plan includes methods often considered for small samples: the Mann-Whitney U test, Fisher’s exact test and Firth logistic regression. Choose methods that fit your design, measurements and assumptions, and the guide to small samples explains the example’s choices.
Optional R code
Open this study in R
d <- sframe_demo("small_sample")
render_report(d$instrument) # the pre-analysis plan
results <- run_analysis_plan(d$responses, d$instrument)



