Pre-analysis plan: Was the event well organised?
Instrument: Was the event well organised?
Authors: Demo author
Version: 1.0.0
Date: 16 November 2026
Instrument hash (SHA-256):
fab7ddf43799e6e6f52be79a288a62dc103e2b291dc3abc2ee862bab96380147
The hash identifies the instrument file this plan describes. Anyone can check that a .sframe file is the one planned by opening it at https://surveyframe.org/verify or with read_sframe() in R.
Study
Purpose: A thesis questionnaire measuring how well organised attendees found an event, on a 4-item Likert scale with 1 reverse-worded item.
Research problem: A student’s thesis needs a short scale of perceived event organisation, and the scale must hold together before its score is used.
| Objective | Research questions |
|---|---|
| O1: Describe how organised the event felt to attendees. | RQ1 (How does the scale score overall?) |
| O2: Check that the organisation scale is reliable. | RQ2 (Is the scale internally consistent?); RQ3 (Is the scale internally consistent according to omega?); RQ4 (Does any item sit poorly with the rest?) |
Population: Attendees of a regional conference
Sampling method: convenience
Planned sample size: 80
Participant information
Welcome title: Was the event well organised?
Introduction: Thank you for taking part. This survey takes a few minutes.
Consent (required to start): I agree to take part, and for my answers to be used for this study.
Thank-you message: Thank you for completing this survey.
The questionnaire
The questions in the order respondents see them.
- The event ran to time. (Rating scale). Options: Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly agree.
- It was easy to find my way around. (Rating scale). Options: Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly agree.
- Staff were helpful when I had a question. (Rating scale). Options: Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly agree.
- I struggled to work out where to go. (Rating scale). Options: Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly agree.
Scales and scoring
| Scale | Items | Reversed | Score | Missing answers |
|---|---|---|---|---|
| Perceived organisation (organisation) | org_1, org_2, org_3, org_4 | org_4 | mean | all 4 items needed |
Pre-declared analysis plan
RQ1: How does the scale score overall?
Method: Scale score descriptive statistics
RQ2: Is the scale internally consistent?
Planned decision rule: Treat the scale as reliable when Cronbach’s alpha is .70 or above.
Method: Cronbach’s alpha (internal consistency)
Method reference: (Cronbach, 1951)
RQ3: Is the scale internally consistent according to omega?
Planned decision rule: Treat the scale as reliable when omega is .70 or above.
Method: McDonald’s omega (internal consistency)
Method reference: (Cronbach, 1951) (McDonald, 1999)
RQ4: Does any item sit poorly with the rest?
Planned decision rule: Review any item whose corrected item-total correlation is below .30.
Method: Item diagnostics
Amendments
None. This is the instrument as first planned.
References
- Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297–334.
- McDonald, R. P. (1999). Test theory: A unified treatment. Lawrence Erlbaum.
- R Core Team. (2026). R: A language and environment for statistical computing. R Foundation for Statistical Computing.
- Sharafuddin, M. A. (2026). surveyframe: Design, Plan, Seal and Report Questionnaire Studies (Version 0.4.3) [Computer software]. https://github.com/MohammedAliSharafuddin/surveyframe
To complete before submission
A preregistration also asks for these. Write each answer on its line before you submit the plan, or add it to the instrument’s study.
Exclusion rules: which responses will be excluded, and why.
________________________________________
Stopping rule: when data collection ends: a date, a sample size or another rule.
________________________________________
Primary outcomes: the outcomes that answer the main question.
________________________________________
Secondary outcomes: the secondary outcomes.
________________________________________
Multiplicity: how the tests are corrected for being run together, if at all.
________________________________________
Contingency decisions: what you will do if an assumption fails or the planned sample is not reached.
________________________________________
Significance level: the alpha each test is judged against.
________________________________________