Skip to contents

Documentation / Methods

These methods give a scale’s score and test whether its items hold together.

Assumptions. Use items that measure 1 idea, with reverse-worded items scored back. Alpha assumes items contribute equally, omega does not.

In SurveyStudio, open Plan on the Design screen, add a research question and choose the method. Choose the scale. Its items, shared answer set and reverse-scored items come from the scale defined on the Design screen. Declare the hypotheses and the decision rule before collecting responses.

Scale score descriptive statistics

SurveyStudio’s Plan screen with the Edit Analysis Plan dialog for a Scale score descriptive statistics research question, from the likert_scale demo.
SurveyStudio’s Plan screen with the Edit Analysis Plan dialog for a Scale score descriptive statistics research question, from the likert_scale demo.

In the pre-analysis plan:

RQ1. How does the scale score overall?

In the report: the APA 7 sentence and a table, with a chart where the method has one, each titled with the research question.

Cronbach’s alpha (internal consistency)

SurveyStudio’s Plan screen with the Edit Analysis Plan dialog for a Cronbach’s alpha (internal consistency) research question, from the likert_scale demo.
SurveyStudio’s Plan screen with the Edit Analysis Plan dialog for a Cronbach’s alpha (internal consistency) research question, from the likert_scale demo.

In the pre-analysis plan:

RQ2. Is the scale internally consistent? Planned decision rule: Treat the scale as reliable when Cronbach’s alpha is .70 or above.

In the report: the APA 7 sentence and a table, with a chart where the method has one, each titled with the research question.

References: Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297-334.

McDonald’s omega (internal consistency)

SurveyStudio’s Plan screen with the Edit Analysis Plan dialog for a McDonald’s omega (internal consistency) research question, from the likert_scale demo.
SurveyStudio’s Plan screen with the Edit Analysis Plan dialog for a McDonald’s omega (internal consistency) research question, from the likert_scale demo.

In the pre-analysis plan:

RQ3. Is the scale internally consistent according to omega? Planned decision rule: Treat the scale as reliable when omega is .70 or above.

In the report: the APA 7 sentence and a table, with a chart where the method has one, each titled with the research question.

References: Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297-334. McDonald, R. P. (1999). Test theory: A unified treatment. Lawrence Erlbaum.

Item diagnostics

SurveyStudio’s Plan screen with the Edit Analysis Plan dialog for a Item diagnostics research question, from the likert_scale demo.
SurveyStudio’s Plan screen with the Edit Analysis Plan dialog for a Item diagnostics research question, from the likert_scale demo.

In the pre-analysis plan:

RQ4. Does any item sit poorly with the rest? Planned decision rule: Review any item whose corrected item-total correlation is below .30.

In the report: the APA 7 sentence and a table, with a chart where the method has one, each titled with the research question.