A law of ordinal random error: The Rasch measurement model and random error distributions of ordinal assessments

David Andrich, Pender Pedler

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

Assessments in ordered categories are ubiquitous in educational, social and health sciences. These assessments are analogous to measurements in the natural sciences in that an idealised linear continuum is partitioned by successive thresholds into contiguous, ordered categories. In advanced analyses, the ordinal assessments are characterised with a probabilistic model as a function of a vector of threshold parameters defining the categories and a scalar parameter for the entity of measurement which is taken to be a measurement on an interval scale with an arbitrary origin and unit. One such model is the Rasch measurement model. If the ordinal assessments fit the model the probability distribution is taken to be a random error distribution of inferred replicated assessments. Therefore, it is analogous to the Gaussian random error distribution of replicated measurements known as the law of error. However, the Gaussian distribution is strictly log-concave which makes it unimodal with a smooth transition between probabilities of adjacent measurements. Such a distribution, referred to as randomly unimodal, ensures there is no evidence that unknown factors have produced systematic errors, and in turn justifies the mean as an estimate of the measure of the entity. The paper establishes that random unimodality arises from the natural ordering of the thresholds in the Rasch measurement model. Then by analogy to the Gaussian law of error, a distribution of ordinal assessments that has its thresholds in the natural order and fits the Rasch model may be said to satisfy the law of ordinal error. Again by analogy to Gaussian distribution with respect to replicated measurements, the law of ordinal error ensures that no unaccounted-for factors have produced systematic errors and that the estimates of the scalar parameter of the Rasch model can be taken as an estimate of the measure of the entity assessed. (C) 2018 Elsevier Ltd. All rights reserved.

Original languageEnglish
Pages (from-to)771-781
Number of pages11
JournalMeasurement
Volume131
DOIs
Publication statusPublished - Jan 2019

Cite this

@article{84e48b84dd0240c48a6e4280bbe05e4a,
title = "A law of ordinal random error: The Rasch measurement model and random error distributions of ordinal assessments",
abstract = "Assessments in ordered categories are ubiquitous in educational, social and health sciences. These assessments are analogous to measurements in the natural sciences in that an idealised linear continuum is partitioned by successive thresholds into contiguous, ordered categories. In advanced analyses, the ordinal assessments are characterised with a probabilistic model as a function of a vector of threshold parameters defining the categories and a scalar parameter for the entity of measurement which is taken to be a measurement on an interval scale with an arbitrary origin and unit. One such model is the Rasch measurement model. If the ordinal assessments fit the model the probability distribution is taken to be a random error distribution of inferred replicated assessments. Therefore, it is analogous to the Gaussian random error distribution of replicated measurements known as the law of error. However, the Gaussian distribution is strictly log-concave which makes it unimodal with a smooth transition between probabilities of adjacent measurements. Such a distribution, referred to as randomly unimodal, ensures there is no evidence that unknown factors have produced systematic errors, and in turn justifies the mean as an estimate of the measure of the entity. The paper establishes that random unimodality arises from the natural ordering of the thresholds in the Rasch measurement model. Then by analogy to the Gaussian law of error, a distribution of ordinal assessments that has its thresholds in the natural order and fits the Rasch model may be said to satisfy the law of ordinal error. Again by analogy to Gaussian distribution with respect to replicated measurements, the law of ordinal error ensures that no unaccounted-for factors have produced systematic errors and that the estimates of the scalar parameter of the Rasch model can be taken as an estimate of the measure of the entity assessed. (C) 2018 Elsevier Ltd. All rights reserved.",
keywords = "Measurement error, Error distributions, Ordered categories, Ordinal counts, Log-concave, Rasch model",
author = "David Andrich and Pender Pedler",
year = "2019",
month = "1",
doi = "10.1016/j.measurement.2018.08.062",
language = "English",
volume = "131",
pages = "771--781",
journal = "Measurement: Journal of the International Measurement Confederation",
issn = "0263-2241",
publisher = "Elsevier",

}

A law of ordinal random error : The Rasch measurement model and random error distributions of ordinal assessments. / Andrich, David; Pedler, Pender.

In: Measurement, Vol. 131, 01.2019, p. 771-781.

Research output: Contribution to journalArticle

TY - JOUR

T1 - A law of ordinal random error

T2 - The Rasch measurement model and random error distributions of ordinal assessments

AU - Andrich, David

AU - Pedler, Pender

PY - 2019/1

Y1 - 2019/1

N2 - Assessments in ordered categories are ubiquitous in educational, social and health sciences. These assessments are analogous to measurements in the natural sciences in that an idealised linear continuum is partitioned by successive thresholds into contiguous, ordered categories. In advanced analyses, the ordinal assessments are characterised with a probabilistic model as a function of a vector of threshold parameters defining the categories and a scalar parameter for the entity of measurement which is taken to be a measurement on an interval scale with an arbitrary origin and unit. One such model is the Rasch measurement model. If the ordinal assessments fit the model the probability distribution is taken to be a random error distribution of inferred replicated assessments. Therefore, it is analogous to the Gaussian random error distribution of replicated measurements known as the law of error. However, the Gaussian distribution is strictly log-concave which makes it unimodal with a smooth transition between probabilities of adjacent measurements. Such a distribution, referred to as randomly unimodal, ensures there is no evidence that unknown factors have produced systematic errors, and in turn justifies the mean as an estimate of the measure of the entity. The paper establishes that random unimodality arises from the natural ordering of the thresholds in the Rasch measurement model. Then by analogy to the Gaussian law of error, a distribution of ordinal assessments that has its thresholds in the natural order and fits the Rasch model may be said to satisfy the law of ordinal error. Again by analogy to Gaussian distribution with respect to replicated measurements, the law of ordinal error ensures that no unaccounted-for factors have produced systematic errors and that the estimates of the scalar parameter of the Rasch model can be taken as an estimate of the measure of the entity assessed. (C) 2018 Elsevier Ltd. All rights reserved.

AB - Assessments in ordered categories are ubiquitous in educational, social and health sciences. These assessments are analogous to measurements in the natural sciences in that an idealised linear continuum is partitioned by successive thresholds into contiguous, ordered categories. In advanced analyses, the ordinal assessments are characterised with a probabilistic model as a function of a vector of threshold parameters defining the categories and a scalar parameter for the entity of measurement which is taken to be a measurement on an interval scale with an arbitrary origin and unit. One such model is the Rasch measurement model. If the ordinal assessments fit the model the probability distribution is taken to be a random error distribution of inferred replicated assessments. Therefore, it is analogous to the Gaussian random error distribution of replicated measurements known as the law of error. However, the Gaussian distribution is strictly log-concave which makes it unimodal with a smooth transition between probabilities of adjacent measurements. Such a distribution, referred to as randomly unimodal, ensures there is no evidence that unknown factors have produced systematic errors, and in turn justifies the mean as an estimate of the measure of the entity. The paper establishes that random unimodality arises from the natural ordering of the thresholds in the Rasch measurement model. Then by analogy to the Gaussian law of error, a distribution of ordinal assessments that has its thresholds in the natural order and fits the Rasch model may be said to satisfy the law of ordinal error. Again by analogy to Gaussian distribution with respect to replicated measurements, the law of ordinal error ensures that no unaccounted-for factors have produced systematic errors and that the estimates of the scalar parameter of the Rasch model can be taken as an estimate of the measure of the entity assessed. (C) 2018 Elsevier Ltd. All rights reserved.

KW - Measurement error

KW - Error distributions

KW - Ordered categories

KW - Ordinal counts

KW - Log-concave

KW - Rasch model

U2 - 10.1016/j.measurement.2018.08.062

DO - 10.1016/j.measurement.2018.08.062

M3 - Article

VL - 131

SP - 771

EP - 781

JO - Measurement: Journal of the International Measurement Confederation

JF - Measurement: Journal of the International Measurement Confederation

SN - 0263-2241

ER -