Please use this identifier to cite or link to this item:
Title: Assessing Consistency of Effects when Applying Multilevel Models to Single-Case Data
Author: Manolov, Rumen
Ferron, John M.
Keywords: Mètodes experimentals
Investigació de cas únic
Models multinivell (Estadística)
Disseny d'experiments
Experimental methods
Single subject research
Multilevel models (Statistics)
Experimental design
Issue Date: 21-May-2020
Publisher: Springer Verlag
Abstract: In the context of single-case experimental designs, replication is crucial. On the one hand, the replication of the basic effect within a study is necessary for demonstrating experimental control. On the other hand, replication across studies is required for establishing the generality of the intervention effect. Moreover, the "replicability crisis" presents a more general context further emphasizing the need for assessing consistency in replications. In the current text, we focus on replication of effects within a study and we specifically discuss the consistency of effects. Our proposal for assessing the consistency of effects refers to one of the promising data analytical techniques: multilevel models, also known as hierarchical linear models or mixed effects models. One option is to check, for each case in a multiple-baseline design, whether the confidence interval for the individual treatment effect excludes zero. This is relevant for assessing whether the effect is replicated as being non-null. However, we consider that it is more relevant and informative to assess, for each case, whether the confidence interval for the random effects includes zero (i.e., whether the fixed effect estimate is a plausible value for each individual effect). This is relevant for assessing whether the effect is consistent in size, with the additional requirement that the fixed effect itself is different from zero. The proposal for assessing consistency is illustrated with real data and it is implemented in free user-friendly software.
Note: Versió postprint del document publicat a:
It is part of: Behavior Research Methods, 2020, vol. 52, num. 6, p. 2460-2479
Related resource:
ISSN: 1554-351X
Appears in Collections:Articles publicats en revistes (Psicologia Social i Psicologia Quantitativa)

Files in This Item:
File Description SizeFormat 
700757.pdf987.63 kBAdobe PDFView/Open

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.