The one-way analysis of variance for independent samples and the Kruskal-Wallis test in psychotherapy science
Recommendations for application and interpretation
DOI:
https://doi.org/10.15135/2021.9.1.68-86Abstract
In this third contribution in the series Statistics in Psychotherapy Science, the application use of methods for comparing k-independent samples (one-way independent ANOVA and the Kruskal-Wallis test) in the sense of a best practice approach is presented. Recommendations are given for (1) an optimal choice of procedure, (2) the use of effect sizes, (3) the designation of the relevance of the results and (4) report conventions for the presentation of results. In addition, the use of this group of procedures in the context of psychotherapy science is illustrated using examples.
References
Beck, A. T., Brown, G., Epstein, N. & Steer, R. A. (1988). An Inventory for Measuring Clinical Anxiety: Psychometric Properties. Journal of Consulting and Clinical Psychology, 56 (6), 893–897.
Beck, A. T. & Steer, R. A. (1990). Manual für the Beck Anxiety Inventory. San Antonio, TX: Psychological Corporation.
Bender, R., Lange, St. & Ziegler, A. (2007). Multiples Testen. Dtsch Med Wochenschr, 132, 26–29
Bortz, J. (2006). Statistik: Für Human-und Sozialwissenschaftler. Heidelberg: Springer Medizin Verlag.
Chow, S.C., Shao, J., Wang, H., Lokhnygina, Y. (2018). Sample Size Calculations in Clinical Research. New York: Chapman and Hall/CRC.
Cohen, J. (1988). Statistical Power Analysis for the Behavioral Sciences, 2nd Edn. New York, NY: Academic Press.
Döring, N. & Bortz, J. (2016). Forschungsmethoden und Evaluation in den Sozial- und Humanwissenschafften (5. Aufl.). Berlin Heidelberg: Springer-Verlag.
Fritz, C. O., Morris, P. E., & Richler, J. J. (2012). Effect size estimates: current use, calculations, and interpretation. Journal of experimental psychology: General, 141(1), 2–18.
Gattermeyer, S., Vladarski, C. & Aden, J. (2020). Der t-, Wilcoxon- und Binomial/Vorzeichen-Test für zwei verbundene Stichproben im psychotherapiewissenschaftlichen Forschungskontext. Empfehlung für Anwendung und Interpretation. SFU Forschungsbulletin, 8(2), 128–146.
Kruskal, W. H., & Wallis, W. A. (1952). Use of ranks in one-criterion variance analysis. Journal of the American statistical Association, 47(260), 583–621.
Lakens, D. (2013). Calculating and reporting effect sizes to facilitate cumulative science: a practical primer for t-tests and ANOVAs. Frontiers in psychology, 4, 863, 1–12.
Nübling, R, Schulz, H., Schmidt, J., Koch, U. & Wittmann, W. W. (2005). Fragebogen zur Psychotherapiemotivation (FPTM) – Testkonstruktion und Gütekriterien. In R. Nübling, F. A. Muthny & J. Bengel (Hrsg.), Reha-Motivation und Behandlungserwartung (S. 252–270). Bern: Huber.
Pierce, C. A., Block, R. A., & Aguinis, H. (2004). Cautionary note on reporting eta-squared values from multifactor ANOVA designs. Educational and psychological measurement, 64(6), 916–924.
Schäfer, T., & Schwarz, M. A. (2019). The meaningfulness of effect sizes in psychological research: Differences between sub-disciplines and the impact of potential biases. Frontiers in Psychology, 10, 813, (1–13).
Schulz, H., Nübling, R. & Rüddel, H (1995): Entwicklung einer Kurzform eines Fragebogens zur Psychotherapiemotivation. Verhaltenstherapie, 5(2), 89–95.
Schulz, H., Lang, K., Nübling, R. & Koch, U. (2003). Psychometrische Überprüfung einer Kurzform des Fragebogens zur Psychotherapiemotivation – FPTM-23. Diagnostica, 49(29), 83–93.
Seistock, D., Bunina, A. & Aden J. (2020). Der t-, Welch- und U-Test im psychotherapiewissenschaftlichen Forschungskontext. Empfehlungen für Anwendung und Interpretation. SFU Forschungsbulletin, 8(1), 87–105.
Sullivan, G. M., & Feinn, R. (2012). Using effect size—or why the P value is not enough. Journal of graduate medical education, 4(3), 279–282.
Downloads
Published
Issue
Section
License
The reproduction of articles published in any form is allowed under the condition that the citation is comprehensive. Prints in other publication media or public media require the written consent of the editor and can be requested under: forschung@sfu.ac.at