Assessing physiotherapists’ communication skills for promoting patient autonomy for self-management: reliability and validity of the communication evaluation in rehabilitation tool

Aileen Murray, Amanda Hall, Geoffrey C. Williams, Suzanne M. McDonough, Nikos Ntoumanis, Ian Taylor, Ben Jackson, Bethan Copsey, Deirdre A. Hurley, James Matthews

Research output: Contribution to journalArticle

Abstract

Purpose: To assess the inter-rater reliability and concurrent validity of the Communication Evaluation in Rehabilitation Tool, which aims to externally assess physiotherapists competency in using Self-Determination Theory-based communication strategies in practice. Materials and methods: Audio recordings of initial consultations between 24 physiotherapists and 24 patients with chronic low back pain in four hospitals in Ireland were obtained as part of a larger randomised controlled trial. Three raters, all of whom had Ph.Ds in psychology and expertise in motivation and physical activity, independently listened to the 24 audio recordings and completed the 18-item Communication Evaluation in Rehabilitation Tool. Inter-rater reliability between all three raters was assessed using intraclass correlation coefficients. Concurrent validity was assessed using Pearson’s r correlations with a reference standard, the Health Care Climate Questionnaire. Results: The total score for the Communication Evaluation in Rehabilitation Tool is an average of all 18 items. Total scores demonstrated good inter-rater reliability (Intraclass Correlation Coefficient (ICC) = 0.8) and concurrent validity with the Health Care Climate Questionnaire total score (range: r = 0.7–0.88). Item-level scores of the Communication Evaluation in Rehabilitation Tool identified five items that need improvement. Conclusion: Results provide preliminary evidence to support future use and testing of the Communication Evaluation in Rehabilitation Tool.Implications for RehabilitationPromoting patient autonomy is a learned skill and while interventions exist to train clinicians in these skills there are no tools to assess how well clinicians use these skills when interacting with a patient. The lack of robust assessment has severe implications regarding both the fidelity of clinician training packages and resulting outcomes for promoting patient autonomy.This study has developed a novel measurement tool Communication Evaluation in Rehabilitation Tool and a comprehensive user manual to assess how well health care providers use autonomy-supportive communication strategies in real world-clinical settings.This tool has demonstrated good inter-rater reliability and concurrent validity in its initial testing phase.The Communication Evaluation in Rehabilitation Tool can be used in future studies to assess autonomy-supportive communication and undergo further measurement property testing as per our recommendations.

Original languageEnglish
Pages (from-to)1699-1705
Number of pages7
JournalDisability and Rehabilitation
Volume41
Issue number14
DOIs
Publication statusPublished - 3 Jul 2019

Fingerprint

Physical Therapists
Self Care
Reproducibility of Results
Rehabilitation
Communication
Climate
Delivery of Health Care
Personal Autonomy
Low Back Pain
Ireland
Health Personnel
Motivation
Referral and Consultation
Randomized Controlled Trials
Exercise
Psychology

Cite this

Murray, Aileen ; Hall, Amanda ; Williams, Geoffrey C. ; McDonough, Suzanne M. ; Ntoumanis, Nikos ; Taylor, Ian ; Jackson, Ben ; Copsey, Bethan ; Hurley, Deirdre A. ; Matthews, James. / Assessing physiotherapists’ communication skills for promoting patient autonomy for self-management : reliability and validity of the communication evaluation in rehabilitation tool. In: Disability and Rehabilitation. 2019 ; Vol. 41, No. 14. pp. 1699-1705.
@article{75aa5ccccd1d43699cab0102d6e75d06,
title = "Assessing physiotherapists’ communication skills for promoting patient autonomy for self-management: reliability and validity of the communication evaluation in rehabilitation tool",
abstract = "Purpose: To assess the inter-rater reliability and concurrent validity of the Communication Evaluation in Rehabilitation Tool, which aims to externally assess physiotherapists competency in using Self-Determination Theory-based communication strategies in practice. Materials and methods: Audio recordings of initial consultations between 24 physiotherapists and 24 patients with chronic low back pain in four hospitals in Ireland were obtained as part of a larger randomised controlled trial. Three raters, all of whom had Ph.Ds in psychology and expertise in motivation and physical activity, independently listened to the 24 audio recordings and completed the 18-item Communication Evaluation in Rehabilitation Tool. Inter-rater reliability between all three raters was assessed using intraclass correlation coefficients. Concurrent validity was assessed using Pearson’s r correlations with a reference standard, the Health Care Climate Questionnaire. Results: The total score for the Communication Evaluation in Rehabilitation Tool is an average of all 18 items. Total scores demonstrated good inter-rater reliability (Intraclass Correlation Coefficient (ICC) = 0.8) and concurrent validity with the Health Care Climate Questionnaire total score (range: r = 0.7–0.88). Item-level scores of the Communication Evaluation in Rehabilitation Tool identified five items that need improvement. Conclusion: Results provide preliminary evidence to support future use and testing of the Communication Evaluation in Rehabilitation Tool.Implications for RehabilitationPromoting patient autonomy is a learned skill and while interventions exist to train clinicians in these skills there are no tools to assess how well clinicians use these skills when interacting with a patient. The lack of robust assessment has severe implications regarding both the fidelity of clinician training packages and resulting outcomes for promoting patient autonomy.This study has developed a novel measurement tool Communication Evaluation in Rehabilitation Tool and a comprehensive user manual to assess how well health care providers use autonomy-supportive communication strategies in real world-clinical settings.This tool has demonstrated good inter-rater reliability and concurrent validity in its initial testing phase.The Communication Evaluation in Rehabilitation Tool can be used in future studies to assess autonomy-supportive communication and undergo further measurement property testing as per our recommendations.",
keywords = "Communication, reliability, self-determination theory, validity",
author = "Aileen Murray and Amanda Hall and Williams, {Geoffrey C.} and McDonough, {Suzanne M.} and Nikos Ntoumanis and Ian Taylor and Ben Jackson and Bethan Copsey and Hurley, {Deirdre A.} and James Matthews",
year = "2019",
month = "7",
day = "3",
doi = "10.1080/09638288.2018.1443159",
language = "English",
volume = "41",
pages = "1699--1705",
journal = "Disability & Rehabilitation",
issn = "0963-8288",
publisher = "Taylor & Francis",
number = "14",

}

Assessing physiotherapists’ communication skills for promoting patient autonomy for self-management : reliability and validity of the communication evaluation in rehabilitation tool. / Murray, Aileen; Hall, Amanda; Williams, Geoffrey C.; McDonough, Suzanne M.; Ntoumanis, Nikos; Taylor, Ian; Jackson, Ben; Copsey, Bethan; Hurley, Deirdre A.; Matthews, James.

In: Disability and Rehabilitation, Vol. 41, No. 14, 03.07.2019, p. 1699-1705.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Assessing physiotherapists’ communication skills for promoting patient autonomy for self-management

T2 - reliability and validity of the communication evaluation in rehabilitation tool

AU - Murray, Aileen

AU - Hall, Amanda

AU - Williams, Geoffrey C.

AU - McDonough, Suzanne M.

AU - Ntoumanis, Nikos

AU - Taylor, Ian

AU - Jackson, Ben

AU - Copsey, Bethan

AU - Hurley, Deirdre A.

AU - Matthews, James

PY - 2019/7/3

Y1 - 2019/7/3

N2 - Purpose: To assess the inter-rater reliability and concurrent validity of the Communication Evaluation in Rehabilitation Tool, which aims to externally assess physiotherapists competency in using Self-Determination Theory-based communication strategies in practice. Materials and methods: Audio recordings of initial consultations between 24 physiotherapists and 24 patients with chronic low back pain in four hospitals in Ireland were obtained as part of a larger randomised controlled trial. Three raters, all of whom had Ph.Ds in psychology and expertise in motivation and physical activity, independently listened to the 24 audio recordings and completed the 18-item Communication Evaluation in Rehabilitation Tool. Inter-rater reliability between all three raters was assessed using intraclass correlation coefficients. Concurrent validity was assessed using Pearson’s r correlations with a reference standard, the Health Care Climate Questionnaire. Results: The total score for the Communication Evaluation in Rehabilitation Tool is an average of all 18 items. Total scores demonstrated good inter-rater reliability (Intraclass Correlation Coefficient (ICC) = 0.8) and concurrent validity with the Health Care Climate Questionnaire total score (range: r = 0.7–0.88). Item-level scores of the Communication Evaluation in Rehabilitation Tool identified five items that need improvement. Conclusion: Results provide preliminary evidence to support future use and testing of the Communication Evaluation in Rehabilitation Tool.Implications for RehabilitationPromoting patient autonomy is a learned skill and while interventions exist to train clinicians in these skills there are no tools to assess how well clinicians use these skills when interacting with a patient. The lack of robust assessment has severe implications regarding both the fidelity of clinician training packages and resulting outcomes for promoting patient autonomy.This study has developed a novel measurement tool Communication Evaluation in Rehabilitation Tool and a comprehensive user manual to assess how well health care providers use autonomy-supportive communication strategies in real world-clinical settings.This tool has demonstrated good inter-rater reliability and concurrent validity in its initial testing phase.The Communication Evaluation in Rehabilitation Tool can be used in future studies to assess autonomy-supportive communication and undergo further measurement property testing as per our recommendations.

AB - Purpose: To assess the inter-rater reliability and concurrent validity of the Communication Evaluation in Rehabilitation Tool, which aims to externally assess physiotherapists competency in using Self-Determination Theory-based communication strategies in practice. Materials and methods: Audio recordings of initial consultations between 24 physiotherapists and 24 patients with chronic low back pain in four hospitals in Ireland were obtained as part of a larger randomised controlled trial. Three raters, all of whom had Ph.Ds in psychology and expertise in motivation and physical activity, independently listened to the 24 audio recordings and completed the 18-item Communication Evaluation in Rehabilitation Tool. Inter-rater reliability between all three raters was assessed using intraclass correlation coefficients. Concurrent validity was assessed using Pearson’s r correlations with a reference standard, the Health Care Climate Questionnaire. Results: The total score for the Communication Evaluation in Rehabilitation Tool is an average of all 18 items. Total scores demonstrated good inter-rater reliability (Intraclass Correlation Coefficient (ICC) = 0.8) and concurrent validity with the Health Care Climate Questionnaire total score (range: r = 0.7–0.88). Item-level scores of the Communication Evaluation in Rehabilitation Tool identified five items that need improvement. Conclusion: Results provide preliminary evidence to support future use and testing of the Communication Evaluation in Rehabilitation Tool.Implications for RehabilitationPromoting patient autonomy is a learned skill and while interventions exist to train clinicians in these skills there are no tools to assess how well clinicians use these skills when interacting with a patient. The lack of robust assessment has severe implications regarding both the fidelity of clinician training packages and resulting outcomes for promoting patient autonomy.This study has developed a novel measurement tool Communication Evaluation in Rehabilitation Tool and a comprehensive user manual to assess how well health care providers use autonomy-supportive communication strategies in real world-clinical settings.This tool has demonstrated good inter-rater reliability and concurrent validity in its initial testing phase.The Communication Evaluation in Rehabilitation Tool can be used in future studies to assess autonomy-supportive communication and undergo further measurement property testing as per our recommendations.

KW - Communication

KW - reliability

KW - self-determination theory

KW - validity

UR - http://www.scopus.com/inward/record.url?scp=85042916278&partnerID=8YFLogxK

U2 - 10.1080/09638288.2018.1443159

DO - 10.1080/09638288.2018.1443159

M3 - Article

VL - 41

SP - 1699

EP - 1705

JO - Disability & Rehabilitation

JF - Disability & Rehabilitation

SN - 0963-8288

IS - 14

ER -