Usability, learnability and performance evaluation of Intelligent Research and Intervention Software: A delivery platform for eHealth interventions

Lori Wozney; Patrick J. McGrath; Amanda Newton; Anna Huguet; Marcia Franklin; Kaitlin Perri; K. Leuschen; Elaine Toombs; Patricia Lingley-Pottie

doi:10.1177/1460458215586803

Usability, learnability and performance evaluation of Intelligent Research and Intervention Software: A delivery platform for eHealth interventions

Lori Wozney, Patrick J. McGrath, Amanda Newton, Anna Huguet, Marcia Franklin, Kaitlin Perri, K. Leuschen, Elaine Toombs, Patricia Lingley-Pottie

Medicine

Research output: Contribution to journal › Article › peer-review

23 Citations (Scopus)

Abstract

Evaluation of an eHealth platform, Intelligent Research and Intervention Software was undertaken via cross-sectional survey of staff users and application performance monitoring. The platform is used to deliver psychosocial interventions across a range of clinical contexts, project scopes, and delivery modalities (e.g. hybrid telehealth, fully online self-managed, randomized control trials, and clinical service delivery). Intelligent Research and Intervention Software supports persuasive technology elements (e.g. tailoring, reminders, and personalization) as well as staff management tools. Results from the System Usability Scale involving 30 Staff and Administrative users across multiple projects were positive with overall mean score of 70 ("Acceptable"). The mean score for "Usability" sub-scale was 82 and for "Learnability" sub-scale 61. There were no significant differences in perceptions of usability across user groups or levels of experience. Application performance management analytics (e.g. Application Performance Index scores) across two test sites indicate the software platform is robust and reliable when compared to industry standards. Intelligent Research and Intervention Software is successfully operating as a flexible platform for creating, delivering, and evaluating eHealth interventions.

Original language	English
Pages (from-to)	730-743
Number of pages	14
Journal	Health Informatics Journal
Volume	22
Issue number	3
DOIs	https://doi.org/10.1177/1460458215586803
Publication status	Published - Sept 1 2016

Bibliographical note

Funding Information:
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This project is funded by an operating grant from the Canadian Institutes of Health Research (CIHR No.103146) and an Innovacorp Early Stage Commercialization Fund grant. Dr Amanda Newton holds a CIHR New Investigator Award. Dr Patrick McGrath holds a Canada Research Chair (Tier 1) in pediatric pain.

Publisher Copyright:
© The Author(s) 2015.

ASJC Scopus Subject Areas

Health Informatics

PubMed: MeSH publication types

Evaluation Study
Journal Article

Access to Document

10.1177/1460458215586803

Cite this

Wozney, L., McGrath, P. J., Newton, A., Huguet, A., Franklin, M., Perri, K., Leuschen, K., Toombs, E., & Lingley-Pottie, P. (2016). Usability, learnability and performance evaluation of Intelligent Research and Intervention Software: A delivery platform for eHealth interventions. Health Informatics Journal, 22(3), 730-743. https://doi.org/10.1177/1460458215586803

@article{27de538280884aad921e98fa4333e48d,

title = "Usability, learnability and performance evaluation of Intelligent Research and Intervention Software: A delivery platform for eHealth interventions",

abstract = "Evaluation of an eHealth platform, Intelligent Research and Intervention Software was undertaken via cross-sectional survey of staff users and application performance monitoring. The platform is used to deliver psychosocial interventions across a range of clinical contexts, project scopes, and delivery modalities (e.g. hybrid telehealth, fully online self-managed, randomized control trials, and clinical service delivery). Intelligent Research and Intervention Software supports persuasive technology elements (e.g. tailoring, reminders, and personalization) as well as staff management tools. Results from the System Usability Scale involving 30 Staff and Administrative users across multiple projects were positive with overall mean score of 70 ({"}Acceptable{"}). The mean score for {"}Usability{"} sub-scale was 82 and for {"}Learnability{"} sub-scale 61. There were no significant differences in perceptions of usability across user groups or levels of experience. Application performance management analytics (e.g. Application Performance Index scores) across two test sites indicate the software platform is robust and reliable when compared to industry standards. Intelligent Research and Intervention Software is successfully operating as a flexible platform for creating, delivering, and evaluating eHealth interventions.",

author = "Lori Wozney and McGrath, {Patrick J.} and Amanda Newton and Anna Huguet and Marcia Franklin and Kaitlin Perri and K. Leuschen and Elaine Toombs and Patricia Lingley-Pottie",

note = "Funding Information: The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This project is funded by an operating grant from the Canadian Institutes of Health Research (CIHR No.103146) and an Innovacorp Early Stage Commercialization Fund grant. Dr Amanda Newton holds a CIHR New Investigator Award. Dr Patrick McGrath holds a Canada Research Chair (Tier 1) in pediatric pain. Publisher Copyright: {\textcopyright} The Author(s) 2015.",

year = "2016",

month = sep,

day = "1",

doi = "10.1177/1460458215586803",

language = "English",

volume = "22",

pages = "730--743",

journal = "Health Informatics Journal",

issn = "1460-4582",

publisher = "SAGE Publications Ltd",

number = "3",

}

TY - JOUR

T1 - Usability, learnability and performance evaluation of Intelligent Research and Intervention Software

T2 - A delivery platform for eHealth interventions

AU - Wozney, Lori

AU - McGrath, Patrick J.

AU - Newton, Amanda

AU - Huguet, Anna

AU - Franklin, Marcia

AU - Perri, Kaitlin

AU - Leuschen, K.

AU - Toombs, Elaine

AU - Lingley-Pottie, Patricia

N1 - Funding Information: The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This project is funded by an operating grant from the Canadian Institutes of Health Research (CIHR No.103146) and an Innovacorp Early Stage Commercialization Fund grant. Dr Amanda Newton holds a CIHR New Investigator Award. Dr Patrick McGrath holds a Canada Research Chair (Tier 1) in pediatric pain. Publisher Copyright: © The Author(s) 2015.

PY - 2016/9/1

Y1 - 2016/9/1

N2 - Evaluation of an eHealth platform, Intelligent Research and Intervention Software was undertaken via cross-sectional survey of staff users and application performance monitoring. The platform is used to deliver psychosocial interventions across a range of clinical contexts, project scopes, and delivery modalities (e.g. hybrid telehealth, fully online self-managed, randomized control trials, and clinical service delivery). Intelligent Research and Intervention Software supports persuasive technology elements (e.g. tailoring, reminders, and personalization) as well as staff management tools. Results from the System Usability Scale involving 30 Staff and Administrative users across multiple projects were positive with overall mean score of 70 ("Acceptable"). The mean score for "Usability" sub-scale was 82 and for "Learnability" sub-scale 61. There were no significant differences in perceptions of usability across user groups or levels of experience. Application performance management analytics (e.g. Application Performance Index scores) across two test sites indicate the software platform is robust and reliable when compared to industry standards. Intelligent Research and Intervention Software is successfully operating as a flexible platform for creating, delivering, and evaluating eHealth interventions.

AB - Evaluation of an eHealth platform, Intelligent Research and Intervention Software was undertaken via cross-sectional survey of staff users and application performance monitoring. The platform is used to deliver psychosocial interventions across a range of clinical contexts, project scopes, and delivery modalities (e.g. hybrid telehealth, fully online self-managed, randomized control trials, and clinical service delivery). Intelligent Research and Intervention Software supports persuasive technology elements (e.g. tailoring, reminders, and personalization) as well as staff management tools. Results from the System Usability Scale involving 30 Staff and Administrative users across multiple projects were positive with overall mean score of 70 ("Acceptable"). The mean score for "Usability" sub-scale was 82 and for "Learnability" sub-scale 61. There were no significant differences in perceptions of usability across user groups or levels of experience. Application performance management analytics (e.g. Application Performance Index scores) across two test sites indicate the software platform is robust and reliable when compared to industry standards. Intelligent Research and Intervention Software is successfully operating as a flexible platform for creating, delivering, and evaluating eHealth interventions.

UR - http://www.scopus.com/inward/record.url?scp=84981352270&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84981352270&partnerID=8YFLogxK

U2 - 10.1177/1460458215586803

DO - 10.1177/1460458215586803

M3 - Article

C2 - 26105726

AN - SCOPUS:84981352270

SN - 1460-4582

VL - 22

SP - 730

EP - 743

JO - Health Informatics Journal

JF - Health Informatics Journal

IS - 3

ER -

Usability, learnability and performance evaluation of Intelligent Research and Intervention Software: A delivery platform for eHealth interventions

Abstract

Bibliographical note

ASJC Scopus Subject Areas

PubMed: MeSH publication types

Access to Document

Other files and links

Fingerprint

Cite this