A multimodal corpus of simulated consultations between a patient and multiple healthcare professionals.

Snaith, Mark; Conway, Nicholas; Beinema, Tessa; De Franco, Dominic; Pease, Alison; Kantharaju, Reshmashree; Janier, Mathilde; Huizing, Gerwin; Pelachaud, Catherine; op den Akker, Harm

Abstract

Language resources for studying doctor–patient interaction are rare, primarily due to the ethical issues related to recording real medical consultations. Rarer still are resources that involve more than one healthcare professional in consultation with a patient, despite many chronic conditions requiring multiple areas of expertise for effective treatment. In this paper, we present the design, construction and output of the Patient Consultation Corpus, a multimodal corpus of simulated consultations between a patient portrayed by an actor, and at least two healthcare professionals with different areas of expertise. As well as the transcribed text from each consultation, the corpus also contains audio and video where for each consultation: the audio consists of individual tracks for each participant, allowing for clear identification of speakers; the video consists of two framings for each participant—upper-body and face—allowing for close analysis of behaviours and gestures. Having presented the design and construction of the corpus, we then go on to briefly describe how the multi-modal nature of the corpus allows it to be analysed from several different perspectives.

Citation

SNAITH, M., CONWAY, N., BEINEMA, T., DE FRANCO, D., PEASE, A., KANTHARAJU, R., JANIER, M., HUIZING, G., PELACHAUD, C. and OP DEN AKKER, H. 2021. A multimodal corpus of simulated consultations between a patient and multiple healthcare professionals. Language resources and evaluation [online], 55(4), pages 1077-1092. Available from: https://doi.org/10.1007/s10579-020-09526-0

• Journal Article Type: Article
• Acceptance Date: Dec 18, 2020
• Online Publication Date: Apr 2, 2021
• Publication Date: Dec 31, 2021
• Deposit Date: Apr 16, 2021
• Publicly Available Date: Apr 16, 2021
• Journal: Language resources and evaluation
• Print ISSN: 1574-020X
• Electronic ISSN: 1574-0218
• Publisher: Springer
• Peer Reviewed: Peer Reviewed
• Volume: 55
• Issue: 4
• Pages: 1077-1092
• DOI: https://doi.org/10.1007/s10579-020-09526-0
• Keywords: Multimodal corpus; Healthcare simulation; Health coaching; Healthcare dialogue; Multi-party dialogue and argumentation in healthcare; Non-verbal behaviours; Coaching styles
• Public URL: https://rgu-repository.worktribe.com/output/1290875
• Additional Information: The Patient Consultation Corpus (PCC) is a multimodal corpus of simulated consultations between a patient and at least two healthcare professionals. Developed as part of the Council of Coaches project, the PCC provides a valuable resource for researchers investigating doctor-patient consultations from a variety of perspectives. The corpus will be available at https://pcc.arg.tech/ in early 2021.