CHI’19: Towards Collaboration Translucence

For several years in CIC, we’ve been prototyping multimodal learning analytics in partnership with our colleagues in the UTS Faculty of Health, with the ambition to generate instant feedback for debriefing after simulation exercises with mannikin patients. I’m looking forward to presenting this new work at CHI in May (in Glasgow, no less, where I grew up!). Congratulations to Vanessa on her great PhD work, and to Roberto for leading the multimodal learning analytics research program.

Echeverria, V., Martinez-Maldonado, R. and Buckingham Shum, S. (2019). Towards Collaboration Translucence: Giving Meaning to Multimodal Group Data. In Proceedings of ACM CHI Conference (CHI’19). ACM, New York, NY, USA, Paper 39, 16 pages. [PDF Reprint]

ABSTRACT: Collocated, face-to-face teamwork remains a pervasive mode of working, which is hard to replicate online. Team members’ embodied, multimodal interaction with each other and artefacts has been studied by researchers, but due to its complexity, has remained opaque to automated analysis. However, the ready availability of sensors makes it increasingly affordable to instrument work spaces to study teamwork and groupwork. The possibility of visualising key aspects of a collaboration has huge potential for both academic and professional learning, but a frontline challenge is the enrichment of quantitative data streams with the qualitative insights needed to make sense of them. In response, we introduce the concept of collaboration translucence, an approach to make visible selected features of group activity. This is grounded both theoretically (in the physical, epistemic, social and affective dimensions of group activity), and contextually (using domain-specific concepts). We illustrate the approach from the automated analysis of healthcare simulations to train nurses, generating four visual proxies that fuse multimodal data into higher order patterns.

Here’s an extended version of the CHI talk, presented at U. Sydney CHAI research group [PDF slides]:


Leave a Reply

You can use these XHTML tags: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <s> <strike> <strong>