ICQE20 keynote: QE Visualizations as tools for thinking

We just wrapped up the 2nd International Conference on Quantitative Ethnography (open access proceedings from Springer), postponed from October due to the pandemic, in the hope that we might all yet meet up in February — alas it was not to be. However, the organisers did a really great job designing the program with a lot of informal interaction time, and the delegates threw themselves into it with a fantastic spirit, with everyone out to help everyone, as the crew figures out how to sail this recently launched ship!

If QE is new to you, it springs from the foundational work at the University of Wisconsin-Madison’s Epistemic Analytics Lab, led by the inspirational David Williamson Shaffer. The team’s publications are the source point, specifically, David’s QE book, which impressed me so much and drew me into this vision of how quant+qual could come together. In fact, I first met David in 2013 after I received a very hot tip that he was doing amazing work, relevant to a discourse analytics workshop I was chairing. His keynote was a revelation to me of his team’s long term research program, but it’s taken a while to figure out if and how to bring it into my own work.

Well, the first conference (ICQE 2019 / proceedings) was a great success, and so it was a real honour to be asked to give one of the keynote talks at this year’s conference. However, following the brilliant 2019 keynotes by Jim Gee, Dragan Gašević and Gol Arastoopour Irgens, I accepted with some trepidation to be honest, since I am far from a QE expert compared to those blazing this new trail. At the time of being invited, my team had not done any work with the main QE analysis approach, Epistemic Network Analysis, though we had drawn inspiration from its data modelling methodology in our multimodal learning analytics work.

So I thought long and hard about what I might bring to the party, with several false starts, which might have gone deeper into QE and Learning Analytics, or QE and Algorithmic Accountability. I decided in the end to go back to my roots — all the way back to my PhD in fact, focusing on the cognitive affordances of semiformal graphical representations, and what I’ve learnt since about what it takes to wield such tools in participatory design with fluency, developing open source visual hypermedia software for 20 years, and more recent work on data storytelling. What was particularly fun was bringing that into dialogue with what I was seeing in the QE webinars last year, specifically, how the community is telling its stories with visualizations. It was really enjoyable thinking what my journey might have to say to the QE community, the talk seemed to go down well, and I’m looking forward to seeing if/how these ideas take deeper root.

I am indebted to so many colleagues who have shaped those ideas, noting in particular, the Knowledge Art research and practice of my PhD student, colleague and friend, Al Selvin, tragically taken from us, far too early.

Quantitative Ethnography Visualizations as Tools for Thinking [pdf slides]

Abstract: All research must give form to data and insights. Visualizations serve as cognitive extensions that assist researchers not only in exploring their data, but in communicating findings to colleagues and broader audiences. Especially in data-intensive fields, widely used software tools define, and are defined by, research communities; you can’t fully participate in a community until you can wield its tools responsibly. In an emerging field like Quantitative Ethnography (QE), inventing its own tools, how we model and map the world are therefore defining characteristics, and merit critical reflection.

QE’s principles currently find fullest expression in Epistemic Network Analysis (ENA). It’s fair to say that the interest in ENA is attributable not only to the power of its data modelling and analysis, but also to the engaging, interactive visualizations it generates. Inspired by the ways I see ENA used, in this talk I bring my background in Human-Computer Interaction and the design of tools for working with conceptual structures, as a lens on ENA and other QEgenerated visuals. When we consider in detail how external representations serve as personal and shared cognitive tools, this illuminates current and future techniques for presenting QE analyses. A data-storytelling lens asks how the audience will engage with our insights, while participatory methods ask whether we cast them as passive recipients or active agents in validating those narratives. Moreover, as QE analyses begin to underpin new tools designed for people other than QE researchers, human-centred design should give voice to non-technical stakeholders. These lenses could point to a future in which visualization tools evolve to scaffold more participatory forms of sensemaking as an important hallmark of how QE models and narrates the world.

Leave a Reply

You can use these XHTML tags: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <s> <strike> <strong>