Compendium used for German public debate on synthetic biology

Thanks to fantastic work by journalist Ralf Groetker, this story just posted to the Compendium Institute community — a good example of using argument maps to synthesise multiple stakeholder input on a complex debate, in order to then scaffold debate by the wider community as part of a parliamentary consultation…

[Other examples: Queensland Environmental Consultation / Stirling Transport Plan / Participatory Urban Planning]

In October 2010, we started www.SynBio.Fuerundwider.org – a website dedicated to the discussions on societal impacts of synthetic biology. The website operates with argument maps; most of them are produced with Compendium. Other elements are comments, Open Eds, news regarding synthethic biology, and summaries of the ongoing discussion in the maps. The project – a pilot to prove the practicability of our concept of guided online argument mapping – was funded partly by the Deutsche Akademie der Technikwissenschaften (acatech) and supported by Wissenschaftspressekonferenz e.V. (WPK).

Before going online, we assembled reports and recommendations on synthethic biology that have been published in the last years. With this material, we started to build our maps. Next, a moderator approached  stakeholders in the field (i.e. scientists, NGOs, company representatives and politicians) and asked them for help to work out critical points in more detail or to resolve remaining questions (e.g. Do synthetic organisms, due to their fundamentally new and incomparable nature, require new methods of risk assessment? Will our understanding of ‚life’ be changed by synthetic biology?).

The contributions of a number of stakeholders, that we collected via email, via the comment section on the website, and via telephone conversations, were integrated into the growing map. A jury (consisting of: a journalist, an NGO representative, a scientist and a biotech-entrepreneur) ensured that all sides of the debate were represented equally.

Our results: Overall, the role model of our approach turned out to be not only a typical online-debate but rather the online-version of a stakeholder conference. Within just a few weeks, we were able to involve about two dozen experts in the discussion and collect their arguments. The online-maps did a great job in organizing and guiding the conversations with our experts, which in turn advanced the map further. Our goal (which was accomplished) was to create a map that all contributors agreed upon (in terms of fair and thorough representation of arguments). We are confident, that at least in those areas of the debate that we covered, the gathered material is much more detailed than what can be found in most of the literature that existed beforehand.

The results were presented at a Parliamentary evening event in Berlin in November 2010. The map will also serve as a tool for critical assessment of future reports, such as the report of the Technology Assessment Buro (TAB) of the German parliament, which will start its work on a report about synthetic biology in Spring 2011.

Participatory, multimedia project memory

Followers of our work will know we’ve worked closely with Jeff Conklin, building on his foundational work on the craft of Dialogue Mapping for capturing key aspects of a team’s deliberations in a visual map. In Al Selvin’s and Maarten Sierhuis’s extension called Conversational Modelling, this has been extended to support visual modelling driven by more constrained templates.

Based on the doctoral work by Anna De Liddo, we’ve just published a KM case study, in the context of managing the diverse, hybrid forms of information and interpretation that surround participatory urban planning, in which shared ownership of outcomes is critical. This uses the above approaches, supported by the open source Compendium visual hypermedia tool, but extended through the systematic use of custom views and tagging to index contributions against five key dimensions of KM in this context — but relevant to many others:

• dialogical • social • spatial • temporal • causal •

De Liddo, A. and Buckingham Shum, S. (2010). Capturing and Representing Deliberation in Participatory Planning Practices. In: De Cindio F., Macintosh A. & Peraboni C., (Eds.) From e-Participation to Online Deliberation, Proceedings OD2010: Fourth International Conference on Online Deliberation, Leeds, UK, 30 June – 2 July, 2010. ISBN 0-96678-186-4. Proceedings accessible online: http://www.od2010.dico.unimi.it/docs/proceedings/Proceedings_OD2010.pdf. Article ePrint: http://oro.open.ac.uk/22279

For more detail see Anna’s dissertation and this webcast seminar:

QuickTime PlayerScreenSnapz026

For an overview of our approach see Hypermedia Discourse: Contesting networks of ideas and arguments, and its historical development in this talk to the Design, Computing & Cognition conference:

Knowledge mappers empower e-democracy?

Background

Horst Rittel‘s IBIS scheme for argumentative dialogue was designed to scaffold participatory inquiry around wicked problems such as urban planning, with messy social, political and technical dimensions (2 key papers). Jeff Conklin‘s gIBIS (graphical IBIS) tool was one of the pioneering hypertext prototypes from the late 1980s. This used the exciting new graph layout capabilities of high-end workstations which only researchers got to play with in those days.

Our Compendium hypermedia knowledge mapping tool is the direct descendant of gIBIS, and our interoperable Cohere tool moves this into the Web 2.0/3.0 sphere. Meanwhile, other groups have developed Web tools around IBIS, which seems to be emerging as the lingua franca for lightly-structured deliberation tools (Debategraph; MIT’s Deliberatorium; others…) which go beyond simple commenting or threaded discussions. Participatory Urban Planning has, not surprisingly, continued to be a prime applications testbed for Compendium.

As well as innovating on the technical side, the core question on which we continue to work with Jeff and many others, is how to use such visualizations to genuinely add value to face-face and asynchronous dialogue, debate and deliberation over courses of action.  Since the emergence of gIBIS and other hypertext mapping tools 20 years ago caused the initial flurry of excitement with the Hypertext, HCI, CSCW and Design Rationale research communities, the widespread perception has been that these never really ‘took’, and embedded into everyday practice. However, the substantial body of work that has now been done to articulate the practices that make such tools effective (reviewed here, plus Jeff Conklin’s work on Dialogue & Issue Mapping and Al Selvin‘s work on the practice of Knowledge Art) has led to a significant user community, as this post helps to illustrate.

From a tech query to some bigger questions

This started out as a technical query to the Compendium Institute‘s discussion forum, about supporting a community planning inquiry. Subscribe to the forum if you want to follow the thread.

On 6 Feb 2010, at 00:27, _________ wrote:

Hi Everyone,

I’m trying to make IBIS maps of a local environmental-vs-property rights issue available to residents of my community in a form that will allow them to comment easily. My idea is to prepare a set of issue maps in Compendium, export them as Web Maps, and tinker with the HTML of the Web Maps so that when those pages are clicked on, the users are taken to a form with blanks to enter additional comments, optional email address, etc., and a “Send” button to send this all to me. I will then be able to read their remarks and figure out how to add them into the map.

Trouble is, I have no idea of how to write a script to do this. I am a complete newbie to scripting.  [snip…]

Here’s an extended version of my reply. The options are hopefully of interest to others engaged in the practicalities of supporting e-participatory projects. But you can see it leads into some bigger issues of interest to those of us now wrestling with how we provide the sociotechnical infrastructures needed to enable the higher order Collective Intelligence needed to tackle wicked problems (eg. yesterday’s CI workshop here at CSCW).

I can see 3 options for enabling community members to engage with Issue Maps in Compendium:

1. Forget a technical extension

In the name of speed (you say you have little time and no programming skills), and simplicity (for respondents) — just get them to email you (or come round your house and sit with a coffee around a big printout!) The key value you already bring is as cartographer: mapping the state of the debate, and acting as a translator of new responses, succinctly summarising and connecting contributions. If every node was numbered manually by you, then you might prompt them to provide the relevant node number(s).

By the way, whatever solution you go for, sticking one or more poster(s) of it on the wall at the meeting might work well as a low-tech/hi-touch way of engaging people — around the largest format, highest resolution display available on the market 😉  Tim van Gelder describes the successful debate poster he posted on the wall of a company in an industrial dispute case study:

2. Link to a web survey tool

If you can’t face lots of emails, provide a single link to a free web survey site like Survey Monkey. It could have just one question! (and invite people to provide the node number)

I guess you could create a web survey question for each core issue to provide finer granularity, or even for every node. But going finer grained might cause you trouble — everytime you add a new node, the expectation would be that there would be a new, specific link from the issue map to the survey for it, which could get you into a version/maintenance nightmare. This might work for any map that wasn’t going to evolve rapidly, however.

3. Add a technical extension

Compendium:

I don’t think you’ll be able to do this quickly without tech help. What you are asking for sounds pretty much like the Web Compendium prototyped as a fuller solution by GlaxoSmithKline. They wanted a simplified, intranet, web-only user experience in the IE browser, and built quite a complete solution. (However, they didn’t have a moderator in the loop)

They demo’d this at the 2005 Compendium Institute workshop (see p5 of the PDF proceedings). Note: their slides are linked from the web map (but all web map exports from this era are now only interactive in Apple’s Safari browser, due to a change in other browsers’ code).

We never got to fold this into a main release in the end, focusing instead on enabling distributed Compendium over the net (avail in the forthcoming v2.0 beta release), and Cohere, while others developed IBIS web tools like DebateGraph and Deliberatorium.

Web IBIS tools:

You’ve said you don’t think DebateGraph provides the layout control and look+feel you want. You can try Cohere, though this may not be quite right for you yet either. Here’s an example Cohere IBIS discussion. This lets anyone signed in connect new nodes to maps.

However, this excludes you from the loop as moderator of contributions, where you add Issue Mapping expertise, and this is a key value add.

A knowledge mapping cadre empowers democracy?

It’s an interesting question whether it is more empowering for a community to be able to say what they want directly in IBIS (with the risk that this just descends into IBIS-flamewars because they lack the skills of good listening and critical engagement), vs. going through a facilitator (whom one hopes, they have learnt to trust) who maintains the hygiene of the map. This is just a version of some of the oldest questions about democracy: using a more highly skilled elite group, to empower all by acting as a control over excesses – which if done badly, turns into silencing.

Another approach is to devise better methods and schemes for scaffolding debate, such as Jack Paulus’ TruthMapping, which claims to reduce the possibility for poor contributions without any supervision from a moderator, but at the cost of requiring more critical reflection from contributors — this is an overhead that “normal” members of the public, especially hot-headed ones of the sort you refer to in your community context, may not be willing or able to make.

Is a more expert group of knowledge curators always going to be needed?

In yesterday’s Collective Intelligence workshop, we had a breakout group specifically around the key  challenges for CI in tackling wicked problems. I summarised some of the points as follows, flagging the first point in the context of this post:

The holy grail seems to be the self-organising/maintaining sociotechnical CI infrastructure whereby no-one does anything much extra beyond what they need to do for their own work, and CI emerges “for free”. But we may be deluding ourselves when it comes to the higher order collective cognition that wicked problems require. Maybe we will always need a tier of knowledge curators to tune and maintain the hygiene of a CI resource?

Other points are appended at the end. This seems to be a central issue that we have to address. For example, some of the debate maps that David Price has created have attracted significant coverage and attention, and are demonstrating that members of the public can contribute to an issue map which grows, and maintains coherence, without moderation. However, David has played a key role in seeding those maps — a key role to get things going, and I believe that there are areas of the map that could now benefit from “curation” (Perhaps I can invite David to comment, and Mark Klein on experiences with Deliberatorium?). Certainly, we know from Wikipedia and many other user generated content sites that there are important social dynamics by which members rise in the ranks to become editors with different roles and permissions.

So, it may be that we shouldn’t be “ashamed” to admit that a cadre of skilled issue/debate mappers is a key element in the architecture of participation around authentic, participatory e-democracy. We recognise the need for accountants to help us manage complex financial assets. No-one thinks it strange that cartography is a highly skilled profession, necessary to manage the complexity geographical spaces for society’s needs. Thus, Knowledge Cartographers may be the new craft, guild, or profession that we need to cope with the complexity of conceptual spaces, as we manage intellectual assets.

____________________________

Other notes from the CI wicked problems breakout group:

  • Sometimes there is a decision to be made, but much of the time it’s about sensemaking to just track the changing environment.
  • Such problems fundamentally require building common ground across diverse stakeholders – empathy with others needed as a backdrop for critical debate/argumentation. Lots of work on how we foster genuine dialogue.
  • Social media may have an important role to play in making antagonists into real people (co-location helps with this, virtual co-location may help) – social capital
  • How to accelerate the building of common ground – meosphere provides lists to select from – cf. Hive5 lists as a precursor to team building
  • A UX challenge is helping users to move from very low effort contributions (eg tagging; rating) to higher cost, more informative ones (connecting; explaining) – we may be able to go back to users to invite more input. eg. on something they’ve said/tagged
  • Patty Hinds (Stanford) – cross-site visiting helped improve distributed programming, since it filled in gaps about people
  • Can be critical to work from the specific domain representations as the start of common ground.
  • Mapping from science to policy/practice is often key (cf. Simone paper on the different “cosmologies”) – we see this in medecine, urban planning, environmental policy, etc etc — a significant mapping/contextualisation task

Dr Anna De Liddo!

Congratulations to Anna De Liddo, who passed her PhD viva with flying colours today! Her thesis “A Process Memory Platform to Support Participatory Planning & Deliberation” is collaborative work with Dept. di Architecttura e Urbanista, Politecnico di Bari, and KMi’s Hypermedia Discourse group.

The viva panel were impressed with the originality of the research, and the scientific rigour with which it had been approached.

Abstract:

The communicative turn in planning theory argues that knowledge in planning is a social construction, emphasizing that knowledge is built in social contexts, by a plurality of actors, through their interactions. This new understanding of knowledge is built around the need of plurality of reasons and voices to inform and legitimate planning actions.

However this knowledge is often difficult to capture and integrate within the wider knowledge base that planners generate in the planning process. The body of knowledge guiding and supporting the planning process is captured in distributed fragments that come from a combination of present and past information, facts, people and artefacts produced by dispersed decision-processes. This knowledge fragmentation and distribution hampers, and often impedes, transparent and coherent decision-making processes in participatory planning practices.

The thesis addresses the challenge of transparent knowledge integration, focusing on the definition of new methods and tools to handle and integrate planning knowledge in order to trace how design decisions develop to create a planning process memory.

An information architecture is proposed to represent and manage participatory planning knowledge, and a multimedia tools platform has been designed to represent how knowledge evolves within this software environment.

This work is evaluated through multiple, real planning case studies, in order to test both the methodological aspects (application of the information architecture for knowledge acquisition and representation) and the tools (Compendium, CoPe_it! and FM).

Evidence is given of how the information architecture coupled with the use of a hypermedia visual Knowledge Management System (hvKMS) (Compendium) offers a valuable support to managing knowledge in Participatory Planning. In particular the information architecture enables effective representation of knowledge fragments in different dimensions according to their relevance to different contexts. This implies two grades of benefits: i. discovering knowledge connections and impacts across contexts; ii. having a thematic but holistic view and understanding of the process memory.

Furthermore, the case studies show that the tools are easy to use, flexible and customizable. Several examples are given of how the tools can support the tracing and representation of planning processes which differentiate for method, task, scale, planning phase and stakeholders involved.

As a final result of the platform and method testing, the thesis discuss three facets of a process-memory platform for planning practices at the technical, political and community levels. A critical analysis of the results is presented regarding limitations of the platform and, starting from this consideration future work and system evolution will be envisioned, recalibrating objective and strategy to new research challenges.