Prototyping a systemic school learning methodology

I’m just back from an amazing workshop at Bristol. This is a step along the path of an unfolding story about how we are using the groundbreaking work of Tony Bryk‘s team on  Design, Educational Engineering and Development (DEED), as a methodology for systemic school change. This is combined with the University of Bristol’s Effective Lifelong Learning Inventory (ELLI), which forms part of a process of Authentic Inquiry (AI) for students, teachers and leaders.

My part of this systemic approach is that the insights from these prototypes are then shared via our Collective Intelligence Evidence Hub. My introduction to this is below, but see the full story on Learning Emergence to understand how this fits into the whole approach, and the demos I then give after teachers’ presentations.

Oasis Academies intend to use the Hub as a key way to distill and share staff learning across the region’s academies. This is  an exciting convergence, with the academy piloting this reports that it has catalysed a profound shift in how they think about professional development.

Dispositional Learning Analytics @LASI-Stanford

The week-long LASI13, Stanford University has just ended, where Ruth Deakin Crick (Univ Bristol), Chris Goldspink (Incept Labs), Rebecca Ferguson (OU), Nelson Gonzalez (Declara), Dave Paunesku (Stanford PERTS Lab) and I ran a Dispositional Learning Analytics workshop.

We’ve had very positive feedback on this, and awareness should grow of Learner Dispositions (or Mindset as Carol Dweck calls it), Teacher Dispositions, the potential of a multi-level Complex Systems approach to educational system design, and from Nelson’s work at Declara, the emerging potential of applying combined social and machine learning techniques to such datasets.

Full story on this and the team’s other LASI activities at Learning Emergence

FirefoxScreenSnapz739

Dispositional Learning Analytics wkshp

TODAY at LASI13, Stanford University…

Full details including background papers and websites:
learningemergence.net/events/lasi-dla-wkshp

GOALS

This LASI workshop does not assume any prior knowledge of learning dispositions, although background papers and resources are provided in advance for those who wish. The goal is to forge new connections between people already working in the field, and spark new conversations for the rest of LASI and beyond, hopefully, growing into new initiatives.

Goals:

  • introduce research on how students’ and educators’ dispositions to learning can shape outcomes
  • describe software tools grounded in that research, which enable the techniques to be deployed at scale
  • review the impact of such tools on learners and educators show how, as a by-product of web delivery, one can build quality datasets
  • describe how this data is amenable not only to traditional educational analysis, but explore the prospects for using machine learning and big data approaches
  • consider user interfaces which enable different stakeholders (eg. learners; educators; researchers) to interact with that data coherently
  • looking to the future, what ideas can we brainstorm for the tough questions this field faces, e.g. Can we develop dispositional analytics based on learners’ activity traces (rather than self-report)? Can we move from analytics, to recommendation engines able to make timely interventions for educators, or guidance to learners?

SPEAKERS

Organiser: Simon Buckingham Shum – Professor of Learning Informatics, Knowledge Media Institute, The Open University, Milton Keynes, UK

Ruth Deakin Crick – Reader in Systems Learning & Leadership, Centre for Systems Learning and Leadership, Graduate School of Education, University of Bristol, UK

Chris Goldspink – Director and Chief Scientific Officer, Incept Labs, Sydney, AUS

Nelson González – Co-Founder & Chief Strategy Officer, PiersonLabs, San Francisco, USA

Dave Paunesku – Founder, PERTS Lab, & Dept. Psychology, Stanford University, USA

PROGRAMME OVERVIEW

2pm: Welcome Simon Buckingham Shum

2.15pm: Dispositional Learning Analytics: Learning Power & Complex Systems Ruth Deakin Crick and Simon Buckingham Shum

2.35pm: Open discussion

2.45pm: Measuring & Changing Student Psychology Online: Lessons from a Scale-up Project Dave Paunesku

3.05pm: Open discussion

3.15pm: Layers, Loops and Processes: Multi-level Analytics in Learning Systems Chris Goldspink and Ruth Deakin Crick

3.35pm: Open discussion

3.45pm: Learner Dispositions: Big Data Meets Focused Social Science Research — Nelson Gonzáles, Chris Goldspink and Ruth Deakin Crick

4.05pm: Open discussion

4.15pm: Closing discussion on key issues, and where next?

4.30pm: Close

…sparking many conversations for the rest of the week, and beyond!…

 

 

Opening: Dispositional Learning Analytics

In joint work with Ruth Deakin Crick and Shaofu Huang at University of Bristol, Rebecca Ferguson and I are developing an approach to modelling learning dispositions, based on the educational research underpinning the ELLI instrument for Learning Power:

Buckingham Shum, S. and Deakin Crick, R., Learning Dispositions and Transferable Competencies: Pedagogy, Modelling and Learning Analytics. Proc. 2nd International Conference on Learning Analytics & Knowledge (Vancouver, 29 Apr-2 May, 2012). ACM: New York. pp.92-101. DOI: http://dx.doi.org/10.1145/2330601.2330629 Eprint: http://oro.open.ac.uk/32823.

See also the LearningEmergence.net blog post and the LAK12 replay

The most recent work on this, which picks up the challenge identified at the end of the above paper, is the question of whether it is possible to generate an ELLI profile automatically from learners’ incidental data traces. Shaofu Huang summarised the concept and work-in-progress on this at a recent SocialLearn symposium.

We now have modest funds available to appoint either a visiting researcher or consultant to work with us on a short, focused project, to design and run the database queries on the SocialLearn platform, which will enable us to begin testing the modelling that we have been doing.

Once you’ve digested the above materials, please contact me if you have the curiosity – and SQL expertise – to work collaboratively with us to take this research forward.

EnquiryBlogger: blog-based learning analytics

Just gave this talk on EnquiryBlogger with Rebecca Ferguson and Ruth Deakin Crick at the annual Open U.’s CALRG 2012 conference.

 

Further reading:

Ferguson, R., Buckingham Shum, S. and Deakin Crick, R. (2011). EnquiryBlogger: using widgets to support awareness and reflection in a PLE Setting. 1st Workshop on Awareness and Reflection in Personal Learning Environments. PLE Conference 2011, 11-13 July, Southampton, UK. Eprint: http://oro.open.ac.uk/30598

Ferguson, R. and Buckingham Shum, S. (2012). Social Learning Analytics: Five Approaches. Proc. 2nd Int. Conf. Learning Analytics & Knowledge, (29 Apr-2 May, Vancouver, BC). ACM Press: New York. Eprint: http://oro.open.ac.uk/32910

Buckingham Shum, S. and Deakin Crick, R. (2012). Learning Dispositions and Transferable Competencies: Pedagogy, Modelling and Learning Analytics. Proc. 2nd Int. Conf. Learning Analytics & Knowledge. (29 Apr-2 May, 2012, Vancouver, BC). ACM Press: New York. Eprint: http://oro.open.ac.uk/32823

2 PhDs: Learning Analytics & Authentic Inquiry

KMi has several studentships for PhDs starting full time in Oct 2012. Two of them are around my joint work with Rebecca Ferguson at the intersection of  learning analytics, deep learning, authentic inquiry and dispositions. You will be competing against many other applicants across all KMi research topics, so show us how good you are!

The first is:

Learning Analytics for Learning Power

and this one, which will shortly go up on the KMi Studentships page:

EnquiryBlogger: tools for reflective learning

Knowledge Media Institute, The Open University, Milton Keynes, UK
3 year fully-funded PhD (Oct. 2012-Sept.2015), Stipend: £40,770 (£13,590/year)

Supervisors: Simon Buckingham Shum & Rebecca Ferguson

Background

Enquiry-based learning is shaped by students’ interests and driven by their curiosity. As learners engage in an authentic enquiry, they not only acquire knowledge and skills but also develop the values and attitudes necessary for learning [1]. The Knowledge Media Institute (KMi), working with partners, has developed an online toolset, EnquiryBlogger, in order to support awareness and reflection for enquiry-based learners [2]. Writing a blog offers learners opportunities to incorporate many perspectives, develop carefully crafted contributions, reflect and make considered responses [3]. It also provides an environment in which people can observe, articulate and refine practices [4]. EnquiryBlogger extends the core features of a robust, open-source blogging platform, offering four additional tools:

  • Enquiry Spiral provides a graphical representation of the enquiry; clickable links allow learners and teachers to track progress within and across blogs.
  • ELLI Spider provides learners with a pre-defined set of tags to reflect self-perceptions of their learning power. The resulting spider diagram provides a searchable graphic representation.
  • Mood graph reflects users’ affective response to their enquiries. Learners select an emoticon, and the written explanation of their choice is recorded as a blog post. The resulting clickable graph charts changes in emotional state.
  • Dashboards provide educators with clickable overviews, allowing them to see how each enquiry is progressing, which learners are having difficulties and which learners are reporting success and high levels of reflection.

Our strategic goal is to develop EnquiryBlogger, its visualisations and its dashboards to help learners at all levels engage in enquiry-based learning and, ultimately, build their capacity as life-long, life-wide learners.

PHD CHALLENGE: This PhD will fund a candidate to evaluate, design and implement tools for reflective, enquiry-based learning.

EnquiryBlogger is currently being trialed with groups including junior school pupils and Masters students. A key next step is to extend and evaluate these trials, which will drive the design and development of tools to support learning and teaching using authentic enquiry. The current tools provide a basis for the development of learning analytics, visualisations and dashboards that could be deployed in other contexts, for example within other Open University platforms such as SocialLearn [5] and Cohere [6]. A possible outcome is an integrated set of tools and dashboards that can be adapted to diverse situations, that are grounded in a theoretically robust framework, and that offer visualisations with the potential to transform learners’ and teachers’ experience of enquiry-based learning. The PhD will be in collaboration with learning scientists and practitioners in the global LearningEmergence.net research network, who are well placed to provide pedagogical input, user communities and impact evaluations.

Seize the Day!

This is a fantastic opportunity if you are passionate about the future of learning and want to engage with next-generation pedagogy. You may be a great web, widget or app developer, aiming to develop a research career in technology-enhanced learning. Or you may have a background in education, and be aiming to build your skills as a developer alongside your experience as a researcher. Your supervisors will be Simon Buckingham Shum and Rebecca Ferguson, who are active contributors to the field of Learning Analytics research. The PhD will be in collaboration with learning scientists and practitioners in the global LearningEmergence.net research network, who are well placed to provide pedagogical input, user communities and impact evaluations. In particular, this work will be done in partnership with Ruth Deakin Crick, University of Bristol (Graduate School of Education & Centre for Systems Learning & Leadership), whose research into modelling and assessing learning power provides a foundational element for this project.

Open U. is the place to do research in learning technology, this being an institutional mission-critical challenge. The Knowledge Media Institute is an 80-strong state of the art research lab, prototyping the future for the Open University and the many other organisations with whom KMi partners. KMi is renowned for its creative, can-do culture, and its high impact on the OU’s strategic thinking and technical capacity [Locate KMi]. The Institute of Educational Technology (where Rebecca Ferguson is based) is home to world leading research on learning technology, as well as conducting institutional research to inform the university’s core business. You will be part of a comprehensive doctoral training programme in computing and educational technology, participating in a dynamic research community, with opportunities to connect with groundbreaking people and ideas — limited only by your energy and imagination.

To Apply…

  • Contact us if you have informal queries: s.buckingham.shum or r.m.ferguson atsign open.ac.uk.
  • Read the background papers, and research technical approaches which will enable you to locate your ideas within the literature on learning analytics. See for instance the ACM Learning Analytics Conference (2011/2012), and SoLAR resources, and other research conferences around data mining and visualization.
  • Open U. Research website gives an overview of the quality of research conducted here, and the Research Degrees Handbook which will answer many practical questions
  • Draft a proposal outlining how you might tackle this challenge, highlighting which of the above approaches you might focus on, and the skills/experience that you bring (plus any that you recognise you will need to acquire). 4 pages max. This is not a binding document, but shows us how clearly you can think and write.
  • Complete the PhD application form [Word doc]
  • Email these with your CV and a cover letter, cc’ing Simon Buckingham Shum & Rebecca Ferguson, to: Ortenz Rose <O.Rose@open.ac.uk>
  • Deadline 7 June: You will be competing for one of several studentships being offered across all KMi research topics.

Reading

[1]     Deakin Crick, R., (2009) Inquiry-based learning: reconciling the personal with the public in a democratic and archaeological pedagogy. Curriculum Journal, 20, 73-92. [abstract] Contact us for a copy

[2]     Ferguson, R., Buckingham Shum, S., & Deakin Crick, R. (2011) EnquiryBlogger – Using Widgets To Support Awareness and Reflection in a PLE Setting. In W. Reinhardt, & T. D. Ullmann (Eds.), 1st Workshop on Awareness and Reflection in Personal Learning Environments. http://oro.open.ac.uk/30598

[3]     Ferguson, R., Clough, G. and Hosein, A., (2007) Postgraduate blogs: beyond the ordinary research journal. In: S. Wheeler and N. Whitton (eds.), ALT-C 2007 Proceedings. http://oro.open.ac.uk/12275

[4]     Efimova, L., Fiedler, S., Verwijs, C. and Boyd, A. (2007) Legitimised theft: distributed apprenticeship in weblog networks. I-know 04, (Graz, Austria).

[5]     Ferguson, R. and Buckingham Shum, S., (2012) Towards a social learning space for open educational resources. In: A. Okada, T. Connolly and P. Scott (eds.), Collaborative Learning 2.0: Open Educational Resources. IGI. http://oro.open.ac.uk/33457

[6]     De Liddo, A., Sándor, A. and Buckingham Shum, S., (in press) Contested collective intelligence: rationale, technologies, and a human-machine annotation study. Computer Supported Cooperative Work. http://oro.open.ac.uk/31052

Introducing Dispositional Learning Analytics

Ruth and I just gave this talk here in Vancouver, introducing the learning analytics community to ELLI as an approach to modelling dispositions and attitudes in a computationally tractable form, and different rationalities for validating learning analytics. This is also the first publication (see below) which details the functionality of the Learning Warehouse platform, and how it changes traditional educational research.

Buckingham Shum, S. and Deakin Crick, R. (2012). Learning Dispositions and Transferable Competencies: Pedagogy, Modelling and Learning Analytics. Proceedings 2nd International Conference on Learning Analytics & Knowledge, 29 Apr – 02 May 2012, Vancouver, British Columbia, CA. ACM Press: New York. DOI: 10.1145/2330601.2330629. Open Access Eprint: http://oro.open.ac.uk/32823

Abstract: Theoretical and empirical evidence in the learning sciences substantiates the view that deep engagement in learning is a function of a complex combination of learners’ identities, dispositions, values, attitudes and skills. When these are fragile, learners struggle to achieve their potential in conventional assessments, and critically, are not prepared for the novelty and complexity of the challenges they will meet in the workplace, and the many other spheres of life which require personal qualities such as resilience, critical thinking and collaboration skills. To date, the learning analytics research and development communities have not addressed how these complex concepts can be modelled and analysed, and how more traditional social science data analysis can support and be enhanced by learning analytics.  We report progress in the design and implementation of learning analytics based on a research validated multidimensional construct termed “learning power”. We describe, for the first time, a learning analytics infrastructure for gathering data at scale, managing stakeholder permissions, the range of analytics that it supports from real time summaries to exploratory research, and a particular visual analytic which has been shown to have demonstrable impact on learners. We conclude by summarising the ongoing research and development programme and identifying the challenges of integrating traditional social science research, with learning analytics and modelling.

Learning Analytics: Ascilite 2011 Keynote

Ascilite 2011 banner

Learning Analytics: Dream, Nightmare, or Fairydust?

From today’s keynote at Ascilite 2011, here’s the podcast plus the slides. I am grateful to Gary, Renee and everyone else at Ascilite for their understanding and flexibility, since after months of planning this trip, unfortunately I could not be there in person after my father passed away last weekend.

For those of you who like to download and watch offline: podcast [Hi-Res version: 93.3Mb] + slides [PPTX/PDF]

For detailed descriptions of work presented here, see other posts tagged learning analytics and the references below.

Abstract

Pervasive digital technology is weaving a fabric around our lives which makes it increasingly hard not to leave digital traces. We are experiencing an unprecedented explosion in the quantity and quality of data available not only to us, but about us. While some people find this blanket suffocating and threatening, for others, it marks an exciting new turn in our cultural evolution. The question for us is: what are the implications for learning?

One answer is it’s time to upgrade our computing kit. The learning platform and business intelligence vendors are rolling out analytics dashboards aggregating data into summary views, and will be a source of innovation as they seek to respond to customer needs — but what will institutions be asking for? It is conceivable that government education departments might see potential for league tables based on them.

Another answer is that, at last, we will have an evidence base previous generations of educators and academics could only dream of: real-time data streaming in from our students, even more from data shared by countless others who are happy to reveal their social networks, geo-location, and recommended books. Previously siloed scholarly datasets are now released into the wild, where they can be harvested and mined in a vibrant ecosystem of connected ideas, learners and educators.

Then there are those of a more cautious nature. So what if we have shedloads of data? Now we can drown faster. Learning, enquiry, argumentation, sensemaking, scholarship, insight — these skills are of an entirely different order, the highest forms of meaning-making, uniquely human. And what have analytics to say about the less tangible 21st Century skills that we need to nurture if the next generation is to manage the unprecedented complexity and uncertainty that they will inherit from us? Surely data analytics have nothing to say about intrinsic disposition to learn, emotional resilience in the face of adversity, the ability to moderate a discussion, resolve conflict, or ask critical questions? Finally, who is in control of analytics: are they tools to study learners, or tools to place in their hands, to create reflective, more agile individuals and collectives?

Analytics may in time come to be used to judge you — as a learner, an educator, or your institution. The challenge for us is to debate what it means for this new breed of performance indicators to have pedagogical and ethical integrity. What can and should we do, and what are the limits? Do they advance what we consider to be important in learning, teaching, and what it means to be a higher education institution in the 21st Century?

Are you thinking Dream, Nightmare, or Fairydust?

Biography

Simon Buckingham Shum’s work on sensemaking, collective intelligence and knowledge cartography inform his thinking about the role of technology in shaping the future of learning in higher education, and at school level. His background is in Psychology (B.Sc., York), Ergonomics (M.Sc., UCL) and Graphical Argumentation for Design Rationale (Ph.D., York). He is Senior Lecturer in Knowledge Media and Associate Director (Technology), at the Open University’s Knowledge Media Institute. Within the OU he served on the Steering Group for OpenLearn, and as Director of SocialLearn. He served on the Steering Group who organized the 1st International Conference on Learning Analytics & Knowledge (LAK11), and is LAK12 Program Co-Chair.

Key refs:

Buckingham Shum, S. and Deakin Crick, R. (2012). Learning Dispositions and Transferable Competencies: Pedagogy, Modelling and Learning Analytics. Proc. 2nd International Conference on Learning Analytics & Knowledge. (29 Apr-2 May, 2012, Vancouver, BC). ACM Press: New York. Eprint: http://oro.open.ac.uk/32823

Ferguson, R. and Buckingham Shum, S. (2012). Social Learning Analytics: Five ApproachesProc. 2nd International Conference on Learning Analytics & Knowledge, (29 Apr-2 May, Vancouver, BC). ACM Press: New York. Eprint: http://oro.open.ac.uk/32910

De Liddo, A., Buckingham Shum, S., Quinto, I., Bachler, M. and Cannavacciuolo, L. (2011). Discourse-Centric Learning Analytics. Proc. 1st International Conference on Learning Analytics & Knowledge. Feb. 27-Mar 1, 2011, Banff. ACM Press: New York. Eprint: http://oro.open.ac.uk/25829

Ferguson, R. and Buckingham Shum, S. (2011). Learning Analytics to Identify Exploratory Dialogue within Synchronous Text Chat. Proc. 1st International Conference on Learning Analytics & Knowledge. Feb. 27-Mar 1, 2011, Banff. ACM Press: New York. Eprint: http://oro.open.ac.uk/28955

Learning skills impact Ofsted inspection

I commented earlier on the way in which schools in England are assessed, which is still dominated by high stakes SATs exam testing, even at Primary School Key Stage 2 level (11 year olds) — the sector in which I’m most involved. The new controversial Ofsted inspection regime has recently got tougher, with a continued emphasis on SATs attainment levels, and even more precisely defined criteria, with many schools finding themselves demoted in the categorisation scheme. You really have to tick every single box to get a given grade: it’s not a ‘best fit’ match.

Having just experienced the new inspection regime at Bushfield School where I am Chair of Governors, I’m afraid I can confirm that it is a gruelling affair for staff, due to the level of detail and questioning required to test all the criteria — when in a school for only 1.5 days to judge it. All I’ll say is that when Headeachers are  professionally tarred, feathered, and made redundant if they don’t get a ‘failing’ school improving (as defined by Ofsted) we do not exactly have a culture conducive to learning and professional development. (We used to do that to children too, but it’s the 21st Century now so we know how destructive that was…).

However, I can report a few glimmers of hope, one regarding the explicit success criteria, the other on the impact of intensive, explicit focus on fostering learning to learn habits of mind and skills.

First, the criteria for being deemed “Outstanding” overall have broadened a little, and do not appear to be so dependent on having “Outstanding” exam attainment levels which are incredibly hard to achieve in areas of special economic need, with all the additional challenges that brings. Academic “achievement” now can be “Good”, if at least four other primary judgements are “Outstanding” — see p.82 below of the hefty evaluation schedule). This is progress of sorts, and it now appears that Leadership can now be deemed “Outstanding” even if academic “Achievement” is not. The fact that Leadership might be “Outstanding” even in a severely depressed locale in which academic attainment measures struggle, seems not to have penetrated yet.

The second area of hope is in relation to the importance of meta-cognition, habits of mind, and learning skills. We care deeply about switching our young people onto learning — fostering their curiosity, their appetite and capacity to question and to figure out how to get answers, and so forth.

The framework we use at Bushfield is based on the formative work at University of Bristol on Learning Power, by Guy Claxton, Patricia Broadfoot and Ruth Deakin Crick. Bushfield has been implementing the Building Learning Power strand of practitioner development resources that came from this research, and is now considering adding in the Effective Lifelong Learning Inventory (ELLI) as a way to personalise and track progress, working with the ViTaL social enterprise. (Open U. has already been piloting ELLI in the ELLI for Adults programme led by Chris Edwards, and I’ve brought it into my research on social learning and sensemaking).

From the original journal paper, here are the seven dimensions of learning that their analysis surfaced:

Deakin Crick, R., Broadfoot, P. and Claxton, G. (2004). Developing an Effective Lifelong Learning Inventory: The ELLI Project. Assessment in Education, Vol. 11, Issue 3, pp. 247–272.

“Seven dimensions of learning energy

These successive statistical operations enabled us to identify what we believe to be some key components of learning. Detailed scrutiny of the loading of the items on the seven factors led to these dimensions being interpreted in terms of the following summary descriptions that are presented in a polarized form here for the sake of clarity. It needs to be stressed, however, that it is important to recognize that these are ‘ideal types’ in that any individual learner is likely to find themselves at different points on each dimension. Moreover, as has been suggested, an individual’s position between the two poles identified for each dimension is likely to vary from time to time and from context to context. At this stage of the analysis the emphasis was on identifying in a robust way the dimensions themselves, rather than the capacity of the scales to characterize particular individuals.

Growth orientation

Some learners appear to regard learning itself as learnable. They believe that, through effort, their minds can get bigger and stronger, just as their bodies can. They see learning as a lifelong process, and gain pleasure and self-esteem from expanding their ability to learn. Having to try is experienced positively: it’s when you are trying that your ‘learning muscles’ are being exercised. A growth orientation includes a sense of getting better at learning over time, and of growing and changing and adapting as a learner in the whole of life. There is a sense of history and hope. The opposite of growth orientation is fixity. Other learners appear to believe that the ability to learn is fixed. They therefore experience difficulty negatively, as revealing their limitations. They are less likely to see challenging situations as opportunities to become a better learner.

Critical curiosity

Some learners manifest a desire to find things out. They like to get below the surface of things and try to find out what is going on. They value ‘getting at the truth’, and are more likely to adopt ‘deep’ rather than ‘surface’ learning strategies. They are less likely to accept what they are told uncritically, enjoy asking questions, and are more willing to reveal their questions and uncertainties in public. They like to come to their own conclusions about things, and are inclined to see knowledge as a product of human inquiry. They take ownership of their own learning and enjoy a challenge. The opposite pole is passivity. Passive learners are more likely to accept what they are told uncritically, and to believe that ‘received wisdom’ is necessarily true. They appear to be less thoughtful, and less likely to engage spontaneously in active speculation and exploratory kinds of discussion.

Meaning-making

Some learners are on the lookout for links between what they are learning and what they already know. They get pleasure from seeing how things ‘fit together’. They like it when they can make sense of new things in terms of their own experience, and when they can see how learning relates to their own concerns. Their questions reflect this orientation towards coherence. They are interested in the big picture and how the new learning fits within it. They like to learn about what really matters to them. The opposite pole is fragmentation. Some learners are more likely to approach learning situations piecemeal, and to respond to them on their own individual merits. They may be more interested in knowing the criteria for successful performance than in looking for joined-up meanings and associations.

Dependence and fragility

Dependent and fragile learners are more easily disheartened when they get stuck or make mistakes. Their ability to persevere is less, and they are likely to seek and prefer less challenging situations. They are dependent upon other people and external structures for their learning and for their sense of self-esteem. They are passive imbibers of knowledge, rather than active agents of their own learning. The opposite of dependence appears to be resilience & robustness. Learners with these characteristics like a challenge, and are willing to ‘give it a go’ even when the outcome and the way to proceed are uncertain. They accept that learning is sometimes hard for everyone, and are not frightened of finding things difficult. They have a high level of ‘stickability’, and can readily recover from frustration. They are able to ‘hang in’ with learning even though they may, for a while, feel somewhat confused or even anxious. They don’t mind making mistakes every so often, and can learn from them.

Creativity

Those learners who score highly on this dimension are able to look at things in different ways. They like playing with ideas and taking different perspectives, even when they don’t quite know where their trains of thought are leading. They are receptive to hunches and inklings that bubble up into their minds, and make use of imagination, visual imagery and pictures and diagrams in their learning. They understand that learning often needs playfulness as well as purposeful, systematic thinking. The opposite pole is literalness or rule boundness. These learners tend to be less imaginative. They prefer clear-cut information and tried-and-tested ways of looking at things, and they feel safer when they know how they are meant to proceed. They function well in routine problem-solving situations, but are more at sea when greater creativity is required.

Relationships/interdependence

Learners who score highly on this dimension are good at managing the balance between being sociable and being private in their learning. They are not completely independent, nor are they dependent. They like to learn with and from others, and to share their difficulties, when it is appropriate. They acknowledge that there are important other people in their lives who help them learn, though they may vary in who those people are, e.g. family, friends or teachers. They know the value of learning by watching and emulating other people, including their peers. They make use of others as resources, as partners and as sources of emotional support. And they also know that effective learning may also require times of studying—or ‘dreaming’—on their own. The opposite pole is dependence. Some learners are more likely to be stuck either in their over-dependency on others for reassurance or guidance; or in their lack of engagement with other people.

Strategic awareness

Some learners appear to be more sensitive to their own learning. They are interested in becoming more knowledgeable and more aware of themselves as learners. They like trying out different approaches to learning to see what happens. They are reflective and good at self-evaluation. They can judge how much time, or what resources, a learning task will require. They are able to talk about learning and about themselves as learners. They know how to repair their own emotional mood when they get frustrated or disappointed. They like being given responsibility for planning and organizing their own learning. The opposite of ‘strategic’ is robotic. Learners with these characteristics appear to be less self-aware, and are more likely to confuse self-awareness with self-consciousness.”

These have since been validated with many other cohorts, and distilled into practitioner training and resources. The ELLI tool reflects back to a learner how they perceive themselves as learners against the seven dimensions, using a visual spider diagram — the basis for mentored conversation. The BLP programme summarises them as four R’s (Resilience, Resourcefulness, Reflection, Reciprocity) which are unpacked into sets of “learning muscles” (introduction by Guy Claxton for QCA) that staff and learners then work on strengthening, e.g. managing distractions, questioning, distilling, empathy.

Well, one day we may see these kinds of dispositions and capabilities fully recognised by government as first-class priorities at the heart of education. It’s possible that this kind of research may have led to Ofsted to now include resilience in their criteria (see also Yvonne Roberts’ review of this concept, which she dubs Grit). Meanwhile, Building Learning Power has served us very well, providing staff with scientifically rigorous principles that they can interpret and contextualise, with intensely pragmatic strategies and resources for transforming classroom practice. The approach should not be thought of as an off-the-shelf, quick-win package, but as a way to open up conversations, over years, about what we are doing as a school. Its success depends on the creation of a learning culture by senior leadership, who explicitly permit experimentation, and model ways to share failures as well as successes. Huge credit is due to the senior team in this regard. Consequently, TLO, who coordinate the BLP programme reported that following an audit:

“The school has made outstanding progress in a short length of time […] The progress of both teachers and pupils was impressive to observe and represents the most profound change I have recorded to date.

The school’s commitment to infusing the principles and practice of building pupils’ learning capacities was observable in all lessons, in teacher planning, in teacher talk, and in pupils’ perceptions of learning.

The school has become a model of growing learning power practice and has much to offer other schools embarking on the journey.”

However, it’s only fair to note that TLO are BLP advocates. It was a delight, therefore, to receive very strong confirmation from the Ofsted inspectors during their visit that they also saw these as indicators of outstanding schooling, confirmed in the final Ofsted report which is full of phrases reflecting the fact that learning to learn skills have value in their own right, but of course, can only develop when woven into the pedagogy of teaching a given subject, in order to advance deeper understanding of that material:

Pupils’ “outstanding behaviour underpins their very positive attitudes to learning

The outstanding curriculum is stimulating for pupils, and planned carefully to suit them.

The school’s rate of progress has far exceeded the national trend

Pupils “develop very positive attitudes to learning and a thirst for knowledge

…and leave with “a strong set of higher-order skills to sustain them for a lifetime of learning”.

Clearly, not everything is simplistically attributable to learning to learn skills and dispositions, e.g. there is a deep, rich skillset around teaching and tracking literacy and numeracy which must be in place for those indicators to go up. However, it is in the creation of a learning culture amongst both staff and pupils, who are all trying to stretch their learning muscles, and who are given permission and autonomy to explore new ideas, that learning power provides a language in which to reframe what it is we think we’re about.

Speaking personally, as both an academic and governor, it is tremendously exciting to witness first-hand such a productive interplay between research and practice. I owe a debt to the Bristol team for what they have added to my life on both fronts — and yes, as a father, I am thrilled that my kids are also talking about and flexing their learning muscles! 🙂

I’m excited at what lies ahead as we seek to embed these ideas in social media for inquiry and sensemaking.

Learning Futures goes live

The Learning Futures programme funded by the Paul Hamlyn Foundation and the Innovation Unit, is rethinking and modelling what goes on in our schools. After spending a day with the school teams recently, hearing how the early days of their initiatives are going, this is definitely a stream to track. Hugely energising to engage with some of the most forward thinking school leaders in England!

Here’s the project summary,  starting with a spot-on quote from the Open U’s Chancellor. Good also to see the emphasis on open source and Open Educational Resources.

Learning Futures Summary from Paul Hamlyn Foundation

“It is time to hold up our hands and admit that our education system just isn’t working well enough. Our emphasis needs not to be on proving the residual value of outdated curricula, tests and league tables, but on inspiring and challenging children so that they in turn can inspire and challenge us.”
David Puttnam

The Learning Futures programme is a collaboration between the Paul Hamlyn Foundation and the Innovation Unit with a simple aim: to have more young people actively and positively engaged in their learning, achieve better outcomes and retain a commitment to learning beyond school.

The £1.2m programme has grown out of the extraordinary success of its predecessor, Musical Futures. This radical innovation in teaching music in high-school has grown from less than 20 participating schools, to almost half of all high schools in England, and pilots in numerous other countries.

A number of success factors were identified in re-energising young people’s motivation:

  • Co-constructing curriculum and pedagogy with students;
  • Integrating the informal out-of-school learning which motivates students, into the more formal context of the classroom;
  • Making the learning processes and content more relevant to young people’s lived experiences;
  • Changing the learner-teacher mix – utilising students as leaders, teachers as students, through coaching, mentoring and the use of experts in business and the community.

We believe that radically re-focusing teaching and learning in high schools is possible through a rigorous and disciplined approach to innovation in these four areas. But we also believe that, for innovation to scale-up, materials and tools must be developed which are ‘open source’: freely available for adaption and adoption by other schools and practitioners. We are therefore working with 40 schools (across 15 ‘sites’) in England over the next two years to trial, test, and document successful innovations across our four key areas. Our goals for the next phase of the project (2011-13) will be to:

  • Make freely available tools for change;
  • Evaluate the impact;
  • Support the scaling of Learning Futures practices across the country
  • Exert policy influence to support educational change

Working with a top performing school

I’m chair of governors (= school board in US) at Bushfield primary school in Wolverton. This has been one of the most interesting things I’ve undertaken in recent years, very much in tune with work at OpenU since the debates about the future of learning in school and university are pretty much the same. When you read the complaints about the current systems, and scenarios of future, you can more or less swap the nouns school/university and it still all makes sense… but the earlier we start to fix the system, the more profound the impact!

So, at Bushfield we just got a letter from the Minister of State for Schools & Learners, congratulating us on being one of the top performing schools in England. Your critical eye will, of course, be asking so what does top performing actually mean? The letter is quite precise:

“Your results show that you are amongst the top performing schools based on the most sustained year-on-year improvements in Level 4+ aggregate performance from 2005 to 2008.”

Hmm, sounds good. That sounded like they were congratulating us on how much progress children make, which in the glorious world of school league tables is called Contextual Added Value (CVA), a “performance indicator” that was introduced as a more rounded way to assess the quality of education than raw attainment levels in SATS, which take no account of the level at which children enter, your socio-economic context, how many special needs pupils you take, etc.

Well on closer inspection it turns out that no, this was all about our improvements in raw attainment levels. While this has some meaning, and we’re proud of the result,  we feel CVA is much more meaningful as an indicator of our philosophy to learning than an absolute league table ranking. And we’re even prouder that we’re amongst the top schools in the city and nationally on this front. No matter where you are in formal academic terms, at Bushfield School you’ll make better than average progress from when you entered to when you leave, than you would in almost any other comparable school. You might score higher if you went to a selective, private institution right at the top of the league tables, but that’s only accessible to a few. For everyone else, this is as good as it gets in the public system. Something for pupils and staff to be very proud of.

However…

Here we are in the 21st Century, gauging learning, and very publicly ranking schools, via a few very selective measures (exam results — scored this very week in May — on literacy, numeracy and science, though science SAT is abolished from next year as an inappropriate way to assess the subject. Hmm…). With the introduction of Contextual Value Added, the indices have grown a little sharper from the initial very blunt instrument of absolute scores, but there is so much more to learning that is left invisible by these categories. To paraphrase Geof Bowker, organisational memory systems are systematic ways of forgetting, since the categorisation systems they employ choose what to erase.

And this is why I love working with the Bushfield staff team, because they’re up for embracing the new conceptions of learning around the skills and habits of mind that the next generation needs to survive, and thrive, in a very fast changing world. In the end, I wrote a summary of my thoughts about our approach to learning, and after some improvements by the Headteacher and other governors, it feels satisfying to paint a much broader, richer picture of how we see learning.

Resilience and Liminal Space

I’m trying to clarify how learning, sensemaking, emotions and spirituality interweave. It all happens in the same person, so we can’t chop them up.

Being in London for a few days at PCF5 has given me that little extra reading time I don’t normally find in the family home 🙂

So yesterday I had the luxury of browsing in the superb Institute of Education bookshop and picked up Guy Claxton’s Wise Up: Learning to Live the Learning Life which has been on the hitlist for a few months. Maybe his work could also add a new dimension to SocialLearn, an Open U. strategic initiative to explore emerging online paradigms for the new learning landscape…

Right from the introduction to this lucid and influential book, Claxton’s writing is engaging and to the point:

Let me be clear. Learning, in the way I am using the term, is what you do when you don’t know what to do. (p.11)

Claxton goes on to present, in accessible language for a non-academic, research in the learning sciences which motivates what turned into the Building Learning Power approach for school teachers to learn how to teach children an explicit language for learning-to-learn. It turns out this derives in turn from a research project at University of Bristol into what makes good learners:

Deakin Crick, R., Broadfoot, P. and Claxton, G. (2004). Developing an Effective Lifelong Learning Inventory: The ELLI Project. Assessment in Education, 11, (3), pp. 247-272.

One of the key dimensions in Learning Power is resilience — the emotional capacity to tolerate the feelings of discomfort that assail us when we are stretched out of our comfort zone, threatening our sense of identity. Both adults and children flee this feeling if they are not resilient enough to persevere and believe that they can push through.

OK, now switch context to our AHRC/EPSRC/JISC-funded e-Dance research project, which as I hoped when putting it together with the others, is turning out to be an incredibly stimulating space to be in. We opened the proposal as follows:

A key problem in the academic field of dance is how to capture and document the incremental development of ideas and their material manifestation in the creative process within practice-led research. In improvisational, embodied investigation, the mode of engagement is generative, pre-verbal, intuitive, experiential and fluid. This militates against types of cognitive engagement necessary for analysis, critique and reflection. The problem is most acute in the context of dance: however it is pertinent to all arts-based disciplines. This project is predicated on dialogic processes between dance and e-Science and the fluidity of concepts as they transverse the two domains, making use of recent advances in the visualisation and representation of spatio-temporal structures and discourse.

Drilling down into the theme of pre-linguistic annotation/capture of choreographic design process, we wrote:

The visual nature of the interface employed by these e-Science documentation tools enables exploration of possibilities for pre-linguistic, multi-layered, non-linear representations of process, more aligned with the characteristics of the creative process itself. This reiteration of process will be considered not just as a static archival document of the process, but as a dynamic source of material that can be redeployed, for example, as a site for forensic, archaeological investigation; a score for further developmental commentaries generated through practice; or pre-recorded audio/visual content for re-use in hybrid distributed performance.

As the Open U. software development effort comes on stream in August, and with our Research Intensive in U. Bedford only a week or so away, we are now thinking about the kinds of user interface that choreographers want to scaffold, capture, provoke, reflect back their creative process. The role of the visual, and perhaps non-verbal human-computer interaction, are to the fore, as we take seriously the pre-linguistic nature of the choreographic design process. We have learnt from Helen and Sita (our choreographers) and from our partial immersion in the choreographic process, that they will ‘just know’ when they see something ‘right’ unfolding before them on the dance floor: a moment that they want to capture without getting verbal, to be revisited and replayed later for reflection and further rehearsal/research.

With these considerations in mind, it seemed providential when Guy Claxton emailed me this article:

Claxton, G. (2006). Thinking at the Edge. Cambridge Journal of Education, Vol. 36, No. 3, pp. 351–362

This tries to put language and concepts on how we conceive, and nurture, creativity. His interest is in how we work with, not fear or fight, that creative period when things remain inchoate, ill-formed and unsettling:

…there is a softer, slower kind of groping for a way of articulating something that is currently, tantalizingly, beyond our linguistic grasp… It is these gentle, generic, but often unsung, aspects of the creative process that I want to describe.

Intruigingly he uses the particular example of choreographers, as he writes about:

…the intuitive feeling of rightness (or wrongness) that guides the process. This sense of rightness—the same immediate, unjustifiable feeling of ‘Yes, that’s it’ that guides the process of focusing—seems to be essential to the kind of creativity I am exploring. A choreographer may not know what it is she is looking for until she tries out one more move and gets the ‘Yes, that’s it’ response. As I write, I too do not know quite what I want to say, nor precisely where the discussion is heading, until a sentence hits the screen and I get the ‘Yes, that’s it’ feeling. Even research scientists must learn to recognize and trust that intuition.

Inspired by the 1960s work of Eugene Gendlin at the University of Chicago on the pre-conceptual period of creativity and cognitive change, and continued by his associates [Focusing Institute], Claxton writes:

Gendlin’s point is this: that the kind of personal problem-solving that happens in counseling and psychotherapy usually requires slow, delicate, hazy knowing, rather than quick, conceptual, conscious knowing. The main problem is often not one of ‘deciding what to do’, but of coming to understand more precisely what it is that makes things appear problematic to us in the particular way they do. And that kind of knowing requires us to be able to go ‘back to basics’; to start with the complicated, murky ‘felt sense’ of the predicament, and then slow down the process of epistemic evolution so we can (a) see more clearly what kinds of assumptions we might, unconsciously, have been stirring in to the conceptual mix; and (b) allow the emerging conceptualization to be driven, and continually refined, by the felt sense itself, rather than forcing it to fit the pre-existing templates, categories, habits and phrases that we happen to have installed in the skill-scape and the word-scape. Focusing enables people to regain some flexibility, with regard to their ‘ways of knowing’. In particular, it helps them relearn the kind of patient, open-minded attentiveness that allows them to conceptualize their predicament in a way that is fresher, more differentiated, and more accurate, in the sense of being closer to the complex reality of their own embodied knowing.

So, all this is quite intruiging. In the context of e-Dance, embodied, pre-verbal cognition looks to be an interesting seam to mine in the coming months as we seek to build language that bridges cognitive interface design and dance, and concretely, to adapt our visual hypermedia tools (Compendium and Cohere) to support the construction of resources for choreographic, practice-based research.

The final strand coming together is around the writing of Richard Rohr, a Franciscan priest, on liminal space. Take this article, written in the aftermath of 9/11, but applicable to all contexts of suffering — which Rohr, uncomfortably, holds to be the only time when we grow spiritually:

“Limina” is the Latin word for threshold, the space betwixt and between.

[…] It is when you have left the “tried and true” but have not yet been able to replace it with anything else. It is when you are finally out of the way. It is when you are in between your old comfort zone and any possible new answer. It is no fun.

[…] IF YOU ARE NOT trained in how to hold anxiety, how to live with ambiguity, how to entrust and wait — you will run — or more likely you will “explain.” Not necessarily a true explanation, but any explanation is better than scary liminal space. Anything to flee from this terrible “cloud of unknowing.” Those of a more fear-based nature will run back to the old explanations. Those who love risk or hate thought will often quickly construct a new explanation where they can feel special and again in control. Few of us know how to stay on the threshold. You just feel stupid there — and we are all trying to say something profound these days.

[…] THE PREFERRED LANGUAGE of both the Christian and the Muslim mystics is the language of darkness. They are most at home in the realm of not-knowing. Often, therefore, it was called “luminous darkness.”

This “cloud of unknowing” is Claxton’s “slower kind of groping for a way of articulating something…”, and Gendlin’s “felt sense of the predicament…” —  but this time it’s framed within the Judaeo-Christian tradition, by a spiritual mentor who counsels normal people like you and me who may be enduring suffering and confronting personal meltdown as all the usual reference points dissolve.

As our times grow more complex and uncertain, nurturing resilience, which we might see as part of the deeper ability to inhabit liminal space, looks to be of central importance — not only for ourselves, but surely also our children. It may be “merely” artistic wrestling in the creative process, or the struggle to learn deeply, or it may be facing immense shock in one’s life.

As Dave Snowden argues, we are past the era of designing fail-safe organisational and societal systems: the only thing we can be confident of is that they will fail, as the environment grows more turbulent. We must instead design for safe-fail systems.

Since people are at the heart of such infrastructure, we might wonder what kind of an educational or organisational learning culture — from kindergarten on — would value the nurturing of such a fine mix of cognitive, emotional and social skills, dispositions and personal qualities? What if we treated them as equally important to — indeed, profoundly enabling of — traditional core literacies, or the performance indicators that conventionally govern the balance sheet?