TEF – Stumbling with Confidence

Beyond Teaching Excellence

(On not filling and measuring the pail, but lighting the fire)

[This is the transcript of a ‘provocation’ I presented at the joint conference of the three subject associations for dance (DanceHE), drama (SCUDD) and music (NAMHE) as part of a debate about the Teaching Excellence Framework (TEF), University of Huddersfield, 7th April 2017]

So…..
We didn’t vote for it. It’s far more complicated than those who envisaged it thought it might be. There are serious doubts about whether it’s going to achieve what it set out to do. But it’s here, it’s happening, and we’re told we’ve got to make the best of it.

And that’s just the TEF.

So what are the “known knowns”, which in some cases turn out to be “unknowns” anyway.

Take ‘excellence’ for example. In the original government Green Paper, there’s a very helpful section headed:

What do we mean by excellence?

(At this point you have to imagine a scene from Yes Minister, in which Sir Humphrey, in his inimitable way, explains ‘excellence’ to a rather bewildered Jim Hacker)

Humphrey: Well, Minister…..

“There is no one broadly accepted definition of “teaching excellence”. In practice it has many interpretations and there are likely to be different ways of measuring it. The Government does not intend to stifle innovation in the sector or restrict institutions’ freedom to choose what is in the best interests of their students. But we do think there is a need to provide greater clarity about what we are looking for and how we intend to measure it in relation to the TEF. Our thinking has been informed by the following principles:

excellence must incorporate and reflect the diversity of the sector, disciplines and missions – not all students will achieve their best within the same model of teaching;
excellence is the sum of many factors – focussing on metrics gives an overview, but not the whole picture;
perceptions of excellence vary between students, institutions and employers;
excellence is not something achieved easily or without focus, time, challenge and change.”

Hacker: Really? Is that it?
Humphrey: Yes, Minister.

So that’s much clearer isn’t it? The Government clearly believes that excellent teaching can occur in many different forms, in a wide variety of institutions, and it is not the intention of the TEF to constrain or prescribe the form that excellence must take. What we should expect though, is that excellent teaching, whatever its form, delivers excellent outcomes.

Well, for a start, the TEF has criteria, and metrics, so the notion and form of excellence in regard to the TEF is already proscribed or constrained. In fact, what will – and no doubt is happening – is that institutions are aligning their priorities precisely to those criteria – which, as almost everyone admits – are in any case based on the proxy ‘outcomes’ of NSS scores, retention and most importantly graduate salaries which are high enough to pay back all the money the government has lost in its ill-advised restructuring of HE finance.

What about some “known unknowns”?

What we do know is that the TEF puts the so-called ‘elite’ institutions, whose excellence is hitherto self-evident and uncontested, under some pressure. It’s been noticeable that while there has been a great deal of loud and insistent criticism of the NSS metrics from that quarter, there has been far less directed at the stats on employment and earnings. Surely that has nothing to do with the fact that, in regard to employment and earnings, Russell Group graduates do rather well…..but the evidence shows that has more to do with the social, educational and cultural capital of Russell Group students than the quality of the teaching

So, while we know that it’s hard to fall once you’ve been at the top for a long time, the “unknown” is how the politics of this will play out in practice when our much vaunted and excellent ‘elite’ institutions don’t appear at the top of whatever league table appears for Teaching Excellence. Paul Blackmore, at Kings, argues that long-held prestige – primarily based on research outcomes – will probably still trump the TEF outcomes in the short-term.

Some years ago, way before TEF even glimmered on the horizon, I was asked to contribute to a special ‘On Excellence’ issue of the HEA’s ‘Exchange’ magazine. I was writing at a time when I’d just been at a large academic conference where there had been a major debate about excellence in higher education.

Even back then there was a clear majority who felt that the term has lost credibility and value. When all institutions are either ‘excellent’ or, at the very least, ‘striving for excellence’ then we are witnessing a lot of sound (but hopefully not fury) signifying nothing. Excellence, in the memorable term coined by Bill Readings’ has become ‘de-referentialised’.

Readings’ extraordinarily prescient book – The University in Ruins – appeared 21 years ago. He described the university, forced to abandon its historical raison d’etre as a bastion of knowledge and culture, now enmeshed in corporatist, consumerist ideology, and obsessed by the ubiquitous, but empty, quest for excellence. Everywhere one looks, one sees mission statements and vision statements aspiring to excellence. There are no modifiers to the word, and thus the excellence can seem empty. It is unspecific. Excellence in teaching, excellence in research, and not forgetting excellence in parking (I kid you not). Everybody’s striving for excellence, because who wants to strive for just being ‘pretty good’.

The “excellence in parking” demonstrate the vacuity of the term. It was actually awarded to a university’s Parking Services for their success in restricting vehicle access to the university, and significantly reducing the number of parking spaces. Excellence could just as well have meant making people’s lives easier by increasing the number of parking spaces available. The issue here is not the merits of either option but the fact that excellence can function equally well as an evaluative criterion on either side of the issue of what constitutes “excellence in parking”, because excellence has no content to call its own.

So beyond the dodgy but unavoidable metrics, and the slipperiness of the notion of excellence, how do we demonstrate our ‘excellence’?

Well, there is of course the Provider Submission to supply a richer, deeper more meaningful narrative. Well having seen a few, there’s a clear M.O. (as the police say at a crime scene):

Use the word excellence or excellent a lot, particular if you can quote a reputable source e.g. QAA or External Examiner or provide some evidence where you can.
Write things like….
“We recognise and reward excellent teaching.”
“Team teaching and team meetings all support teaching excellence”
“Our eternal examiner comments that students’ standards of analysis are at times excellent”
“Our accrediting body commented on our ‘Excellent interaction with industry bodies and exemplary experiential learning practices’”

So we do what we’ve always done which is to play the game, and play it as well, or as excellently, as we can.

But…thinking back to that article on excellence I wrote for the HEA: my starting point for the article was the thought that we tend to avoid the ‘E’ word when it comes to talking about our art and performance practices. I know it’s a cliché, but when we greet the performers after a great show, we rarely, if ever, say “That was excellent”.

We say “That was wonderful” (the ‘darling’ is an optional extra), and I do think ‘wonderful’ is truly a much better word than ‘excellent’. Rather than ‘excellent’s’ rather hard-edged, triumphalist implication of being better than others, ‘wonderful’, i.e. full of wonder, has a sense of the remarkable, the extraordinary, the inspirational, the truly successful that is the mark of the highest quality work.

There is that famous quote ‘education is not the filling of a pail, but the lighting of a fire‘ (which is often misattributed to W.B.Yeats). That ‘lighting of the fire’ is what I know we truly strive for, and that we need to look beyond our obsession with trying to define, achieve, assess and reward excellence. What the TEF forces us to do is to focus on the filling of the pail, and then tick off when it is full, when we should be focusing on the fire.

If you enjoyed this, you might also enjoy The Emperor’s Folderol or Tales of the TEF: https://stumblingwithconfidence.wordpress.com/2015/11/12/the-emperors-folderol-or-tales-of-the-tef/

Higher Education and the Myth of the Level Playing Field

For as long as I can remember, the idea that the many and diverse higher education institutions in the UK are playing, and must continue to play, on a single, level playing field has been one of the key tenets of our HE sector. The phrase appears in virtually every major policy document in regard to higher education, and it underpins many of the debates and discussions about its future. The idea of the single level playing field underpins notions such as a 2:1 from institution x is the exactly the same as a 2:1 from every other institution in the sector.

Really?

I find I am not alone in my scepticism. Back in 2012, Paul Greatrix reported that “Steve Egan, Deputy Chief Executive at HEFCE, at a recent AHUA (Association of Heads of University Administration) event, was rather dismissive of the idea of a single level playing field, preferring to imagine number of different playing fields. However, it was not clear if these were side by side or one on top of each other or indeed whether they were marked up for the same game or which teams were playing on each”.

To answer Paul Greatrix, of course there are a number of different playing fields, and though everyone is playing the same game, the pitches are marked up for different versions of the game. Think football. There’s 11-a-side, 6-a-side, 5-a-side, Futsal, beach football, etc. There are outdoor pitches and indoor pitches. There are different types and sizes of pitches, different markings, different goal sizes. There are different rules…..but it’s all still, clearly football.

It is patently absurd to believe that a small, specialist, world-leading music conservatoire is playing the same game, on the same pitch, as a large, multi-subject, research-intensive, world-leading university. They may have ‘world-leading’ in common, but that’s about it. It is similarly absurd to imagine that a university that successfully specialises in widening participation and recruits from the lower social percentiles is playing the same ‘game’ with the same outcomes as an elite-focused university that recruits mainly from the top social percentiles. Mission, values, teaching styles, staff-student ratios, the student body, student experience on campus and external, research profiles and output, employability, etc. are all very different.

The problem we have in the UK was elegantly expressed by David Eastwood, the Chair of the Russell Group, at the recent Parliamentary Select Committee meeting into teaching quality in higher education: “We have a genius for turning difference into hierarchy”. That is certainly one reason we are loath to let go of the myth of the single level playing field. The fear is that once we admit there are different playing fields in higher education, we will immediately begin to construct hierarchies and league tables, with all the consequent gaming of the system (and academics are expert gamers), triumphalism and desperation.

It was also pointed out at the Select Committee meeting that the sheer diversity of UK higher education is one of its greatest strengths. Prof. Joy Carter, Chair of GuildHE, spoke about importance of having and maintaining ‘Excellence in Diversity’ (which just happens to be the title of the report I wrote for Guild HE). The different playing fields lie together on a hierarchy-less plane, each displaying excellence in different forms. Any hierarchy is in the eye of the beholder, and that excellence in diversity is something that ought to be celebrated and sustained by intelligent, informed policies and strategies, not threatened by simplistic, unfit-for-purpose, one-size-fits all metrics. The maintenance and enhancement of the UK’s world-leading sector requires sophisticated evidence-based policies, not policy-based evidence.

The Emperor’s Folderol or Tales of the TEF

(with apologies to Hans Christian Andersen, adapted from the translation by Jean Hersholt.)

Many years ago there was an Emperor so exceedingly fond of excellence in everything and everyone that he spent all his time and money on ensuring that everything and everyone was, indeed, truly excellent. He cared for nothing else. He had a test and a metric for everything and everyone, and instead of saying, as one might, about any other ruler, “The King’s in council,” here they always said. “The Emperor’s pursuing excellence.”

One day the Emperor announced that he wanted to create a magnificent and complex instrument – to be called The Emperor’s Folderol – that would tell him quickly and accurately who and what was excellent and, importantly, who and what was not excellent. Those who were found to be excellent were to be amply rewarded, while those who were found to be unable to meet the Emperor’s expectations of excellence were to be punished severely.

The many courtiers surrounding the Emperor could not be bothered to pronounce ‘The Emperor’s Folderol’ in full, and so proceeded to refer to it as the ‘TEF’.

In the great city where the Emperor lived, life was always dynamic. Every day many strangers came to town (despite strict border controls) and among them one day came two swindlers. They let it be known they were expert Folderol constructors, and they said they could create the most magnificent TEF imaginable. Not only were the tests, metrics and materials they used uncommonly fine, but a TEF made from them had a wonderful way of becoming invisible to anyone who was unfit for his or her office, or who was unusually stupid.

“That would be just the Folderol for me,” thought the Emperor. “If I used it I would be able to discover which institutions and people in my empire are unfit for their purpose and posts. And I could separate the wheat from the chaff, the good from the bad, and the elite from the hoi polloi. Yes, I certainly must get a Folderol constructed of those special materials made for me right away.” He paid the two swindlers a large sum of money to start work at once.

They set up a large workshop with two imposing looking machines and pretended to construct the TEF, though the machines in fact produced nothing at all. All the fees and costs which they demanded went into their traveling bags, while they worked the machines far into the night.

“I’d like to know how those constructors are getting on with the TEF,” the Emperor thought, but he felt slightly uncomfortable when he remembered that those who were unfit for their position would not be able to see the product. It couldn’t have been that he doubted himself, yet he thought he’d rather send someone else to see how things were going. The whole town knew about the TEF’s peculiar power, and all were impatient to find out how stupid their neighbours were.

“I’ll send my honest old minister to the TEF workshop.” the Emperor decided. “He’ll be the best one to tell me how it looks, for he’s a sensible man and no one does his duty better.”

So the honest old minister went to the room where the two swindlers sat working away at the machines, producing nothing.

“Heaven help me,” he thought as his eyes flew wide open, “I can’t see anything at all”. But he did not say so.

Both the swindlers begged him to be so kind as to come near to approve the excellent tests, the beautiful metrics. They pointed to the machines, and the poor old minister stared as hard as he dared. He couldn’t see anything, because there was nothing to see. “Heaven have mercy,” he thought. “Can it be that I’m a fool? I’d have never guessed it, and not a soul must know. Am I unfit to be the minister? It would never do to let on that the TEF doesn’t appear to exist at all.”

“Don’t hesitate to tell us what you think of it,” said one of the constructors.

“Oh, it’s beautiful – it’s magnificent.” The old minister peered through his spectacles. “Such a comprehensive system of tests, what excellent metrics of genuine value and utility, such exquisite workmanship! I’ll be sure to tell the Emperor how delighted I am with it.”

“We’re pleased to hear that,” the swindlers said. They proceeded to name all the tests and to explain the intricate metrics. The old minister paid the closest attention, so that he could tell it all to the Emperor. And so he did.

The swindlers at once asked for more money, more fees and more costs, to get on with the construction of the TEF. But it all went into their pockets. Not a single useful component went into the machines, though they worked at the machines as hard as ever.

The Emperor presently sent another trustworthy official to see how the work progressed and how soon it would be ready. The same thing happened to him that had happened to the minister. He looked and he looked, but as there was nothing to see coming out of the machines he couldn’t see anything.

“Isn’t it a beautiful piece of work?” the swindlers asked him, as they displayed and described their imaginary construction.

“I know I’m not stupid,” the man thought, “so it must be that I’m unworthy of my good office. That’s strange. I mustn’t let anyone find it out, though.” So he praised the intricate workings he could not see. He declared he was delighted with the beautiful tests and the exquisite metrics. To the Emperor he said, “It held me spellbound.”

All the town was talking of this splendid TEF, and the Emperor wanted to see it for himself while it was still in the workshop. Attended by a band of chosen men, among whom were his two old trusted officials – the ones who had been sent to see what was going on – he set out to see the two swindlers. He found them working the machines with might and main, but producing nothing that he could see.

“Magnificent,” said the two officials already duped. “Just look, Your Majesty, what tests! What a design! What craftsmanship!” They pointed to the machines, each supposing that the others could what the machines were producing.

“What’s this?” thought the Emperor. “I can’t see anything. This is terrible! Am I a fool? Am I unfit to be the Emperor? What a thing to happen to me of all people! – Oh! It’s exquisite. So elegant.” he said. “It has my highest endorsement.” And he nodded approval at the empty loom. Nothing could make him say that he couldn’t see anything.

His whole retinue stared and stared. One saw no more than another, but they all joined the Emperor in exclaiming, “Oh! It’s wonderful,” and they advised him to place the TEF on the grandest carriage at the front of the great procession he was soon to lead. “Magnificent! Excellent! Unsurpassed!” were bandied from mouth to mouth, and everyone did his best to seem well pleased. The Emperor gave each of the swindlers a cross to wear in his buttonhole, and declared them to be ‘Knights of the Order of the TEF’.

Before the procession the swindlers sat up all night and burned more than six candles, to show how busy they were finishing the TEF. They pretended to move the machine into the centre of the workshop, and they spent hours pretending to polish it. And at last they said, “Now The Emperor’s Folderol is ready for him.”

Then the Emperor himself came with his noblest noblemen, and the swindlers stood either side of their imaginary machine and pointed to it. They said, “Here is the testing instrumentation, and here is the metric matrix, and here is the excellence calculator which is linked dynamically to the financial reward generator. All the components are made of the lightest and finest materials. No expense has been spared. The machine runs absolutely silently, and one would almost think there was nothing there, but that’s the whole point.”

“Exactly,” all the noblemen agreed, though they could see nothing, for there was nothing to see.

“If Your Imperial Majesty will condescend to accept our humble construction,” said the swindlers, “we will now demonstrate how it works, and after the parade we will provide you with detailed instructions on how to operate it.”

The Emperor nodded his assent, and the swindlers pretended to operate the machine. Turning a dial here. Switching a switch there. They invited each of the noblemen to enter the machine and stand between them. After more imaginary turning of dials and switching of switches, and taking great care to check the imaginary results, the TEF contructors declared each nobleman to be truly excellent and they congratulated the Emperor on his choice of courtiers.

And the courtiers said: “What a wonderful machine!”, “How clever your Majesty is to have thought of it!” “Those metrics, so perfect! Those tests, so suitable! It is a magnificent machine!”

Then the minister of public processions announced: “Your Majesty, the procession is waiting outside.”

“Well, if not now, when?” the Emperor said, and gave orders for the TEF machine to be carefully lifted and placed on the lead carriage. “It is a remarkable machine, isn’t it?”

The noblemen stooped low and reached for the floor as if they were picking up an exceedingly heavy object. “No, remember it’s extraordinarily light. Just be very careful” said one of the constructors. Then they pretended to lift and hold it high. They didn’t dare admit they had nothing to hold.

So off went the Emperor in procession, sitting in his throne behind the TEF machine, while several noblemen stood around the machine as it wound through the city. Everyone in the streets and the windows said, “Oh, what a wonderful machine! Look at the exquisite workmanship! What a truly excellent Emperor!” Nobody would confess that he couldn’t see anything, for that would prove him either unfit for his position, or a fool. No machine the Emperor had ever had built before was ever such a complete, excellent success.

“But there’s nothing there!” a little child said.

“Did you ever hear such innocent prattle?” said its mother. And one person whispered to another what the child had said, “There’s nothing there. A child says there’s nothing there.”

“But there’s nothing there!” the whole town cried out at last.

The Emperor felt his blood run cold, for he suspected they were right. But he thought, “This procession has got to go on, there is far too much at stake.” So he waved at the crowds more enthusiastically than ever, as his noblemen stood proudly alongside The Emperor’s Folderol that wasn’t there at all. And the excellent procession continued.

Dialogues of the TEF: considering teaching excellence

Amongst the plethora of analyses, critiques, diatribes etc. concerning the recent HE Green Paper, and particularly the introduction of the Teaching Excellence Framework (TEF), it’s worth considering – in relation to the complex and very slippery notion of ‘teaching excellence’ – the valuable and comprehensive 2014 report by Vicky Gunn and Anna Fisk: Considering teaching excellence in higher education: 2007-2013 A literature review since the CHERI report 2007 (The Higher Education Academy, 2014).

Here is the final concluding chapter of that report in full, which ought to be required reading at BIS and for anyone who has a genuine desire a) to get to grips with the notion of teaching excellence, and b) to help create and implement something genuinely useful and valuable.

Conclusions and recommendations

Perhaps the first thing to note in this conclusion is: the higher education sector has, through over a decade of initiatives, shifted significantly in terms of the professionalisation of university teaching. With regards to the UK specifically, this is clearly illustrated in the research literature but also from the evaluation of the high-level group on the modernisation of higher education which has just reported to the European Commission. Indeed, from a European perspective, UK approaches to teaching development and enhancement are now deemed effective enough to be worthy of emulation. This does not mean, however, that there is space for complacency. The level of impact of these initiatives has been patchy in some places and finding ways of ensuring top-down and bottom-up engagement is critical.

Additionally, changes to academic roles represented within institutions demand continued attention in terms of implications for defining excellent teaching and its relation to student learning. These changes also require a level of sophisticated understanding of how the way academics inhabit their disciplinary spaces in terms of the roles and identities they construct for themselves (and increasingly have constructed for them) influences the way they engage with notions of teaching excellence.

What is clear in the research and grey literature since the CHERI 2007 report, however, is:

there is a lack of articulation around the differences between threshold quality and teaching excellence. Shared repertoires, if not consensus, around qualitatively variable concepts of threshold quality, good teaching, and excellence are largely absent. (And there is little evidence of engagement with Gibbs & Habershaw’s distinctions between competency in basic tasks, excellence at new and more demanding tasks, and leadership and scholarship: as outlined in the CHERI report, p.20)
there is a lack of sophistication in conceptualisation of university teaching excellence both generally but more particularly in terms of changing expectations over a career. The absence of sophisticated theorising is particularly acute in terms of leadership in teaching excellence;
in terms of the differentiated nature of the HE sector, there is a lack of representatively diverse conceptualisation of how teaching excellence is defined and plays out (it tends to be portrayed as uniform), as well as little evidencebased discussion on the relationships between researcher and teacher excellence and how the status of each is balanced and recognised within differing clusters of institutions;
at least in the research literature, there is a significant gap between recognition of the dynamic engagement of academics and students in teaching enhancement and innovation, on the one hand, and some educational theorists who view teaching excellence as part of a neoliberal, inherently ‘performative’ agenda, on the other.

Overall, from the higher education research literature as it stands, it would still be hard for institutional teams, individual academics, and students to get a sense of the qualitative and quantitative differences between university teaching that is satisfactory and teaching that is excellent. What is demonstrated clearly by teaching excellence awards is that individual excellence has primarily been defined by initiatives and individuals which have come to be recognised as excellent, rather than as having been identified through theoretically robust, systematic or strategic models. Gibbs (2008) noted this and there has been little change. One of the difficulties this presents universities with, however, is that such a retrospective qualitative process does not necessarily allow for either a transfer of a readily adaptable framework to evaluate rapid changes in teaching practice (such as in the case of MOOCs) or mainstreaming approaches which take local activity and enhance practice beyond the locality. While the absence of systematic and transferable principles and conceptualisations has enabled or forced (depending on one’s world view) institutionally-generated responses to excellence to emerge, it has not addressed how we might develop comparative mechanisms for exploring excellence that would allow:

effective cross-institutional benchmarking as an enabling process in response to the need for some institutions to improve their engagement with teaching enhancement;
internal benchmarking to ensure reward and recognition processes are perceived and experienced as fair and robust across the institution;
research-informed, student development of teaching excellence criteria in reflection of their own generation of criteria for the student-led teaching excellence awards;
clear messages to the external environment concerning levels of and engagement with teaching excellence within universities.

Recommendations for further research

In terms of research there is a clear need for:

the development of robust methodologies for analysing the links between teaching excellence and student learning outcomes, which are able to explore the impact of roles and stages within an academic career, including the links between excellent student learning and excellent leading in teaching;
an analysis of the relationships and intersections between vocational service virtues as excellence identified in educational research (also implied in some teaching excellence awards) and the ethics and ethos of the disciplines, including both implicit and explicit virtues and vices represented in universities and through which teaching excellence is manifested. This needs to be done to properly identify the dissonances between the two and how in turn these dissonances impact on the success of educational endeavours, including those related to enhancing student learning. Research is particularly needed on the impact of these relationships in terms of:

– academic orientations to the various educational outcomes expected of university programmes of study and how they might move academics away or towards systematically imposed definitions of teaching excellence;

– student learning outcomes. Excellence in student learning was the primary focus of the CHERI report and since 2007 there has been a growing literature on teaching and curricular redesigns aimed at enhancing student engagement and learning outcomes. The headline initiatives responding to this have been: research-teaching linkages, employability, graduate attributes, student as co-producers, students as co-curricular designers. It is clear from the literature, however, that bigger questions are being asked regarding what an undergraduate education is for and whether there is a responsibility on the part of the university sector to play a more significant role in the socialisation of students. This is particularly seen in terms of citizenship (global and democratic) as well as approaches to learning which enable graduates in the future to respond to ‘worlds of constant change’. What this means for how teaching excellence comes to be defined needs to be analysed, as does how we would demonstrate a rigorous and defendable link between teaching excellence and excellent student learning in these areas;

3. theorising which challenges the universalising (and culturally predicated) tendencies around teaching excellence;

4. longitudinal projects which study the educational orientations, performance and impact of leadership as related to learning and teaching, particularly in terms of the impact on student learning, and their place within broader academic leadership and management;

5. rigorously analysing the dialectic between external needs and internal institutional dynamics in how excellence comes to be defined, incentivised, and measured;

6. research on the definition and operationalisation of teaching excellence and teacher excellence in the areas of interprofessional educational development activity, transnational education, learning analytics and disruptive innovations.

Recommendations for policy

In terms of policy, the over-riding focus needs to be on developing a shared repertoire around teaching and teacher excellence which fulfils the requirements of the range of internal and external groups invested in facilitating excellent learning outcomes.

At a national or sector-wide level, the development of a usable/convincing taxonomy which considers teaching excellence is required. This literature review suggests that such a taxonomy would need to address:

− academic role profile;

− career stages;

− the relationship of these to the broader educational demands on universities in terms of learning outcomes; disciplinary needs; institutional missions.

The success of such a taxonomy may depend on its capacity to demonstrate alignment with/ integration of researcher excellence taxonomies and teaching quality processes.

To design the architecture of such a taxonomy is not easy but this literature review suggests elements drawn from the review process which might be useful for initiating a sector-wide discussion.

2. Finally, there is also a need for strategic direction to be reached concerning the ethical use of learning analytics to facilitate teaching excellence and demonstrate excellent student learning outcomes.

Conceptualising what lies behind the judgement of good teaching was undertaken by Trigwell 2010. His idea is adapted below to provide an introduction to the minimum components necessary for the composition of a taxonomy of teaching excellence. Thus the two underlying preoccupations in designing a taxonomy would be:

• qualitatively identifiable variation in approach (classified as excellent, recognisably different from threshold and good) and relevant to different types of academic career profile and stage of career;

• how well an institution, discipline, individual academic informs, demonstrates, and judges that variation.

Elements for developing the architecture of a teaching excellence taxonomy (adapted from Trigwell 2010)

These would underlie four dimensions, with each dimension having four components.

Dimension 1 – Achieving educational demands on universities: extent to which excellent learning outcomes in response to the relevant educational demands are defined and illustrated.

Providing context in which disciplinary mastery is achieved by students
Providing a context in which student learning development (both discipline mastery and generic attributes) is achieved
Providing a context in which the students experience an education which enables fitfor-purpose entry into a determined career/ profession
Providing a context for the development of ways of being, doing, and acting associated with life-wide career opportunities as well as appropriate economic, financial, sociocultural, and ethical attitudes.

Dimension 2 – Excellent structures: level of quality of the approaches of different domains promoting teaching excellence in universities

National strategic approaches: • National recognition schemes • Establishing national bodies to oversee teaching excellence • Establishing national centres for teaching excellence • Enhancement approaches within quality assurance frameworks
Institutional • Teaching excellence awards • Linked top-down and bottom-up institutional-wide enhancement initiatives
Disciplinary • Signature pedagogies • Teaching and learning regimes
Students • Student-led teaching excellence awards • Active student participation

Dimension 3 – Demonstrating individual excellence: degrees of success in demonstrating excellence in teaching practice

Planning and delivery • Curriculum design • Knowledge of the subject • Ability to inspire and motivate • Respect, care and kindness for students as individuals • Active and group learning • Critical and scholarly
Assessment • Conscientious use of formative feedback • Creative and innovative approaches to feedback • Offering students a range of assessments to assess their mastery
Contributing to the profession • Innovation in delivery, assessment, feedback, evaluation, technology • Significant contribution to curriculum renewal and reform • SoTL • Participation in formal networks focused on teaching excellence • Leadership in teaching
Reflection and evaluation • Reflecting on inadequacies of own teaching • Degree of diligence in actively engaging with and responding to student and peer feedback and evaluations

Dimension 4 – Quality of evidence: levels of quality of evidencing individual teacher excellence

Peer observation/review of teaching • Documentary evidence of peerinvolved developmental processes • Report of peer review of teaching • Summative assessment of teaching practice through certificated programmes
Pedagogical competences portfolio – Focus on personal philosophy of teaching, evidencing how this is then operationalised in a variety of ways. (It is likely to include evidence from the three other quadrants.)
Scholarship of Teaching & Learning • Process of, dissemination of outcomes from learning and teaching projects • Publication of outcomes of initiatives (with a recognition that this does not equate primarily with peer review international journals as required in research excellence frameworks)
Evaluations and letters of support • Students • Alumni • Learning analytics – this particular data-revolution can allow for rapid performance management and might come to play a significant role in the assessment of academics’ teaching quality

Final word

Both the literature and the grey material demonstrate that supplying a quality higher education for students is at the core of university identity (even though the notions of quality are themselves ambiguous and contestable). In this, providing a high standard of teaching is afforded the status of a threshold activity for most universities and by most scholars.

The question increasingly, however, is how excellence can be singled out and is achieved in an organisational environment in which role diversification and associated specialisation means that:

• what it is ‘to be an academic’ is becoming increasingly contested and, in some cases, fluid over a career-span;

• the time to experiment, imagine and innovate in teaching is squeezed between other demands established by alternative research and quality focused taxonomies.

Managing both externally recommended and internally generated concepts of teaching excellence so that they do not become unsustainable burdens within an already stratified context is critical. Experimentation, imagination and innovation are areas of excellence that need time and space. Any framework of teaching excellence needs to address this as well as the professional virtues, strategies and practices excellent teaching academics in different disciplines, roles, and at different stages of the career bring to their institutions.

[END]

extended extract, with permission, from Gunn, V. & Fisk,A: (2014) Considering teaching excellence in higher education: 2007-2013 A literature review since the CHERI report 2007 York:HEA pp.47-52, d