Why examples are hard, and what to do about it |
Lancaster University www.hcibook.com/alan/ |
article in Interfaces, Autumn 2007
download article (PDF, 198K)
| ||||
Examples are important to generate ideas, to test ideas and to communicate ideas, but often we end up talking in generalisations, or read texts that never seem to move from the abstract to the concrete. For the reader and receiver of communication, examples are easy – so why are they so hard to produce? In this article I’ll look at why examples are important, why they are not used, why they are hard to produce … and how to make them easier! Examples and abstractionsI’m a mathematician, so I love very abstract ideas. The beauty and power of abstraction is both fascinating in itself and intensely practical. I only know of two ways to generalise: through abstraction and through analogy, and even to generalise through analogy requires some level of abstraction in order to understand which features are critical to the analogy. However, equally important are concrete examples, both real examples from our experience and ‘made up’ examples from our imagination. These examples themselves may be ‘concrete’ in a fairly abstract space, such as 2 x 3 = 3 x 2 as an example of commutativity, or may be very solid, such as ‘the day I went to Bognor Regis’. Concrete examples work together with abstractions and theories:
Academics and examplesFor years I’ve wondered why, given the obvious importance of concrete examples, academics are so bad at using them. Textbooks can be pretty bad, but articles and academic monographs are even worse. Strangely, this seems to be more common in the social sciences and humanities than in the sciences or even mathematics. There are several reasons for this: (a) too much understanding - Writers may simply understand their material so well that they don’t realise that the concepts and terms that have become familiar to them are difficult for others, or are simply not the terms others would use. (b) too little understanding – The writer may have a vague idea, but not really understand it clearly enough to be able to make it concrete. This is often an important precursor to deeper understanding, although in this case the attempt to formulate examples can be one of the ways to solidify and deepen understanding. (c) fear of misunderstanding – Examples may over-simplify. When giving an example we often choose a central case, for example; a poster-paint red, not deep crimson, as an example of red. This may mislead a listener into believing it is only the central category, or only the simple case, that we are trying to communicate. (d) defence from understanding – If you stick with vague abstractions, it is hard for anyone to challenge your ideas, but as soon as you give an example, it is easy for someone to say you are wrong. (e) rhetoric of incomprehensibility – By using abstract, hard to understand language a fairly ordinary statement may sound impressive. And if readers do not understand something they often think the ideas must be clever and difficult, not just that the writer is poor at communicating. That is, readers can confuse (a) for (b)! (f) being academic – Researchers may feel that because the product of their work is often abstract theory or concepts, the way they reach this and reason about it must also be abstract. In these circumstances, using examples may appear to be an un-academic way of thinking. (g) sounding academic – For similar reasons, even if the writer has thought about a problem domain concretely themselves, they may choose to write about it purely abstractly, for fear of sounding un-academic, or lightweight. Sadly, this appears to be the ‘right’ thing to do in terms of academic success: when experimenters submitted the same paper to academic journals in either plain or obscure English, the obscure versions obtained better reviews. (h) writing to genre – In several disciplines the standard way of writing has fossilised into an abstract form of writing. This is the case in mathematical proofs, where all the small examples and counter-examples that formed part of the mathematician’s creative process are apparently forgotten in the abstract proof. This seems to be part of a cult of minimalism. For different reasons, in parts of the social sciences obscurantism in writing seems to have become the accepted style. Here it appears more that the nuanced complexity of early thinkers in the field has been emulated in form, but not substance, by later writers. Note that some of these are weaknesses in communication by strong academics (a & c), some failures of weak academics (b) or misguided academics (f & g), and some deceptions of Machiavellian academics (d & e). In practice it is often the first of these that lead to disciplinary patterns of obscurantism (h), but for the most part we see a mixture of many of these reasons. Interestingly, Newton apparently wrote his Principia in geometric terms, rather than the emerging calculus, partly to make it difficult to understand except by those who had sufficient knowledge of the subject. This is not for any of the above reasons, but more a Gnostic-style writing for the elite (and by using the work ‘Gnostic’ I’m aware I am doing the same and sending some readers scurrying for a dictionary!). Arguably the obscurantism of some disciplines is related to this, and certainly part of the rhetoric of abstraction is saying “I can write like this, I am part of the intellectual elite”. Examples are hardIn all the reasons (a – h), the writer is at best poor at communicating, and at worst deliberately misleading. While there are no excuses for the latter, there is in fact a good reason for the former: creating examples is hard. When an abstract concept or theory arises through induction then the examples come first and so these examples are easy. However, in other cases you really do need to generate or find examples. Even when the concepts come through induction you may wish to find other examples of the general concept as well as those that drove you to formulate them. For example, in Coleridge’s The Rime of the Ancient Mariner are the lines ‘the furrow followed free’; having read these, you realise that the common first letter gives a sort of inverse rhyme and decide to call this ‘alliteration’ … it seems obvious to you that alliteration will be a good poetic technique and you try to think back over other poems to recall further examples in addition to the line from the Ancient Mariner that started your quest. If the concepts came through a process of abstract reasoning, then even if you had examples of some of the concepts and theories that started your thinking, you may not have any for the end point of that reasoning. This is often particularly difficult for negative reasoning – ‘a place name that begins with A but does not end with A’; and pretty hard for conjunctive reasoning – ‘a poem that uses alliteration and rhyming within a line’. Furthermore, the concepts may simply have ‘come into your mind’. This may be through some more subconscious process of induction or ‘reasoning’, but if so you are not explicitly aware of the underlying instances that drove the process. For example, poems usually use alliteration within lines and end, or near end, sounds in rhyming. What about a poem where the beginnings of lines sound the same? Let’s call this an emhyr (pronounced em-here) … can you think of an example? The problem in all these cases is that we have a concept and want to either: (a) generate an example ex nihilo, or (b) recall an example from memory that matches the concept. It is clear that (a) is difficult, to somehow generate an example of something from the abstract description. In the case of the poetry you would have to create a poem. However, (b) sounds easier. Indeed, this is precisely the annoyance in books or articles that remain abstractly ‘in the clouds’. Why not simply give us an example you’ve seen?, I always think. In fact, even this is not as easy as it sounds. To understand this we need to think about the way our brains code memories through associations. When I think of ‘group theory’ all sorts of associations spring to mind, the texture and colours of the first books in which I read about it; Galois, who formalised the area and solved problems outstanding since the Greeks, but died, at nineteen, in a duel; the axioms of the theory (and a few examples!), of course; and Open University presenters with fish-tail ties and flared trousers. Now, for you, ‘group theory’ may not mean much. If so, and I explained it to you (which sadly would take longer than explaining alliteration), you would find it hard to think of examples of it, not just because it is mathematical, but because when you have seen real examples (e.g. the manipulations of a Rubik’s cube), you will not have thought (consciously or subconsciously) “ah that’s connected with group theory”. With no associations between your new concept and the old memories, you cannot recall them. So it is no wonder that we find it hard to recall old examples for new concepts, and perhaps remarkable that we ever manage this at all! In fact the process for recalling old memories for new concepts appears to go something like: 1. You start off generating semi-concrete examples of the concept 2. These examples are then available to be matched by similarity to past memories (our brains are good at this!) 3. After a while, suddenly an old memory comes to mind (which is a good candidate example, as it is similar to the generated example) 4. You check to see whether it actually matches the concept 5. If it does … hey presto – got it! 6. If it doesn’t ... repeat the process starting with new generated examples (step 1) or more retrieved examples (step 3) Notice how this, in effect, retrieves using analogy, the more primitive (as in ‘older’ and more basic) way to generalise. But also note how this retrieval of past examples, which seemed like the easier process, actually requires that you first generate examples … the difficult process! Finding examples: transformation and semi-abstractionsAs in so many areas, once you understand that examples are difficult, and furthermore why they are difficult, you can start to conceive strategies to make them easier. Step 6 above says – if the retrieved example doesn’t match the concept then repeat the process. In fact, this elides an important step that we may make instead: 6a. if the old example doesn’t match the new concept, try to alter it Finding an example of a concept is not a simple accept/reject decision, but if we find something that is almost right we adapt it. We may often follow steps 1–6 and 6a unconsciously. However, when we find it difficult to think of examples, we can adopt the process more explicitly. Given that step 1 is the hardest, why not skip it – think of any concrete example, analyse why it isn’t an example of the concept you are after, and then alter it until it is. Note that even this process of altering examples normally has starting points that are in some sense roughly in the right area. In the boxed ‘emhyr’ example I started with a poem, not a mathematical equation. It would be harder to transform E=mc2 into an emhyr! However, when things get really tough this can be a good way of generating novel/different examples; indeed, one of the creativity techniques I suggest is the use of completely random analogies. So normally there is at least some level of generation of an example, followed by transformation; we have not managed to skip step 1 entirely! However, instead of having to get an example of an abstraction exactly, we are now simply trying to generate examples that are vaguely in the right area: easier for recall (e.g. any poem) and easier for generation. More ‘pure’ generation of an example may come through a process of semi-abstracted examples. That is, examples that have concrete elements, but where other parts are still vague or completely unspecified. These can then successively be made more concrete, or may simply suggest or cue a full concrete example. In the case of the emhyr, we might start with a couplet:
or a set of line start sounds and metre only:
In the first case we would need to add more lines to make a fuller example, but the couplet alone might be enough to remind us of something. Similarly we might try to complete the line ends in the second example, or simply find that this process of thinking of start sounds reminds us of a poem we have heard before. In a more analytic domain such as mathematics, we can have similar partially concrete examples: if we were interested in a property of two numbers we might consider what it would be like if the first number was 2. However, these semi-abstractions may also be more descriptive, but using concepts that are well understood. For example, if we have a new property about numbers in general, we may consider what this would be like for even numbers, or positive numbers. Working in the space betweenWe initially started with a dichotomy between abstraction and concrete examples. However, the process of semi-abstraction reminds us that in fact all our mental images are somewhat like this. When you recall a face, it is not every line and feature you recall, but parts and general aspects; indeed our very perceptual systems have already done a level of abstraction. Perhaps it is only when we externalise these, whether in action or in communication, that we start to make them truly concrete, but even then our words themselves are highly abstracted (e.g. the word ‘poem’ or even ‘cloud’ covers so many things). In mathematics, the most concrete things are themselves abstractions (e.g. numbers), and through the process of naming and axiomatising, more and more complex theoretical constructs become in some sense ‘concrete’, but this simply mirrors the ‘normal’ process of day-to-day language. The flow between more and less concrete examples is fairly fluid and often we do not need fully elaborated concrete examples to get inspiration for where to go next. Similar levels of inspiration and reasoning can happen in this in-between space of semi-abstracted examples in other domains. For example, as I thought about the semi-abstracted emhyrs, it became obvious that the technique (if it works at all) would be most effective in simple patterns, perhaps three lines starting with ‘lo…’ words, or three lines starting with ‘fl…’ words. Challenge! Write an emhyr about HCI and mail it to alan@hcibook.com. I’ll post the best on www.alandix.com/blog and at the HCI conference in Lancaster.
|
Alan Dix 19/7/2008 (article © June 2007)