The Science of Cycology: can you draw a bicycle?

Cognitive psychologist Rebecca Lawson shares her findings as she asks cyclists and non-cyclists alike where the different bits of a bike go

by Dave Atkinson   August 25, 2013  

Four badly drawn bikes.png

Tags

'As we know, there are known knowns; there are things we know we know. We also know there are known unknowns; that is to say we know there are some things we do not know. But there are also unknown unknowns - the ones we don't know we don't know.'
Donald Rumsfeld, United States Secretary of Defense, 2003.

I work as a cognitive psychologist at the University of Liverpool and I investigate how we recognise everyday objects in our world. Recent research indicates that we may be deluded into thinking that we know more about objects in our world than we really do. Kevin O'Regan has suggested that we may use the world as an "outside memory" to save us from having to store huge amounts of information. Since this information can usually be found simply by moving our eyes, we do not need to retrieve it from our brains. In 2002, Leonid Rozenblit and Frank Keil argued that, in particular, we overestimate our ability to explain how things work - whether artefacts like greenhouses and bicycles, or natural phenomena like tides and rainbows. They suggested that this illusion of explanatory depth is especially severe for objects with visible parts. Rozenblit and Keil's conclusions were based only on people's self-ratings of the quality of their explanations. I wanted to extend their work to measure how accurate people's explanations really are, to see how well people understand how everyday objects work. The bicycle is an obvious choice to test this.

Firstly, bicycles are familiar objects even for non-cyclists. I have given the test to over 200 students and parents coming to Open Days at the University. Over 96% had learnt to cycle as children with a further 1.5% learning as adults and less than 3% never having learned. Also 52% of this group owned a bicycle. Sadly, the figures on actual cycling were low, with just 1% cycling most days, 4% cycling around once a week and 9% cycling about once a month. The vast majority either never cycle (52%) or rarely do so (33%). Nevertheless, even for these non-cyclists, bicycles are a common sight. Secondly, if Rozenblit and Keil are correct, people should greatly over-estimate their understanding of how bicycles work because bicycle parts are visible and they seem to be simple, mechanical devices.

Figure 1. The drawing response sheet for the Draw-A-Bicycle task.

As best you can, please fill in on the above schematic bicycle drawing the main bits of the frame of the bicycle that you think are missing, the pedals and the bicycle chain. Use the symbols given on the right of the drawing to show the frame, pedals and chain.

I first asked people to draw a bicycle and I then asked them to select which of four alternatives were correct for the frame, the pedals and the chain, see Figure 1. I used the multiple choice test to check that errors that people made were not just due to problems with drawing or in my judgement of the accuracy of their drawings, see Figure 2.

Figure 2. The multiple choice questions for the Draw-A-Bicycle task.

CIRCLE which one of these four bicycles best shows the usual position of the frame:

   

 

CIRCLE which one of these four bicycles best shows the usual position of the pedals:

 

 

CIRCLE which one of these four bicycles best shows the usual position of the chain:

 

I looked at three types of errors which would severely impair the functioning of a bicycle (see Figure 3 for examples of all three):

1. drawing the frame joining the front and back wheels (making steering impossible)

2. not placing the pedals between the wheels and inside the chain (the pedals were sometimes drawn attached to the front wheel, the back wheel or dangling off the cross-bar)

3. not putting the chain around the pedals and the back wheel (these errors were almost all because people drew the chain looping around both the front and the back wheel of the bicycle)

Figure 3: Four sample bicycle drawings.

The top two drawings both show pedal and chain errors for a man who said he cycled at least once a month (left) and a woman who said she never cycled (right). The bottom left drawing shows both frame and chain errors for a woman who said she cycled most days. The bottom right drawing shows the very rare triple combination of frame, pedal and chain errors for a man who said he rarely cycled.

 

The errors could be made on the drawing or on the multiple choice test. Generally, people made somewhat fewer errors on the multiple choice test than the drawings for pedals and chains, so cueing them with pictures of the alternative possibilities helped them a little. The increase in frame errors for the multiple choice question is an artefact; many people were so unsure of where the frame went in the drawing that they missed it out altogether. I did not code these frame omissions in the drawings as errors.

Experiment 1 - non-cyclists

For the first group of 64 non-cyclists that I tested, many errors were made, specifically:

  Error Type Drawings Multiple Choice
1. Frame 13% (33%)
2. Pedal 9% (5%)
3. Chain 44% (36%)

People made lots of fundamental mistakes. For example, over one third thought that the bicycle chain runs around the front as well as the back wheel of the bicycle. The data can seem rather dry, so here are some comments that people made:

"I think context matters, I know a bike when I see it but it's different to recall (it) when sat in a room"

"Thinking about it in more detail, I realised I had no idea about its structure"

"I can't believe I found it so difficult to remember what a bike frame looks like!!!"

"I thought I knew more about the workings than I actually did"

"It's hard to picture a bicycle when you have to"

"I did not think long enough about the front wheel turning"

"I never knew how little I knew about things until I had to draw them".

Experiment 2 - non-cyclists with function hint

I was concerned that people might have made lots of errors in the first experiment because they were concentrating on trying to produce good-looking drawings of bicycles rather than trying to draw functionally viable bicycles. To address this, in the second experiment, before they started the Draw-A-Bicycle test, I gave them a heavy and rather patronising hint about what the task was about. I told them: "I am not interested in your drawing ability. It does not matter if your lines are wobbly or whatever. What I am interested in is what you know about how bicycles work. I want to make you think about what the pedals of the bike do .... and what the chain of the bike does ... and why the frame of the bike is a particular shape ... and how you steer a bike. So I want you to think about how a bike works before you draw in the parts". In a group of 94 non-cyclists I found:

  Error Type Drawings Multiple Choice
1. Frame 23% (47%)
2. Pedal 11% (6%)
3. Chain 50% (43%)

Compared to Experiment 1, giving a function hint did not reduce errors at all in Experiment 2.

Experiment 3 - cyclists

In the first two studies I found that non-cyclists made many fundamental mistakes when showing how bicycles worked, even when I gave them strong hints about what was important in the task in the second experiment. Would regular cyclists have a good, functional knowledge of how bicycles worked? I tested 31 cyclists at the Merseyside Cycle Campaign's Annual General Meeting and another 34 cyclists thanks to the Liverpool Wheelers, Cambridge University Caving Club and a few other random souls. These cyclists showed - hurrah - much reduced errors on the task. However even cyclists were not perfect:

  Error Type Drawings Multiple Choice
1. Frame 3% (8%)
2. Pedal 5% (2%)
3. Chain 6% (9%)

Experiment 4 - non-cyclists with a real bicycle to look at

At the start of this article I mentioned O'Regan's suggestion that we could use the world as an outside memory. Developing this idea, I wondered how well non-cyclists would do if I showed them an actual bicycle whilst they did the study. I tested 58 people and, yes, these non-cyclists were now at least as good as cyclists, supporting O'Regan's argument:

  Error Type Drawings Multiple Choice
1. Frame 2% (7%)
2. Pedal 3% (0%)
3. Chain 12% (5%)

This study also shows that the errors made by non-cyclists in the first two experiments were not due to them being unable to draw bicycles or not trying to do well. Non-cyclists can succeed at the task but only if they are helped by being given a bicycle to look at. Interestingly, people's comments suggested that they sometimes misinterpreted their success at the task as being due to their stored knowledge about bicycles. They said things like "I realised I knew more about bicycles than I thought". However others realised that they were helped by being shown a real bicycle that they could copy. They commented "looking at the bike made it easier to remember how it worked" and "I have never had to consider this problem. Helped by looking at the bicycle".

I am still collecting data on the Draw-A-Bicycle task but what do the results suggest so far? It seems that many people have virtually no understanding of how bicycles work. This is despite bicycles being highly familiar and most people having learnt how to ride one. Most people know that turning the pedals drives one or both of the bicycle wheels forward, but they probably understand little more than this. People's performance improves - but is still not perfect - if they either have increased experience with bicycles (in Experiment 3, testing cyclists) or if they are shown a bicycle that they can copy (in Experiment 4). I had hoped to look at whether cyclists made fewer errors because they had seen and used bicycles more (so gaining perceptual and motor experience) or whether it was time spent repairing bicycles that helped them (an increased functional experience). Unfortunately I did not have enough data to look at these two effects separately - most people who cycle a lot also do at least basic bicycle repairs; likewise most people who repair bicycles also cycle fairly often.

As far as cognitive psychology is concerned, though, the main finding of interest is how sketchy and shallow most people's understanding of bicycles is. Frank Keil argues that this minimal, superficial understanding is actually beneficial. It lets us efficiently interpret the world and make accurate, causal predictions without overburdening the limited processing and storage resources of our brain. We will almost always be able to just look at a bicycle whenever we need to know how it works. Why, then, should we bother trying to learn this information before we need it and then having the problem of needing to store this understanding in our limited-capacity memory system?

One last thing: unexpected sex effects. One finding that I was not looking for jumped out from the data. There were huge sex differences with females making many more errors than males. First, combining all the data from the first three experiments for people who said they never or rarely cycled, errors for these non-cyclists were:

  Non-Cyclists MALES FEMALES
  Error Type Drawings (Multiple Choice) Drawings (Multiple Choice)
1. Frame 10% (21%) 23% (50%)
2. Pedal 11% (9%) 12% (6%)
3. Chain 25% (26%) 59% (50%)

Thus, at least for frame and chain errors, females make around twice as many errors as males. It could be argued that this is still a matter of experience. It is likely that boys cycle more than girls so many males who currently rarely cycle may have, over their lifetime, seen and used more bicycles than females. However the sex difference is even more extreme for those who claim to cycle around once a month, once a week or most days. Errors for these cyclists were:

  Cyclists MALES FEMALES
  Error Type Drawings (Multiple Choice) Drawings (Multiple Choice)
1. Frame 0% (2%) 23% (27%)
2. Pedal 0% (0%) 15% (8%)
3. Chain 1% (0%) 34% (35%)

From these results it seems unlikely that the sex difference is just down to a greater experience with bicycles for males. Not only do male non-cyclists make fewer errors than female non-cyclists, they also make fewer errors than female cyclists; whilst male cyclists make almost no errors. Why? It might be that men generally have a better functional understanding of objects. To look at this, I have tried similar tests as the Draw-A-Bicycle test with objects such as rowing boats and cranes. However here I have found no clear sex differences. Let me know if you have any other suggestions that I could try testing.

I will be writing this up as a (dull!) academic paper. If you would be interested in seeing this, email me and I will send you a copy of that when it is ready. Thanks once again to those of you who did the test for me. Do email if you have any queries or suggestions about this work. I am particularly interested in any ideas why so many people think that the chain goes around the front as well as the back wheel. My email address is: rlawson -at- liv.ac.uk

14 user comments

Oldest firstNewest firstBest rated

Very interesting!

Does anyone know of any data on whether self reported rates of cycling correlate well with actual rates?

i.e. The people who claim to cycle "once a month, once a week or most days" - do they? Or is that wishful thinking on their part? I find it hard to believe that anyone cycling most days would struggle to draw a (diamond, two triangle) bike frame!

In terms of confounding factors -

Could it be that women are more likely to have seen alternative frame designs, maybe they have had step-through / single down-tube frames, whereas men may have had traditional diamond frames? This would help explain the difference in frame recall, maybe.

PJ McNally's picture

posted by PJ McNally [591 posts]
26th August 2013 - 6:57

27 Likes

PJ McNally wrote:

Could it be that women are more likely to have seen alternative frame designs, maybe they have had step-through / single down-tube frames, whereas men may have had traditional diamond frames? This would help explain the difference in frame recall, maybe.

maybe, but the greatest error levels were with the chain, which is in the same place on every bike

Dave Atkinson's picture

posted by Dave Atkinson [7506 posts]
26th August 2013 - 7:58

28 Likes

This is an interview question I've been using for several years, it is actually quite insightful in to someone's mind and good fun too.

They get a piece of paper, a multi-coloured pen and in five minutes, have to draw a bicycle for someone who has never seen one before putting in as much information as they feel relevant.

posted by kitkat [228 posts]
26th August 2013 - 8:57

24 Likes

The mind boggles.....

posted by caaad10 [130 posts]
26th August 2013 - 13:14

26 Likes

caaad10 wrote:
The mind boggles.....

Ditto!

antonio

antonio's picture

posted by antonio [1018 posts]
26th August 2013 - 15:24

21 Likes

12% of non-cyclists with a real bicycle to look at STILL managed to get the chain in the wrong place. How?

Although I have to say that a lot of these incorrect answers do put me in mind of one of the mechanics down at my LBS. Never go in there on a Monday!

Low Speed Wobble's picture

posted by Low Speed Wobble [140 posts]
26th August 2013 - 17:32

29 Likes

The bicycle sketch looks weird to me, I had to stop and think but mainly I was pondering how wiggly the bike was drawn.

posted by TeamCC [146 posts]
26th August 2013 - 17:46

27 Likes

Maybe the takehome message is that most people don't have the brains that God gave a bag of wet mice?

posted by MNgraveur [40 posts]
26th August 2013 - 17:53

20 Likes

TeamCC wrote:
The bicycle sketch looks weird to me, I had to stop and think but mainly I was pondering how wiggly the bike was drawn.

You're not wrong. What's going on at the front end? Perhaps this is to encourage a less careful effort on the part of the subjects?

nowasps's picture

posted by nowasps [263 posts]
26th August 2013 - 20:41

29 Likes

Perhaps get men and women to functionally draw a video player. I know that this caused havoc with the female population in the 80s and 90s.

posted by Colin Peyresourde [1205 posts]
26th August 2013 - 23:00

23 Likes

Pretty cool. I don't expect the paper is going to be dull at all. Looking forward to reading it. Curious about the actual stats, but I can see why you didn't include them in this write-up.

posted by cescolini [7 posts]
27th August 2013 - 10:21

25 Likes

The pedals and chain questions seem a little unfair - the right answers have a lump of machinery apparently floating in space, with no connection to the bike. It'd be interesting to see what the results would be with a normal frame shown.

posted by mogrim [41 posts]
27th August 2013 - 19:27

23 Likes

Regarding the sex differences (speaking as a girl who could definitely draw a bike, and has been fixing it herself for years), there's a couple of aspects I would consider, apart from natural tendencies of male/female brains.

It might be that boys often have a better technical understanding from playing more with the kind of toys that develop it. I always liked playing with my lego technic as well as my dolls etc. and I'm sure that helped my understanding of how these things interact and function. How much of that is a natural tendency and how much is social is another matter entirely.

I'd also say that the generalisation that men do the technical things such as DIY and bike maintenance is kind of self fulfilling, as the women will pass it across and therefore not learn and not have the confidence to try to do it themselves. If the idea of this kind of memory/learning is that you have to understand it to draw it, then you have to get quite up close and personal with a bike to understand it - fixing it, taking it to pieces rather than just riding it - and perhaps many women just don't even try, as it's someone else's (man/bike shop's) job? Maybe it would be worth analysing the results against men/women who maintain their bike instead of just ride it on a regular basis?

I also thought I'd add that I'm a musician, and I can think of times where this kind of memory process (learning the only the 'outline' of something but being able to interact with it in a more functional way) is used for sound as well as visually.

chrisl's picture

posted by chrisl [38 posts]
30th August 2013 - 23:39

33 Likes

Very interesting article. I guess one way to test whether a persons ability to fix a bike has an effect on their ability to recall the drawing would be to go (send your project students) down to some local bike shops and get customers to repeat the test taking a note of why they are there for. For example, if someone is there to get a puncture fixed they may know less than someone who wants their bottom bracket serviced. If you used this as a gauge along with basic questions such as 'can you fix a puncture?' or 'can you realign/index your gears?' you can start to build up an idea of their bicycle maintenance ability level.
What I find interesting is the increase in error when you give them a function hint. Are these differences significant? And if they are, does this point to people using a different part of their memory to complete the drawing? E.g. Are they are drawing it using artistic talent rather than as a functional object?

posted by esayers [22 posts]
9th September 2013 - 11:46

25 Likes