The big road.cc lights test 2012

we've been in a tunnel with 41 of this year's front lights and the results are in...


Dave Atkinson, October 20, 2012

Beam shot - Cateye Nano Shot Plus

Well, here we are again. Waking up in the dark, riding home in the dark... it's lights time.

We've been busy getting some of this year's crop and the reviews will be going up through the winter. In the meantime, however, we thought we'd share our beam testing data with you so you have something to be going on with. We took all the lights that came into the office before the Big Test deadline – about 40 of them – and put them through their paces. The great thing about lights is that it isn't just subjective: you can measure the beam and take directly comparable photos of what it looks like, so we did. The results are available in the big road.cc light comparator at the bottom of the page. Rear lights are coming soon.

What did you do?

We've collected lots of beam data so you can compare and contrast the different lights. Light manufacturers use a number of different metrics to describe light output. Top of the pile right now is lumens, which is a measure of the total output of the light across the whole beam. Some cheaper lights use candlepower, candela or lux, which are measurements of the brightest part of the beam at a set distance. We've used lux here, but measured at a number of points across the width of the beam. That gives an indication of the brightness of the beam at the centre, the amount of peripheral light and the throw of the beam. Specifically, we measured the lux value of the beam at two metres distance, in 10cm increments from the centre of the beam to 1m from the centre, giving eleven readings.

This year we've also included data on the shape of the beam. Putting the brightest part of the beam at the centre, we measured the output at thirty-degree increments around the beam, at a distance of 50cm from the centre. That gives you a good idea of the pattern of the beam; most are more or less round, but some have more interesting characteristics.

To get a good idea of what the beam looks like, we set up a bike on a rig so that we could photograph the beams of all the different lights in a comparable way. We used a tunnel this year, because it has the advantage of always being dry and pitch black down there which means that we should be able to more easily add to this test when more lights come in; last year we found with outdoor shots that replicating the rig wasn't easy, as different conditions above gorund mean differing levels of ambient light and reflection from surfaces, even in the same spot. Each of the beam shots you can see above was taken using the same settings on the camera. Specifically, they're all shot from directly above the saddle, using a 28mm lens on a Canon EOS1100D (effective 45mm), shooting for 2s at f22 on ISO3200. If you fancy doing some of your own. So as much as they can be, they're directly comparable to one another. If one looks brighter than another, that's because it was. The two reflective jackets are at a distance of 15m and 30m, respectively, from the light. The reflective strips down the centre are at 2.8m intervals.

Is that it, then?

No, of course not. You can look through out Buyer's Guide for more information on what kind of lights will suit your riding. A super-bright beam isn't much use if the light ends up in a hedge after the first pothole, or fizzles out when it starts raining. We'll be subjecting all the lights to the rigours of the road.cc testing process and when we're happy that we've thrashed them they'll each get a full review. We'll include the comparison tool in each review too. In the meantime, we thought you'd like to see how they fared.

A word about logs

The graph displaying the beam data uses a logarithmic scale to display the output of the lights. If you understand or care about such things, here's why:

Firstly, light beams follow an inverse square law regarding the strength of the light at increasing distance, because they're illuminating a two-dimensional plane. So at twice the distance, the light beam is spread over four times the area. Consequently, a light that is measured as twice as bright at its centre won't let you see twice as far. The logarithmic scale produces a more realistic comparison because of this.

Secondly, the variations in the amount of peripheral light, though much smaller than the variations in the centre, make a big difference to how much peripheral vision you get. The logarithmic scale amplifies these differences relative to the centre of the beam, so it's easier to see which unit is putting out more light at the sides.

A word about the non-circular beam patterns

Some of the lights on test don't have a uniform circular beam pattern, with more light along the centre of the beam. Because of this, the beam values on the long graph are a bit inflated because there's more light concentrated in the axis we're measuring, and less illuminating the tree canopy. It doesn't skew the data hugely though, and the beam graph in conjunction with the beam shot  and beam shape should give you the whole story.

The comparator is below. Have fun!

If you have a nice big screen you can click here for the widescreen version (1400x1000px)

This is great! A good addition would also be a picture of what the bike looks like with one of these on it from 100m and 30m, ie. how much visibility you get, especially from the cheaper lights.

Horses for courses, on dark country roads you need to see where you are going and be visible from as far as possible; whereas for urban commuting often you dont need a little sun mounted on your bars, too-bright or badly aimed lights can be a bit of a menace to others.

sparrow_h's picture

posted by sparrow_h [35 posts] 18th October 2012 - 16:05

How come a light like Magicshine costing 80£ can crush most other lights costing as much as 200£? O.o

IS somebody ripping somebody off?

seabass89's picture

posted by seabass89 [216 posts] 18th October 2012 - 16:19

I have to applaud you Dave for a concise and easily understood comparison of lots of different lights. Applause

posted by Marauder [196 posts] 18th October 2012 - 16:31

An impressive test and presentation of the results (though I find the "beam shape" plots a little easy to misinterpret). Very good indeed.

May I (having checked the lights I've used and some equivalents to other lights I've used) raise one significant issue with it?

The fact that it's set in a narrow tunnel with pale walls distorts the results for scattergun-beamed lights, mainly in that it heavily favours them over those with a proper road beam. In a tunnel the light from the former is being bounced back into view when it would otherwise be going into the sky or drivers' eyes. So scatterguns not only look more impressive because they illuminate the walls and roof, but even the light they cast on the ground is being flattered by reflected light.

posted by Bez [189 posts] 18th October 2012 - 16:44

Where's the front light from Poundland costing just one pound?

Mixte Rider

posted by adriank999 [36 posts] 18th October 2012 - 16:34

top class report Smile I'll definitely use this next time I'm looking for lights. Well done.

posted by nuclear coffee [22 posts] 18th October 2012 - 16:57

Excellent test. Any information about the best rear lights?

posted by NeilG83 [133 posts] 18th October 2012 - 17:07

This is awesome. Possibly the easiest to understand light test ever.

Chiggety check yourself before you wreck yourself

posted by therealsmallboy [29 posts] 18th October 2012 - 17:11

NeilG83 wrote:
Excellent test. Any information about the best rear lights?

rear lights will be along presently...

Dave Atkinson's picture

posted by Dave Atkinson [6070 posts] 18th October 2012 - 17:12

Bez wrote:
The fact that it's set in a narrow tunnel with pale walls distorts the results for scattergun-beamed lights, mainly in that it heavily favours them over those with a proper road beam. In a tunnel the light from the former is being bounced back into view when it would otherwise be going into the sky or drivers' eyes. So scatterguns not only look more impressive because they illuminate the walls and roof, but even the light they cast on the ground is being flattered by reflected light.

it's a valid point. we chose a tunnel because the environment is easy to control. ideally we would have had a blacked-out room the size of a football pitch but we couldn't find one. maybe next year Smile

we did consider the reflected light issue. if you look at a strong road beam light (say the supernova airstream), there's plenty of light on the walls and the floor, which is a similar colour to the walls. but there's no light at all on the ceiling. if the reflecting of the light was a big issue you'd expect to see some light reflected on the ceiling; you don't. That's not to say there isn't some light pollution from reflection - there is - but i don't think it heavily favours the round-beamed lights.

Dave Atkinson's picture

posted by Dave Atkinson [6070 posts] 18th October 2012 - 17:24

Great piece of work!

posted by alronald [29 posts] 18th October 2012 - 17:49

Have you got the Lezyne Power drive xl and the Super drive xl mixed up?
Surely the Super drive should be brighter than the Power drive.

posted by roxycoxy [2 posts] 18th October 2012 - 17:54

Great work chaps.

posted by sorebones [38 posts] 18th October 2012 - 18:02

Congratulations on this, I can see a lot of effort when into it and probably the best light test I've ever seen on the web.

posted by jackh [82 posts] 18th October 2012 - 18:21

great test! well done road.cc

posted by Karbon Kev [470 posts] 18th October 2012 - 18:53

I just got a £30 ebay light, claims 1800 Lumens (approx 18w), it might not be quite that bright but it's more than enough to cycle 20mph through a dark unlit park.

It withstood a 45min downpour in which I got soaked even with waterproof jacket.

'CREE XML XM-L T6 1800 LM LED' It comes with a recharger, the claimed battery length is 3hours on full. The flashing mode is strobe only, which you'd have to be a dangerous pest to use (doh). Takes several hours to charge.

Why pay £100 - £200 when you can get a good light for £30.

The ebay no' is 140744146377 and it's a UK seller.

Come on road.cc review this one, it's a bargain.

posted by kie7077 [75 posts] 18th October 2012 - 19:15

Did you turn the Knog Blinder on? Devil Devil

Gkam84's picture

posted by Gkam84 [6446 posts] 18th October 2012 - 19:49

I've just ordered one of the Chinese "Cree 1800 lumen" lamps from eBay. Several club-mates have them and are raving about them.

posted by stealth [107 posts] 18th October 2012 - 19:54

shit the bed!

hope you patent this test. amazing!

@kie7077

the cree for most parts is not eu tested and is slightly dubious build quality versus some, i also wouldnt charge it out of my sight either, just in case..

i run the cree along with a Exposure joystick. I take the joystick waiting for the inevitable failure of the cree, i have to say this fear is fading fast though Smile the cree has not missed a beat and some chaps i ride with are on their 3rd season with them.

i took a punt and thought for £18 (got mine from china direct) if it only makes one winter i will be happy

in short there is no way its pumping out 12/1800 lumen but its plenty bright and i am getting 3 hours out of mine on full beam.

sites like this kind of cant review these things, abit like fake pinarellos etc.
they know they work im sure but the site will be funded by advert revenue and im sure legit and tested manufacturers would not support people advertising.

in short though a cree works fine, is nice and bright but always in the back of my mind is the sealing and build quality, so my trusty Exposure will always join it Smile

russ

posted by russyparkin [443 posts] 18th October 2012 - 19:59

I have Cree's, best lights I've had in many years, but they are VERY strong, thats my only worry with them, blinding other road users.

Gkam84's picture

posted by Gkam84 [6446 posts] 18th October 2012 - 20:11

Another year, another test missing the Philips SafeRide.

posted by Dr_Lex [64 posts] 18th October 2012 - 20:42

A pedant writes: it's worth pointing out that "Cree" in itself isn't a brand of light - they just make the actual LED devices and sell a wide range either as bare chips to solder to a board or as little PCB modules. Once you've picked your LED, you've got all the physical construction issues to deal with as well as cooling the chip and making a nice efficient constant-current power supply to drive the thing (if you hook it up directly to a battery it will try very hard to turn into a gas).

I got a couple of unbranded cree lights off eBay a while back - one was DOA (at the chip level), the other worked OK but the drive circuitry wasn't very good - got hot on a fresh battery and dimmed as it discharged. Caveat emptor and all that.

posted by steff [81 posts] 18th October 2012 - 21:21

kie7077 wrote:
I just got a £30 ebay light, claims 1800 Lumens (approx 18w), it might not be quite that bright but it's more than enough to cycle 20mph through a dark unlit park.

It withstood a 45min downpour in which I got soaked even with waterproof jacket.

'CREE XML XM-L T6 1800 LM LED' It comes with a recharger, the claimed battery length is 3hours on full. The flashing mode is strobe only, which you'd have to be a dangerous pest to use (doh). Takes several hours to charge.

Why pay £100 - £200 when you can get a good light for £30.

The ebay no' is 140744146377 and it's a UK seller.

Come on road.cc review this one, it's a bargain.

Looks interesting.. what's the build quality like?

posted by ALIHISGREAT [104 posts] 18th October 2012 - 21:23

Fantastic test. Well done. I liked the old version, but this is miles better. Despite the flaws about bouncing light beams and all.

Ticktock

Michael5's picture

posted by Michael5 [118 posts] 18th October 2012 - 21:52

Dr_Lex wrote:
Another year, another test missing the Philips SafeRide.

we did try, we can only test what we're sent

Dave Atkinson's picture

posted by Dave Atkinson [6070 posts] 18th October 2012 - 21:52

This is great, one of the best and most comprehensive tests I've ever seen on the internet full stop.

Must have got a bit freaky being in that tunnel in the dark though!

posted by thelimopit [30 posts] 18th October 2012 - 22:57

Nice test, but I'm not sure about the tunnel for the beam shots - I'd rather see what they look like on the road.

Shame you couldn't get your hands on a SafeRide. There's a real shortage of lights with proper beam patterns suitable for use on the road.

posted by pdw [8 posts] 18th October 2012 - 23:32

Has the camera's white balance been set manually or left on automatic?

Keen to know if the variation in colour is entirely due to the different lights or not.

byke.com.au's picture

posted by byke.com.au [11 posts] 19th October 2012 - 0:56

roxycoxy wrote:
Have you got the Lezyne Power drive xl and the Super drive xl mixed up?
Surely the Super drive should be brighter than the Power drive.

+1

Be interesting to know whether there's been an error at Road.cc, the difference between the Super XL & Power XL is just an artificial distinction of Lezyne's marketing department, or whether it's just a bit of a lottery from unit to unit.

byke.com.au's picture

posted by byke.com.au [11 posts] 19th October 2012 - 1:27

what's the build quality like?

Seems very solid, attaches to the bike nicely, the battery pack attaches to the bike with Velcro easily and water didn't bother the battery to light connection.

Only been using it a couple of weeks though.

posted by kie7077 [75 posts] 19th October 2012 - 1:27

Great comparative test - sets a new standard - please add the full exposure range though

Sudor

posted by Sudor [114 posts] 19th October 2012 - 6:18

Dave Atkinson wrote:
Dr_Lex wrote:
Another year, another test missing the Philips SafeRide.

we did try, we can only test what we're sent

Dave,
Thanks. That also explains why other "furren" but popular lights like Ay-Up are absent.
Nice coding to get the slick horizontal comparison!

posted by Dr_Lex [64 posts] 19th October 2012 - 8:14

adriank999 wrote:
Where's the front light from Poundland costing just one pound?

It's called the Electron micro 5 and it retails at a certain bike shop chain starting with E, for £17.99 Devil

FATBEGGARONABIKE's picture

posted by FATBEGGARONABIKE [350 posts] 19th October 2012 - 9:05

Dr_Lex wrote:

Nice coding to get the slick horizontal comparison!

nice paying of $8 to get someone else's code, more like

Smile

Dave Atkinson's picture

posted by Dave Atkinson [6070 posts] 19th October 2012 - 10:50

byke.com.au wrote:
Be interesting to know whether there's been an error at Road.cc, the difference between the Super XL & Power XL is just an artificial distinction of Lezyne's marketing department, or whether it's just a bit of a lottery from unit to unit.

we think we might just have a faulty one, lezyne are sending us another for comparison.

it's possible that we had it on the wrong setting but the beam shot and the beam graph are both lower than the power drive, and they were done separately, it's unlikely that we got it wrong both times on that one light.

certainly the super drive is *meant* to be brighter so we'll see what gives when we get another sample

Dave Atkinson's picture

posted by Dave Atkinson [6070 posts] 19th October 2012 - 10:54

I've just recently bought the Magicshine. It's an awesome light but I was worried that it would blind oncoming motorists so I've added a bit of reflective plastic as a cowling to limit the beam a bit. This makes me much more comfortable using it as the last thing i want is for drivers to not see me because I've blinded them

posted by paulrattew [48 posts] 19th October 2012 - 11:11

Extremely thorough. Brilliant, even.

www.vulpine.cc
@aslongasicycle
@vulpinecc

aslongasicycle's picture

posted by aslongasicycle [133 posts] 19th October 2012 - 11:49

Funny thing Paul, if the driver can't see they are meant to slow down.

posted by euanlindsay [47 posts] 19th October 2012 - 11:56

paulrattew wrote:
I've just recently bought the Magicshine. It's an awesome light but I was worried that it would blind oncoming motorists so I've added a bit of reflective plastic as a cowling to limit the beam a bit. This makes me much more comfortable using it as the last thing i want is for drivers to not see me because I've blinded them

that's what i ended up doing with mine last year too.

Dave Atkinson's picture

posted by Dave Atkinson [6070 posts] 19th October 2012 - 12:14

Thanks for this. Really a very helpful test!

posted by MrSkeen89 [4 posts] 19th October 2012 - 12:54

I've got a couple of the Ebay/DealExtreme Magicshine clones - one with a smooth mirror and one with light orange-peel effect mirror. I have one of them on the bar, one on a head mount (when off road only).

They are completely and totally amazing. Amazing enough that in the forest last night - under trees in the pitch dark - I was still bombing along at over 20mph in places although it was a bit muddy and I was taking it easy.

The smooth mirror is a bit better on road, it 'throws' better, but off-road the orange peel one is brilliant as it gives a smoother, wider field. £30 or so each and if one breaks I'll buy another - I can't imagine why anyone buys these £200-plus ones!

Scott Sportster '08 | Cannondale CAAD8 '12

Gizmo_'s picture

posted by Gizmo_ [161 posts] 19th October 2012 - 13:25

Well done Road.CC it's a great test and should be rolled out every year or a permanent web feature. As a reward all Road.CC staff may have Christmas day off.

posted by Roberj4 [86 posts] 19th October 2012 - 14:37

euanlindsay wrote:
Funny thing Paul, if the driver can't see they are meant to slow down.

And forcing oncoming traffic to slow down by shining a blinding light in their eyes is acceptable how? Thinking

Rob Simmonds's picture

posted by Rob Simmonds [211 posts] 19th October 2012 - 20:19

Quote:
Another year, another test missing the Philips SafeRide.

we did try, we can only test what we're sent

Yes shame to miss this as it is meant to be one of the few lights to be designed for the road more like a car or motorcycle light

BUT

great article and presentation! very useful.

posted by rootes [36 posts] 19th October 2012 - 20:30

kie7077 wrote:
I just got a £30 ebay light, claims 1800 Lumens (approx 18w), it might not be quite that bright but it's more than enough to cycle 20mph through a dark unlit park.

It withstood a 45min downpour in which I got soaked even with waterproof jacket.

'CREE XML XM-L T6 1800 LM LED' It comes with a recharger, the claimed battery length is 3hours on full. The flashing mode is strobe only, which you'd have to be a dangerous pest to use (doh). Takes several hours to charge.

Why pay £100 - £200 when you can get a good light for £30.

The ebay no' is 140744146377 and it's a UK seller.

Come on road.cc review this one, it's a bargain.


I am a Sustrans Ranger and a few of us have this light . It is easily as good if not better than those 2 shown. Cool

posted by brandobiker [11 posts] 19th October 2012 - 23:26

This is fantastic! Many thanks for the extremely hard work that must have gone into developing this. This must be the world's only bible for bike light choice.

Thoughts for further tests:
1) Would be awesome if possible to add some lights from previous years to act as a useful benchmark for those of us buying new lights (appreciate that this will depend largely on what you have lying around at any point in time, but that may be better than nothing)

2) Agree about the photo of the light from in front of the bike so you can see how much you will blind/be invisible to oncoming traffic

Amazing stuff. Hope this lives and grows for many years!

posted by Tjuice [44 posts] 20th October 2012 - 0:05

rootes wrote:
Quote:
Another year, another test missing the Philips SafeRide.

we did try, we can only test what we're sent

Yes shame to miss this as it is meant to be one of the few lights to be designed for the road more like a car or motorcycle light

BUT

great article and presentation! very useful.


We did test the Trelock 950 last year, which is very similar in concept. Awesome light. Cool

Chuffy's picture

posted by Chuffy [183 posts] 20th October 2012 - 4:29

Agreed!
Although the bracket on the dyno version is a piece of s**t, the light itself is excellent, good switch, nice wide beam, good for seeing both verges on dark country lanes, and enough throw for normal speeds.
As a back-up I use one of the silly bright chinese "Cree" torches which has a narrow beam but enough throw for full speed descents. Makes a brilliant combination and for less money total than, say, a Strada.

posted by PpPete [6 posts] 20th October 2012 - 12:01

Dave Atkinson wrote:
we think we might just have a faulty one, lezyne are sending us another for comparison.

Excellent. I've got the Super Drive (ordered it two days before the XL's were announced - arggggh!) and I'm very happy with it. Possibly not quite as bright as my 3yo Magic Shine, but much more practical, so I actually use it.

Quote:
it's possible that we had it on the wrong setting but the beam shot and the beam graph are both lower than the power drive, and they were done separately, it's unlikely that we got it wrong both times on that one light.

Seems unlikely then - at least on my version the brightest setting is the first setting in the cycle.

Of course now every road.cc-reading Lezyne owner is going to be worrying that they got a dud too - me included!

byke.com.au's picture

posted by byke.com.au [11 posts] 20th October 2012 - 23:13

Where's the latest version of the Hope Vision One? As far as I'm aware this is still a very popular light choice, and has been in at least one previous roadcc test. Really disappointed that I can't compare the Lezyne models with the updated Hope Vision One. Sad

posted by wodge [3 posts] 23rd October 2012 - 15:47

OK, you guys did a nice job with the photos and the side by side stuff, but you completely missed the boat in your comment "Some cheaper lights use candlepower, candela or lux, which are measurements of the brightest part of the beam at a set distance." You correctly state that light falls off per the square of the distance (Inverse Square Law), but what you missed is that the candela value is the number that is plugged into the ISL to determine how much light is on a surface at a given distance.

Lumens are not an accurate way to compare projected light. It's like this: I have a gallon of water, how deep is it? You can't say unless you know how big your bucket is. If these were LEDs that were to be used in table lamps (spreading light in all directions with no optics), lumen count is enough to compare them side-by-side.

What very few LED bike light manufacturers do is publish candela or candlepower values, which can be used to calculate footcandles (lumens/sq ft) or lux (per square meter) at a given distance. These numbers are really the only value that should be used, and we need to demand that manufacturers publish them. Instead, unfortunately, you discounted them in your introduction.

Think of candela or candlepower like water pressure from your garden hose. If you can set the spray to wide fan or narrow stream, the flow rate has not changed but the distribution has. A spot and a flood may have the same lumen package but will distribute their light very differently.

Unfortunately, by discounting this value, your article supports the manufacturers that publish only initial (not actual) lumens, and does not increase pressure on them to publish photometric data that they have.

posted by Alpenglow [1 posts] 11th November 2012 - 15:38

wodge wrote:
Where's the latest version of the Hope Vision One? As far as I'm aware this is still a very popular light choice, and has been in at least one previous roadcc test. Really disappointed that I can't compare the Lezyne models with the updated Hope Vision One. Sad

+1 on the lack of hope lights. I thought Exposure might have been included too. Fantastic test all the same. Any idea when the rear light test will be with us? I'm poised to buy some better rear end illumination!

posted by partsandlabour [28 posts] 14th November 2012 - 13:34

Calendar