(Updated January 2013 with added and amended tables)
Tests performed by SP Technical Research Institute of Sweden for the consumer organisation Swedish Consumers’ Association and published in their consumer guide Råd & Rön. The lamps are tested in hanging position, uncovered. 3 lamps of each model are tested for light output, and 5 of each for durability. On-off periods are 2 hours 45 minutes on, 15 minutes off, 2:45 on, 0:15 off etc.
For easy overview in English, I’ve transferred the most relevant data to my own tables. Black numbers are from the actual tests. Brown are my own, added for comparison and summary. The incandescent columns to the left shows the official recommended incandescent equivalent, and the single yellow column shows the difference in lumen (which is a measure of light quantity) between initial measured lumen of each energy saver from its incandescent equivalent to the left.
This 2009 test I’ve included mainly because it is one of the few that tested lamps up to 8 000 hours.
• Lamp life: Quite a few burned out long before stated life. Of the Osram ‘Miniball’ 11W (marked 6 000 h), all had gone out by half that time! And of a less known brand, North Light (marked 10 000 h), 40 % had gone out by 6 000 hours. Bulb models were least durable while spiral models gave most light and lasted longest. One Osram spiral model (marked 6 000 h) lasted more than 8 000 hours.
• Startup: Very slow, especially in cold weather, except the GE ‘Extra Mini’ 20W. The test article quotes the test supervisor:
“Those who want a bright outdoor lamp that turns on quickly may have to use a halogen lamp instead”, suggests Ronny Karlsson. “But then you need to remember that they use more electricity than CFLs.”
The 2010 test included three dimmable, but dimming behaviour was not tested.
• Light output: The ‘spiral’ models generally did best when it comes to light quantity (lumen) per watt.
(Probably because the thinner twirled tube creates more light surface in a smaller space than a stick. As long as you don’t put it in a recessed can where it will more easily overheat than a ‘stick’ tube. I also speculate that this thinner twirled bulb is more vulnerable to breakage and toxic mercury spill, but I have no proof of this as it has not been tested either.)
• Light loss: A mean of 11, 10 and 18 %, respectively, for each of the three groups after 3 000 h.
• Lamp life: After only 3 000 hours (!) 20% and 100%, respectively, of Osram ‘Miniball’ models (marked 6 000 h) had gone out, and 20% of Philips ‘Tornado’ dimmable spiral (marked 8 000 h). The remaining weren’t tested for longer than that so we’ll never know if any of the longer life lamps lasted anywhere near their stated life, or how much light they had lost by then.
• Startup: Very slow, especially at colder temperatures.
The ‘stick’ group
• Light output: In this group, only two of the ’60W equivalent’ retrofit CFLs even try to exceed 600 lumen! Only one 100W and one 150W bulb actually gives more light than its equivalent incandescent, and only in the beginning. For 9 of these 14 lamps, the difference was over 100 lumen, in one as much as 237 lumen!
• Light loss: After 5 000 hours a mean of 28% for this type of CFL. But as some are advertised as burning for 15 000 h, light output will continue to weaken with age so that on the off chance that they really last that long in real life conditions, the light will be fairly useless towards the end of its life. (And most already give less light from the start compared with their recommended incandescent equivalents.)
The IKEA 11W lamp was by far the cheapest (around €1) but did not perform any worse than the ones that cost 6-8 times more. How that is possible, I guess only their Chinese supplier knows…
The ‘spiral’ group
• Light output: Spiral CFLs gave the most light in this test, several actually ended up on plus compared with their incandescent equivalents (initially anyway).
• Light loss: After 5 000 hours a mean of 14% .
• Lamp life: Although these lamps were marked from 8 000 to 15 000 h, some had already gone out by 5 000 hours!
The ‘bulb’ group (incl. candle and globe bulbs)
As expected, this group did not do so well. Sticking a CFL in a frosted outer bulb a) probably offers a little better protection against UV-radiation and accidental breakage and b) makes the light less harsh on the eyes, but also c) filters out some of the light and d) makes the tube or spiral inside more vulnerable to overheating as CFLs are very sensitive to temperature.
• Light output: This group gave up to 254 lumen less light than their incandescent equivalents! One of the poorest performers was the 11W Philips dimmable bulb, which was also by far the most expensive. (Note: even incandescent lamps have slightly lower output in low wattage ball and candle models, which is reflected in the comparison table.)
At least Megaman and Philips no longer try to pretend that all their 7 and 11 watt CFLs give as much light as a 40 or 60 watt incandescent. When I checked their online catalogues, they have actually started marking some as 35 and 50 watt equivalents, respectively – but again, only initially, of course. Getting a little bit closer to truth in advertising, but as there are no standard incandescent bulbs of those wattages, the consumer still gets less light than they originally had, unless they as a choose a higher wattage replacements than standard recommendations.
• Light loss: After 5 000 hours a mean of 29%!
• Lamp life: Again, although marked from 6 000 hours to 15 000 hours, 9 of these 24 models had already started losing lamps at 5 000 hours.
• Light output: Lower performance at cold temperatures.
• Startup: Some improvement in some lamps but most CFLs tested still struggled with light-up time, especially at colder temperatures.
• Light colour: 2513 – 2870 Kelvin, which sounds acceptable enough. As of a couple of years ago, leading brands finally got their phosphor mix right so that the light now looks fairly incandescent (which was not the case earlier, and is still not true of every lamp on the market).
• Colour rendition: Stated and measured colour rendering index (CRI) still only 81-83 for standard CFLs.
Råd & Rön test winner of all CFL lamps 2011 was surprisingly Swedish supermarket chain Coop’s ’Änglamark’ spiral 12W.
CFLs 2012 Spring
• Light output: Average lumen/W similar to earlier years, but with big variations between models. Again the spiral group gave most light on average. Markedly lower output at -10 C, except 4 models.
• Light loss: A mean of 15, 14 and 23 %, respectively, for each of the three groups after 5 000 hours.
• Lamp life: Again, despite being marked between 6 000 and 15 000 hours, 8 of the 22 models tested had lost lamps by 5 000 hours!
• Startup: Some improvement from earlier years but still not instant. The Sylvania ‘Mini-Lynx Compact Fast Start’ spiral was not among the fastest despite its name (71% after 30 seconds). IKEA’s spiral lamp had the quickest startup (90% light after 10 seconds). Bulb models were still markedly slower than stick and spiral models.
• Light colour: Varying between incandescent-like and a bit colder.
• Colour rendition: CRI 80-83, about the same as before., so the light quality has not improved over the last 25 years, despite the light itself appearing more incandescent in colour in the best lamps = still only ‘brass’ compared to ‘gold’.
CFLs 2012 Autumn
All Råd & Rön CFL Tests & Articles
2012 - Råd & Rön (Sweden): Lågenergilampor (available only at a fee)
2009 Autumn (update incl. 8 000 h) - Råd & Rön (Sweden): Lågenergilampan lyser svagt i kylan
CFL ‘stick’ models 2009c test result chart
CFL ‘spiral’ models 2009c test result chart
CFL ‘bulb’ models 2009c test result chart
More CFL Tests
2012 – Test Aankoop (Netherlands): Spaarlampen (in het testlab en in het containerpark): niet altijd besparend en milieuvriendelijk (described in English here: CFL Fail Again)
2009 – Konsumo (Germany): Energiesparlampen-Test: Zweifel beseitigt
2009 – video (Germany) - Energisparlampen im Dauertest
2009/2010 - Öko-Test (Germany): Energiesparlampen
2009 - Öko-Test (Germany): Energiesparlampen, Haltbarkeit
2008 – Öko-Test (Germany): Energiesparlampen
2008 – DN Din Ekonomi (Sweden): Lågenergilampan – en ljusskygg investering
2008? – Din Side (Norway): Ingen holder mål (“Not up to standard”)
2007 – S.A.F.E. (Switzerland): 14 Sparlampen im Test