Why can a lens get weak lab reviews but still have many happy owners?
Asked 1/18/2012
2 views
2 answers
0
I’m trying to understand how to interpret lens reviews when lab testing and user feedback seem to disagree. For example, a superzoom lens may be criticized in a technical review for strong distortion or softness at certain focal lengths, yet still receive many positive owner reviews.
Assuming the reviewer is competent and the tested copy is representative, how should a beginner reconcile these two perspectives? Are lab reviews holding the lens to standards that don’t matter to most photographers, or are owner reviews often influenced by expectations, convenience, or bias?
Originally by Photography Stack Exchange contributor. Source · Licensed CC BY-SA 4.0
Photography Stack Exchange contributor
14y ago
2 Answers
14
The reviewer may have used a sample of one. Lenses will vary.
The reviewer is measuring scientifically in the lab, pixel peeping using test charts and compiling MTF curves. Owners of the lens are taking vacations shots and pictures of the family dog.
the reveiwer has experience with a number of other lenses, including pro lenses. Owners of the 18-200mm? It may be the only lens they own.
the reviewer is measuring 1% distortion that most users will not see in real life images. Most wouldn't know what pincushion distortion is, or notice it unless you pointed it out. I have the lens and distortion is only noticeable to me in shots of brick walls or skyscrapers, and photoshop corrects it anyway!
the reviewer is using test charts meant to expose any weaknesses in the lens. An owner of the lens is just taking pictures in real life situations and probably can't tell which images were taken with the 18-200mm and which were with the 50mm prime. I can't, not in terms of sharpness or distortion.
the reviewer is judging the quality of the lens vs cost to arrive at a overall value relative to other lenses. He will no doubt think it's pricey and may judge that you could obtain a better value (either sharper or less expensive). But an owner of the lens has already paid (or overpaid) and paid the credit card bill and they're not concerned about how it compares on a test chart against another lens. They're taking pictures, and able to zoom to 200mm or out to 18mm and catch shots they wouldn't get if they had to switch lenses, or left the other lenses at home.
I would also wager than 90% of amateur photographers don't know about or care about vignetting or chromatic aberration either. Even the trendy bokeh is probably not in most people's vocabulary :)
I bought the lens expecting it to be reasonably sharp, but mainly versatile and convenient, for a walk about lens. It's amazing that a super zooms exist IMO, much less that they are reasonably sharp. If I had experience using professional lenses, I might feel this lens was a bit soft or slow. But hey, it's basically a kit lens. Most of the people buying these are not pros and not interested in test charts.
What he says about distortion is probably true of all samples. Not sure about the softness at 135mm, I've not noticed it, and other reviewers like Thom Hogan didn't mention it. To be honest, I use the lens mainly between 18-50mm, and occasionally zoom out to 200mm to get some detail. I would rarely use 135mm.
I have done basic testing of my 18-200 at 50mm f/8 and compared to my prime 50mm at f/8. I didn't use a proper test pattern, but some newspaper. To my eye they were almost the same. The prime had a bit more contrast, and slightly sharper. If it had been a normal picture of a landscape I don't know if I could tell them apart to be honest.
As much as I love the my 85mm prime and a few others, if I could only own one lens I guess I'd stick with the 18-200mm for versatility. For that versatility it's worth the price IMO. So I'd give it a good review, but if I worked for dpreview and had all the gear to measure it against a database of other lenses, I might be more lukewarm in my assessment.
Originally by user4191. Source · Licensed CC BY-SA 4.0
user4191
14y ago
0
Generated from our catalog & community — verify before relying on it.
Both can be true.
Technical reviews usually measure a lens under controlled conditions designed to reveal weaknesses: test charts, low ISO, close inspection, and comparison against many other lenses. That makes distortion, edge softness, or weak performance at one focal length easy to see.
Owner reviews are usually based on real-world use: travel, family, casual shooting, web-sized sharing, and convenience. In that context, a lens can still be very satisfying even if it has measurable flaws. Many users may never notice mild distortion except in subjects like buildings, and some issues can be corrected in software.
Other factors also explain the gap:
- sample variation: a review may reflect one copy
- different standards: reviewers often compare against better or more specialized lenses
- different output: flaws visible at 100% may disappear in normal prints or on screens
- subjective bias: some user reviews are influenced by expectations or purchase justification
So the best approach is to treat lab reviews as showing a lens’s limits, and user reviews as showing whether those limits matter in everyday use. Neither is wrong—they answer different questions.
Recommended products
UniqueBot
AI14y ago
Your Answer
Related Questions
Who owns copyright in old company scrapbook photos if the photographer is unknown?
How should I photograph old, dimly lit shop interiors without disrupting business?
Do camera lenses have a fixed lifespan?
Can deconvolution improve the sharpness of a mirror lens image?
Why is the Canon SX510 HS so inexpensive despite its 30x zoom and features?