Why is Real-World Visual Object Recognition Hard?
View/ Open
Published Version
https://doi.org/10.1371/journal.pcbi.0040027Metadata
Show full item recordCitation
Pinto, Nicolas, David D. Cox, and James J. DiCarlo. 2008. Why is Real-World Visual Object Recognition Hard? PLoS Computational Biology 4(1): e27.Abstract
Progress in understanding the brain mechanisms underlying vision requires the construction of computational models that not only emulate the brain's anatomy and physiology, but ultimately match its performance on visual tasks. In recent years, “natural” images have become popular in the study of vision and have been used to show apparently impressive progress in building such models. Here, we challenge the use of uncontrolled “natural” images in guiding that progress. In particular, we show that a simple V1-like model—a neuroscientist's “null” model, which should perform poorly at real-world visual object recognition tasks—outperforms state-of-the-art object recognition systems (biologically inspired and otherwise) on a standard, ostensibly natural image recognition test. As a counterpoint, we designed a “simpler” recognition test to better span the real-world variation in object pose, position, and scale, and we show that this test correctly exposes the inadequacy of the V1-like model. Taken together, these results demonstrate that tests based on uncontrolled natural images can be seriously misleading, potentially guiding progress in the wrong direction. Instead, we reexamine what it means for images to be natural and argue for a renewed focus on the core problem of object recognition—real-world image variation.Other Sources
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC2211529/pdf/Terms of Use
This article is made available under the terms and conditions applicable to Other Posted Material, as set forth at http://nrs.harvard.edu/urn-3:HUL.InstRepos:dash.current.terms-of-use#LAACitable link to this page
http://nrs.harvard.edu/urn-3:HUL.InstRepos:11213329
Collections
- FAS Scholarly Articles [18276]
Contact administrator regarding this item (to report mistakes or request changes)