Psychophysical Evaluation of Deep Re-Identification Models
Author
Nicholson, Hamish
Metadata
Show full item recordCitation
Nicholson, Hamish. 2020. Psychophysical Evaluation of Deep Re-Identification Models. Bachelor's thesis, Harvard College.Abstract
Pedestrian re-identification (ReID) is the task of continuously recognising the same individual across time and camera views. Researchers of pedestrian ReID and their GPUs spend enormous energy producing novel algorithms, challenging datasets, and readily accessible tools to successfully improve results on standard metrics. Yet practitioners in biometrics, surveillance, and autonomous driving have not realized benefits that reflect these metrics. Different detections, slight occlusions, changes in perspective, and other banal perturbations render the best neural networks virtually useless. This work makes two contributions. First, we introduce the ReID community to a budding area of computer vision research in model evaluation. By adapting established principles of psychophysical evaluation from psychology, we can quantify the performance degradation and begin research that will improve the utility of pedestrian ReID models; not just their performance on test sets. Second, we introduce NuscenesReID, a challenging new ReID dataset designed to reflect the real world autonomous vehicle conditions in which ReID algorithms are used. We show that, despite performing well on existing ReID datasets, most models are not robust to synthetic augmentations or to the more realistic NuscenesReID data.Terms of Use
This article is made available under the terms and conditions applicable to Other Posted Material, as set forth at http://nrs.harvard.edu/urn-3:HUL.InstRepos:dash.current.terms-of-use#LAACitable link to this page
https://nrs.harvard.edu/URN-3:HUL.INSTREPOS:37364671
Collections
- FAS Theses and Dissertations [5435]
Contact administrator regarding this item (to report mistakes or request changes)