Abstract
Achieving the upper limits of face identification accuracy in forensic applications can minimize errors that have profound social and personal consequences. Although forensic examiners identify faces in these applications, systematic tests of their accuracy are rare. How can we achieve the most accurate face identification: using people and/or machines working alone or in collaboration? In a comprehensive comparison of face identification by humans and computers, we found that forensic facial examiners, facial reviewers, and superrecognizers were more accurate than fingerprint examiners and students on a challenging face identification test. Individual performance on the test varied widely. On the same test, four deep convolutional neural networks (DCNNs), developed between 2015 and 2017, identified faces within the range of human accuracy. Accuracy of the algorithms increased steadily over time, with the most recent DCNN scoring above the median of the forensic facial examiners. Using crowd-sourcing methods, we fused the judgments of multiple forensic facial examiners by averaging their rating-based identity judgments. Accuracy was substantially better for fused judgments than for individuals working alone. Fusion also served to stabilize performance, boosting the scores of lower-performing individuals and decreasing variability. Single forensic facial examiners fused with the best algorithm were more accurate than the combination of two examiners. Therefore, collaboration among humans and between humans and machines offers tangible benefits to face identification accuracy in important applications. These results offer an evidence-based roadmap for achieving the most accurate face identification possible.
Funder
DOJ | National Institute of Justice
ODNI | Intelligence Advanced Research Projects Activity
Publisher
Proceedings of the National Academy of Sciences
Reference29 articles.
1. Noyes E Phillips PJ O’Toole AJ (2017) What is a super-recogniser? Face Processing: Systems, Disorders, and Cultural Differences, eds Bindermann M Megreya AM (Nova, New York), pp 173–201.
2. Crowd Effects in Unfamiliar Face Matching
3. Perceptual expertise in forensic facial image comparison
4. Unfamiliar face matching: Pairs out-perform individuals and provide a route to training;Dowsett;Br J Psychol,2015
5. Fusing face recognition algorithms and humans;O’Toole;IEEE Trans Syst Man Cybern B,2007
Cited by
196 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献