June 4, 2018 By David Bisson 2 min read

Face identification is most accurate when human analysts and machines work together, a recent multidisciplinary study uncovered.

According to a report published in the Proceedings of the National Academy of Sciences, three scientists at the National Institute of Standards and Technology (NIST) found that facial identification performance is optimal when humans and machines collaborate.

Specifically, the researchers observed the best results after pairing a single professional facial examiner with a top-performing algorithm. This analytical setup was more accurate than arrangements involving multiple examiners or algorithms.

Face Identification Most Effective When Humans and Machines Collaborate

For the study, NIST analyzed the face identification performance of 184 participants, 87 of which were professional face examiners who analyze faces for legal purposes. There were also 13 “super recognizers” who are naturally gifted at comparing faces.

The control group of 84 participants involved 53 fingerprint examiners and 31 undergraduate students, none of whom had received training in facial examinations.

NIST asked each participant to compare 20 face image pairs that were deemed extremely challenging based on their characteristics. The scientists then conducted the same analyses using four machine learning facial recognition technology algorithms developed between 2015 and 2017.

Professional face examiners were more accurate than individuals in the untrained group. The NIST researchers asserted that these results should help scientifically substantiate experts’ testimony in court.

The algorithms also performed well, but their accuracy was even better when combined with the insights of an expert examiner. This human-machine collaboration even beat out groups of professional face examiners.

Results Reveal a Need for Further Research

“This is the first study to measure face identification accuracy for professional forensic facial examiners, working under circumstances that apply in real-world casework,” said NIST electronic engineer P. Jonathon Phillips. “Our deeper goal was to find better ways to increase the accuracy of forensic facial comparisons.”

The NIST researchers noted that current real-world forensic frameworks don’t encourage the combination of human examiners and artificial intelligence (AI). They asserted that the study’s findings can serve as a road map for improving face identification in the future and raised questions about what distinguishes human approaches from AI-based methods.

More from

How prepared are you for your first Gen AI disruption?

5 min read - Generative artificial intelligence (Gen AI) and its use by businesses to enhance operations and profits are the focus of innovation in virtually every sector and industry. Gartner predicts that global spending on AI software will surge from $124 billion in 2022 to $297 billion by 2027. Businesses are upskilling their teams and hiring costly experts to implement new use cases, new ways to leverage data and new ways to use open-source tooling and resources. What they have failed to look…

Cybersecurity crisis communication: What to do

4 min read - Cybersecurity experts tell organizations that the question is not if they will become the target of a cyberattack but when. Often, the focus of response preparedness is on the technical aspects — how to stop the breach from continuing, recovering data and getting the business back online. While these tasks are critical, many organizations overlook a key part of response preparedness: crisis communication.Because a brand’s reputation often takes a significant hit, a cyberattack can significantly affect the company’s future success…

Brands are changing cybersecurity strategies due to AI threats

3 min read -  Over the past 18 months, AI has changed how we do many things in our work and professional lives — from helping us write emails to affecting how we approach cybersecurity. A recent Voice of SecOps 2024 study found that AI was a huge reason for many shifts in cybersecurity over the past 12 months. Interestingly, AI was both the cause of new issues as well as quickly becoming a common solution for those very same challenges.The study was conducted…

Topic updates

Get email updates and stay ahead of the latest threats to the security landscape, thought leadership and research.
Subscribe today