Current status of forensic lie detection with the comparison question technique: An update of the 2003 National Academy of Sciences report on polygraph testing

This systematic review examined polygraph research published since the 2003 National Academy of Sciences report to assess whether scientific support for the Comparison Question Technique had improved. The authors found that research quality remained poor and the NAS report's critical conclusions about CQT validity still stand.

The authors conducted a systematic critical review of polygraph literature published since 2003, evaluating field studies, laboratory experiments, and meta-analyses while examining how the NAS report has been cited by polygraph advocates.

Iacono and Ben-Shakhar conducted a comprehensive review of polygraph research published since the landmark 2003 National Academy of Sciences report that criticized the Comparison Question Technique. Using systematic review methodology, they evaluated the quality of subsequent field studies, laboratory experiments, and meta-analyses to determine if the scientific foundation had improved. The review found that research quality remained unchanged, with the same methodological flaws and biases that plagued earlier studies. The authors concluded that polygraph advocates had systematically misrepresented the NAS findings and that the original report's critical assessment of CQT validity remains accurate. Despite 15 years of additional research, the fundamental problems identified by the NAS panel—including weak theoretical foundations and unknown error rates—were never adequately addressed.

The findings suggest that current polygraph practices in criminal investigations and security screening lack adequate scientific validation, challenging the continued widespread use of CQT-based examinations in forensic settings.

Background & Context

The 2003 National Academy of Sciences (NAS) report on polygraph testing represented a watershed moment in deception detection science, delivering a damning assessment of the Comparison Question Technique that dominates forensic practice. The report concluded that the scientific basis of the CQT was weak, the extant research was of low quality, the polygraph profession's claims for the high accuracy of the CQT were unfounded, and although the CQT has greater than chance accuracy, its error rate is unknown. This landmark evaluation challenged decades of polygraph industry assertions and cast doubt on the widespread use of these tests in criminal investigations and security screening.

Fifteen years after the NAS report, William Iacono and Gershon Ben-Shakhar—two of the field's most prominent critics—undertook a comprehensive re-examination of polygraph science to determine whether the landscape had improved. Polygraph proponents argued that current research indicated the CQT has 90% or better accuracy, that the National Research Council's 2003 analysis supports this accuracy claim, and that the CQT qualifies as legally admissible scientific evidence. The authors set out to evaluate these claims and assess whether the intervening years had produced the quality research necessary to validate or refute the NAS conclusions.

This review holds particular significance for both forensic practice and legal proceedings. Polygraph tests continue to be widely used in criminal investigations, security screenings, and sex offender management programs despite ongoing scientific controversy. The stakes are enormous: false positives can derail innocent lives, while false negatives may allow guilty parties to evade accountability.

Research Design & Methodology

Rather than conducting new empirical research, Iacono and Ben-Shakhar performed a systematic critical review of the polygraph literature published since the 2003 NAS report. The authors reviewed the scientific literature that appeared since the NAS publication, including a new method for estimating polygraph accuracy. Their methodology involved evaluating the quality of field studies, laboratory experiments, and meta-analyses, with particular attention to how the NAS report has been cited and interpreted by polygraph advocates.

A centerpiece of their analysis was examination of methodological problems that plague CQT validity research. The authors reintroduced the "Iacono Thought Experiment," which demonstrated how a polygraph test with chance-level accuracy could produce a confession-criterion field study with artificially high accuracy, promulgating the hypothesis that all polygraph confession criterion studies produce exaggeratedly high estimates of accuracy. This theoretical framework allowed them to expose fundamental biases in how field validity is estimated.

The review also scrutinized recent attempts to validate the CQT through novel methodologies, particularly Ginton's (2013) paired-examination technique that claimed to overcome traditional field study limitations. Iacono and Ben-Shakhar dedicated a significant portion of their article to scrutinizing Ginton's novel approach, examining whether it genuinely addressed the longstanding controversy regarding CQT validity.

Results & Key Findings

The central finding was unequivocal: research quality has not improved. The authors concluded that the quality of research has changed little in the years elapsing since the release of the NAS report, and that the report's landmark conclusions still stand. Despite 15 years of additional research, the fundamental problems identified by the NAS panel—weak theoretical foundations, poor study quality, and unknown error rates—remained unresolved.

The review revealed systematic misrepresentation of the NAS findings by polygraph advocates. Iacono and Ben-Shakhar showed that the NAS report has been misrepresented and misinterpreted by those who support use of the CQT in forensic settings. Industry claims of 90% or better accuracy were not supported by rigorous scientific evidence when studies were properly evaluated for methodological quality.

Key specific findings included:

• Field studies continue to suffer from sampling bias when confessions are used to establish ground truth, as this criterion is not independent of the polygraph test outcome
• Laboratory studies, while more methodologically sound, have limited generalizability to real-world forensic contexts with high-stakes consequences
• Novel validation methods like Ginton's paired-examination approach contain fatal flaws that invalidate their accuracy estimates
• The theoretical basis for why comparison questions should elicit differential responses in truthful versus deceptive examinees remains scientifically questionable

Discussion & Significance

The implications of this review are profound for the polygraph field and the justice system. Fifteen years after a major scientific panel identified critical flaws, the research community has failed to address these fundamental problems. Iacono and Ben-Shakhar concluded that the National Academy of Sciences' determination that polygraph testing had a weak scientific basis and unknown error rate remained valid, as analysis of research conducted over the last 15 years indicated these conclusions still stand.

The continued use of polygraph testing despite persistent scientific concerns raises troubling questions about the relationship between forensic practice and scientific evidence. The authors' work demonstrates that industry claims of high accuracy are not supported when studies are subjected to rigorous scientific scrutiny. The gap between what the science shows and what practitioners claim represents a significant threat to justice.

The review also highlights how difficult it is to conduct truly valid field research on polygraph accuracy. The confession-criterion problem creates an nearly insurmountable methodological challenge: cases are selected for validation studies based on whether confessions occurred, but confession rates are influenced by polygraph results, creating circular reasoning that inflates apparent accuracy.

Limitations & Considerations

As a review article rather than original empirical research, this study's scope was limited to evaluating existing literature rather than generating new data. The authors acknowledged ongoing debates about the generalizability of laboratory studies to field settings, a controversy that continues to divide the deception detection community. The authors noted that despite rejection by the broader scientific community, some researchers continue to hold that laboratory study results are not useful for estimating field validity because they lack external validity.

The review focused primarily on the Comparison Question Technique rather than alternative approaches like the Concealed Information Test (CIT), which has stronger theoretical foundations but limited field application. Additionally, the analysis did not address emerging technologies in deception detection, focusing instead on traditional psychophysiological polygraph methods.

Practical Applications

For polygraph examiners and consumers of polygraph evidence, this review sends a clear message: claims of high accuracy are not scientifically justified. Criminal justice professionals, attorneys, employers, and policymakers should understand that current polygraph testing lacks the scientific foundation necessary for high-stakes decision-making. The persistence of methodological flaws means that error rates remain unknown, making it impossible to properly weight polygraph evidence against other investigative information.

The findings suggest that stakeholders should demand higher evidentiary standards before relying on polygraph results. For defense attorneys, the review provides ammunition for challenging admissibility under Daubert standards. For policymakers, it underscores the need for stricter regulation of polygraph use and clearer disclosure of limitations. Most importantly, the continued inability to estimate error rates with confidence should give pause to anyone considering how much weight to place on polygraph test results in investigations or legal proceedings.