Current Status of Forensic Lie Detection with the Comparison Question Technique: An Update

Updated review reaffirming concerns about the Comparison Question Test, noting potential overestimation of accuracy in experimental studies and calling for continued caution in field applications.

Critical narrative review of CQT research literature, examining methodological issues in accuracy estimation and theoretical critiques of the CQT rationale.

Iacono and Ben-Shakhar's 2019 update revisited their longstanding criticisms of the CQT, reaffirming conclusions aligned with the 2003 NRC review. They argued that experimental studies may overestimate CQT accuracy due to methodological limitations and that the theoretical basis for the comparison question format remains contested. While acknowledging that the CQT produces above-chance discrimination, they cautioned against interpreting published accuracy rates as representative of real-world performance. This paper stimulated significant debate and directly motivated the Honts et al. (2021) comprehensive meta-analysis, which addressed many of the criticisms raised.

This critical perspective is valuable for maintaining scientific rigor in the field. The debate it stimulated led to the most comprehensive CQT meta-analysis ever conducted (Honts et al., 2021), which addressed the criticisms directly with data. The ongoing scholarly dialogue demonstrates that polygraph science is subject to the same self-correcting processes as other scientific disciplines.

Background & Context

Fifteen years after the National Academy of Sciences released its landmark 2003 report on polygraph testing, Iacono and Ben-Shakhar revisited the scientific status of the Comparison Question Technique (CQT), the most widely used polygraph method in forensic settings. The original NAS report concluded that the scientific basis of the CQT was weak, extant research was of low quality, and although the CQT demonstrated greater than chance accuracy, its error rate remained unknown.

This 2019 review emerged in a contentious scientific environment where polygraph proponents argued that current research indicates the CQT achieves 90% or better accuracy and that the NAS analysis supports this accuracy claim. The authors sought to examine whether the intervening decade and a half had produced methodological improvements or evidence that would alter the NAS report's cautionary conclusions about CQT validity in forensic applications.

The review directly challenged claims that the NAS report had been misrepresented and misinterpreted by CQT supporters, arguing that research quality had changed little in the years following the report's release and that its landmark conclusions still stand.

Research Design & Methodology

This study employed a critical narrative review methodology rather than a quantitative meta-analysis. The authors systematically reviewed scientific literature that appeared since the 2003 NAS publication, including examination of a novel method for estimating polygraph accuracy.

The review focused on several key methodological issues in CQT research:

• Confession criterion contamination: Analysis of field studies using post-test confessions as ground truth
• Laboratory versus field study validity: Evaluation of external validity and generalizability concerns
• Ginton's paired-testing method: Detailed critique of innovative approaches claiming to overcome traditional validation problems
• Theoretical foundations: Examination of the underlying assumptions of the CQT technique

The authors dedicated significant attention to Ginton's (2013) innovative paired-examination method, which reported accuracy rates of 94% for deceptive and 83.5% for truthful examinees with 20.3% undecided tests, acknowledging its innovation while ultimately critiquing its outcomes. The review employed qualitative synthesis to evaluate whether methodological advances warranted revision of earlier critical conclusions.

Results & Key Findings

The central conclusion was that research quality remained largely unchanged since 2003, with the NAS report's landmark findings still valid. The authors concluded that research quality had changed little in the years elapsing since the release of the NAS report, and that the report's landmark conclusions still stand.

Specific findings regarding CQT research quality included:

• Field study limitations persist: Confession-criterion studies continue to suffer from sampling bias and circularity problems
• Laboratory studies lack ecological validity: Mock-crime scenarios fail to capture real-world consequences and motivations
• Accuracy claims remain unsupported: Industry claims of 90%+ accuracy lack rigorous empirical foundation
• Novel methods show promise but have flaws: Ginton's paired-testing approach, while innovative, cannot definitively establish CQT validity

The review reaffirmed that while the CQT demonstrates greater than chance accuracy, its true error rate remains unknown, and claims for high accuracy in forensic applications are unfounded. The authors emphasized that the NAS report has been misrepresented and misinterpreted by those who support use of the CQT in forensic settings.

Discussion & Significance

This review holds significant importance as a sustained critical perspective in the polygraph debate. By systematically demonstrating that 15 years of research failed to address fundamental methodological problems, the authors challenged the polygraph industry's narrative of continuous scientific improvement and validation.

The paper sparked immediate and substantial controversy. Ginton (2020) published a detailed rebuttal, and the debate continued with Iacono and Ben-Shakhar publishing a rejoinder maintaining their critical stance. More significantly, this critique directly motivated Honts et al. (2021) to conduct the most comprehensive meta-analysis of CQT research ever undertaken, capturing as many studies as possible using broad inclusion criteria.

The authors' skepticism about theoretical foundations proved particularly influential. They argued that the core assumption underlying the CQT—that truthful examinees respond more strongly to comparison questions than relevant questions—lacks adequate scientific support, making the technique fundamentally problematic regardless of observed accuracy rates in individual studies.

Limitations & Considerations

As a narrative review rather than systematic meta-analysis, this work presents critical interpretation rather than quantitative synthesis. The authors acknowledged that their critique represents a specific theoretical perspective within an ongoing scientific debate, though they maintained that the preponderance of evidence supports their cautionary stance.

Several considerations should be noted:

• The review reflects the longstanding "Minnesota school" critical perspective on polygraphy, which some researchers argue underestimates CQT utility
• Subsequent meta-analytic work (Honts et al., 2021) produced more favorable accuracy estimates than those emphasized by the authors
• The critique of Ginton's method generated substantial technical disagreement about statistical assumptions and interpretation
• The review focuses primarily on theoretical and methodological flaws rather than practical effectiveness in applied settings

The authors' rejection of laboratory studies as informative about field accuracy remains controversial, as other deception detection researchers argue that well-designed laboratory studies provide valuable validity evidence.

Practical Applications

For polygraph practitioners and consumers, this review underscores the importance of maintaining appropriate skepticism about accuracy claims. The finding that research quality has not substantially improved since 2003 suggests that examiners should avoid overconfident interpretations of CQT results in forensic contexts.

The review has particular relevance for legal proceedings. By demonstrating that industry claims of 90%+ accuracy lack rigorous scientific support, the paper provides important context for judges evaluating polygraph admissibility and for fact-finders weighing polygraph evidence. The continued uncertainty about real-world error rates argues for extreme caution when CQT results might influence investigations, prosecutions, or employment decisions with serious consequences for examinees.