Review of Field Studies of CQT Since 1988

Review of field studies since 1988 producing overall accuracy of 90.5% with improved methods.

Field study using actual criminal investigations or operational examinations with confirmed outcomes serving as ground truth.

Published in 1997 in In Raskin (Ed.), Psychological Methods in Criminal Investigation, this work by Raskin and colleagues examined review of field studies of cqt since 1988. Key findings include: Review of all field studies published since 1988 producing an overall accuracy of 90.5%. Documented consistent improvement in field accuracy with adoption of numerical scoring methods. As a field study conducted with real cases, this research provides ecological validity that laboratory studies cannot match.

The 90.5% accuracy rate from modern field studies represents the current best estimate for properly conducted CQT examinations.

Background & Context

By the mid-1990s, the polygraph field was experiencing a methodological revolution. The 1997 review by Raskin, Honts, and Kircher examined field studies published since 1988, producing an overall accuracy of 90.5%. This work emerged during a critical period of debate about polygraph validity, appearing as a chapter in "Modern Scientific Evidence: The Law and Science of Expert Testimony"—a legal reference volume designed to inform judges and lawyers about scientific admissibility standards.

The review addressed a fundamental gap in polygraph science: the need to synthesize real-world accuracy data using modern, standardized evaluation methods. Prior to the widespread adoption of numerical scoring in the 1980s, polygraph chart interpretation relied heavily on subjective, global evaluations. This review documented whether the implementation of systematic, numerical scoring systems—particularly those developed at the University of Utah—had improved field accuracy in actual criminal investigations.

The work appeared alongside competing analyses in the same volume, representing the "case for polygraph tests" in an adversarial scientific debate. This context is crucial: Iacono and Lykken (1997) published a contrasting chapter titled "The case against polygraph tests" in the same volume, concluding that the CQT literature was methodologically inadequate. The Raskin team's review thus served both as scientific synthesis and legal advocacy.

Research Design & Methodology

This was a comprehensive literature review examining CQT field studies conducted from 1988 forward. The authors identified and analyzed field validation studies that used actual criminal investigations with confirmed outcomes serving as ground truth. The compilation included four field studies scored by independent examiners that produced a mean accuracy of 90.5%, and six field studies scored by original examiners that yielded mean accuracy of 97.5%.

The review methodology focused on several key analytical dimensions:

• Ground truth criteria: Studies required independent verification of guilt or innocence through confessions, physical evidence, or judicial outcomes
• Scoring methodology: The review distinguished between studies using numerical scoring systems versus older global evaluation approaches
• Examiner independence: Results were analyzed separately for original examiner decisions versus blind, independent evaluations
• Temporal focus: Only post-1988 studies were included to capture the impact of modern numerical scoring adoption

The authors contended that evaluators using numerical evaluations could achieve accuracies exceeding 90%, and that the most important difference from earlier work was that interpreters were trained in numerical scoring procedures rather than using global evaluation procedures. This methodological distinction formed the core thesis of the review.

Results & Key Findings

The review's headline finding was clear: field studies conducted since 1988 produced an overall accuracy of 90.5% when charts were scored by independent examiners. This represented a significant advancement over earlier field study estimates and laboratory analog studies.

Key statistical findings included:

• Independent scoring accuracy: 90.5% across four field studies with blind evaluators
• Original examiner accuracy: 97.5% across six field studies
• Laboratory study concordance: Eight laboratory studies compiled in the review placed mean accuracy at approximately 90%
• Numerical scoring superiority: Studies using validated numerical methods consistently outperformed those relying on global chart interpretation

The review documented a consistent pattern: The adoption of numerical scoring methods was associated with documented consistent improvement in field accuracy. One 1997 field study using criminal cases from the Royal Canadian Mounted Police indicated examiners were 100% correct in detecting guilty suspects and 94% correct in identifying innocent suspects. These findings suggested that standardized, objective scoring methods reduced examiner subjectivity and improved diagnostic precision.

The convergence between laboratory and field estimates was particularly noteworthy, addressing long-standing concerns about the ecological validity of mock-crime studies and supporting the generalizability of laboratory findings to real-world forensic applications.

Discussion & Significance

This review represented a watershed moment in polygraph validation research. The 90.5% accuracy estimate became a benchmark figure widely cited in subsequent legal proceedings and scientific debates. The work provided systematic evidence that properly conducted CQT examinations using validated numerical scoring could achieve diagnostic accuracy comparable to or exceeding other forensic methods routinely admitted in courts.

The significance extended beyond the accuracy numbers themselves. The review demonstrated that polygraph science had evolved from an intuitive art into a more standardized, replicable methodology. The shift from subjective global evaluations to objective numerical scoring represented genuine scientific progress—a transition from clinical judgment to actuarial decision-making that parallel developments in medicine and clinical psychology.

However, the work also intensified scientific controversy. While Raskin's team reported 90.5% accuracy, critics accessing the same information concluded that the literature was methodologically inadequate, accuracy claims were not credible, and the CQT did not meet Daubert standards for admissible scientific evidence. This divergence highlighted fundamental disagreements about study quality, appropriate validation criteria, and the interpretation of mixed evidence.

Limitations & Considerations

As a literature review rather than an original empirical study, this work inherited all the limitations of the underlying field studies. Field validation research faces inherent methodological challenges: ground truth is often uncertain, sampling bias may occur when confessions serve as verification, and examiner knowledge of case details can compromise blinding. The substantially higher accuracy when original examiners scored their own cases (97.5%) versus independent evaluators (90.5%) suggests potential confirmation bias or information leakage.

Additional limitations include:

• Publication bias: Field studies with negative or null findings may be less likely to reach publication
• Case selection issues: Field studies typically include only cases with confirmed outcomes, potentially excluding the most ambiguous cases
• Generalizability constraints: Post-1988 studies may reflect examiner quality and training at specific institutions during a particular era
• Quality variation: Not all reviewed studies used equally rigorous methodologies or independent verification of ground truth

The 1988 cutoff date, while justified as capturing the numerical scoring era, also limited the sample size and may have introduced temporal bias. The legal advocacy context of the publication raises questions about whether the synthesis prioritized evidence supporting polygraph admissibility over a more balanced assessment of limitations.

Practical Applications

This review established the 90.5% accuracy benchmark that has guided professional practice and legal proceedings for decades. For polygraph examiners, the findings validated the investment in numerical scoring training and standardized protocols. The work demonstrated that field accuracy could match or exceed laboratory estimates when examiners followed validated procedures, providing empirical support for professional certification standards and continuing education requirements.

For consumers and stakeholders, the review offers important context: properly conducted examinations by trained examiners using validated numerical scoring systems can achieve meaningful accuracy, but the substantial gap between original examiner and independent evaluator accuracy (97.5% vs. 90.5%) underscores the value of independent quality control and blind rescoring. The convergence of laboratory and field estimates suggests that research-validated techniques, when faithfully implemented in practice, can deliver real-world diagnostic utility approaching the 90% threshold—though still "well below perfection" as later reviews would characterize it.