Iacono and Ben-Shakhar's response to Ginton (2020): Validity estimates from paired testing

This 2020 rejoinder by Iacono responds to Ginton's defense of his paired-testing method for estimating polygraph field validity. The authors categorically reject Ginton's validity estimates and maintain that methodological concerns about examiner bias and contamination remain unresolved.

This is a theoretical and methodological critique employing logical analysis and examination of assumptions underlying Ginton's paired-testing paradigm for field validity estimation.

This paper represents a critical exchange in the ongoing debate about polygraph field validity estimation methods. Iacono responds to Ginton's defense of his innovative paired-testing method that claimed 94% accuracy for deceptive examinees by examining cases where two suspects provide contradictory accounts. The authors systematically address Ginton's counterarguments but maintain their original criticisms regarding confession contamination, examiner independence, and confirmation bias. They conclude that the paired-testing method fails to overcome longstanding problems in field validity research and that Ginton's accuracy estimates remain unreliable.

This ongoing debate highlights the continued challenges in establishing reliable field validity estimates for polygraph testing and suggests that innovative methodologies like paired testing may still be insufficient to overcome fundamental methodological problems in real-world polygraph research.

Background & Context

This 2021 paper represents a critical exchange in one of polygraph science's most contentious ongoing debates about field validity estimation. Iacono and Ben-Shakhar had previously critiqued Ginton's (2013) novel method for estimating comparison question polygraph technique accuracy, and Ginton (2020) argued they misconstrued and misinterpreted his study. This rejoinder addresses Ginton's counterarguments point by point.

Ginton's 2013 study introduced an innovative "paired testing" method that computed accuracy rates of 94% for deceptive and 83.5% for truthful examinees with 20.3% undecided tests, and was considered a breakthrough by some researchers. The method examines cases where two suspects provide contradictory accounts of the same incident—both take polygraph tests, but only one version can be true, creating a natural control that eliminates the need for external ground truth criteria like confessions.

The 2003 National Academy of Sciences report concluded that the scientific basis of the Comparison Question Technique (CQT) was weak, extant research was of low quality, polygraph profession claims for high accuracy were unfounded, and although the CQT has greater than chance accuracy, its error rate is unknown. This paper continues the debate about whether post-2003 research, particularly Ginton's method, has meaningfully advanced the field.

Research Design & Methodology

This is a theoretical and methodological critique rather than an empirical study. Ben-Shakhar and Iacono systematically dismiss Ginton's critical points and maintain that his polygraph validity estimates cannot be trusted. The authors employ logical analysis, examination of methodological assumptions, and discussion of confirmation bias to challenge Ginton's paired-testing paradigm.

The core analytical approach involves examining several key methodological concerns:

• Confession contamination: Whether cases involving confessions biased the paired-testing results
• Examiner bias: Whether knowledge from first tests influenced second test administration
• Test utility versus accuracy: Distinguishing between whether tests provide useful information versus whether they are accurate
• Statistical assumptions: Evaluating the algebraic models used to calculate accuracy rates from paired outcomes

The authors draw on extensive literature regarding forensic confirmation bias—the tendency for examiners' prior expectations to influence their decisions. This theoretical framework underpins their criticism that Ginton's method cannot adequately control for bias in real-world field settings.

Results & Key Findings

The central finding is a categorical rejection of Ginton's validity estimates. The authors conclude that Ginton's critical points fail to address their concerns and his polygraph validity estimates cannot be trusted. This represents a fundamental disagreement about whether the paired-testing method successfully overcomes longstanding field validity problems.

Key arguments advanced in the rejoinder include:

• Contamination remains unresolved: Cases with confessions may still bias the dataset despite Ginton's claims of controlling for this
• Examiner independence questioned: Even with policies against information sharing, real-world implementation likely involved knowledge transfer between paired tests
• High inconclusive rates problematic: The substantial percentage of non-indicative results itself reflects limited CQT validity
• Confirmation bias unavoidable: Field examiners' prior case knowledge inevitably influences test administration and scoring

The authors maintain that the quality of research has changed little since the NAS report, and the report's landmark conclusions still stand despite new methodologies like Ginton's. They argue that the fundamental problems with CQT field validation—lack of independent ground truth, examiner bias, case selection effects—cannot be solved through paired testing alone.

Discussion & Significance

This exchange represents more than a technical methodological dispute—it reflects a fundamental divide in polygraph science between critics who view the CQT as scientifically unsound and proponents who argue field evidence demonstrates practical validity. Iacono and Ben-Shakhar acknowledged that Ginton's novel paradigm warrants careful scrutiny because the last half-century of field research has been plagued by vexing methodological shortcomings, yet ultimately conclude these shortcomings persist.

The theoretical importance centers on confirmation bias in forensic settings. Research shows that even with explicit policies, examiners may not remain immune from information indicating guilt or innocence before testing begins. This makes truly blind field testing extraordinarily difficult to achieve in practice, undermining one of paired testing's key claimed advantages.

The paper's significance lies in maintaining scientific skepticism about CQT validity claims. By systematically refuting Ginton's rebuttals, the authors preserve the position that no current methodology—including innovative paired testing—has definitively established the CQT's accuracy in real-world criminal investigations. This has direct implications for legal admissibility, policy decisions about polygraph screening, and resource allocation in law enforcement.

Limitations & Considerations

As a commentary rather than empirical research, this paper's limitations differ from traditional studies. The primary limitation is that the critique relies on logical arguments and theoretical concerns about potential bias rather than direct empirical evidence that Ginton's specific dataset was contaminated. The authors identify plausible threats to validity without demonstrating they actually occurred in Ginton's Israeli police cases.

Additionally, the paper represents one side of an ongoing debate. Ginton's own response indicated that Iacono and Ben-Shakhar's critique shows reliance on speculations disconnected from reality and profound misunderstanding of the data. Readers must recognize this as part of a scholarly exchange where both parties make legitimate points from different epistemological perspectives—critics demanding rigorous proof versus practitioners emphasizing real-world evidence.

Practical Applications

For polygraph practitioners, this paper reinforces that even innovative field methodologies face scientific scrutiny regarding examiner bias and ground truth verification. Examiners should implement rigorous blinding procedures when conducting paired tests, ensuring complete information independence between examinations. Documentation of case selection criteria and confession handling becomes essential when attempting to establish validity evidence.

For consumers of polygraph services and policymakers, this exchange underscores that field accuracy claims exceeding 90% remain scientifically controversial despite decades of research. When polygraph results influence criminal investigations, employment screening, or security clearances, decision-makers should understand that validity estimates vary dramatically depending on methodological perspective. The absence of scientific consensus about fundamental CQT accuracy means polygraph evidence should not be the sole basis for consequential decisions. Independent corroboration remains essential, and the debate highlighted in this paper demonstrates why courts continue to treat polygraph evidence with substantial caution.