The effects of prior expectations and outcome knowledge on polygraph examiners' decisions

AbstractThe present study deals with the question of whether judgments made by experts working in familiar contexts are affected by prior expectations and beliefs. Two experiments in which prior expectations were manipulated were designed to determine whether and to what extent polygraph examiners are affected by their prior expectations when analyzing and interpreting polygraph charts. Prior expectations affected the examiners' judgments when the polygraph charts did not include clear indications of guilt or innocence, but when the objective physiological evidence included strong indications which clearly contradicted the examiner's expectations, judgments were not affected by these expectations. Theoretical and practical implications of these results are discussed.

Two controlled experiments using Israeli police examiners who blindly scored actual polygraph charts after receiving manipulated information about whether examinees had confessed or been proven innocent. Studies compared effects on both inconclusive and conclusive chart patterns using matched-group statistical analyses.

This study systematically investigated confirmation bias in practicing polygraph examiners—a long-standing criticism of CQT methodology. Researchers manipulated examiners' prior expectations by providing false information about suspect confessions, then had them score actual polygraph charts that varied in clarity. The key finding was a conditional bias effect: when charts were objectively ambiguous or inconclusive, prior expectations significantly influenced scoring in the direction of the examiner's expectation; however, when physiological evidence was strong and unambiguous, prior expectations did not override the objective data. This held true for both experienced and inexperienced examiners, suggesting that professional expertise alone does not protect against expectancy bias in ambiguous cases.

The findings highlight a critical vulnerability in CQT practice: expectancy effects can contaminate chart interpretation when evidence is ambiguous, suggesting the need for stronger quality control measures, blinded scoring procedures, and enhanced training to mitigate confirmation bias. This research provides empirical support for procedural safeguards in polygraph administration and interpretation to ensure fairness in legal and security contexts.

Background & Context

This 1994 study addresses one of the most persistent criticisms leveled against polygraph testing: the potential impact of polygraph examiners' prior expectations on the outcome of a polygraph test is considered a major flaw of polygraph testing. The research emerged from a broader scientific debate about whether expert judgments remain objective when conducted in familiar professional contexts, or whether they fall prey to the same cognitive biases that affect novices.

The study holds particular importance for the Comparison Question Test (CQT), a core polygraph testing technique, is considered to suffer from this weakness. Unlike truly blind forensic analyses, CQT examiners typically gather extensive case background during pre-test interviews, creating opportunities for expectancy effects to contaminate chart interpretation. This research provided the first systematic experimental evidence of such bias effects in practicing polygraph professionals.

Conducted by researchers from the Israeli National Police and Hebrew University, the study examined whether the psychological phenomenon of confirmation bias—well documented in laboratory settings—operates in the high-stakes context of actual polygraph practice. The findings would have profound implications for quality control procedures, training protocols, and the validity of polygraph evidence in legal proceedings.

Research Design & Methodology

The researchers conducted two experiments aimed to examine the effects of prior expectations of the examiners about the guilt of the examinees, on the interpretation of the physiological records. Both experiments employed polygraph examiners from the Israeli National Police, including both experienced and inexperienced practitioners, to assess whether professional expertise provided immunity from bias.

The experimental manipulation was elegant: examiners were asked to score test records after being led to believe that the examinees had confessed guilty or whose innocence was proven through confessions made by others. This created strong prior expectations—either guilt or innocence—before examiners evaluated the physiological charts. Crucially, the study included two types of polygraph records: those with clear, conclusive physiological patterns and those that were objectively inconclusive or ambiguous.

Key methodological features included:

• Blind scoring of actual polygraph charts from real cases
• Manipulation of outcome knowledge through false feedback about confessions
• Prior expectations affected both experienced and inexperienced examiners
• Statistical analysis using matched-group t-tests to assess bias effects
• Experiment 2 specifically tested whether conclusive polygraph records would also be vulnerable to expectancy effects

Results & Key Findings

The headline finding revealed a conditional bias effect: Prior expectations affected the examiners' judgments when the polygraph charts did not include clear indications of guilt or innocence, but when the objective physiological evidence included strong indications which clearly contradicted the examiner's expectations, judgments were not affected by these expectations.

More specifically, when the records were not that clear to make a call about the veracity of the examinee (Inconclusive records), prior expectations did have a significant effect on the results of the scoring process. When the records were objectively inconclusive, a statistically significant shift of the final scores took place in the direction which was established by the manipulative information that the examiners had received.

Key statistical and practical findings:

• The differences were statistically significant for the bias effect in inconclusive charts
• No effect of prior expectations could be demonstrated when the records were clear enough to render a decision by examiners with no prior expectations
• Prior expectations affected both experienced and inexperienced examiners, suggesting professional training did not eliminate vulnerability
• The effect operated on the numerical scoring scale rather than just categorical decisions

Discussion & Significance

The findings paint a nuanced picture of examiner objectivity. Strong physiological evidence appears to override biasing expectations, suggesting that when charts provide clear diagnostic information, examiners can interpret them accurately regardless of preconceptions. However, the vulnerability demonstrated with ambiguous charts has substantial practical implications given that inconclusive results represent a meaningful proportion of real-world polygraph examinations.

Since then, this finding has been the leading empirical scientific demonstration of the danger embedded in the CQT. The research provided ammunition for critics who argued that the CQT could not be considered an objective test of veracity. This finding supported the claim made by polygraph opponents that the CQT should not be used in the field.

Subsequent reanalysis suggests the real-world impact may be more limited than initially interpreted. Based on the 1994 study the estimated impact of prior expectations on real-life polygraph decisions has been greatly overestimated by polygraph opponents, and would in fact adversely impact just 3% of the total volume of polygraph examinations. The adverse effect in practice may concern less than 5% of the specific event-related CQT examinations.

Limitations & Considerations

The study used a laboratory simulation where examiners scored pre-existing charts rather than conducting full examinations. The CQT procedure is not limited to the psychophysiological data, but rather relies on the whole examiner-examinee interaction, including the pre-test interview, which was absent in this chart-scoring paradigm. Real examinations involve behavioral observations that might counteract or amplify expectancy effects.

The manipulation—telling examiners that subjects had confessed—may have created stronger expectancies than typically occur in field practice. Additionally, the study was conducted with Israeli police examiners; cross-cultural validation would strengthen generalizability. The research also could not determine individual differences in susceptibility to bias, though it is possible that examiners differ in their vulnerability to expectancy effects.

Practical Applications

This research provides empirical support for blind chart evaluation procedures, where the scoring examiner remains unaware of case details and investigative findings. Some polygraph agencies (including the Israeli Police) the procedure includes an additional, 'blind', evaluation of the polygraph charts. Such quality control measures appear especially critical for cases where initial chart readings fall into the inconclusive range.

The findings suggest that examiner training should explicitly address cognitive biases and develop skills for recognizing when prior information might be influencing interpretation. For inconclusive cases specifically, agencies might implement mandatory secondary blind review or elevate the threshold for decisive conclusions. The research demonstrates that while strong physiological evidence can overcome bias, examiners remain vulnerable when confronting ambiguous data—precisely the situations where objectivity matters most.