Effects of items' repetitions and variations on the efficiency of the guilty knowledge test

AbstractTwo mock‐crime experiments were designed to examine the effects of question repetition and variation on the efficiency of the guilty knowledge test. In the first experiment, two factors (single vs. multiple questions, and high vs. low motivation) were manipulated and in the second experiment, which was an analog study conducted in a police laboratory using field equipment, only the first factor was examined. Similar detection efficiencies were obtained in both experiments when a single question was repeated 12 times, and when each of four different questions was repeated 3 times. The results also showed that accumulating information across repetitions and across physiological measures tended to increase detection efficiency and reduce false positive errors. The results of Experiment 1 suggest that motivation to avoid detection may be associated with better detection efficiency.

Two mock-crime experiments: Experiment 1 manipulated question format (single vs. multiple) and motivation (high vs. low); Experiment 2 used police laboratory equipment and examined only question format. ROC analysis evaluated detection efficiency across electrodermal, respiration, and cardiovascular measures.

Background & Context

The question of how to optimally structure polygraph questions has been a persistent challenge in Concealed Information Test (CIT) research, formerly known as the Guilty Knowledge Test (GKT). Prior to this study, polygraph practitioners faced a practical dilemma: should they repeat the same question multiple times to accumulate physiological data, or use a variety of different questions covering multiple crime details?

This 1997 study by Elaad and Ben-Shakhar addressed a critical gap by systematically comparing these two approaches through controlled experiments. The research emerged during an era when CIT validity was under intense scrutiny, and researchers were working to optimize test protocols. Understanding whether question repetition or variation yields better detection efficiency had direct implications for real-world criminal investigations, where the number of viable crime details and testing time are both limited.

The study was grounded in orienting response theory—the idea that guilty examinees show enhanced physiological responses to crime-relevant items because those items carry special significance. The key question was whether this significance could be better captured through repeated presentations of the same critical information or through diverse questions covering different crime details.

Research Design & Methodology

Two mock-crime experiments were conducted, with Experiment 1 manipulating both question format (single vs. multiple questions) and motivation level (high vs. low), while Experiment 2—conducted in a police laboratory using field equipment—examined only the question format variable. This dual-study approach enhanced both internal and external validity.

In both experiments, participants committed simulated thefts and were later tested using the GKT. The critical manipulation involved test structure:

• Single-question condition: One question repeated 12 times
• Multiple-question condition: Four different questions, each repeated 3 times
• Both formats produced 12 total question presentations

Experiment 1 also varied motivational instructions, creating high-motivation conditions (with incentives to avoid detection and deceptive verbal responses required) and low-motivation conditions (no special instructions or verbal responses). Multiple physiological measures were recorded, including electrodermal (skin conductance), respiration, and cardiovascular responses. Detection efficiency was analyzed using ROC (Receiver Operating Characteristic) methodology, a signal-detection approach that evaluates diagnostic accuracy across all possible decision thresholds.

Results & Key Findings

The headline finding was striking: similar detection efficiencies were obtained in both experiments when a single question was repeated 12 times and when each of four different questions was repeated 3 times. This suggested that total information accumulation mattered more than question diversity—at least within the parameters tested.

Key statistical outcomes included:

• Accumulating information across repetitions and across physiological measures tended to increase detection efficiency and reduce false positive errors
• Results from Experiment 1 suggested that motivation to avoid detection may be associated with better detection efficiency
• Both single-question and multiple-question formats produced comparable areas under the ROC curve
• Combining physiological measures improved overall classification accuracy

The results were consistent across both the university laboratory setting (Experiment 1) and the more ecologically valid police laboratory environment (Experiment 2), suggesting the findings were robust across testing contexts. Importantly, the study found no systematic advantage for question variation when the total number of presentations was held constant.

Discussion & Significance

These findings had important theoretical and practical implications for CIT administration. The equivalence of the two formats suggested that what matters most is the total accumulation of physiological information, not whether that information comes from repeating one question or varying across multiple questions. This challenged some prevailing assumptions about the value of question diversity in polygraph protocols.

The motivation findings were particularly noteworthy. The observation that higher motivation to avoid detection was associated with better—not worse—detection efficiency contradicted concerns that motivated examinees might successfully suppress their responses. Instead, it supported the orienting response framework: guilty examinees with high stakes show enhanced physiological differentiation to crime-relevant items.

However, subsequent research by Ben-Shakhar and Elaad (2002) reached different conclusions, finding that GKT based on multiple questions was superior to many repetitions of single questions. This later replication study suggested the 1997 findings might not generalize across all testing conditions, highlighting the complexity of optimizing CIT protocols.

Limitations & Considerations

The study employed mock-crime scenarios rather than actual criminal investigations, limiting ecological validity. While Experiment 2 used field equipment in a police laboratory to enhance realism, participants still faced no genuine legal consequences. The range of question formats tested was also limited—only 1 versus 4 different questions were compared, leaving open the question of whether even greater question diversity (e.g., 8 or 12 different questions) might yield different results.

The study used relatively simple mock crimes, and it remains unclear whether findings would generalize to complex real-world crimes with numerous salient details. Additionally, the later contradictory findings from Ben-Shakhar and Elaad's 2002 replication suggest that moderating variables not fully explored in this study may influence the relative effectiveness of repetition versus variation strategies.

Practical Applications

For polygraph examiners, this research suggested flexibility in test construction: when crime details are limited, repeated presentations of available information can be as effective as seeking additional question topics. This is particularly valuable in cases where few crime-relevant details are available or can be safely used without risk of information leakage to innocent suspects.

The finding that combining multiple physiological measures improves accuracy reinforces the value of multi-channel recording in operational settings. Examiners should prioritize maximizing total information accumulation—whether through repetitions or variations—rather than rigidly adhering to one approach. The motivation findings also suggest that high-stakes testing conditions need not compromise validity and may actually enhance detection under certain circumstances.