2015 Update to the APA 2011 Meta-Analytic Survey of Validated Polygraph Techniques

This study updated the 2011 APA meta-analytic survey with newly available research data and studies published between 2011 and 2015. It re-confirmed the accuracy estimates from the original survey and introduced evidence-based practice frameworks for polygraph examiners.

Updated meta-analytic survey extending the 2011 APA analysis. New studies meeting inclusion criteria were incorporated into the existing dataset. Accuracy estimates were recalculated with expanded samples. Evidence-based practice guidelines were developed from the accumulated data.

Nelson's 2015 update confirmed the robustness of the 2011 APA meta-analytic findings by incorporating additional research published in the intervening years. The updated analysis confirmed a mean accuracy of .89 for event-specific diagnostic polygraphs (95% CI: .83-.95) and .85 for multi-issue screening (95% CI: .77-.93). Beyond replicating the original accuracy estimates, this update introduced evidence-based practice frameworks designed to guide examiners in selecting appropriate test formats, scoring methods, and decision rules based on the accumulated scientific evidence. This represented a significant step toward standardizing polygraph practice around empirical findings rather than tradition or personal preference.

The replication of accuracy estimates across additional studies strengthens confidence in the original benchmarks. The evidence-based practice framework provides practitioners with concrete guidance for selecting validated techniques and scoring methods, moving the profession toward more standardized, scientifically grounded practice.

Background & Context

The 2015 update to the APA's landmark 2011 meta-analytic survey represented a critical milestone in polygraph science, marking the first systematic validation of the field's most comprehensive accuracy benchmarks. Published as Appendix B in Krapohl and Shaw's "Fundamentals of Polygraph Practice," this update appeared at pages 319-333, arriving at a pivotal moment when the profession was transitioning from tradition-based practices to evidence-based protocols.

The original 2011 meta-analysis had established definitive accuracy estimates for validated polygraph techniques, but the scientific value of any meta-analysis depends on replicability. The APA had undertaken an exhaustive review of peer-reviewed publications on polygraph testing that represented field practices and met APA Standards of Practice requirements, completing the meta-analysis in late 2011. By incorporating newly published studies from 2011 through 2015, this update tested whether the original findings were robust or artifacts of the specific sample analyzed.

Beyond simple replication, this update introduced a transformative framework for evidence-based practice, providing examiners with concrete guidance for selecting validated techniques and scoring methods based on empirical evidence rather than personal preference or institutional tradition. This represented a fundamental shift in how the profession approached standardization and quality assurance.

Research Design & Methodology

The 2015 update employed an extension methodology, building upon the rigorous foundation established by the 2011 APA meta-analysis committee. The approach involved identifying studies published between 2011 and 2015 that satisfied the same stringent inclusion criteria used in the original survey, then integrating these new datasets with the existing meta-analytic framework to recalculate accuracy estimates with expanded sample sizes.

The original 2011 meta-analysis included 38 studies satisfying qualitative and quantitative requirements, involving 32 different samples describing results of 45 different experiments and surveys, with 295 scorers providing 11,737 scored results of 3,723 examinations. The update methodology required that newly incorporated studies meet identical standards for confirmation methods, statistical reporting, peer review or editorial oversight, and adherence to validated testing protocols outlined in APA Standards of Practice.

Key methodological elements included:

• Systematic literature search for polygraph validation studies published 2011-2015
• Application of identical inclusion/exclusion criteria from the 2011 survey
• Integration of new study data with existing meta-analytic dataset
• Recalculation of aggregated accuracy rates and confidence intervals
• Development of evidence-based practice frameworks from accumulated findings

The statistical approach maintained the distinction between event-specific diagnostic examinations (single-issue tests) and multi-issue screening examinations, recognizing their different applications and accuracy characteristics. The update identified validated test formats and contributed to noticeable growth in applied psychophysiological research, though it also revealed that some formats like the relevant-irrelevant screening test showed substantially poorer decision accuracy than other validated screening formats.

Results & Key Findings

The 2015 update confirmed the remarkable stability of polygraph accuracy estimates across the expanded dataset, providing powerful evidence for the reliability of the original 2011 findings. Event-specific diagnostic polygraphs demonstrated mean accuracy of .89 with a 95% confidence range from .83 to .95, while multi-issue screening polygraphs showed accuracy rates with a mean of .85 and a 95% confidence range of .77 to .93. These figures precisely matched the original 2011 estimates, despite incorporating additional years of research.

Specific accuracy parameters documented in the update included:

• Event-specific diagnostic polygraphs: 89% mean accuracy (95% CI: .83–.95)
• Multi-issue screening polygraphs: 85% mean accuracy (95% CI: .77–.93)
• False negative error rate: 8% (deceptive persons incorrectly classified as truthful)
• False positive error rate: 12% (truthful persons incorrectly classified as deceptive)
• Inconclusive rates: 9% for deceptive persons, 13% for truthful persons

The most recent meta-analytic survey using 24 peer-reviewed scientific studies involving 8,975 confirmed scores of field and lab studies reported .08 for false negative errors and .12 for false positive errors, with inconclusive rates of .09 for deceptive persons and .13 for truthful persons, and a 95% confidence range for decision accuracy of event-specific diagnostic polygraphs from .83 to .95. This convergence of findings across multiple years and thousands of examinations provided unprecedented empirical support for polygraph validity when conducted according to validated protocols.

Importantly, the update extended beyond accuracy replication to introduce practical frameworks. The analysis confirmed that inconclusive rates in CQT typically fall between 10%-20%, with APA Standards of Practice requiring that acceptable polygraph techniques demonstrate objective inconclusive rates not exceeding 20%. This standardization provided clear benchmarks for quality assurance programs.

Discussion & Significance

The replication of accuracy estimates across additional studies and an expanded time window profoundly strengthened confidence in the 2011 benchmarks. When independent samples collected under diverse conditions by different researchers yield statistically indistinguishable results, it provides compelling evidence that the observed effects reflect genuine phenomenon rather than sampling artifacts or methodological idiosyncrasies. The stability of the .89 accuracy rate for diagnostic testing across years of additional research represents a level of empirical consistency rare in applied psychology.

Perhaps more transformative than the accuracy confirmation was the introduction of evidence-based practice frameworks. The philosophy of evidence-based practice advocates for professionals to rely on scientific evidence, and despite initial controversy, it gained disciples and was embraced by the polygraph profession, with the polygraph community gradually abandoning intuitive-based practice that relied on less scientifically rooted subjective procedures and advancing toward evidence-based polygraph practice. This represented a paradigm shift from experiential to empirical decision-making.

The findings showed event-specific diagnostic testing produced aggregated decision accuracy of 89% with estimated inconclusive rate of 11%, while multiple-issue techniques produced aggregated decision accuracy of 85% with inconclusive rate of 13%, and the combination of all validated PDD techniques produced decision accuracy of 87% with inconclusive rate of 13%, consistent with National Research Council (2003) conclusions. This convergence with independent authoritative reviews enhanced the credibility of both the original meta-analysis and its update.

Limitations & Considerations

The update inherited certain methodological limitations from the original 2011 meta-analysis, particularly regarding the mixture of field and laboratory studies with different levels of experimental control. Field studies provide superior ecological validity but cannot control all confounding variables, while laboratory studies offer experimental rigor but may not fully replicate real-world conditions. The aggregation of these different study types, while increasing sample size and generalizability, introduces heterogeneity that may obscure technique-specific or context-specific variations in accuracy.

Additionally, deviations from empirically validated testing protocols may decrease expected test accuracy, and accuracy estimates assume each examination is conducted on a suitable examinee. This qualification is significant because it means the reported accuracy rates represent best-case scenarios achievable when all quality standards are maintained. Real-world accuracy in programs with inconsistent adherence to protocols may differ substantially from meta-analytic estimates. The publication format as a book appendix rather than a standalone peer-reviewed journal article may have limited accessibility for some researchers, though the findings were widely cited in subsequent polygraph literature.

Practical Applications

For polygraph examiners and program administrators, this update provided empirical justification for adopting evidence-based protocols and abandoning outdated or invalidated techniques. The research identified that some formats like the relevant-irrelevant screening test showed substantially poorer decision accuracy than other validated screening formats, yet many agencies and examiners continued practicing formats that failed despite existing evidence. The evidence-based framework introduced in the update gave quality assurance programs objective criteria for evaluating examiner practices and institutional policies.

For consumers of polygraph services—including criminal justice agencies, security clearance programs, and legal professionals—the confirmed accuracy benchmarks provide realistic expectations about test performance. Understanding that even optimal polygraph testing achieves approximately 89% accuracy for diagnostic examinations with 11% inconclusive rates enables appropriate integration of polygraph results with other investigative information. These findings support the characterization of polygraph as a valuable but imperfect forensic tool requiring professional interpretation and contextual judgment rather than mechanical application.