Validated Techniques and Scoring Models for PDD Test Data Analysis – Conclusions from the 2011 APA Report

Gołaszewski provides a systematic review and synthesis of the landmark 2011 APA meta-analytic survey on polygraph validity, translating dense statistical findings into actionable guidance for practitioners. The work serves as a critical bridge between the comprehensive technical report and the international polygraph community, particularly European practitioners adapting to new validation standards.

Systematic review and synthesis of the APA's 2011 meta-analysis, which examined 38 studies involving 32 samples, 45 experiments, and 11,737 scored results from 3,723 examinations.

Gołaszewski conducted a systematic review of the landmark 2011 APA meta-analysis to translate technical findings into practical guidance for polygraph examiners, particularly in Europe. The analysis examined which techniques met scientific validation criteria under new APA standards that came into effect January 1, 2012, requiring mandatory use of validated techniques only. The review systematically categorized techniques by test purpose, scoring systems, and validation criteria, finding that properly implemented validated techniques achieved 87% accuracy. This work served as a critical bridge between the comprehensive APA technical report and international polygraph practitioners needing to adapt to evidence-based standards. The findings established robust empirical foundations for polygraph validity when validated protocols are followed.

This analysis provided crucial guidance for practitioners transitioning to mandatory evidence-based polygraph standards, effectively ending reliance on tradition or preference alone. The work established clear accuracy benchmarks and validation requirements that continue to shape professional polygraph practice globally.

Background & Context

In 2011, the American Polygraph Association undertook the most comprehensive examination of polygraph validity to date, producing a landmark meta-analytic survey that would fundamentally reshape professional standards across the field. The APA conducted an exhaustive review of all peer-reviewed publications on polygraph testing that represented field practices and met the requirements of the APA Standards of Practice, completing the meta-analysis in late 2011. Marcin Gołaszewski's 2012 analysis served as a critical bridge between this extensive technical report and the international polygraph community, particularly practitioners in Europe who needed to understand the practical implications of these new validation standards.

The timing was crucial: on January 1, 2012, new APA standards of practice came into force, introducing mandatory motion sensor usage, obligatory instrument functionality testing, and a general requirement for using only validated techniques supported by research conducted in accordance with APA research standards. This marked a watershed moment in polygraph history—the profession was now mandating that examiners use only scientifically validated techniques, effectively ending the era when tradition or personal preference alone could justify testing methods.

The 2011 meta-analysis represented an unprecedented synthesis of polygraph research. The executive summary reports that 38 studies satisfied the qualitative and quantitative requirements for inclusion, involving 32 different samples and describing 45 different experiments and surveys, with 295 scorers providing 11,737 scored results of 3,723 examinations. Gołaszewski's work translated these dense statistical findings into actionable guidance for working examiners.

Research Design & Methodology

Gołaszewski's 2012 paper employed a systematic review and synthesis methodology, analyzing the findings from the APA's meta-analytic report to identify which specific polygraph techniques and scoring models met scientific validation criteria. The approach centered on examining criterion accuracy—the ability of tests to correctly categorize examinations as truthful or deceptive—alongside reliability and generalizability metrics.

The analysis focused on key methodological distinctions that affect validity generalization:

• Test purpose categories: Event-specific diagnostic testing (single-issue investigations), multi-issue screening, evidentiary testing, paired testing, and investigative testing
• Scoring systems: Seven-position versus three-position test data analysis (TDA) models, and comparison of traditional manual scoring with emerging empirical systems
• Validation criteria: Published peer-reviewed research, inter-rater reliability data, and sufficient statistical information for meta-analytic inclusion
• Accuracy thresholds: Different requirements for evidentiary (≥90% accuracy), investigative (≥80% accuracy), and paired testing (≥86% accuracy) applications

Gołaszewski systematically reviewed the reasons why popular techniques were excluded from validation, examining methodological shortcomings in existing research and identifying which techniques required additional independent verification. The paper provided detailed tables comparing validated techniques, their associated scoring models, decision rules, and empirical accuracy rates with confidence intervals.

Results & Key Findings

The combination of all validated PDD techniques, excluding outlier results, produced a decision accuracy of 87% (confidence interval 80%-94%) with an inconclusive rate of 13%. This landmark finding established a robust empirical foundation for polygraph validity when techniques are properly implemented according to validated protocols.

The meta-analysis revealed critical differences in accuracy based on test type and scoring methodology:

• Event-specific (single issue) diagnostic testing produced an aggregated decision accuracy of 89% (confidence interval 83%-95%), with an estimated inconclusive rate of 11%
• Techniques with multiple issues encompassed by relevant questions produced an aggregated decision accuracy of 85% (confidence interval 77%-93%) with an inconclusive rate of 13%
• Decision accuracy for 3-position techniques was not significantly different from 7-position, but inconclusive rates were excessive and beyond the boundaries permitted by the APA 2012 standards
• Four polygraph techniques produced mean accuracy rates over 80% with mean inconclusive rates lower than 20%: the AFMGQT scored with seven-position TDA, the Concealed Information Test, the DLST/TES scored with seven-position TDA, and the DLST/TES scored with ESS

Gołaszewski's analysis identified several widely-used techniques that failed to achieve validation status. Among excluded techniques were the US Army MGQT (which failed to satisfy criterion accuracy), the Reid technique (most studies could not be included due to serious sampling confounds, insufficient statistical information, use of test-data-analysis models that differ substantially from the Reid method, and use of instrumentation and testing procedures that differ substantially), searching POT tests, the Marcy technique, and Relevant-Irrelevant formats.

The IZCT and MQTZCT had not been verified by independent researchers, representing a significant limitation that warranted caution despite their inclusion based on available data. The scientific evidence available indicated that differences in accuracy among validated techniques were not statistically significant, excluding statistical outliers not accounted for by available evidence.

Discussion & Significance

Gołaszewski's synthesis revealed that the 2011 APA meta-analysis fundamentally transformed polygraph practice from a craft-based profession to an evidence-based scientific discipline. The establishment of mandatory validation requirements represented the profession's response to decades of scientific criticism, particularly the National Research Council's 2003 report that had questioned polygraph's scientific foundations. These findings were consistent with the National Research Council's conclusions regarding polygraph accuracy, and provided additional support for the validity of polygraph testing when conducted in accordance with APA Standards of Practice.

The analysis highlighted a crucial methodological insight: the three-position scoring model is valid in a scientific sense and can be used in field settings when field practices require that the results of inconclusive tests are re-evaluated using another method. This finding provided practical flexibility for examiners while maintaining scientific rigor through a two-stage decision process. The work also clarified that validation is technique-specific and cannot be assumed to generalize when test structure, question construction, or scoring methods deviate from validated protocols.

For the international polygraph community, particularly in Europe where Gołaszewski practiced, this synthesis provided essential guidance on aligning with emerging global standards. Both the American Polygraph Association (with over three thousand polygraphists) and ASTM International (tracing its roots to 1898) are international organizations open to representatives from all over the world, making their validation standards globally relevant despite their American nomenclature.

Limitations & Considerations

Gołaszewski identified several important limitations in the validation landscape. Certain techniques like the IZCT and MQTZCT warranted caution because they had not been verified by independent researchers, and the APA drew attention to some shortcomings in their validation studies. This highlighted an ongoing challenge: some techniques developed by individuals with proprietary interests lacked the independent replication essential for robust scientific validation.

The exclusion of widely-practiced techniques like the Reid method created practical challenges for the field. While these techniques may have empirical support, studies were excluded if they did not provide the statistical data of interest to the meta-analysis or if testing procedures did not conform to published descriptions of an identifiable polygraph technique or test data analysis method. This meant that techniques with long field histories might lack validation not because they don't work, but because existing research didn't meet modern methodological standards.

The analysis also noted that reliability (whether a test gives the same result when repeated or re-evaluated) and generalizability (whether tests that work on sample data also work in field cases) are critical considerations, and generalization of validity is not warranted when the structure or intended use of a test variant differs from a validated model. This limitation requires examiners to carefully match their field practices to validated protocols.

Practical Applications

For polygraph examiners, Gołaszewski's analysis provided clear guidance on technique selection based on examination purpose. Practitioners conducting evidentiary examinations where results might be used in court must use techniques meeting the 90% accuracy threshold with inconclusive rates below 20%. For investigative work, the 80% accuracy standard applies, while screening applications require techniques demonstrating accuracy significantly above chance. The paper's detailed tables of validated techniques, scoring models, and decision rules serve as essential reference material for ensuring compliance with professional standards.

For consumers and stakeholders evaluating polygraph services, this work underscores the critical importance of examiner qualifications and technique selection. Not all polygraph examinations are created equal—accuracy depends fundamentally on whether the examiner uses validated techniques with proper training and adherence to standardized protocols. Questions about which specific technique and scoring model will be used, whether the examiner graduated from an APA-approved school, and whether the examination purpose matches the technique's validation category are essential for quality assurance. The 87% overall decision accuracy figure represents what is achievable when best practices are followed, not a guarantee applicable to all polygraph testing regardless of methodology.