Polygraph Peer Review: Why It Matters & How It Works

Defining the Peer Review Process

Polygraph peer review is the systematic evaluation of a completed polygraph examination by a second, independent qualified examiner. The reviewer analyzes the physiological charts (polygrams), the test questions, the scoring methodology, procedural compliance, and the original examiner's conclusions to determine whether the findings are accurate, well-supported, and defensible.

In its simplest form, peer review asks a fundamental question: if another competent examiner independently evaluated this same data, would they reach the same conclusion? As the National Research Council noted in 2003, inter-rater reliability measures the extent to which different examiners would draw the same conclusions about a given subject at a given time for a given examination [1]Verified The Polygraph and Lie Detection
Defines inter-rater reliability in polygraph context and provides comprehensive analysis of polygraph measurement reliability and validity.. When the answer is consistently yes, the polygraph profession demonstrates that its methods produce reliable, reproducible results — a cornerstone of any evidence-based discipline.

The concept parallels peer review in the broader scientific community, where it serves as the gatekeeping mechanism for published research. In polygraph practice, the application is direct and consequential: a single examiner's conclusions can affect criminal investigations, employment decisions, supervision conditions, and personal relationships. The stakes demand verification.

Peer review is not about second-guessing a colleague. It is a structured, professional quality assurance process that strengthens the examiner's conclusions when they are correct and catches errors when they are not. For more details on establishing robust quality assurance protocols, see our guide to polygraph exam quality control and APA standards.

Peer Review in Context: From Medicine to Polygraph

The peer review model is well-established in professions where decisions carry significant consequences. Radiologists routinely have their interpretations reviewed by colleagues. Pathologists submit difficult tissue samples for second opinions. In forensic science, DNA analysis and fingerprint comparisons undergo independent verification before reaching courtrooms.

Polygraph peer review follows the same logic. A polygraph examination generates objective physiological data — changes in respiration, electrodermal activity, and cardiovascular function — that must be interpreted through established scoring rules. Like reading an X-ray or interpreting a lab result, there is both an objective component (the recorded data) and an interpretive component (the examiner's scoring and conclusion). For a deeper understanding of the physiological foundations, see our guide on psychophysiology for polygraph examiners.

The profession's pioneers recognized this need early. Donald Krapohl, who served as APA President in 2006 and was Editor-in-Chief for APA publications from 1997–2003 and 2007–2014 [2]Verified Fundamentals of Polygraph Practice
Confirms Krapohl served as APA President in 2006 and Editor-in-Chief 1997–2003 and 2007–2014. Published by Academic Press (Elsevier) in 2015., championed quality control protocols that included systematic peer review as a non-negotiable element of professional practice. His co-authored textbook, Fundamentals of Polygraph Practice (2015), published by Academic Press (Elsevier), provides comprehensive coverage of evidence-based scoring and quality assurance methods [2]Verified Fundamentals of Polygraph Practice
Confirms Krapohl served as APA President in 2006 and Editor-in-Chief 1997–2003 and 2007–2014. Published by Academic Press (Elsevier) in 2015..

The seminal work by Horvath and Reid (1971) was among the earliest systematic studies examining agreement among polygraph examiners interpreting the same charts, establishing foundational data on inter-rater reliability in the field [3]Verified The Reliability of Polygraph Examiner Diagnosis of Truth and Deception
Seminal reliability study examining agreement among polygraph examiners interpreting the same charts, with experienced examiners achieving 91.4% accuracy.. Their study demonstrated that experienced examiners made an average of 91.4% correct judgments, while inexperienced examiners averaged 77.5% [4]Verified Scientific Validity of Polygraph Testing: A Research Review and Evaluation
1983 OTA report to Congress confirming experienced examiners achieved 91.4% accuracy vs 77.5% for inexperienced examiners in the Horvath & Reid study..

Protecting the Examinee

An incorrect polygraph result can have serious consequences for an examinee. A false deceptive finding in a pre-employment screening can cost someone a career in law enforcement or national security. A false deceptive result in a PCSOT examination can trigger violations and re-incarceration. In a private relationship test, a wrong call can damage families.

Peer review serves as a safety net. When a second examiner independently verifies the scoring and conclusions, the probability of an erroneous result reaching the decision-maker drops significantly. A comprehensive review of CQT and CIT methods has shown that structured, validated approaches are essential for maintaining accuracy [5]Verified A Review of the Polygraph: History, Methodology and Current Status
Comprehensive review of CQT and CIT methods analyzing shortcomings and potential of both approaches.. The examinee — who may not understand the technical aspects of chart scoring — benefits from knowing that multiple qualified professionals have evaluated their data.

This is particularly critical in contexts where the examinee has limited ability to challenge results, such as federal screening programs or court-ordered supervision. Learn more about ideal conditions for lie detector tests and the factors that affect results.

Protecting the Examiner

Peer review also shields the original examiner. Every polygraph examiner, regardless of experience, can make scoring errors — particularly in marginal cases where physiological reactions are subtle or ambiguous. Having a peer confirm a difficult call provides professional validation and legal protection.

If a polygraph result is later challenged in court, a peer-reviewed examination stands on much stronger ground. The examiner can demonstrate that their conclusions were independently verified, that the scoring followed validated algorithms such as the Numerical Scoring System, and that quality control procedures were followed. This is far more defensible than a solo examiner's uncorroborated opinion.

Examiners who invest in continuing education and maintain peer review protocols demonstrate the highest standards of professional practice, as exemplified by leaders like Marc Bester, voted APA International Member of the Year.

Protecting the Profession

Polygraph has faced scrutiny regarding reliability and examiner subjectivity. High-profile cases where polygraph results were questioned — such as the Aldrich Ames CIA espionage case — highlighted vulnerabilities in quality assurance when polygraph programs lack robust review processes. In 1986 and 1991, Ames passed two polygraph examinations while actively spying for the Soviet Union [6]Verified Unclassified Abstract of the CIA Inspector General's Report on the Aldrich H. Ames Case
Confirms Ames passed polygraph examinations in 1986 and 1991 while spying, and had not been polygraphed for almost ten years before 1986 test.. The CIA Inspector General's report noted that Ames had not been polygraphed for almost ten years when he was tested in 1986, and that the 1991 polygraph sessions were not properly coordinated [6]Verified Unclassified Abstract of the CIA Inspector General's Report on the Aldrich H. Ames Case
Confirms Ames passed polygraph examinations in 1986 and 1991 while spying, and had not been polygraphed for almost ten years before 1986 test.. These findings led to strengthened quality control requirements across federal polygraph programs.

Systematic peer review directly addresses concerns about examiner subjectivity. It demonstrates that the profession does not rely on individual examiner judgment alone, that results are verifiable by independent experts, and that quality control mechanisms exist to catch and correct errors. The APA meta-analytic survey of criterion accuracy analyzed 38 studies involving 295 scorers who provided 11,737 scored results of 3,723 examinations, demonstrating that validated polygraph techniques achieve decision accuracy of 89% for single-issue testing [8]Verified Meta-Analytic Survey of Criterion Accuracy of Validated Polygraph Techniques
Confirms APA meta-analysis analyzed 38 studies, 295 scorers, 11,737 scored results showing 89% accuracy for single-issue testing and 87% overall..

What Makes a Review 'Blind'?

Blind chart analysis is the most rigorous form of peer review in polygraph practice. In a blind review, the reviewing examiner receives only the physiological charts (polygrams) and the test questions. They do not receive the original examiner's scores or conclusions, background information about the case, the examinee's statements or admissions, any pre-test interview notes or behavioral observations, or information about who requested the test.

This deliberate information restriction eliminates confirmation bias — the well-documented psychological tendency to interpret ambiguous data in a way that confirms pre-existing beliefs. If a reviewer knows the original examiner called the test deceptive, they may unconsciously score borderline reactions more harshly. Blind review removes this possibility entirely.

The concept parallels double-blind research methodology in clinical trials. In polygraph, blind review means the chart scorer evaluates data purely on its physiological merits, without any contextual influence. As noted in the 1983 OTA report to Congress, blind evaluation of charts is a fundamental methodology in polygraph validation research [4]Verified Scientific Validity of Polygraph Testing: A Research Review and Evaluation
1983 OTA report to Congress confirming experienced examiners achieved 91.4% accuracy vs 77.5% for inexperienced examiners in the Horvath & Reid study..

How Blind Chart Analysis Works in Practice

The process begins when the original examiner (or a quality control coordinator) prepares a review packet containing sanitized materials. The charts are exported from the polygraph instrument software in a format that another examiner can view and score. All identifying information about the examinee is removed or redacted. For a comparison of leading instrument software platforms, see our Lafayette LXEdge vs Stoelting CPS comparison.

The test questions are included because the reviewer needs to know which were relevant questions, comparison questions, and irrelevant questions to score properly. For a deeper understanding of test question structures, see the Federal Zone Comparison Technique guide.

The reviewing examiner then applies the same validated scoring algorithm used by the original examiner — whether that is the Empirical Scoring System (ESS), the seven-position numerical scoring system, or another APA-approved methodology. The ESS, developed by Nelson, Handler, and colleagues, uses evidence-based normative data and has been validated across multiple studies involving 5,192 scored results of 732 confirmed examinations scored by 140 experienced and inexperienced scorers [9]Verified Using the Empirical Scoring System
Describes the ESS procedures with validation data for 5,192 scored results of 732 confirmed examinations across 140 scorers in 16 cohorts.. They score each chart presentation independently, calculate the total score, and reach a conclusion: No Deception Indicated (NDI), Deception Indicated (DI), or Inconclusive (INC).

Only after documenting their independent conclusion is the original examiner's result revealed. If they agree, the finding is confirmed with high confidence. If they disagree, a resolution process is triggered.

The Science Behind Blind Review

Research supporting blind chart analysis comes from decades of laboratory and field studies. The foundational work by Horvath and Reid (1971) demonstrated that trained examiners could reliably score charts without case information [3]Verified The Reliability of Polygraph Examiner Diagnosis of Truth and Deception
Seminal reliability study examining agreement among polygraph examiners interpreting the same charts, with experienced examiners achieving 91.4% accuracy.. According to the OTA report, experienced examiners in the Horvath and Reid study made an average of 91.4% correct judgments, while inexperienced examiners averaged 77.5% [4]Verified Scientific Validity of Polygraph Testing: A Research Review and Evaluation
1983 OTA report to Congress confirming experienced examiners achieved 91.4% accuracy vs 77.5% for inexperienced examiners in the Horvath & Reid study..

The OJP compendium of 80 polygraph research projects published since 1980 found that 11 studies involving the reliability of independent analyses of 1,609 sets of charts from confirmed field examinations provided an average accuracy of 92% [7]Verified Validity and Reliability of Polygraph Testing
Compendium of 80 research projects showing independent analyses of 1,609 field examination charts achieved 92% average accuracy; lab simulations achieved 81%.. Laboratory simulations showed independent analyses achieved 81% accuracy [7]Verified Validity and Reliability of Polygraph Testing
Compendium of 80 research projects showing independent analyses of 1,609 field examination charts achieved 92% average accuracy; lab simulations achieved 81%.. This represents substantial agreement between independent scorers.

A review of all field studies published since 1988 produced an overall accuracy of 90.5%, documenting consistent improvement in field accuracy with the adoption of numerical scoring methods [10]Verified Review of Field Studies of CQT Since 1988
Review of all field studies published since 1988 producing an overall accuracy of 90.5% with consistent improvement from numerical scoring methods.. The APA-commissioned review of 12 field validity studies since 1980 concluded that CQT accuracy in real-life applications ranged from 92%–98% [11]Verified Review of 12 Field Validity Studies of CQT
APA-commissioned review of 12 field validity studies concluding CQT accuracy in real-life applications ranged from 92%–98%..

More information does not always lead to better decisions — when examiners have access to case details, behavioral observations, and the examinee's emotional presentation, these non-physiological factors can contaminate the objective scoring process. Blind review eliminates these human factors from the scoring equation. The reviewer should also be watchful for signs of purposeful distortion in polygraph charts.

Understanding the Concept

Inter-rater reliability (IRR) is a statistical measure of the degree to which two or more independent raters reach the same conclusion when evaluating the same data [1]Verified The Polygraph and Lie Detection
Defines inter-rater reliability in polygraph context and provides comprehensive analysis of polygraph measurement reliability and validity.. High inter-rater reliability indicates that the measurement system produces consistent results regardless of who does the measuring — a fundamental requirement for any diagnostic tool.

In polygraph, IRR is typically expressed as a percentage of agreement between examiners or through statistical measures like Cohen's Kappa. The OJP compendium documented that independent analyses of field examination charts achieved an average accuracy of 92%, while laboratory simulations showed 81% accuracy [7]Verified Validity and Reliability of Polygraph Testing
Compendium of 80 research projects showing independent analyses of 1,609 field examination charts achieved 92% average accuracy; lab simulations achieved 81%..

The key insight is that perfect agreement (100%) is neither expected nor necessary. What matters is that the level of agreement is high enough to demonstrate that the scoring system is reliable — that the result depends on the data, not on which examiner happened to score it. The 1997 review by Honts and Peterson reported accuracy of polygraph studies as exceeding.90, consistent with findings by Raskin and Podlesny (1979), helping establish the scientific consensus that properly conducted examinations achieve high accuracy [12]Verified Review of Polygraph Accuracy Research
Reported accuracy of polygraph studies as exceeding.90, helping establish scientific consensus on properly conducted examination accuracy..

Polygraph IRR vs. Other Diagnostic Fields

Inter-rater variability exists across all diagnostic fields. In radiology, peer review studies have shown that interrater agreement can be surprisingly low. A study of radiological error scoring at discrepancy meetings found Fleiss' kappa values ranging from 0.12 to 0.20, with a mean of 0.17 — classified as only slight agreement [13]Verified Interrater variation in scoring radiological discrepancies
Confirms radiologist interrater agreement was slight, with Fleiss' kappa values ranging from 0.12 to 0.20 in peer review scoring of errors.. In chest radiograph interpretation for community-acquired pneumonia, kappa for detecting infiltrates was 0.37, classified as only fair reliability [14]Verified Interobserver reliability of the chest radiograph in community-acquired pneumonia
Confirms chest X-ray interobserver agreement of 79.4% for infiltrate presence, with kappa of 0.37, classified as fair reliability.. A COVID-19 chest X-ray scoring study involving 14 radiologists achieved a Fleiss' kappa of 0.53, indicating moderate agreement [15]Verified Performance of Radiologists in the Evaluation of Chest Radiography with COVID-19 Score
Confirms Fleiss' kappa of 0.53 (moderate agreement) among 14 radiologists scoring chest X-rays..

By comparison, the Utah numerical scoring system for polygraph demonstrated inter-rater reliability correlations exceeding.90, with percent agreement on decisions exceeding 95% when both numerical evaluators reached a definite decision [16]Verified The Utah Numerical Scoring System
Confirms interrater reliability of the Utah system exceeded.90 and percent agreement on decisions exceeded 95% across five studies.. This favorable comparison illustrates that polygraph scoring with validated numerical systems achieves competitive or superior reliability compared to subjective interpretation in established medical diagnostic fields.

This context is important: polygraph peer review operates at reliability levels that meet or exceed many accepted diagnostic practices in medicine.

Factors That Affect Inter-Rater Reliability

Several factors influence how closely two examiners will agree when scoring the same charts:

Scoring algorithm used: Validated numerical scoring systems (like the ESS or the seven-position system) produce higher IRR than subjective global assessment methods [4]Verified Scientific Validity of Polygraph Testing: A Research Review and Evaluation
1983 OTA report to Congress confirming experienced examiners achieved 91.4% accuracy vs 77.5% for inexperienced examiners in the Horvath & Reid study.. The more structured and rule-based the scoring protocol, the more consistent the results. A replication study of the Empirical Scoring System found that even inexperienced examiners achieved a bootstrap mean accuracy of 87.9%, comparable to experienced scorers [17]Verified A Replication and Validation Study on an Empirically Based Manual Scoring System
Confirms ESS achieved 87.9% bootstrap mean accuracy and inter-scorer Kappa of.56; inexperienced examiners achieved accuracy comparable to experienced scorers..

Examiner training: Examiners trained at APA-accredited programs using standardized curricula show higher agreement than those trained informally. As the 1983 OTA report noted, experienced examiners achieved significantly higher accuracy rates than intern-level examiners [4]Verified Scientific Validity of Polygraph Testing: A Research Review and Evaluation
1983 OTA report to Congress confirming experienced examiners achieved 91.4% accuracy vs 77.5% for inexperienced examiners in the Horvath & Reid study.. Continuing education requirements help maintain scoring proficiency.

Chart quality: Clean, well-recorded charts with clear physiological reactions produce higher agreement. Poor sensor attachment, excessive artifact, or unstable baselines create ambiguity that different scorers may resolve differently. Using properly calibrated polygraph equipment is essential.

Test format: Some test formats consistently produce higher IRR than others. The number and type of comparison questions, relevant questions, and chart presentations all affect scoring consistency. Understanding sacrifice relevant questions and their role is important for consistent scoring.

Reaction clarity: Strong, unambiguous physiological reactions — clear respiratory suppression, large electrodermal responses, cardiovascular changes — produce near-perfect agreement. Subtle or mixed reactions are where disagreements occur.

Measuring IRR: Cohen's Kappa and Beyond

Simple percentage agreement is commonly reported, but statisticians recognize that it can overstate reliability because some agreement occurs by chance. Cohen's Kappa corrects for chance agreement and provides a more conservative estimate. Using the widely accepted Landis and Koch scale, a Kappa value above 0.80 is generally considered 'almost perfect' agreement, 0.61–0.80 is 'substantial,' 0.41–0.60 is 'moderate,' and below 0.40 indicates fair or lower agreement [13]Verified Interrater variation in scoring radiological discrepancies
Confirms radiologist interrater agreement was slight, with Fleiss' kappa values ranging from 0.12 to 0.20 in peer review scoring of errors..

The Utah numerical scoring system has demonstrated inter-rater reliability correlations exceeding.90 across five laboratory studies, with percent agreement on decisions exceeding 95% when both scorers reached definite decisions [16]Verified The Utah Numerical Scoring System
Confirms interrater reliability of the Utah system exceeded.90 and percent agreement on decisions exceeded 95% across five studies.. The ESS replication study by Blalock, Cushman, and Nelson (2009) found inter-scorer Kappa of.56, indicating moderate to good reliability, while achieving a bootstrap mean accuracy of 87.9% [17]Verified A Replication and Validation Study on an Empirically Based Manual Scoring System
Confirms ESS achieved 87.9% bootstrap mean accuracy and inter-scorer Kappa of.56; inexperienced examiners achieved accuracy comparable to experienced scorers.. A cross-cultural replication with 19 international trainees achieved a mean accuracy rate of 90.1% [18]Verified Empirical Scoring System: A Cross-Cultural Replication and Extension Study
Confirms 19 international trainees achieved mean accuracy of 90.1% (95% CI: 83.8%–95.8%) using ESS with 85% average decision agreement..

The APA meta-analytic survey confirmed these patterns at scale: analyzing 38 studies with 295 scorers providing 11,737 scored results, validated techniques produced overall decision accuracy of 87% (confidence interval 80%–94%) [8]Verified Meta-Analytic Survey of Criterion Accuracy of Validated Polygraph Techniques
Confirms APA meta-analysis analyzed 38 studies, 295 scorers, 11,737 scored results showing 89% accuracy for single-issue testing and 87% overall.. These data demonstrate that polygraph scoring systems, when properly applied, yield reliable and reproducible results.

APA Standards and Quality Assurance Requirements

The APA Standards of Practice require that member polygraph examiners use evidence-based validated testing techniques [8]Verified Meta-Analytic Survey of Criterion Accuracy of Validated Polygraph Techniques
Confirms APA meta-analysis analyzed 38 studies, 295 scorers, 11,737 scored results showing 89% accuracy for single-issue testing and 87% overall.. While peer review is not mandated for every single examination, it is strongly recommended as a quality assurance practice and is effectively required in several contexts:

PCSOT (Post-Conviction Sex Offender Testing): Treatment providers and supervision agencies commonly require peer review of examinations. For those entering this field, see our guide on how to become a certified PCSOT examiner. Research has shown that PCSOT reliably elicits increased disclosures, making quality control even more critical for supervision decisions [19]Verified Sex Offender Management Using the Polygraph: A Critical Review
Acknowledged PCSOT reliably elicits increased disclosures, calling the polygraph an effective 'truth facilitator.'.

Federal screening programs: Government agencies with polygraph programs typically maintain internal quality control divisions that review a substantial percentage of examinations.

Legal and evidentiary examinations: When polygraph results may be presented in court or used in legal proceedings, peer review is essential for establishing defensibility.

The APA Standards also require that examination records be maintained for a minimum of three (3) years, or as otherwise required by law, and that audio or audio-video recordings be maintained for a minimum of one (1) year [20]Verified APA Standards of Practice (Adopted August 23, 2019)
Confirms APA record retention requirement of minimum 3 years for exam records, 1 year for recordings, validated technique requirement, and 30-hour CE requirement.. These retention requirements ensure that peer review can be conducted even after the initial examination.

Complete Workflow

Step 1 — Preparation: The original examiner or quality control coordinator prepares a sanitized review packet. Charts are exported from the polygraph instrument software. All identifying case information is redacted for blind review.

Step 2 — Assignment: The review packet is sent to a qualified independent examiner. The reviewer should have no knowledge of the case, the examinee, or the original examiner's conclusions.

Step 3 — Independent Scoring: The reviewing examiner applies the same validated scoring algorithm (ESS, seven-position system, or other APA-approved method) to score each chart presentation independently. They calculate total scores and subtotal scores for each relevant question.

Step 4 — Independent Conclusion: Based on their scoring, the reviewer reaches an independent conclusion: NDI, DI, or Inconclusive. This conclusion is documented before the original result is revealed.

Step 5 — Comparison: The reviewer's conclusion is compared to the original examiner's conclusion. Agreement confirms the finding. Disagreement triggers the resolution process.

Step 6 — Resolution (if needed): When the original examiner and reviewer disagree, a third independent examiner is engaged. Consensus of two out of three determines the final call.

Step 7 — Documentation: The entire peer review process, including the reviewer's scores, conclusions, and any resolution, is documented and maintained as part of the examination file.

Blind vs. Informed Review

Blind review is the gold standard, where the reviewer receives only charts and test questions without knowing the original conclusion. This eliminates confirmation bias entirely.

Informed review involves the reviewer having access to some case information, including the original examiner's conclusion. While less rigorous, informed review is used in quality assurance contexts where the goal is to audit procedural compliance rather than independently verify the scoring outcome.

Administrative review focuses on procedural compliance — whether the correct test format was used, whether question construction followed guidelines, whether timing requirements were met, and whether the examination was conducted in accordance with APA Standards of Practice.

Random vs. Triggered Review

Random review involves selecting a percentage of examinations for peer review regardless of outcome. This approach provides ongoing quality monitoring and prevents examiners from only submitting clear-cut cases for review.

Triggered review occurs when specific conditions are met — for example, when a result is inconclusive, when an examinee disputes the outcome, when the examination will be used in legal proceedings, or when a training supervisor identifies potential issues. Many agencies combine both approaches for comprehensive quality assurance.

Qualifications for Reviewers

Effective peer reviewers must be qualified polygraph examiners with demonstrated proficiency in the scoring system used for the examination under review. Key qualifications include graduation from an APA-accredited polygraph training program, current certification and licensing (where applicable), proficiency in the specific scoring algorithm (ESS, seven-position system, etc.), and experience with the test format used (FZCT, Utah ZCT, Backster, etc.).

In federal programs, quality control reviewers are typically experienced examiners with advanced training in chart analysis. In the private sector, peer review may be performed by colleagues within the same organization or by external independent reviewers.

The British Psychological Society's 2004 assessment provided recommendations for standards across polygraph applications, reinforcing the importance of qualified review personnel [21]Verified A Review of the Current Scientific Status and Fields of Application of Polygraphic Deception Detection
Official UK scientific assessment by the British Psychological Society reviewing evidence base across multiple polygraph applications.. Organizations like the Georgia Polygraph Association also promote high standards for examiner competence.

Resolution Protocols

When the original examiner and reviewer disagree, a structured resolution process is triggered. The most common approach involves engaging a third independent examiner who also scores the charts blindly. Consensus of two out of three determines the final result.

Some protocols require the disagreeing examiners to confer and attempt to identify the source of disagreement before bringing in a third reviewer. Sources of disagreement may include ambiguous reaction patterns, differences in how scoring criteria were applied to borderline responses, chart quality issues, or differences in baseline interpretation.

Documenting the resolution process is critical. The final file should include the original examiner's scores and conclusion, the reviewer's scores and conclusion, the third examiner's scores and conclusion (if applicable), a brief description of the source of disagreement, and the final determination.

This transparent documentation strengthens the defensibility of the result, regardless of the outcome. A resolved disagreement that is fully documented is more defensible than an unreviewed examination. Understanding non-deceptive response patterns can help reviewers identify sources of scoring differences.

Scoring and Procedural Errors

Peer review regularly identifies several categories of errors:

Scoring errors: Mathematical miscalculations, incorrect application of decision rules, or inconsistent feature identification across chart presentations. The structured nature of the ESS and seven-position system helps minimize these, but human error remains possible.

Technique violations: Using non-validated question sequences, incorrect question spacing (the APA requires not less than 20 seconds from question onset to question onset [20]Verified APA Standards of Practice (Adopted August 23, 2019)
Confirms APA record retention requirement of minimum 3 years for exam records, 1 year for recordings, validated technique requirement, and 30-hour CE requirement.), or insufficient chart presentations.

Baseline issues: Failure to recognize unstable baselines, artifact contamination, or sensor malfunction that compromises data quality. Equipment calibration is essential — see our polygraph equipment guide.

Conclusion errors: Reaching a definitive conclusion when scores indicate an inconclusive result, or misapplying decision rules. The two-stage decision rules used with the ESS help prevent premature conclusions.

Documentation deficiencies: Incomplete records, missing chart presentations, inadequate question documentation, or failure to note deviations from validated protocols.

The Role of Computer Scoring

Modern polygraph instruments include computer-based scoring algorithms that can serve as an additional layer of review. These algorithms apply mathematical models to the physiological data and produce scores that can be compared to human scoring.

Computer scoring offers several advantages for peer review: it applies rules with perfect consistency (no fatigue or bias), it can process all channels simultaneously, and it provides a reproducible baseline against which human scoring can be compared. Research comparing the Objective Scoring System version 3 (OSS-3) to human scorers has demonstrated that computer algorithms achieve competitive accuracy [9]Verified Using the Empirical Scoring System
Describes the ESS procedures with validation data for 5,192 scored results of 732 confirmed examinations across 140 scorers in 16 cohorts..

However, computer scoring does not replace human peer review. Algorithms cannot assess chart quality, identify artifact, evaluate whether proper procedures were followed, or account for unusual physiological patterns that may require clinical judgment. The optimal approach combines both: human scoring reviewed by a peer examiner, with computer scoring as an additional reference point.

New technologies continue to emerge, including EyeDetect, though professional polygraph with peer review remains the most validated and defensible approach. Importantly, fake AI lie detector tests cannot replicate the rigor of professional polygraph with peer review.

Building a Peer Review Program

For individual examiners or small agencies establishing a peer review program, several practical considerations apply:

Establish reciprocal relationships with qualified examiners in your area or through professional associations. Many examiners form peer review agreements where they routinely review each other's work.

Use standardized review forms that document the reviewer's scores, conclusions, and any observations about chart quality or procedural compliance.

Maintain records of all peer reviews as part of the examination file. These records are invaluable if results are later challenged. The APA requires examination records to be maintained for a minimum of three years or as required by applicable law [20]Verified APA Standards of Practice (Adopted August 23, 2019)
Confirms APA record retention requirement of minimum 3 years for exam records, 1 year for recordings, validated technique requirement, and 30-hour CE requirement..

Consider implementing both random and triggered review protocols. Even reviewing a subset of cases provides valuable quality monitoring.

Invest in continuing education focused on chart analysis and scoring to keep peer review skills sharp. The APA requires 30 hours of continuing education every two years for practicing examiners [20]Verified APA Standards of Practice (Adopted August 23, 2019)
Confirms APA record retention requirement of minimum 3 years for exam records, 1 year for recordings, validated technique requirement, and 30-hour CE requirement..

The scientific foundation for these practices is well-established. Barland and Raskin's 1976 major review of laboratory and field studies established empirical support for polygraph validity and identified key factors affecting accuracy, providing the groundwork for modern quality standards [22]Verified Polygraph Validity and Reliability: A Review
Major review of laboratory and field studies establishing empirical support for polygraph validity and identifying key accuracy factors.. Raymond Nelson's comprehensive 2015 review of the scientific basis for polygraph testing confirmed that event-specific diagnostic polygraphs achieve mean accuracy of.89 with a 95% confidence range from.83 to.95 [23]Verified Scientific Basis for Polygraph Testing
Comprehensive review reporting event-specific diagnostic polygraph mean accuracy of.89 (95% CI:.83-.95) and multi-issue screening accuracy of.85..