ooligo
claude-skill

Screen interview records for identity and answer-provenance fraud

Difficulty
advanced
Setup time
90min
For
recruiter · talent-acquisition · recruiting-engineer
Recruiting & TA

Stack

A Claude Skill that reads interview transcripts and the loop metadata your ATS already holds, and returns a per-candidate corroboration report: what the record confirms, what it contradicts, and which specific questions remain open. Flagged candidates go to a live verification step. They do not go to a rejection — the skill has no output field that can carry one, and the arithmetic in the next section is why.

It never touches the video file. No face geometry, no voiceprint, no blink rate, no affect scoring. That constraint is the design, not a limitation of it.

The number that decides the design

A fraud screen lives or dies on its base rate. With a prior of 2% fraudulent candidates reaching a live loop, a screen catching 80% of them at a 5% false-positive rate produces a 24.6% chance that any given flag is real. Three flags in four are innocent people. Raise the prior to 10% and the same screen reaches 64% — still not a number that rejects anyone.

So the skill routes flags to verification and stops there. A structured 45-minute follow-up resolves most of them, and the outcome of that conversation — not the score — is what reaches the hiring decision. This also keeps the workflow clear of automated-decision-system framing under NYC Local Law 144 and California’s FEHA ADS regulations, and it narrows the FCRA question: the CFPB’s Circular 2024-06 places third-party algorithmic scores about workers used for employment decisions inside the FCRA, with consent, disclosure, and pre-adverse-action duties attached. An in-house screen gating a conversation sits somewhere different from a purchased score gating an offer. The skill prints that as a counsel question rather than answering it.

When to use

  • A fully-remote req where the loop is the only thing standing between an applicant and production credentials.
  • Roles that ship equipment before day one. The address on the shipping label diverging from the address on the identity document is the cheapest signal on the list and nobody looks at it.
  • A candidate whose written work and live answers read as two different people, and the recruiter cannot say why.
  • Security or IT reqs at companies inside the DPRK IT-worker threat surface. The UN Panel of Experts estimate puts that program’s annual revenue at $250-600 million, and CrowdStrike has reported North Korean actors posing as insiders at more than 100 primarily US technology companies.

When NOT to use

  • To reject anyone. See the arithmetic above. A 24.6% posterior that ends a candidacy is a screen that discriminates against the innocent majority of the people it flags.
  • As media forensics. Deepfake detectors collapse out of distribution. Cross-dataset benchmarks show a detector at 0.998 AUC on its training distribution falling to 0.674 on an unseen dataset and 0.633 on Celeb-DF. The adversary picks the generator. A detector you cannot benchmark against the generator actually in use returns a number, not a control.
  • To infer emotion, stress, or honesty. EU AI Act Article 5(1)(f) prohibits inferring emotions of a natural person in the workplace from biometric data, and the Commission’s February 2025 guidelines on prohibited practices read “workplace” to cover candidates during selection and hiring. Penalties reach €35 million or 7% of worldwide annual turnover. Demeanor-based deception detection is also unsupported, so the ban costs nothing.
  • Where AI assistance is permitted. Decide the policy first and publish it. ai_use_policy defaults to prohibited so that turning the answer-provenance class off is a deliberate act — but if nothing is published, the honest setting is permitted, because you cannot screen against an unstated rule.
  • Retroactively, across a closed pipeline. Running this over last year’s rejected applicants builds a file of unadjudicated accusations against named people, discoverable in any later charge, with no verification step available to clear anyone in it.
  • On in-person loops. Identity substitution and live assistance both need the remote channel. An onsite final round is the stronger control and needs no skill at all.

Setup

  1. Drop the bundle at apps/web/public/artifacts/ai-interview-fraud-detection-skill/SKILL.md into your skills directory with references/ alongside.
  2. Set the parameters in references/1-signal-taxonomy.md §0. base_rate comes from your own confirmed cases over the last 12 months; with none, keep 0.02 and read every posterior as an upper bound. The file carries a checked: date and a 90-day review cadence.
  3. Fill the intake in references/2-interview-record-intake.md. Section A wants utterance timestamps — mark NO_TIMESTAMPS where you lack them so the skill reports the answer-provenance class as unavailable instead of scoring it on nothing.
  4. Answer Section E before the first run. Five consent and notice prerequisites; a NO halts the run. The row that fails most is the written camera policy, and without it the skill scores nothing on camera reluctance.
  5. Check verification capacity in Section F. Flags are a capacity number, not a quality signal: 100 loops per month at a 2% prior and 5% false-positive rate yields about 6.5 flags, of which 1.6 are real. Negative headroom means tighten the taxonomy before running, not after the queue backs up.

What the skill actually does

Six steps. Two structural choices carry the design.

Two passes, and the extractor never sees the taxonomy. Pass one pulls the claim ledger, per-answer latency numbers, and register descriptions with no fraud vocabulary anywhere in its context. Pass two scores those facts against the taxonomy. A single primed pass manufactures what it was told to find — every pause becomes evasion once the model knows it is hunting evasion. The split costs one extra call per candidate.

The blocklist is enforced at output. Step 4 drops accent, non-native phrasing, name origin, home background, webcam and bandwidth quality, virtual-background use, timezone alone, and employment gaps. Each correlates with national origin, race, disability, or socioeconomic status, and each is the exact route by which a fraud screen becomes an AI screening bias claim. Dropped signals print in the report, so the exclusion is auditable rather than assumed.

Between those, step 1 refuses to run on consent-gated biometric artifacts without a cited consent record — voiceprints and face-geometry exports arrive attached to vendor exports, and Illinois BIPA carries statutory damages of $1,000 for negligent and $5,000 for reckless or intentional violations per person. SB 2979, signed 2 August 2024, narrowed that to a single recovery per person per collection method, and the Seventh Circuit held on 1 April 2026 that the narrowing applies retroactively. The exposure is smaller than it was and it is not zero. Strip, do not analyze.

Step 5 converts priority to a posterior and orders the queue by posterior times role risk, where role risk is day-one access rather than seniority. Step 6 prints contradictions with both the loop quote and the conflicting claim verbatim, so the reader sees evidence instead of a conclusion.

Cost reality

  • Per loop — a four-round loop of 45-minute interviews runs 40-55k input tokens of transcript plus about 8k of reference files, and 3-5k output across two passes. At Claude Sonnet list rates ($3 per million input, $15 per million output) that is $0.20-0.35 per candidate. Estimate, from token counts of transcripts at that length.
  • At volume — 100 loops a month lands at $20-35 in model spend. The cost that matters is the verification step: 6-7 structured 45-minute follow-ups per month, plus interviewer prep, is roughly 8-10 hours of loaded interviewer time.
  • Setup — 90 minutes to configure, honest only if your ATS already exports transcripts with timestamps. Teams wiring transcript capture for the first time spend a day or more, and the interview intelligence layer is the prerequisite.
  • What it does not save — the in-person round. For a HIGH-risk role with a posterior above 20%, travel costs less than the alternative and resolves all three fraud classes at once.

Success metric

  • Flag volume tracking the predicted rate. If a 2% prior predicts 6.5 flags and you get 30, the taxonomy is mis-tuned, not the pipeline compromised.
  • Every flag closed with a recorded outcome. The decision log in references/3-verification-playbook.md §4 has no partial state. An open flag on a candidate declined for unrelated reasons is the worst record to hold.
  • RESOLVED share above 70%. Most flags should clear at verification. A lower share means the screen is firing on noise.
  • Zero excluded-signal appearances in reports. A deterministic check that should never fire.

vs alternatives

  • vs real-time deepfake detection vendors. Pindrop, Reality Defender, and the detection layers now embedded in conferencing platforms work on the media stream, which this skill deliberately does not. Complementary, not redundant — and worth buying only from a vendor who will state their benchmark set, given the cross-dataset numbers above. They verify the pixels. They do not verify that the person answering knows what they claimed on the resume.
  • vs identity-verification vendors. Document-plus-liveness checks at offer stage are the right control for class A, and you likely already run something like Checkr adjacent to it. They verify who signed. They do not verify who does the work from week two, which is where the laptop-farm pattern lives.
  • vs proctoring and lockdown browsers. Cheaper to buy, worse to run. They push the loop toward surveillance, penalize candidates on shared connections and assistive technology, and resolve less than one well-run depth follow-up.
  • vs a technical assessment platform. Karat and similar run live human interviews that structurally resist both proxy and copilot assistance. Where budget allows, this is a stronger answer than any screen — the skill is for the rounds you run yourself.
  • vs the status quo. Untrained humans detect synthetic media at close to chance. The realistic status quo is not “recruiters catch it” but “nobody looks,” and the marginal cost of looking is $0.30 a candidate.

Watch-outs

  • A flag read as a finding. Guard: every flag prints its posterior with the inputs beside it, and no output field is a rejection ground.
  • Confirmation bias from a primed extractor. Guard: pass one runs with no fraud vocabulary in context; the taxonomy loads only in pass two.
  • Proxy discrimination through demeanor. Guard: the §4 blocklist is enforced at output and dropped signals are printed.
  • Camera reluctance scored against an accommodation need. Guard: the signal scores only where a written uniform policy and an offered accommodation path both exist; otherwise the skill reports the policy gap instead of the candidate.
  • Biometric artifacts arriving with the export. Guard: step 1 halts on consent-gated material without a cited consent record.
  • Verification capacity overrun. Guard: expected monthly flag volume prints before the first run, and the queue orders by posterior times role risk so the tail is what waits.
  • The report becomes discovery material. Guard: the playbook’s decision log closes each flag explicitly, and §6 publishes candidate-facing notice before the first run rather than after the first flag.

Stack

The bundle lives at apps/web/public/artifacts/ai-interview-fraud-detection-skill/ and contains:

  • SKILL.md — the skill definition
  • references/1-signal-taxonomy.md — four signal classes with weights and false-positive estimates, the excluded-signals blocklist, and the base-rate parameters
  • references/2-interview-record-intake.md — fillable intake with a lawful-basis column per field
  • references/3-verification-playbook.md — verification methods, the live re-verification protocol, the decision log, and candidate-notice scaffolding

Assumes Claude for the run, an ATS such as Greenhouse for the process facts, and a transcript source — Metaview or equivalent — for section A.

Pairs with Audit an AI interviewing stack against US employment-AI rules, which covers disclosure and configuration duties rather than the record itself.

Related reading: structured interviewing, AI screening bias, candidate experience, AI policy for recruiting teams, interview intelligence.

Files in this artifact

Download all (.zip)