Kernsignal

Synthetic Panel Audit ยท API example

Which synthetic answers can you use?

The audit compares a synthetic panel with human answers, question by question, and sorts every question into use, spot-check or field. This page is a finished report on a public panel.

Use synthetic17 of 87 questions scored
Spot-check with humans23 of 87 questions scored
Field with humans47 of 87 questions scored
Open the full report Download the PDF Questions as CSV
The data. 2,058 real respondents against 2,058 GPT-4.1-mini synthetic respondents (Twin-2K-500). 87 questions scored.

The three riskiest questions

  1. Please rate the following technology or products from "not at all risky" to "extremely risky" - bicycles
    Observed gap 0.70 exceeds the 0.15 threshold even after allowing 0.04 for sampling noise (n=2058 human, 2058 synthetic).
  2. Would you support or oppose... - Offering seniors healthcare vouchers to purchase private healthcare plans in place of traditional medicare coverage?
    Observed gap 0.70 exceeds the 0.15 threshold even after allowing 0.04 for sampling noise (n=2058 human, 2058 synthetic).
  3. Imagine that the U.S. is preparing for the outbreak of an unusual disease, which is expected to kill 600 people. Two alternative programs to combat the disease have been proposed. Assume that the exact scientific estimate of the consequences of the programs are as follows: If Program A is adopted, 200 people will be saved. If Program B is adopted, there is 1/3 probability that 600 people will be saved, and 2/3 probability that no people will be saved. Which of the two programs would you favor?
    Observed gap 0.68 exceeds the 0.15 threshold even after allowing 0.05 for sampling noise (n=1003 human, 1003 synthetic).

The call behind it

Upload the two files, poll until the job succeeds, then download the report. Replace the placeholder with your own test key, which is never billed; its results are removed from the live system 24 hours after creation.

curl -X POST https://api.kernsignal.ai/v1/audits \
  -H "Authorization: Bearer ks_test_YOUR_API_KEY" \
  -F synthetic_file=@synthetic.csv \
  -F human_file=@human.csv \
  -F 'config={"subgroups": ["gender", "age_band"], "seed": 7}'

curl -H "Authorization: Bearer ks_test_YOUR_API_KEY" \
  https://api.kernsignal.ai/v1/audits/aud_...

curl -H "Authorization: Bearer ks_test_YOUR_API_KEY" \
  -o report.pdf https://api.kernsignal.ai/v1/audits/aud_.../report.pdf

Uploaded files are processed in memory and never stored. Live results are kept for 30 days. DELETE /v1/audits/<id> removes a result from the live system immediately; nightly backups hold it for up to 14 days. Verification records persist until revoked.

Data: Twin-2K-500 (LLM-Digital-Twin, Hugging Face), licence CC BY 4.0, revision f883165a; human answers and GPT-4.1-mini simulation outputs as published. To request a test key, write to hello@kernsignal.ai.