API v0 · Pilot phase
Understanding results
Synthesis, agreement and confidence
How the combined answer is built, what agreement and confidence measure, and what they don't.
When a request completes, Synquery adds a synthesis: answer, a per-field summary, agreement, clusters, disagreement_summary and confidence.
How it is built
The synthesis is generated by a model from the expert responses on that request only. It uses no outside sources and adds no figures the experts didn't give. Numeric summaries are calculated from the experts' values, which may themselves be estimates.
Incompatible answers are kept apart
Interviewers, AI or human, check that experts answer the same question with the same scope, such as the same denominator, and ask when they don't. If a mismatch still reaches the synthesis, the answers are not blended: the summary separates them, warnings names the mismatch and disagreement_summary explains it.
Agreement
agreement counts how many experts agree on the first numeric or range field in your answer_fields, or on the first choice field if there is none. It is null when there is neither.
Confidence
Confidence measures agreement within this panel and how relevant the experts' experience is to the question. It does not measure factual accuracy. The rules apply in order, and the first that matches wins:
- low if fewer than half the included experts agree, or more than half the answers are estimates or reused;
- high if at least 80% agree and at least half the answers are first-hand and from the last 2 years;
- otherwise medium.
A request with no numeric or choice field gets its confidence from basis and recency alone.
Where disagreement comes from
disagreement_source is stated when experts gave the reason themselves, and inferred when the model inferred it from their answers.
Synthesis fields
null while the request is pending.
low / high for numeric and range fields, top for lists, counts for choices; each with n (answers included), received (answers given) and basis where numeric.{"agreeing": n, "total": n, "on": field}. How many experts agree on the first numeric or range field in your answer_fields, or on the first choice field if there is none; null when there is neither.null if all agree.stated (experts gave the reason) or inferred (the model inferred it).high, medium or low. See Synthesis, agreement and confidence.responses[].fields, built from your answer_fields; every property is nullable.Next
Evidence and transcripts →