100.0%
field accuracy
0
invented values, in 0 of 3 conversations
100%
conversations finished
5.0
questions on average, vs a 25-field form
$0.0019
agent cost per conversation (+$0.0005 for the simulated customer)
What the numbers mean
- Correct: matches the owner's true fact, or left empty because the owner didn't know it.
- Invented: a field filled that the owner never could have stated: a fact they didn't know, or a question that doesn't apply to their business. In insurance a made-up answer can void a policy, so this matters more than accuracy.
- Wrong / missed: the owner knew it, and the agent recorded something else / nothing.
- Accuracy counts every field that applies to the business, except the free-text description. Simulated customers are easier than real people and occasionally state facts they were told they don't know, so the transcripts are published below to be read.
Sample conversations
- #1 · daycare, ID, rambling 100% · 4 questions
- #2 · restaurant, IL, typos 100% · 8 questions
Accuracy by field
| Field | Correct | Accuracy |
|---|---|---|
| Annual revenue | 3/3 | 100% |
| Business name | 3/3 | 100% |
| Deep fryers | 1/1 | 100% |
| Pool on premises | 1/1 | 100% |
| Industry | 3/3 | 100% |
| Licensed capacity (children) | 1/1 | 100% |
| Employees | 3/3 | 100% |
| Business vehicles | 3/3 | 100% |
| Offers delivery | 1/1 | 100% |
| Claims in last 3 years | 3/3 | 100% |
| Seats | 1/1 | 100% |
| Serves alcohol | 1/1 | 100% |
| State | 3/3 | 100% |
| State licensed | 1/1 | 100% |
| Transports children | 1/1 | 100% |
| Years in business | 3/3 | 100% |
By industry
| daycare | 100.0% |
| other | 100.0% |
| restaurant | 100.0% |
By speaking style
| many facts | 100.0% |
| rambling | 100.0% |
| typos | 100.0% |
Every conversation in run 1
Run history
| Run | Date | Note | Personas | Accuracy | Invented | Finished | Avg questions |
|---|---|---|---|---|---|---|---|
| 4 | 2026-11-08 | repeat of run 3, same code, to measure run-to-run variance | 50 | 99.3% | 0 | 90% | 7.5 |
| 3 | 2026-11-08 | after summary fixes (state names, hide industry other, classification hint) | 50 | 99.8% | 1 | 98% | 6.8 |
| 2 | 2026-11-08 | first full run | 50 | 98.9% | 0 | 78% | 10.8 |
| 1 | 2026-11-08 | smoke test | 3 | 100.0% | 0 | 100% | 5.0 |