ONNX detector
bardsai-eu PII detection benchmark
Measured on 41 of 41 retained datasets under the same frozen scoring and masking protocol.
66.62%fully hidden annotations
81.37%detected / overlapped
7.72%extra masking
—CPU characters / second
Strengths
Highest complete-masking rates by normalized data type.
People's names90.73%59,642 / 65,736
Logins & usernames80.01%9,107 / 11,382
Addresses & locations75.76%30,002 / 39,602
Watch list
Lowest observed complete-masking rates; inspect before deployment.
Network identifiers10.62%2,721 / 25,631
Other sensitive attributes39.51%1,267 / 3,207
Phone numbers & email43.27%9,511 / 21,981
Language coverage
The overall leader can differ from the best choice for one language slice.
| Language | Datasets | Fully hidden ↑ | Detected ↑ | Extra masking ↓ |
|---|---|---|---|---|
| English | 17 | 71.87% | 84.39% | 8.72% |
| Russian | 19 | 61.12% | 78.19% | 5.61% |
| Multilingual | 5 | 76.97% | 87.36% | 2.07% |
Configuration, source and version
- Family
- ONNX
- Revision
- 0e72e19f030ed4e661b1673e549af8e0dd176386
- Eligible datasets
- 41 / 41
- Character F1
- 0.703
- Untouched diagnostic
- 18.63% · 42,383 / 227,466
- Benchmark version
- 1.0.3 · 2026-09-09
- CPU seconds / 10k chars
- Not measured
- GPU seconds / 10k chars
- Not measured
Results by dataset
Complete masking is primary; detection shows whether any character overlapped.
| Dataset | Gold annotations | Fully hidden ↑ | Detected ↑ | Extra masking ↓ |
|---|---|---|---|---|
| rubai-ru | 3,458 | 18.16% | 94.82% | — |
| multiconer-ru | 1,208 | 22.02% | 30.05% | 3.61% |
| alexen2 | 1,261 | 26.33% | 92.94% | 11.46% |
| leak-museum | 101 | 26.73% | 38.61% | 4.46% |
| privy | 1,899 | 35.02% | 48.87% | 6.10% |
| synth-ru-tickets | 32,099 | 35.09% | 55.52% | — |
| ameau01 | 2,242 | 44.69% | 54.82% | 3.27% |
| synth-jira-comments | 2,705 | 44.81% | 60.96% | — |
| synth-wiki-tables | 13,094 | 45.60% | 81.84% | — |
| corrupt-redmadrobot | 5,531 | 53.34% | 64.71% | 1.15% |
| tonicai | 2,417 | 53.58% | 69.47% | 0.25% |
| leaky-repo | 95 | 53.68% | 78.95% | 2.32% |
| synth-env-configs | 392 | 56.89% | 89.80% | 23.30% |
| corrupt-hivetrace | 1,667 | 59.51% | 80.26% | 0.25% |
| redmadrobot | 5,516 | 62.89% | 73.97% | 1.84% |
| creddata | 776 | 64.56% | 75.77% | 6.15% |
| dialogpii-multi | 10,345 | 64.74% | 77.06% | — |
| tab-echr | 3,830 | 65.46% | 86.55% | — |
| alrosait | 1,862 | 65.95% | 97.10% | 5.33% |
| gretel-multi | 4,484 | 66.57% | 81.51% | 2.09% |
| hivetrace | 1,667 | 67.07% | 85.54% | 0.31% |
| jayguard | 1,195 | 68.95% | 82.85% | 2.20% |
| synth-secrets-ru | 581 | 70.22% | 90.53% | 28.24% |
| corrupt-secrets-issues | 288 | 70.83% | 94.44% | 5.73% |
| dialogpii-en | 3,087 | 71.66% | 82.93% | 5.86% |
| secrets-issues | 288 | 72.57% | 95.49% | 5.97% |
| scanpatch | 8,708 | 72.58% | 81.73% | 1.26% |
| nym-en | 3,584 | 73.47% | 83.04% | 0.39% |
| synth-secrets-en | 581 | 73.49% | 92.94% | 27.99% |
| nym-ru | 9,497 | 74.20% | 86.10% | — |
| nym-multi | 8,169 | 76.80% | 84.43% | 0.94% |
| redact-ru | 9,230 | 77.83% | 92.13% | 9.64% |
| nemotron-pii | 9,391 | 78.42% | 92.39% | 6.68% |
| redact-multi | 22,864 | 79.98% | 91.65% | — |
| russian-pii-66k | 4,805 | 81.58% | 96.57% | — |
| secrets-rules | 746 | 82.17% | 90.21% | 37.30% |
| nerel | 24,369 | 85.55% | 90.18% | — |
| kiji-en | 7,623 | 89.69% | 95.82% | — |
| kiji-multi | 7,565 | 90.96% | 95.14% | — |
| factrueval | 7,966 | 92.96% | 94.15% | — |
| arthur-passwords | 280 | 95.00% | 95.00% | 14.53% |