OPF detector
apararti PII detection benchmark
Measured on 41 of 41 retained datasets under the same frozen scoring and masking protocol.
62.49%fully hidden annotations
70.23%detected / overlapped
11.16%extra masking
2,446CPU characters / second
Strengths
Highest complete-masking rates by normalized data type.
Dates & times92.44%5,086 / 5,502
Passwords, keys & tokens89.42%6,143 / 6,870
Phone numbers & email89.21%19,610 / 21,981
Watch list
Lowest observed complete-masking rates; inspect before deployment.
Organizations8.89%1,713 / 19,274
Other sensitive attributes15.53%498 / 3,207
Addresses & locations41.87%16,583 / 39,602
Language coverage
The overall leader can differ from the best choice for one language slice.
| Language | Datasets | Fully hidden ↑ | Detected ↑ | Extra masking ↓ |
|---|---|---|---|---|
| English | 17 | 69.08% | 72.31% | 11.73% |
| Russian | 19 | 60.43% | 70.32% | 10.25% |
| Multilingual | 5 | 63.09% | 68.55% | 1.57% |
Configuration, source and version
- Family
- OPF
- Revision
- a1650a1927ed8aceb9e15fa8ed13ffdf60cbf107
- Eligible datasets
- 41 / 41
- Character F1
- 0.658
- Untouched diagnostic
- 29.77% · 67,711 / 227,466
- Benchmark version
- 1.0.3 · 2026-09-09
- CPU seconds / 10k chars
- 4.088
- GPU seconds / 10k chars
- 1.685
Results by dataset
Complete masking is primary; detection shows whether any character overlapped.
| Dataset | Gold annotations | Fully hidden ↑ | Detected ↑ | Extra masking ↓ |
|---|---|---|---|---|
| multiconer-ru | 1,208 | 4.72% | 8.86% | 3.48% |
| rubai-ru | 3,458 | 5.81% | 94.94% | — |
| nerel | 24,369 | 19.49% | 22.89% | — |
| alexen2 | 1,261 | 22.05% | 92.62% | 11.20% |
| factrueval | 7,966 | 25.78% | 26.54% | — |
| tab-echr | 3,830 | 26.37% | 28.85% | — |
| dialogpii-multi | 10,345 | 30.81% | 38.23% | — |
| jayguard | 1,195 | 48.54% | 61.67% | 3.09% |
| dialogpii-en | 3,087 | 51.96% | 56.79% | 9.13% |
| ameau01 | 2,242 | 57.76% | 59.95% | 3.96% |
| tonicai | 2,417 | 59.33% | 62.72% | 0.36% |
| corrupt-redmadrobot | 5,531 | 60.91% | 72.92% | 3.62% |
| synth-jira-comments | 2,705 | 63.59% | 75.12% | — |
| gretel-multi | 4,484 | 65.66% | 73.19% | 1.54% |
| alrosait | 1,862 | 68.15% | 89.63% | 6.25% |
| redact-multi | 22,864 | 68.32% | 74.10% | — |
| privy | 1,899 | 69.25% | 75.57% | 10.42% |
| leaky-repo | 95 | 70.53% | 84.21% | 4.00% |
| redmadrobot | 5,516 | 71.23% | 78.21% | 2.48% |
| nemotron-pii | 9,391 | 72.40% | 74.90% | 2.55% |
| corrupt-secrets-issues | 288 | 72.92% | 97.22% | 7.81% |
| leak-museum | 101 | 74.26% | 75.25% | 3.59% |
| scanpatch | 8,708 | 74.44% | 81.14% | 2.32% |
| secrets-issues | 288 | 74.65% | 97.92% | 6.67% |
| kiji-multi | 7,565 | 75.97% | 77.75% | — |
| nym-multi | 8,169 | 76.02% | 80.34% | 3.93% |
| synth-ru-tickets | 32,099 | 76.16% | 86.81% | — |
| redact-ru | 9,230 | 77.54% | 83.15% | 12.88% |
| synth-env-configs | 392 | 78.32% | 99.23% | 21.29% |
| corrupt-hivetrace | 1,667 | 80.38% | 90.16% | 4.87% |
| nym-ru | 9,497 | 81.98% | 88.45% | — |
| synth-wiki-tables | 13,094 | 81.98% | 90.68% | — |
| nym-en | 3,584 | 82.06% | 85.38% | 2.47% |
| kiji-en | 7,623 | 84.77% | 85.39% | — |
| synth-secrets-en | 581 | 87.95% | 97.07% | 50.54% |
| russian-pii-66k | 4,805 | 88.53% | 91.05% | — |
| hivetrace | 1,667 | 89.74% | 93.52% | 1.53% |
| synth-secrets-ru | 581 | 91.74% | 99.31% | 52.15% |
| creddata | 776 | 94.20% | 97.55% | 6.62% |
| arthur-passwords | 280 | 98.57% | 98.57% | 15.27% |
| secrets-rules | 746 | 98.79% | 99.60% | 54.66% |