OPF detector
opf-ru PII detection benchmark
Measured on 40 of 41 retained datasets under the same frozen scoring and masking protocol.
49.51%fully hidden annotations
66.49%detected / overlapped
9.41%extra masking
2,839CPU characters / second
Strengths
Highest complete-masking rates by normalized data type.
Passwords, keys & tokens85.87%5,733 / 6,676
Logins & usernames85.03%9,414 / 11,071
Phone numbers & email76.35%16,176 / 21,188
Watch list
Lowest observed complete-masking rates; inspect before deployment.
Network identifiers1.96%502 / 25,631
Organizations8.88%1,711 / 19,274
Other sensitive attributes12.35%396 / 3,207
Language coverage
The overall leader can differ from the best choice for one language slice.
| Language | Datasets | Fully hidden ↑ | Detected ↑ | Extra masking ↓ |
|---|---|---|---|---|
| English | 17 | 59.39% | 68.63% | 10.24% |
| Russian | 18 | 43.33% | 63.41% | 7.88% |
| Multilingual | 5 | 57.79% | 72.57% | 0.62% |
Configuration, source and version
- Family
- OPF
- Revision
- ae813a5aaeb31def75e87064818f0b1fbc65e31f
- Eligible datasets
- 40 / 41
- Character F1
- 0.595
- Untouched diagnostic
- 33.51% · 74,621 / 222,661
- Benchmark version
- 1.0.3 · 2026-09-09
- CPU seconds / 10k chars
- 3.522
- GPU seconds / 10k chars
- 1.118
source overlap: russian-pii-66k
Results by dataset
Complete masking is primary; detection shows whether any character overlapped.
| Dataset | Gold annotations | Fully hidden ↑ | Detected ↑ | Extra masking ↓ |
|---|---|---|---|---|
| rubai-ru | 3,458 | 5.64% | 97.60% | — |
| multiconer-ru | 1,208 | 6.13% | 20.36% | 3.07% |
| tab-echr | 3,830 | 19.61% | 27.05% | — |
| alexen2 | 1,261 | 23.47% | 95.72% | 11.46% |
| nerel | 24,369 | 29.58% | 37.72% | — |
| synth-ru-tickets | 32,099 | 34.56% | 56.78% | — |
| factrueval | 7,966 | 36.35% | 38.24% | — |
| corrupt-redmadrobot | 5,531 | 42.27% | 65.12% | 5.95% |
| dialogpii-multi | 10,345 | 44.62% | 59.58% | — |
| dialogpii-en | 3,087 | 45.19% | 56.30% | 10.26% |
| alrosait | 1,862 | 45.60% | 98.82% | 5.41% |
| jayguard | 1,195 | 49.04% | 73.22% | 3.32% |
| synth-wiki-tables | 13,094 | 49.77% | 75.36% | — |
| ameau01 | 2,242 | 50.22% | 60.17% | 3.25% |
| synth-jira-comments | 2,705 | 51.68% | 68.39% | — |
| gretel-multi | 4,484 | 51.90% | 74.11% | 0.55% |
| redmadrobot | 5,516 | 52.83% | 71.57% | 1.85% |
| scanpatch | 8,708 | 54.67% | 76.53% | 2.73% |
| redact-multi | 22,864 | 58.26% | 74.80% | — |
| tonicai | 2,417 | 59.45% | 63.14% | 0.27% |
| privy | 1,899 | 59.87% | 74.72% | 11.62% |
| nemotron-pii | 9,391 | 62.40% | 72.02% | 1.76% |
| redact-ru | 9,230 | 63.13% | 80.44% | 8.88% |
| corrupt-hivetrace | 1,667 | 63.53% | 91.24% | 9.48% |
| nym-en | 3,584 | 65.71% | 77.43% | 4.45% |
| kiji-multi | 7,565 | 66.72% | 74.63% | — |
| synth-env-configs | 392 | 67.35% | 99.49% | 23.09% |
| nym-multi | 8,169 | 68.10% | 80.01% | 5.24% |
| kiji-en | 7,623 | 69.15% | 75.30% | — |
| corrupt-secrets-issues | 288 | 70.83% | 97.57% | 8.62% |
| secrets-issues | 288 | 72.92% | 98.26% | 5.85% |
| nym-ru | 9,497 | 75.66% | 88.46% | — |
| leak-museum | 101 | 77.23% | 85.15% | 4.79% |
| synth-secrets-en | 581 | 77.45% | 98.28% | 29.14% |
| synth-secrets-ru | 581 | 79.69% | 99.83% | 31.14% |
| leaky-repo | 95 | 80.00% | 91.58% | 3.32% |
| hivetrace | 1,667 | 82.00% | 95.02% | 1.42% |
| creddata | 776 | 92.65% | 97.04% | 4.90% |
| secrets-rules | 746 | 98.39% | 99.60% | 49.17% |
| arthur-passwords | 280 | 98.93% | 98.93% | 13.19% |