HF detector
ner-ru-yqelz PII detection benchmark
Measured on 41 of 41 retained datasets under the same frozen scoring and masking protocol.
39.74%fully hidden annotations
49.75%detected / overlapped
9.17%extra masking
1,413CPU characters / second
Strengths
Highest complete-masking rates by normalized data type.
People's names74.27%48,819 / 65,736
Organizations65.64%12,651 / 19,274
Addresses & locations60.20%23,840 / 39,602
Watch list
Lowest observed complete-masking rates; inspect before deployment.
Customer & employee IDs0.81%65 / 7,994
Dates & times1.07%59 / 5,502
Phone numbers & email1.26%278 / 21,981
Language coverage
The overall leader can differ from the best choice for one language slice.
| Language | Datasets | Fully hidden ↑ | Detected ↑ | Extra masking ↓ |
|---|---|---|---|---|
| English | 17 | 43.79% | 51.08% | 9.18% |
| Russian | 19 | 36.52% | 47.88% | 9.35% |
| Multilingual | 5 | 45.12% | 53.59% | 4.15% |
Configuration, source and version
- Family
- HF
- Revision
- 4e03a3a079f5bfdb678eb9ee01235e25a7aef5f6
- Eligible datasets
- 41 / 41
- Character F1
- 0.445
- Untouched diagnostic
- 50.25% · 114,298 / 227,466
- Benchmark version
- 1.0.3 · 2026-09-09
- CPU seconds / 10k chars
- 7.077
- GPU seconds / 10k chars
- 0.177
Results by dataset
Complete masking is primary; detection shows whether any character overlapped.
| Dataset | Gold annotations | Fully hidden ↑ | Detected ↑ | Extra masking ↓ |
|---|---|---|---|---|
| synth-env-configs | 392 | 1.53% | 15.56% | 8.55% |
| arthur-passwords | 280 | 3.93% | 3.93% | 10.17% |
| rubai-ru | 3,458 | 4.51% | 56.28% | — |
| synth-secrets-ru | 581 | 5.16% | 9.29% | 13.91% |
| synth-secrets-en | 581 | 5.68% | 11.36% | 14.06% |
| leak-museum | 101 | 5.94% | 7.92% | 8.55% |
| synth-ru-tickets | 32,099 | 10.54% | 29.85% | — |
| leaky-repo | 95 | 13.68% | 18.95% | 14.58% |
| synth-wiki-tables | 13,094 | 14.42% | 18.24% | — |
| secrets-rules | 746 | 18.77% | 28.02% | 27.26% |
| corrupt-hivetrace | 1,667 | 19.56% | 33.23% | 5.19% |
| corrupt-secrets-issues | 288 | 19.79% | 33.68% | 7.56% |
| synth-jira-comments | 2,705 | 21.74% | 24.62% | — |
| privy | 1,899 | 23.49% | 34.39% | 1.94% |
| secrets-issues | 288 | 25.35% | 34.38% | 8.70% |
| alexen2 | 1,261 | 26.09% | 55.99% | 18.61% |
| hivetrace | 1,667 | 26.87% | 37.79% | 5.96% |
| nym-ru | 9,497 | 29.78% | 38.33% | — |
| gretel-multi | 4,484 | 29.88% | 47.26% | 4.21% |
| russian-pii-66k | 4,805 | 32.47% | 40.60% | — |
| corrupt-redmadrobot | 5,531 | 32.53% | 42.27% | 8.18% |
| nym-multi | 8,169 | 33.10% | 37.24% | 0.00% |
| nym-en | 3,584 | 38.48% | 42.24% | 4.79% |
| ameau01 | 2,242 | 38.76% | 42.69% | 12.88% |
| nemotron-pii | 9,391 | 40.52% | 46.81% | 14.58% |
| redmadrobot | 5,516 | 41.53% | 50.53% | 9.74% |
| creddata | 776 | 43.04% | 54.77% | 10.84% |
| scanpatch | 8,708 | 44.89% | 52.04% | 4.12% |
| redact-multi | 22,864 | 45.79% | 55.84% | — |
| redact-ru | 9,230 | 46.01% | 55.62% | 16.05% |
| kiji-multi | 7,565 | 49.76% | 52.20% | — |
| kiji-en | 7,623 | 51.65% | 55.06% | — |
| alrosait | 1,862 | 54.99% | 98.93% | 4.33% |
| tab-echr | 3,830 | 55.46% | 75.25% | — |
| dialogpii-multi | 10,345 | 56.33% | 65.28% | — |
| tonicai | 2,417 | 57.34% | 64.63% | 5.25% |
| dialogpii-en | 3,087 | 60.12% | 66.76% | 4.06% |
| jayguard | 1,195 | 60.33% | 82.59% | 6.22% |
| nerel | 24,369 | 69.29% | 74.06% | — |
| factrueval | 7,966 | 78.77% | 79.94% | — |
| multiconer-ru | 1,208 | 93.54% | 96.52% | 35.17% |