HF detector
ner-ru-gherman PII detection benchmark
Measured on 41 of 41 retained datasets under the same frozen scoring and masking protocol.
27.63%fully hidden annotations
48.78%detected / overlapped
0.28%extra masking
4,026CPU characters / second
Strengths
Highest complete-masking rates by normalized data type.
People's names58.61%38,527 / 65,736
Addresses & locations52.98%20,980 / 39,602
Logins & usernames20.55%2,339 / 11,382
Watch list
Lowest observed complete-masking rates; inspect before deployment.
Network identifiers0.00%0 / 25,631
Dates & times0.02%1 / 5,502
Phone numbers & email0.03%7 / 21,981
Language coverage
The overall leader can differ from the best choice for one language slice.
| Language | Datasets | Fully hidden ↑ | Detected ↑ | Extra masking ↓ |
|---|---|---|---|---|
| English | 17 | 31.65% | 43.80% | 0.18% |
| Russian | 19 | 23.06% | 47.84% | 0.51% |
| Multilingual | 5 | 36.44% | 54.70% | 0.08% |
Configuration, source and version
- Family
- HF
- Revision
- fc6b2c5a2c5d7c82da7416f7fd9c055159bbb984
- Eligible datasets
- 41 / 41
- Character F1
- 0.453
- Untouched diagnostic
- 51.22% · 116,497 / 227,466
- Benchmark version
- 1.0.3 · 2026-09-09
- CPU seconds / 10k chars
- 2.484
- GPU seconds / 10k chars
- 0.150
Results by dataset
Complete masking is primary; detection shows whether any character overlapped.
| Dataset | Gold annotations | Fully hidden ↑ | Detected ↑ | Extra masking ↓ |
|---|---|---|---|---|
| corrupt-secrets-issues | 288 | 0.00% | 0.00% | 0.10% |
| creddata | 776 | 0.00% | 0.00% | 0.06% |
| leak-museum | 101 | 0.00% | 0.00% | 0.09% |
| leaky-repo | 95 | 0.00% | 0.00% | 0.03% |
| secrets-issues | 288 | 0.00% | 0.00% | 0.11% |
| synth-secrets-en | 581 | 0.00% | 0.00% | 0.01% |
| synth-secrets-ru | 581 | 0.00% | 0.00% | 0.00% |
| secrets-rules | 746 | 0.13% | 0.13% | 0.13% |
| synth-env-configs | 392 | 0.26% | 0.26% | 0.13% |
| hivetrace | 1,667 | 0.90% | 30.29% | 0.11% |
| arthur-passwords | 280 | 1.07% | 1.07% | 4.13% |
| corrupt-hivetrace | 1,667 | 1.44% | 27.65% | 0.38% |
| rubai-ru | 3,458 | 1.76% | 55.32% | — |
| alrosait | 1,862 | 1.77% | 96.19% | 2.51% |
| synth-jira-comments | 2,705 | 2.26% | 27.02% | — |
| synth-wiki-tables | 13,094 | 3.89% | 39.12% | — |
| synth-ru-tickets | 32,099 | 4.66% | 27.19% | — |
| alexen2 | 1,261 | 4.76% | 52.18% | 9.53% |
| multiconer-ru | 1,208 | 10.18% | 30.79% | 1.52% |
| ameau01 | 2,242 | 10.48% | 29.79% | 0.07% |
| gretel-multi | 4,484 | 13.20% | 52.45% | 0.08% |
| tab-echr | 3,830 | 15.20% | 56.06% | — |
| privy | 1,899 | 20.59% | 34.60% | 0.10% |
| nym-ru | 9,497 | 25.38% | 37.85% | — |
| nym-multi | 8,169 | 27.14% | 33.14% | 0.00% |
| russian-pii-66k | 4,805 | 28.95% | 42.12% | — |
| nym-en | 3,584 | 29.24% | 37.08% | 0.14% |
| corrupt-redmadrobot | 5,531 | 30.65% | 39.63% | 0.27% |
| nemotron-pii | 9,391 | 31.91% | 39.83% | 0.00% |
| redact-ru | 9,230 | 32.86% | 60.46% | 3.79% |
| redmadrobot | 5,516 | 34.97% | 44.29% | 0.19% |
| scanpatch | 8,708 | 36.15% | 58.41% | 0.51% |
| redact-multi | 22,864 | 36.48% | 60.13% | — |
| jayguard | 1,195 | 37.15% | 79.00% | 0.88% |
| tonicai | 2,417 | 38.85% | 49.86% | 0.08% |
| nerel | 24,369 | 39.95% | 72.24% | — |
| dialogpii-multi | 10,345 | 40.02% | 56.25% | — |
| dialogpii-en | 3,087 | 46.10% | 65.89% | 2.07% |
| kiji-multi | 7,565 | 55.27% | 60.81% | — |
| kiji-en | 7,623 | 56.25% | 61.56% | — |
| factrueval | 7,966 | 66.43% | 69.23% | — |