GLINER detector
gliner-multi-v21-ru PII detection benchmark
Measured on 19 of 41 retained datasets under the same frozen scoring and masking protocol.
43.02%fully hidden annotations
52.58%detected / overlapped
1.60%extra masking
1,491CPU characters / second
Strengths
Highest complete-masking rates by normalized data type.
People's names66.71%22,637 / 33,934
Organizations59.18%6,691 / 11,306
Logins & usernames58.37%5,842 / 10,009
Watch list
Lowest observed complete-masking rates; inspect before deployment.
Customer & employee IDs8.03%324 / 4,036
Bank accounts & cards8.19%238 / 2,906
Phone numbers & email15.42%2,217 / 14,377
Language coverage
The overall leader can differ from the best choice for one language slice.
| Language | Datasets | Fully hidden ↑ | Detected ↑ | Extra masking ↓ |
|---|---|---|---|---|
| Russian | 19 | 43.02% | 52.58% | 1.60% |
Configuration, source and version
- Family
- GLINER
- Revision
- 443d26d654e0324125a96bebd8e796c14ff2efe6
- Eligible datasets
- 19 / 41
- Character F1
- 0.553
- Untouched diagnostic
- 47.42% · 64,690 / 136,419
- Benchmark version
- 1.0.3 · 2026-09-09
- CPU seconds / 10k chars
- 6.707
- GPU seconds / 10k chars
- Not measured
Russian labels
Results by dataset
Complete masking is primary; detection shows whether any character overlapped.
| Dataset | Gold annotations | Fully hidden ↑ | Detected ↑ | Extra masking ↓ |
|---|---|---|---|---|
| rubai-ru | 3,458 | 5.64% | 83.05% | — |
| synth-wiki-tables | 13,094 | 11.97% | 13.92% | — |
| synth-secrets-ru | 581 | 16.18% | 22.03% | 1.50% |
| redact-ru | 9,230 | 23.95% | 32.08% | 2.54% |
| alexen2 | 1,261 | 26.72% | 84.06% | 3.48% |
| corrupt-redmadrobot | 5,531 | 27.93% | 31.62% | 0.62% |
| corrupt-hivetrace | 1,667 | 31.43% | 47.69% | 0.71% |
| redmadrobot | 5,516 | 38.81% | 41.82% | 0.93% |
| synth-ru-tickets | 32,099 | 39.08% | 51.80% | — |
| nym-ru | 9,497 | 39.38% | 44.42% | — |
| synth-jira-comments | 2,705 | 39.85% | 46.95% | — |
| hivetrace | 1,667 | 41.63% | 55.73% | 1.06% |
| multiconer-ru | 1,208 | 42.72% | 59.11% | 6.70% |
| scanpatch | 8,708 | 45.99% | 50.71% | 2.71% |
| russian-pii-66k | 4,805 | 60.69% | 71.59% | — |
| nerel | 24,369 | 68.28% | 72.77% | — |
| jayguard | 1,195 | 69.29% | 82.68% | 1.39% |
| alrosait | 1,862 | 70.89% | 99.19% | 6.80% |
| factrueval | 7,966 | 72.63% | 73.45% | — |