RU · PII
russian-pii-66k PII detection benchmark results
A frozen evaluation slice with 1,500 rows, 4,805 normalized gold annotations and source-level provenance.
1,500input rows
4,805gold annotations
195,840characters
50measured detectors
Dataset provenance
- Language group
- RU
- Task
- PII
- License
- not specified
- Data categories
- ACCOUNT, ADDRESS, CONTACT, DATE, ID, PERSON, SECRET
- Project generated
- No
- Corrupted copy
- No
Rows without annotations are not verified clean. Reported extra masking is not a human-confirmed false-positive rate.
Detector outcomes
Sorted by fully hidden annotations. Training-source overlaps are excluded.
| Detector | Family | Fully hidden ↑ | Detected / any overlap ↑ | Extra masking ↓ | Char F1 ↑ |
|---|---|---|---|---|---|
| nym-base | HF | 99.44% | 99.94% | — | 0.993 |
| nym-small | ONNX | 99.42% | 99.71% | — | 0.991 |
| pplx | PPLX | 97.94% | 99.77% | — | 0.955 |
| ru-pii-ner | RUPII | 96.23% | 96.36% | — | 0.958 |
| gliner2-fastino | GLINER2 | 92.26% | 94.94% | — | 0.965 |
| gliner2-fastino-ru | GLINER2 | 92.07% | 94.84% | — | 0.960 |
| gliner-nvidia-ru | GLINER | 91.95% | 96.50% | — | 0.961 |
| gliner-nvidia | GLINER | 91.09% | 96.07% | — | 0.936 |
| openai-base | OPF | 89.82% | 92.20% | — | 0.901 |
| apararti | OPF | 88.53% | 91.05% | — | 0.902 |
| gliner2-hivetrace-omni-ru | GLINER2 | 87.49% | 93.88% | — | 0.950 |
| gliner2-hivetrace-omni | GLINER2 | 86.85% | 93.40% | — | 0.951 |
| ru-legal-ner | HF | 86.72% | 94.03% | — | 0.939 |
| traciora | OPF | 86.24% | 89.28% | — | 0.906 |
| opf-ru-v2 | OPF | 85.49% | 87.22% | — | 0.910 |
| nuner-zero | GLINER | 82.14% | 86.58% | — | 0.839 |
| bardsai-eu | ONNX | 81.58% | 96.57% | — | 0.930 |
| openmed-multilingual | HF | 80.17% | 88.05% | — | 0.934 |
| opf-kz-ru | OPF | 79.65% | 86.56% | — | 0.874 |
| gliner2-vladlinv-ru | GLINER2 | 78.96% | 79.06% | — | 0.878 |
| pii-shield-onnx | ONNX | 78.88% | 85.64% | — | 0.922 |
| gliner2-large | GLINER2 | 76.15% | 77.50% | — | 0.892 |
| mmbert32k | HF | 75.96% | 97.36% | — | 0.942 |
| gliner25-fastino-ru | GLINER2 | 75.48% | 77.79% | — | 0.858 |
| gliner-pii-edge | GLINER | 73.92% | 78.79% | — | 0.844 |
| gliner-urchade | GLINER | 70.36% | 71.49% | — | 0.876 |
| gliner2-vladlinv | GLINER2 | 69.80% | 69.89% | — | 0.824 |
| gliner-urchade-ru | GLINER | 67.99% | 68.84% | — | 0.858 |
| fef2-secret-ru | HF | 67.35% | 81.42% | — | 0.867 |
| openmed-nemotron | HF | 66.53% | 79.77% | — | 0.790 |
| gliner-stream-pii | GLINER | 64.60% | 78.88% | — | 0.816 |
| gliner25-fastino | GLINER2 | 63.89% | 66.24% | — | 0.787 |
| gravitee-small | HF | 62.96% | 69.59% | — | 0.651 |
| gliner2-hivetrace-uni | GLINER2 | 62.60% | 67.83% | — | 0.863 |
| kalyan-ettin | HF | 61.79% | 76.84% | — | 0.820 |
| gliner-multi-v21-ru | GLINER | 60.69% | 71.59% | — | 0.704 |
| gliner-multi-v21 | GLINER | 54.80% | 65.20% | — | 0.653 |
| gliner-pii-base | GLINER | 39.19% | 42.58% | — | 0.627 |
| stanza-ru | STANZA | 39.13% | 49.57% | — | 0.551 |
| spacy-alrosait | SPACY | 36.13% | 37.02% | — | 0.373 |
| davlan-xlmr | HF | 35.46% | 38.98% | — | 0.403 |
| gliner2-hivetrace-uni-ru | GLINER2 | 33.88% | 35.46% | — | 0.415 |
| rules-ru | RULES | 33.63% | 33.86% | — | 0.623 |
| ner-ru-yqelz | HF | 32.47% | 40.60% | — | 0.432 |
| davlan-mbert | HF | 31.26% | 36.27% | — | 0.383 |
| spacy-ru-lg | SPACY | 29.30% | 37.84% | — | 0.436 |
| ner-ru-gherman | HF | 28.95% | 42.12% | — | 0.409 |
| natasha | NATASHA | 23.56% | 30.11% | — | 0.298 |
| betterleaks | LEAKS | 0.00% | 0.00% | — | 0.000 |
| gitleaks | LEAKS | 0.00% | 0.00% | — | 0.000 |