RU · PII
nerel PII detection benchmark results
A frozen evaluation slice with 933 rows, 24,369 normalized gold annotations and source-level provenance.
933input rows
24,369gold annotations
1,510,956characters
64measured detectors
Dataset provenance
- Language group
- RU
- Task
- PII
- License
- not specified
- Data categories
- ADDRESS, ORG, PERSON
- Project generated
- No
- Corrupted copy
- No
Rows without annotations are not verified clean. Reported extra masking is not a human-confirmed false-positive rate.
Detector outcomes
Sorted by untouched annotations. Training-source overlaps are excluded.
| Detector | Family | Untouched ↓ | Fully hidden ↑ | Extra masking ↓ | Char F1 ↑ |
|---|---|---|---|---|---|
| nym-base+ov100 | HF | 8.04% | 81.46% | — | 0.728 |
| nym-base | HF | 9.37% | 79.00% | — | 0.730 |
| bardsai-eu | ONNX | 9.82% | 85.55% | — | 0.825 |
| stanza-ru | STANZA | 10.43% | 85.35% | — | 0.840 |
| gliner2-fastino | GLINER2 | 10.48% | 86.08% | — | 0.831 |
| fef2-secret-ru | HF | 10.92% | 83.10% | — | 0.892 |
| davlan-xlmr | HF | 11.16% | 84.10% | — | 0.897 |
| davlan-mbert | HF | 11.24% | 83.56% | — | 0.891 |
| gliner2-fastino-ru | GLINER2 | 11.26% | 84.86% | — | 0.817 |
| nym-small | ONNX | 11.53% | 76.38% | — | 0.739 |
| spacy-ru-lg | SPACY | 11.73% | 82.10% | — | 0.881 |
| natasha | NATASHA | 12.72% | 81.37% | — | 0.880 |
| nym-base+sent300 | HF | 12.76% | 74.47% | — | 0.734 |
| gliner25-fastino+sent300 | GLINER2 | 16.33% | 79.84% | — | 0.820 |
| nuner-zero | GLINER | 21.11% | 73.61% | — | 0.826 |
| gliner-urchade | GLINER | 21.14% | 75.37% | — | 0.797 |
| gliner25-fastino | GLINER2 | 22.31% | 74.09% | — | 0.817 |
| gliner-nvidia+sent300 | GLINER | 22.65% | 66.15% | — | 0.752 |
| gliner25-fastino+ov100 | GLINER2 | 23.02% | 73.30% | — | 0.813 |
| gliner25-fastino-ru | GLINER2 | 23.03% | 73.30% | — | 0.812 |
| gliner-multi-v21 | GLINER | 23.54% | 72.27% | — | 0.801 |
| ner-ru-yqelz | HF | 25.94% | 69.29% | — | 0.771 |
| gliner-pii-edge | GLINER | 26.21% | 64.96% | — | 0.696 |
| gliner-multi-v21-ru | GLINER | 27.23% | 68.28% | — | 0.781 |
| ner-ru-gherman | HF | 27.76% | 39.95% | — | 0.715 |
| gliner2-hivetrace-omni | GLINER2 | 28.90% | 67.04% | — | 0.772 |
| gliner2-large | GLINER2 | 29.53% | 66.55% | — | 0.719 |
| gliner2-hivetrace-omni-ru | GLINER2 | 31.91% | 64.09% | — | 0.730 |
| gliner-nvidia | GLINER | 32.77% | 56.82% | — | 0.717 |
| gliner-pii-base | GLINER | 33.94% | 60.88% | — | 0.700 |
| gliner-nvidia+ov100 | GLINER | 34.60% | 55.21% | — | 0.704 |
| gliner25-fastino+nochunk | GLINER2 | 35.39% | 61.01% | — | 0.764 |
| gliner25-fastino-ru+nochunk | GLINER2 | 35.69% | 60.66% | — | 0.758 |
| ru-legal-ner+sent300 | HF | 37.47% | 55.36% | — | 0.604 |
| gliner-nvidia-ru | GLINER | 38.45% | 51.71% | — | 0.661 |
| ru-legal-ner | HF | 42.83% | 50.33% | — | 0.588 |
| ru-legal-ner+ov100 | HF | 43.81% | 49.39% | — | 0.581 |
| gliner-stream-pii | GLINER | 44.54% | 49.35% | — | 0.638 |
| spacy-alrosait | SPACY | 48.56% | 44.89% | — | 0.620 |
| kalyan-ettin | HF | 49.44% | 29.56% | — | 0.543 |
| gliner2-hivetrace-uni | GLINER2 | 50.22% | 45.71% | — | 0.597 |
| mmbert32k | HF | 51.16% | 34.06% | — | 0.542 |
| gliner-urchade-ru | GLINER | 53.49% | 43.42% | — | 0.527 |
| openmed-nemotron | HF | 54.16% | 25.03% | — | 0.468 |
| pii-shield-onnx | ONNX | 60.52% | 31.05% | — | 0.485 |
| opf-ru | OPF | 62.28% | 29.58% | — | 0.495 |
| gliner2-vladlinv-ru | GLINER2 | 62.47% | 36.01% | — | 0.547 |
| gliner2-vladlinv | GLINER2 | 62.62% | 35.96% | — | 0.548 |
| openmed-multilingual | HF | 64.23% | 18.93% | — | 0.417 |
| mmbert32k+nochunk | HF | 65.60% | 17.74% | — | 0.393 |
| ru-pii-ner | RUPII | 66.51% | 32.84% | — | 0.495 |
| traciora | OPF | 70.73% | 24.74% | — | 0.434 |
| pplx+sent300 | PPLX | 70.94% | 27.73% | — | 0.441 |
| opf-ru-v2+sent300 | OPF | 77.05% | 20.13% | — | 0.387 |
| apararti | OPF | 77.11% | 19.49% | — | 0.354 |
| opf-ru-v2+ov100 | OPF | 80.61% | 16.81% | — | 0.345 |
| opf-ru-v2 | OPF | 80.74% | 16.69% | — | 0.343 |
| gliner2-hivetrace-uni-ru | GLINER2 | 81.36% | 17.73% | — | 0.300 |
| pplx+ov100 | PPLX | 84.34% | 15.27% | — | 0.283 |
| pplx | PPLX | 87.33% | 12.42% | — | 0.241 |
| opf-kz-ru | OPF | 88.20% | 9.40% | — | 0.219 |
| openai-base | OPF | 90.30% | 8.88% | — | 0.199 |
| gravitee-small | HF | 96.23% | 2.76% | — | 0.067 |
| rules-ru | RULES | 99.85% | 0.12% | — | 0.004 |