RU · PII
nerel PII detection benchmark results
A frozen evaluation slice with 933 rows, 24,369 normalized gold annotations and source-level provenance.
933input rows
24,369gold annotations
1,510,956characters
64measured detectors
Dataset provenance
- Language group
- RU
- Task
- PII
- License
- not specified
- Data categories
- ADDRESS, ORG, PERSON
- Project generated
- No
- Corrupted copy
- No
Rows without annotations are not verified clean. Reported extra masking is not a human-confirmed false-positive rate.
Detector outcomes
Sorted by fully hidden annotations. Training-source overlaps are excluded.
| Detector | Family | Fully hidden ↑ | Detected / any overlap ↑ | Extra masking ↓ | Char F1 ↑ |
|---|---|---|---|---|---|
| gliner2-fastino | GLINER2 | 86.08% | 89.52% | — | 0.831 |
| bardsai-eu | ONNX | 85.55% | 90.18% | — | 0.825 |
| stanza-ru | STANZA | 85.35% | 89.57% | — | 0.840 |
| gliner2-fastino-ru | GLINER2 | 84.86% | 88.74% | — | 0.817 |
| davlan-xlmr | HF | 84.10% | 88.84% | — | 0.897 |
| davlan-mbert | HF | 83.56% | 88.76% | — | 0.891 |
| fef2-secret-ru | HF | 83.10% | 89.08% | — | 0.892 |
| spacy-ru-lg | SPACY | 82.10% | 88.27% | — | 0.881 |
| nym-base+ov100 | HF | 81.46% | 91.96% | — | 0.728 |
| natasha | NATASHA | 81.37% | 87.28% | — | 0.880 |
| gliner25-fastino+sent300 | GLINER2 | 79.84% | 83.67% | — | 0.820 |
| nym-base | HF | 79.00% | 90.63% | — | 0.730 |
| nym-small | ONNX | 76.38% | 88.47% | — | 0.739 |
| gliner-urchade | GLINER | 75.37% | 78.86% | — | 0.797 |
| nym-base+sent300 | HF | 74.47% | 87.24% | — | 0.734 |
| gliner25-fastino | GLINER2 | 74.09% | 77.69% | — | 0.817 |
| nuner-zero | GLINER | 73.61% | 78.89% | — | 0.826 |
| gliner25-fastino-ru | GLINER2 | 73.30% | 76.97% | — | 0.812 |
| gliner25-fastino+ov100 | GLINER2 | 73.30% | 76.98% | — | 0.813 |
| gliner-multi-v21 | GLINER | 72.27% | 76.46% | — | 0.801 |
| ner-ru-yqelz | HF | 69.29% | 74.06% | — | 0.771 |
| gliner-multi-v21-ru | GLINER | 68.28% | 72.77% | — | 0.781 |
| gliner2-hivetrace-omni | GLINER2 | 67.04% | 71.10% | — | 0.772 |
| gliner2-large | GLINER2 | 66.55% | 70.47% | — | 0.719 |
| gliner-nvidia+sent300 | GLINER | 66.15% | 77.35% | — | 0.752 |
| gliner-pii-edge | GLINER | 64.96% | 73.79% | — | 0.696 |
| gliner2-hivetrace-omni-ru | GLINER2 | 64.09% | 68.09% | — | 0.730 |
| gliner25-fastino+nochunk | GLINER2 | 61.01% | 64.61% | — | 0.764 |
| gliner-pii-base | GLINER | 60.88% | 66.06% | — | 0.700 |
| gliner25-fastino-ru+nochunk | GLINER2 | 60.66% | 64.31% | — | 0.758 |
| gliner-nvidia | GLINER | 56.82% | 67.23% | — | 0.717 |
| ru-legal-ner+sent300 | HF | 55.36% | 62.53% | — | 0.604 |
| gliner-nvidia+ov100 | GLINER | 55.21% | 65.40% | — | 0.704 |
| gliner-nvidia-ru | GLINER | 51.71% | 61.55% | — | 0.661 |
| ru-legal-ner | HF | 50.33% | 57.17% | — | 0.588 |
| ru-legal-ner+ov100 | HF | 49.39% | 56.19% | — | 0.581 |
| gliner-stream-pii | GLINER | 49.35% | 55.46% | — | 0.638 |
| gliner2-hivetrace-uni | GLINER2 | 45.71% | 49.78% | — | 0.597 |
| spacy-alrosait | SPACY | 44.89% | 51.44% | — | 0.620 |
| gliner-urchade-ru | GLINER | 43.42% | 46.51% | — | 0.527 |
| ner-ru-gherman | HF | 39.95% | 72.24% | — | 0.715 |
| gliner2-vladlinv-ru | GLINER2 | 36.01% | 37.53% | — | 0.547 |
| gliner2-vladlinv | GLINER2 | 35.96% | 37.38% | — | 0.548 |
| mmbert32k | HF | 34.06% | 48.84% | — | 0.542 |
| ru-pii-ner | RUPII | 32.84% | 33.49% | — | 0.495 |
| pii-shield-onnx | ONNX | 31.05% | 39.48% | — | 0.485 |
| opf-ru | OPF | 29.58% | 37.72% | — | 0.495 |
| kalyan-ettin | HF | 29.56% | 50.56% | — | 0.543 |
| pplx+sent300 | PPLX | 27.73% | 29.06% | — | 0.441 |
| openmed-nemotron | HF | 25.03% | 45.84% | — | 0.468 |
| traciora | OPF | 24.74% | 29.27% | — | 0.434 |
| opf-ru-v2+sent300 | OPF | 20.13% | 22.95% | — | 0.387 |
| apararti | OPF | 19.49% | 22.89% | — | 0.354 |
| openmed-multilingual | HF | 18.93% | 35.77% | — | 0.417 |
| mmbert32k+nochunk | HF | 17.74% | 34.40% | — | 0.393 |
| gliner2-hivetrace-uni-ru | GLINER2 | 17.73% | 18.64% | — | 0.300 |
| opf-ru-v2+ov100 | OPF | 16.81% | 19.39% | — | 0.345 |
| opf-ru-v2 | OPF | 16.69% | 19.26% | — | 0.343 |
| pplx+ov100 | PPLX | 15.27% | 15.66% | — | 0.283 |
| pplx | PPLX | 12.42% | 12.67% | — | 0.241 |
| opf-kz-ru | OPF | 9.40% | 11.80% | — | 0.219 |
| openai-base | OPF | 8.88% | 9.70% | — | 0.199 |
| gravitee-small | HF | 2.76% | 3.77% | — | 0.067 |
| rules-ru | RULES | 0.12% | 0.15% | — | 0.004 |