RU · PII
factrueval PII detection benchmark results
A frozen evaluation slice with 254 rows, 7,966 normalized gold annotations and source-level provenance.
254input rows
7,966gold annotations
546,618characters
64measured detectors
Dataset provenance
- Language group
- RU
- Task
- PII
- License
- mit
- Data categories
- ADDRESS, ORG, PERSON
- Project generated
- No
- Corrupted copy
- No
Rows without annotations are not verified clean. Reported extra masking is not a human-confirmed false-positive rate.
Detector outcomes
Sorted by untouched annotations. Training-source overlaps are excluded.
| Detector | Family | Untouched ↓ | Fully hidden ↑ | Extra masking ↓ | Char F1 ↑ |
|---|---|---|---|---|---|
| stanza-ru | STANZA | 3.28% | 95.56% | — | 0.877 |
| fef2-secret-ru | HF | 3.41% | 95.33% | — | 0.928 |
| davlan-xlmr | HF | 3.98% | 94.73% | — | 0.927 |
| natasha | NATASHA | 4.39% | 94.39% | — | 0.925 |
| davlan-mbert | HF | 4.57% | 93.96% | — | 0.924 |
| spacy-ru-lg | SPACY | 4.61% | 93.95% | — | 0.918 |
| bardsai-eu | ONNX | 5.85% | 92.96% | — | 0.829 |
| nym-base+ov100 | HF | 10.53% | 88.02% | — | 0.788 |
| nym-base | HF | 11.34% | 87.23% | — | 0.792 |
| gliner2-fastino-ru | GLINER2 | 12.18% | 87.06% | — | 0.764 |
| nym-base+sent300 | HF | 13.41% | 85.00% | — | 0.788 |
| nym-small | ONNX | 13.68% | 84.70% | — | 0.790 |
| gliner-pii-edge | GLINER | 15.40% | 81.53% | — | 0.733 |
| gliner2-fastino | GLINER2 | 17.10% | 81.91% | — | 0.758 |
| gliner-nvidia+sent300 | GLINER | 18.01% | 80.86% | — | 0.811 |
| ner-ru-yqelz | HF | 20.06% | 78.77% | — | 0.773 |
| gliner25-fastino-ru | GLINER2 | 21.78% | 77.54% | — | 0.798 |
| gliner-multi-v21 | GLINER | 23.74% | 75.40% | — | 0.760 |
| gliner-nvidia+ov100 | GLINER | 25.08% | 73.79% | — | 0.813 |
| gliner-nvidia | GLINER | 25.17% | 73.75% | — | 0.804 |
| gliner-multi-v21-ru | GLINER | 26.55% | 72.63% | — | 0.754 |
| gliner2-large | GLINER2 | 28.45% | 70.60% | — | 0.704 |
| gliner2-hivetrace-omni | GLINER2 | 29.24% | 69.81% | — | 0.741 |
| ner-ru-gherman | HF | 30.77% | 66.43% | — | 0.732 |
| gliner2-hivetrace-omni-ru | GLINER2 | 31.23% | 67.99% | — | 0.744 |
| ru-legal-ner+sent300 | HF | 39.64% | 57.18% | — | 0.579 |
| gliner25-fastino+sent300 | GLINER2 | 40.20% | 59.11% | — | 0.648 |
| gliner25-fastino | GLINER2 | 43.31% | 55.96% | — | 0.662 |
| gliner25-fastino+ov100 | GLINER2 | 43.50% | 55.82% | — | 0.666 |
| ru-legal-ner | HF | 43.82% | 53.41% | — | 0.570 |
| ru-legal-ner+ov100 | HF | 44.01% | 53.13% | — | 0.564 |
| nuner-zero | GLINER | 45.19% | 53.57% | — | 0.666 |
| gliner-nvidia-ru | GLINER | 46.76% | 52.54% | — | 0.667 |
| spacy-alrosait | SPACY | 47.46% | 50.95% | — | 0.610 |
| gliner25-fastino-ru+nochunk | GLINER2 | 48.49% | 50.74% | — | 0.666 |
| mmbert32k | HF | 54.22% | 42.19% | — | 0.542 |
| gliner25-fastino+nochunk | GLINER2 | 55.54% | 43.60% | — | 0.611 |
| kalyan-ettin | HF | 55.89% | 40.80% | — | 0.526 |
| openmed-nemotron | HF | 56.20% | 40.16% | — | 0.449 |
| gliner-stream-pii | GLINER | 57.07% | 41.14% | — | 0.545 |
| pii-shield-onnx | ONNX | 57.98% | 39.88% | — | 0.511 |
| gliner-pii-base | GLINER | 58.01% | 40.70% | — | 0.543 |
| gliner-urchade | GLINER | 59.42% | 40.07% | — | 0.536 |
| gliner2-hivetrace-uni-ru | GLINER2 | 61.49% | 38.14% | — | 0.505 |
| opf-ru | OPF | 61.76% | 36.35% | — | 0.471 |
| gliner-urchade-ru | GLINER | 62.44% | 37.13% | — | 0.511 |
| openmed-multilingual | HF | 65.69% | 31.77% | — | 0.427 |
| gliner2-vladlinv | GLINER2 | 66.46% | 33.42% | — | 0.440 |
| traciora | OPF | 67.95% | 31.02% | — | 0.419 |
| gliner2-vladlinv-ru | GLINER2 | 68.44% | 31.50% | — | 0.421 |
| ru-pii-ner | RUPII | 70.16% | 29.79% | — | 0.401 |
| pplx+sent300 | PPLX | 72.51% | 27.40% | — | 0.370 |
| mmbert32k+nochunk | HF | 72.87% | 24.50% | — | 0.359 |
| opf-ru-v2+sent300 | OPF | 72.93% | 26.35% | — | 0.373 |
| apararti | OPF | 73.46% | 25.78% | — | 0.354 |
| opf-ru-v2+ov100 | OPF | 75.22% | 24.28% | — | 0.347 |
| opf-ru-v2 | OPF | 76.07% | 23.34% | — | 0.340 |
| pplx+ov100 | PPLX | 83.04% | 16.92% | — | 0.246 |
| opf-kz-ru | OPF | 84.65% | 15.03% | — | 0.234 |
| gliner2-hivetrace-uni | GLINER2 | 85.76% | 14.01% | — | 0.223 |
| openai-base | OPF | 85.84% | 14.02% | — | 0.215 |
| pplx | PPLX | 87.42% | 12.58% | — | 0.188 |
| gravitee-small | HF | 95.93% | 3.72% | — | 0.073 |
| rules-ru | RULES | 99.45% | 0.55% | — | 0.014 |