RU · PII
factrueval PII detection benchmark results
A frozen evaluation slice with 254 rows, 7,966 normalized gold annotations and source-level provenance.
254input rows
7,966gold annotations
546,618characters
64measured detectors
Dataset provenance
- Language group
- RU
- Task
- PII
- License
- mit
- Data categories
- ADDRESS, ORG, PERSON
- Project generated
- No
- Corrupted copy
- No
Rows without annotations are not verified clean. Reported extra masking is not a human-confirmed false-positive rate.
Detector outcomes
Sorted by fully hidden annotations. Training-source overlaps are excluded.
| Detector | Family | Fully hidden ↑ | Detected / any overlap ↑ | Extra masking ↓ | Char F1 ↑ |
|---|---|---|---|---|---|
| stanza-ru | STANZA | 95.56% | 96.72% | — | 0.877 |
| fef2-secret-ru | HF | 95.33% | 96.59% | — | 0.928 |
| davlan-xlmr | HF | 94.73% | 96.02% | — | 0.927 |
| natasha | NATASHA | 94.39% | 95.61% | — | 0.925 |
| davlan-mbert | HF | 93.96% | 95.43% | — | 0.924 |
| spacy-ru-lg | SPACY | 93.95% | 95.39% | — | 0.918 |
| bardsai-eu | ONNX | 92.96% | 94.15% | — | 0.829 |
| nym-base+ov100 | HF | 88.02% | 89.47% | — | 0.788 |
| nym-base | HF | 87.23% | 88.66% | — | 0.792 |
| gliner2-fastino-ru | GLINER2 | 87.06% | 87.82% | — | 0.764 |
| nym-base+sent300 | HF | 85.00% | 86.59% | — | 0.788 |
| nym-small | ONNX | 84.70% | 86.32% | — | 0.790 |
| gliner2-fastino | GLINER2 | 81.91% | 82.90% | — | 0.758 |
| gliner-pii-edge | GLINER | 81.53% | 84.60% | — | 0.733 |
| gliner-nvidia+sent300 | GLINER | 80.86% | 81.99% | — | 0.811 |
| ner-ru-yqelz | HF | 78.77% | 79.94% | — | 0.773 |
| gliner25-fastino-ru | GLINER2 | 77.54% | 78.22% | — | 0.798 |
| gliner-multi-v21 | GLINER | 75.40% | 76.26% | — | 0.760 |
| gliner-nvidia+ov100 | GLINER | 73.79% | 74.92% | — | 0.813 |
| gliner-nvidia | GLINER | 73.75% | 74.83% | — | 0.804 |
| gliner-multi-v21-ru | GLINER | 72.63% | 73.45% | — | 0.754 |
| gliner2-large | GLINER2 | 70.60% | 71.55% | — | 0.704 |
| gliner2-hivetrace-omni | GLINER2 | 69.81% | 70.76% | — | 0.741 |
| gliner2-hivetrace-omni-ru | GLINER2 | 67.99% | 68.77% | — | 0.744 |
| ner-ru-gherman | HF | 66.43% | 69.23% | — | 0.732 |
| gliner25-fastino+sent300 | GLINER2 | 59.11% | 59.80% | — | 0.648 |
| ru-legal-ner+sent300 | HF | 57.18% | 60.36% | — | 0.579 |
| gliner25-fastino | GLINER2 | 55.96% | 56.69% | — | 0.662 |
| gliner25-fastino+ov100 | GLINER2 | 55.82% | 56.50% | — | 0.666 |
| nuner-zero | GLINER | 53.57% | 54.81% | — | 0.666 |
| ru-legal-ner | HF | 53.41% | 56.18% | — | 0.570 |
| ru-legal-ner+ov100 | HF | 53.13% | 55.99% | — | 0.564 |
| gliner-nvidia-ru | GLINER | 52.54% | 53.24% | — | 0.667 |
| spacy-alrosait | SPACY | 50.95% | 52.54% | — | 0.610 |
| gliner25-fastino-ru+nochunk | GLINER2 | 50.74% | 51.51% | — | 0.666 |
| gliner25-fastino+nochunk | GLINER2 | 43.60% | 44.46% | — | 0.611 |
| mmbert32k | HF | 42.19% | 45.78% | — | 0.542 |
| gliner-stream-pii | GLINER | 41.14% | 42.93% | — | 0.545 |
| kalyan-ettin | HF | 40.80% | 44.11% | — | 0.526 |
| gliner-pii-base | GLINER | 40.70% | 41.99% | — | 0.543 |
| openmed-nemotron | HF | 40.16% | 43.80% | — | 0.449 |
| gliner-urchade | GLINER | 40.07% | 40.58% | — | 0.536 |
| pii-shield-onnx | ONNX | 39.88% | 42.02% | — | 0.511 |
| gliner2-hivetrace-uni-ru | GLINER2 | 38.14% | 38.51% | — | 0.505 |
| gliner-urchade-ru | GLINER | 37.13% | 37.56% | — | 0.511 |
| opf-ru | OPF | 36.35% | 38.24% | — | 0.471 |
| gliner2-vladlinv | GLINER2 | 33.42% | 33.54% | — | 0.440 |
| openmed-multilingual | HF | 31.77% | 34.31% | — | 0.427 |
| gliner2-vladlinv-ru | GLINER2 | 31.50% | 31.56% | — | 0.421 |
| traciora | OPF | 31.02% | 32.05% | — | 0.419 |
| ru-pii-ner | RUPII | 29.79% | 29.84% | — | 0.401 |
| pplx+sent300 | PPLX | 27.40% | 27.49% | — | 0.370 |
| opf-ru-v2+sent300 | OPF | 26.35% | 27.07% | — | 0.373 |
| apararti | OPF | 25.78% | 26.54% | — | 0.354 |
| mmbert32k+nochunk | HF | 24.50% | 27.13% | — | 0.359 |
| opf-ru-v2+ov100 | OPF | 24.28% | 24.78% | — | 0.347 |
| opf-ru-v2 | OPF | 23.34% | 23.93% | — | 0.340 |
| pplx+ov100 | PPLX | 16.92% | 16.96% | — | 0.246 |
| opf-kz-ru | OPF | 15.03% | 15.35% | — | 0.234 |
| openai-base | OPF | 14.02% | 14.16% | — | 0.215 |
| gliner2-hivetrace-uni | GLINER2 | 14.01% | 14.24% | — | 0.223 |
| pplx | PPLX | 12.58% | 12.58% | — | 0.188 |
| gravitee-small | HF | 3.72% | 4.07% | — | 0.073 |
| rules-ru | RULES | 0.55% | 0.55% | — | 0.014 |