RU · PII
multiconer-ru PII detection benchmark results
A frozen evaluation slice with 1,500 rows, 1,208 normalized gold annotations and source-level provenance.
1,500input rows
1,208gold annotations
87,200characters
49measured detectors
Dataset provenance
- Language group
- RU
- Task
- PII
- License
- cc-by-4.0
- Data categories
- ADDRESS, ORG, PERSON
- Project generated
- No
- Corrupted copy
- No
Rows without annotations are not verified clean. Reported extra masking is not a human-confirmed false-positive rate.
Detector outcomes
Sorted by untouched annotations. Training-source overlaps are excluded.
| Detector | Family | Untouched ↓ | Fully hidden ↑ | Extra masking ↓ | Char F1 ↑ |
|---|---|---|---|---|---|
| ner-ru-yqelz | HF | 3.48% | 93.54% | 35.17% | 0.637 |
| gliner2-fastino | GLINER2 | 7.86% | 73.76% | 17.04% | 0.646 |
| gliner2-fastino-ru | GLINER2 | 8.03% | 72.85% | 15.66% | 0.662 |
| gliner2-hivetrace-omni | GLINER2 | 9.93% | 73.92% | 17.85% | 0.656 |
| gliner2-hivetrace-omni-ru | GLINER2 | 11.26% | 72.68% | 18.21% | 0.642 |
| gliner25-fastino | GLINER2 | 19.70% | 60.93% | 16.03% | 0.628 |
| gliner25-fastino-ru | GLINER2 | 21.44% | 59.19% | 12.70% | 0.628 |
| gliner2-large | GLINER2 | 25.75% | 54.97% | 17.37% | 0.539 |
| gliner-urchade | GLINER | 26.66% | 66.31% | 11.50% | 0.621 |
| gliner-pii-edge | GLINER | 28.23% | 43.38% | 19.92% | 0.487 |
| spacy-ru-lg | SPACY | 32.12% | 50.17% | 6.99% | 0.624 |
| gliner-multi-v21 | GLINER | 33.94% | 48.84% | 8.16% | 0.591 |
| nuner-zero | GLINER | 38.66% | 43.63% | 9.66% | 0.507 |
| gliner-multi-v21-ru | GLINER | 40.89% | 42.72% | 6.70% | 0.552 |
| gliner-nvidia | GLINER | 41.06% | 44.04% | 10.13% | 0.526 |
| gliner-stream-pii | GLINER | 42.05% | 32.45% | 11.60% | 0.457 |
| gliner2-hivetrace-uni | GLINER2 | 44.04% | 43.05% | 7.58% | 0.542 |
| gliner-urchade-ru | GLINER | 45.20% | 48.76% | 6.72% | 0.554 |
| mmbert32k | HF | 46.44% | 27.98% | 6.96% | 0.470 |
| gliner2-hivetrace-uni-ru | GLINER2 | 46.94% | 39.57% | 7.52% | 0.507 |
| ru-legal-ner | HF | 51.08% | 27.40% | 10.94% | 0.399 |
| gliner-nvidia-ru | GLINER | 51.32% | 34.60% | 6.46% | 0.474 |
| nym-base | HF | 53.31% | 32.45% | 5.71% | 0.459 |
| gravitee-small | HF | 53.48% | 32.28% | 21.08% | 0.348 |
| davlan-xlmr | HF | 57.95% | 29.22% | 2.14% | 0.497 |
| gliner-pii-base | GLINER | 59.77% | 26.24% | 5.47% | 0.392 |
| gliner2-vladlinv | GLINER2 | 60.60% | 32.04% | 3.65% | 0.442 |
| gliner2-vladlinv-ru | GLINER2 | 60.84% | 32.20% | 3.53% | 0.444 |
| davlan-mbert | HF | 63.00% | 24.17% | 2.01% | 0.427 |
| fef2-secret-ru | HF | 63.74% | 24.42% | 2.68% | 0.422 |
| ru-pii-ner | RUPII | 65.31% | 25.50% | 3.66% | 0.394 |
| ner-ru-gherman | HF | 69.21% | 10.18% | 1.52% | 0.341 |
| bardsai-eu | ONNX | 69.95% | 22.02% | 3.61% | 0.368 |
| nym-small | ONNX | 70.12% | 20.03% | 5.03% | 0.332 |
| kalyan-ettin | HF | 73.34% | 9.60% | 5.11% | 0.233 |
| traciora | OPF | 74.25% | 13.74% | 4.95% | 0.313 |
| openmed-nemotron | HF | 74.59% | 10.76% | 7.86% | 0.258 |
| pii-shield-onnx | ONNX | 77.15% | 11.18% | 4.86% | 0.269 |
| openmed-multilingual | HF | 77.90% | 7.28% | 6.82% | 0.205 |
| opf-ru | OPF | 79.64% | 6.13% | 3.07% | 0.200 |
| pplx | PPLX | 80.71% | 11.67% | 2.38% | 0.240 |
| stanza-ru | STANZA | 89.98% | 7.12% | 2.89% | 0.133 |
| apararti | OPF | 91.14% | 4.72% | 3.48% | 0.114 |
| openai-base | OPF | 92.88% | 4.22% | 1.33% | 0.116 |
| opf-ru-v2 | OPF | 93.21% | 3.06% | 0.95% | 0.098 |
| opf-kz-ru | OPF | 95.94% | 2.15% | 1.62% | 0.055 |
| natasha | NATASHA | 99.17% | 0.75% | 0.02% | 0.013 |
| spacy-alrosait | SPACY | 99.34% | 0.17% | 0.09% | 0.010 |
| rules-ru | RULES | 99.50% | 0.25% | 0.00% | 0.005 |