RU · PII
synth-wiki-tables PII detection benchmark results
A frozen evaluation slice with 300 rows, 13,094 normalized gold annotations and source-level provenance.
300input rows
13,094gold annotations
402,095characters
49measured detectors
Dataset provenance
- Language group
- RU
- Task
- PII
- License
- cc-by-4.0
- Data categories
- ACCOUNT, CONTACT, NET, ORG, PERSON
- Project generated
- Yes
- Corrupted copy
- No
Rows without annotations are not verified clean. Reported extra masking is not a human-confirmed false-positive rate.
Detector outcomes
Sorted by untouched annotations. Training-source overlaps are excluded.
| Detector | Family | Untouched ↓ | Fully hidden ↑ | Extra masking ↓ | Char F1 ↑ |
|---|---|---|---|---|---|
| nym-small | ONNX | 3.73% | 74.50% | — | 0.932 |
| pplx | PPLX | 5.61% | 88.89% | — | 0.944 |
| ru-legal-ner | HF | 5.93% | 63.46% | — | 0.815 |
| nym-base | HF | 6.85% | 68.56% | — | 0.842 |
| apararti | OPF | 9.32% | 81.98% | — | 0.905 |
| gliner2-fastino-ru | GLINER2 | 9.62% | 85.34% | — | 0.910 |
| opf-kz-ru | OPF | 11.41% | 79.37% | — | 0.900 |
| gliner2-fastino | GLINER2 | 11.83% | 85.69% | — | 0.898 |
| openmed-nemotron | HF | 12.79% | 65.53% | — | 0.865 |
| openai-base | OPF | 12.97% | 80.89% | — | 0.881 |
| mmbert32k | HF | 13.01% | 28.52% | — | 0.737 |
| openmed-multilingual | HF | 15.40% | 61.81% | — | 0.849 |
| bardsai-eu | ONNX | 18.16% | 45.60% | — | 0.705 |
| gliner2-hivetrace-omni-ru | GLINER2 | 18.34% | 80.92% | — | 0.888 |
| gliner2-hivetrace-omni | GLINER2 | 20.10% | 79.61% | — | 0.843 |
| nuner-zero | GLINER | 21.13% | 64.04% | — | 0.903 |
| gliner-pii-edge | GLINER | 22.54% | 55.23% | — | 0.773 |
| traciora | OPF | 22.68% | 65.33% | — | 0.765 |
| pii-shield-onnx | ONNX | 22.93% | 63.45% | — | 0.878 |
| gliner2-large | GLINER2 | 24.45% | 74.23% | — | 0.873 |
| kalyan-ettin | HF | 24.49% | 33.47% | — | 0.729 |
| opf-ru | OPF | 24.64% | 49.77% | — | 0.742 |
| gliner2-vladlinv-ru | GLINER2 | 26.34% | 69.07% | — | 0.744 |
| opf-ru-v2 | OPF | 26.49% | 63.30% | — | 0.738 |
| gliner2-vladlinv | GLINER2 | 26.55% | 69.10% | — | 0.744 |
| ru-pii-ner | RUPII | 28.75% | 66.67% | — | 0.725 |
| rules-ru | RULES | 30.30% | 69.70% | — | 0.867 |
| gliner25-fastino-ru | GLINER2 | 30.46% | 68.24% | — | 0.794 |
| gliner25-fastino | GLINER2 | 34.73% | 63.78% | — | 0.768 |
| gliner-urchade | GLINER | 35.57% | 62.22% | — | 0.709 |
| gliner-nvidia | GLINER | 38.35% | 53.50% | — | 0.708 |
| gliner-stream-pii | GLINER | 42.90% | 53.71% | — | 0.637 |
| gliner-urchade-ru | GLINER | 43.26% | 52.40% | — | 0.614 |
| gliner-nvidia-ru | GLINER | 52.08% | 41.10% | — | 0.600 |
| gravitee-small | HF | 54.70% | 36.99% | — | 0.579 |
| gliner2-hivetrace-uni | GLINER2 | 58.26% | 40.84% | — | 0.580 |
| fef2-secret-ru | HF | 60.78% | 24.84% | — | 0.551 |
| ner-ru-gherman | HF | 60.88% | 3.89% | — | 0.421 |
| gliner-pii-base | GLINER | 67.03% | 31.86% | — | 0.433 |
| gliner-multi-v21 | GLINER | 77.66% | 18.14% | — | 0.317 |
| davlan-xlmr | HF | 79.95% | 14.83% | — | 0.311 |
| ner-ru-yqelz | HF | 81.76% | 14.42% | — | 0.297 |
| stanza-ru | STANZA | 84.05% | 13.69% | — | 0.264 |
| davlan-mbert | HF | 85.60% | 13.64% | — | 0.266 |
| gliner-multi-v21-ru | GLINER | 86.08% | 11.97% | — | 0.206 |
| spacy-alrosait | SPACY | 87.67% | 11.75% | — | 0.236 |
| natasha | NATASHA | 87.87% | 9.84% | — | 0.218 |
| spacy-ru-lg | SPACY | 91.73% | 3.41% | — | 0.138 |
| gliner2-hivetrace-uni-ru | GLINER2 | 93.98% | 5.74% | — | 0.081 |