RU · PII
synth-wiki-tables PII detection benchmark results
A frozen evaluation slice with 300 rows, 13,094 normalized gold annotations and source-level provenance.
300input rows
13,094gold annotations
402,095characters
49measured detectors
Dataset provenance
- Language group
- RU
- Task
- PII
- License
- cc-by-4.0
- Data categories
- ACCOUNT, CONTACT, NET, ORG, PERSON
- Project generated
- Yes
- Corrupted copy
- No
Rows without annotations are not verified clean. Reported extra masking is not a human-confirmed false-positive rate.
Detector outcomes
Sorted by fully hidden annotations. Training-source overlaps are excluded.
| Detector | Family | Fully hidden ↑ | Detected / any overlap ↑ | Extra masking ↓ | Char F1 ↑ |
|---|---|---|---|---|---|
| pplx | PPLX | 88.89% | 94.39% | — | 0.944 |
| gliner2-fastino | GLINER2 | 85.69% | 88.17% | — | 0.898 |
| gliner2-fastino-ru | GLINER2 | 85.34% | 90.38% | — | 0.910 |
| apararti | OPF | 81.98% | 90.68% | — | 0.905 |
| gliner2-hivetrace-omni-ru | GLINER2 | 80.92% | 81.66% | — | 0.888 |
| openai-base | OPF | 80.89% | 87.03% | — | 0.881 |
| gliner2-hivetrace-omni | GLINER2 | 79.61% | 79.90% | — | 0.843 |
| opf-kz-ru | OPF | 79.37% | 88.59% | — | 0.900 |
| nym-small | ONNX | 74.50% | 96.27% | — | 0.932 |
| gliner2-large | GLINER2 | 74.23% | 75.55% | — | 0.873 |
| rules-ru | RULES | 69.70% | 69.70% | — | 0.867 |
| gliner2-vladlinv | GLINER2 | 69.10% | 73.45% | — | 0.744 |
| gliner2-vladlinv-ru | GLINER2 | 69.07% | 73.66% | — | 0.744 |
| nym-base | HF | 68.56% | 93.15% | — | 0.842 |
| gliner25-fastino-ru | GLINER2 | 68.24% | 69.54% | — | 0.794 |
| ru-pii-ner | RUPII | 66.67% | 71.25% | — | 0.725 |
| openmed-nemotron | HF | 65.53% | 87.21% | — | 0.865 |
| traciora | OPF | 65.33% | 77.32% | — | 0.765 |
| nuner-zero | GLINER | 64.04% | 78.87% | — | 0.903 |
| gliner25-fastino | GLINER2 | 63.78% | 65.27% | — | 0.768 |
| ru-legal-ner | HF | 63.46% | 94.07% | — | 0.815 |
| pii-shield-onnx | ONNX | 63.45% | 77.07% | — | 0.878 |
| opf-ru-v2 | OPF | 63.30% | 73.51% | — | 0.738 |
| gliner-urchade | GLINER | 62.22% | 64.43% | — | 0.709 |
| openmed-multilingual | HF | 61.81% | 84.60% | — | 0.849 |
| gliner-pii-edge | GLINER | 55.23% | 77.46% | — | 0.773 |
| gliner-stream-pii | GLINER | 53.71% | 57.10% | — | 0.637 |
| gliner-nvidia | GLINER | 53.50% | 61.65% | — | 0.708 |
| gliner-urchade-ru | GLINER | 52.40% | 56.74% | — | 0.614 |
| opf-ru | OPF | 49.77% | 75.36% | — | 0.742 |
| bardsai-eu | ONNX | 45.60% | 81.84% | — | 0.705 |
| gliner-nvidia-ru | GLINER | 41.10% | 47.92% | — | 0.600 |
| gliner2-hivetrace-uni | GLINER2 | 40.84% | 41.74% | — | 0.580 |
| gravitee-small | HF | 36.99% | 45.30% | — | 0.579 |
| kalyan-ettin | HF | 33.47% | 75.51% | — | 0.729 |
| gliner-pii-base | GLINER | 31.86% | 32.97% | — | 0.433 |
| mmbert32k | HF | 28.52% | 86.99% | — | 0.737 |
| fef2-secret-ru | HF | 24.84% | 39.22% | — | 0.551 |
| gliner-multi-v21 | GLINER | 18.14% | 22.34% | — | 0.317 |
| davlan-xlmr | HF | 14.83% | 20.05% | — | 0.311 |
| ner-ru-yqelz | HF | 14.42% | 18.24% | — | 0.297 |
| stanza-ru | STANZA | 13.69% | 15.95% | — | 0.264 |
| davlan-mbert | HF | 13.64% | 14.40% | — | 0.266 |
| gliner-multi-v21-ru | GLINER | 11.97% | 13.92% | — | 0.206 |
| spacy-alrosait | SPACY | 11.75% | 12.33% | — | 0.236 |
| natasha | NATASHA | 9.84% | 12.13% | — | 0.218 |
| gliner2-hivetrace-uni-ru | GLINER2 | 5.74% | 6.02% | — | 0.081 |
| ner-ru-gherman | HF | 3.89% | 39.12% | — | 0.421 |
| spacy-ru-lg | SPACY | 3.41% | 8.27% | — | 0.138 |