RU · PII
rubai-ru PII detection benchmark results
A frozen evaluation slice with 1,500 rows, 3,458 normalized gold annotations and source-level provenance.
1,500input rows
3,458gold annotations
362,298characters
49measured detectors
Dataset provenance
- Language group
- RU
- Task
- PII
- License
- apache-2.0
- Data categories
- ADDRESS, CONTACT, ID, PERSON
- Project generated
- No
- Corrupted copy
- No
Rows without annotations are not verified clean. Reported extra masking is not a human-confirmed false-positive rate.
Detector outcomes
Sorted by untouched annotations. Training-source overlaps are excluded.
| Detector | Family | Untouched ↓ | Fully hidden ↑ | Extra masking ↓ | Char F1 ↑ |
|---|---|---|---|---|---|
| pplx | PPLX | 0.46% | 10.70% | — | 0.941 |
| nym-base | HF | 1.62% | 5.29% | — | 0.730 |
| mmbert32k | HF | 1.62% | 5.67% | — | 0.651 |
| nym-small | ONNX | 1.74% | 5.00% | — | 0.716 |
| gliner25-fastino | GLINER2 | 2.05% | 7.92% | — | 0.957 |
| gliner25-fastino-ru | GLINER2 | 2.17% | 7.87% | — | 0.961 |
| opf-ru | OPF | 2.40% | 5.64% | — | 0.639 |
| traciora | OPF | 4.11% | 7.11% | — | 0.924 |
| nuner-zero | GLINER | 4.63% | 7.55% | — | 0.894 |
| apararti | OPF | 5.06% | 5.81% | — | 0.928 |
| ru-pii-ner | RUPII | 5.12% | 8.01% | — | 0.923 |
| bardsai-eu | ONNX | 5.18% | 18.16% | — | 0.783 |
| opf-ru-v2 | OPF | 5.47% | 5.44% | — | 0.919 |
| openai-base | OPF | 6.82% | 26.17% | — | 0.924 |
| opf-kz-ru | OPF | 7.00% | 4.22% | — | 0.915 |
| openmed-multilingual | HF | 7.26% | 3.96% | — | 0.633 |
| ru-legal-ner | HF | 10.03% | 6.74% | — | 0.697 |
| gliner2-large | GLINER2 | 10.41% | 6.45% | — | 0.750 |
| pii-shield-onnx | ONNX | 11.71% | 5.12% | — | 0.845 |
| gliner-multi-v21 | GLINER | 13.59% | 6.04% | — | 0.760 |
| gliner-stream-pii | GLINER | 14.17% | 4.19% | — | 0.777 |
| openmed-nemotron | HF | 15.53% | 2.89% | — | 0.664 |
| gliner-multi-v21-ru | GLINER | 16.95% | 5.64% | — | 0.781 |
| gliner-nvidia | GLINER | 19.64% | 7.17% | — | 0.764 |
| gliner2-vladlinv | GLINER2 | 19.81% | 6.82% | — | 0.861 |
| gliner-urchade | GLINER | 21.52% | 7.17% | — | 0.748 |
| gliner2-vladlinv-ru | GLINER2 | 22.99% | 6.62% | — | 0.850 |
| gliner-nvidia-ru | GLINER | 23.92% | 6.04% | — | 0.743 |
| gliner-pii-edge | GLINER | 24.47% | 6.33% | — | 0.661 |
| gliner2-hivetrace-omni | GLINER2 | 25.42% | 7.26% | — | 0.653 |
| fef2-secret-ru | HF | 26.89% | 5.81% | — | 0.430 |
| gliner2-hivetrace-omni-ru | GLINER2 | 27.96% | 7.23% | — | 0.637 |
| gliner2-fastino | GLINER2 | 30.62% | 7.29% | — | 0.633 |
| gliner2-fastino-ru | GLINER2 | 31.43% | 7.17% | — | 0.635 |
| gliner-urchade-ru | GLINER | 32.16% | 3.09% | — | 0.732 |
| kalyan-ettin | HF | 34.88% | 2.69% | — | 0.446 |
| gliner-pii-base | GLINER | 36.21% | 6.13% | — | 0.534 |
| stanza-ru | STANZA | 37.83% | 5.44% | — | 0.348 |
| gravitee-small | HF | 38.43% | 3.59% | — | 0.595 |
| ner-ru-yqelz | HF | 43.72% | 4.51% | — | 0.457 |
| ner-ru-gherman | HF | 44.68% | 1.76% | — | 0.655 |
| davlan-xlmr | HF | 44.79% | 4.45% | — | 0.417 |
| davlan-mbert | HF | 44.88% | 4.05% | — | 0.408 |
| natasha | NATASHA | 46.30% | 4.34% | — | 0.300 |
| spacy-ru-lg | SPACY | 47.63% | 4.05% | — | 0.300 |
| spacy-alrosait | SPACY | 49.57% | 2.66% | — | 0.628 |
| gliner2-hivetrace-uni | GLINER2 | 50.98% | 4.80% | — | 0.342 |
| gliner2-hivetrace-uni-ru | GLINER2 | 67.93% | 3.59% | — | 0.225 |
| rules-ru | RULES | 96.56% | 0.17% | — | 0.051 |