RU · PII
alrosait PII detection benchmark results
A frozen evaluation slice with 1,500 rows, 1,862 normalized gold annotations and source-level provenance.
1,500input rows
1,862gold annotations
274,584characters
50measured detectors
Dataset provenance
- Language group
- RU
- Task
- PII
- License
- mit
- Data categories
- ADDRESS, PERSON
- Project generated
- No
- Corrupted copy
- No
Rows without annotations are not verified clean. Reported extra masking is not a human-confirmed false-positive rate.
Detector outcomes
Sorted by fully hidden annotations. Training-source overlaps are excluded.
| Detector | Family | Fully hidden ↑ | Detected / any overlap ↑ | Extra masking ↓ | Char F1 ↑ |
|---|---|---|---|---|---|
| pplx | PPLX | 96.67% | 99.46% | 4.06% | 0.938 |
| ru-pii-ner | RUPII | 94.20% | 95.97% | 2.23% | 0.952 |
| gliner2-vladlinv | GLINER2 | 90.71% | 97.15% | 1.59% | 0.957 |
| gliner2-vladlinv-ru | GLINER2 | 90.49% | 96.94% | 1.40% | 0.958 |
| gliner-urchade | GLINER | 90.28% | 92.43% | 8.26% | 0.850 |
| gliner25-fastino | GLINER2 | 87.06% | 99.57% | 10.77% | 0.889 |
| gliner25-fastino-ru | GLINER2 | 86.63% | 99.03% | 6.07% | 0.923 |
| gliner2-hivetrace-omni-ru | GLINER2 | 78.84% | 89.53% | 8.04% | 0.794 |
| gliner2-hivetrace-omni | GLINER2 | 78.79% | 89.37% | 9.82% | 0.782 |
| gliner2-fastino | GLINER2 | 78.46% | 87.76% | 11.35% | 0.757 |
| gliner2-fastino-ru | GLINER2 | 78.25% | 86.68% | 5.23% | 0.805 |
| nuner-zero | GLINER | 77.93% | 99.36% | 10.18% | 0.873 |
| traciora | OPF | 76.80% | 92.27% | 6.91% | 0.865 |
| openai-base | OPF | 73.85% | 87.16% | 5.39% | 0.850 |
| ru-legal-ner | HF | 72.45% | 96.29% | 3.86% | 0.887 |
| gliner-nvidia | GLINER | 72.40% | 85.93% | 7.97% | 0.763 |
| gliner-multi-v21 | GLINER | 71.64% | 99.52% | 10.82% | 0.831 |
| gliner-multi-v21-ru | GLINER | 70.89% | 99.19% | 6.80% | 0.865 |
| opf-ru-v2 | OPF | 69.07% | 89.10% | 3.42% | 0.874 |
| apararti | OPF | 68.15% | 89.63% | 6.25% | 0.845 |
| bardsai-eu | ONNX | 65.95% | 97.10% | 5.33% | 0.897 |
| gliner-nvidia-ru | GLINER | 60.58% | 82.98% | 3.84% | 0.750 |
| davlan-xlmr | HF | 56.12% | 98.12% | 3.50% | 0.883 |
| gliner2-hivetrace-uni | GLINER2 | 55.42% | 73.04% | 1.66% | 0.699 |
| fef2-secret-ru | HF | 55.37% | 96.56% | 4.27% | 0.810 |
| ner-ru-yqelz | HF | 54.99% | 98.93% | 4.33% | 0.779 |
| stanza-ru | STANZA | 54.83% | 95.81% | 6.24% | 0.761 |
| pii-shield-onnx | ONNX | 52.74% | 87.49% | 3.55% | 0.832 |
| davlan-mbert | HF | 52.63% | 96.40% | 3.97% | 0.830 |
| gliner2-large | GLINER2 | 51.18% | 87.92% | 10.94% | 0.721 |
| gliner-pii-base | GLINER | 51.07% | 65.41% | 3.37% | 0.622 |
| gliner-pii-edge | GLINER | 50.38% | 72.72% | 5.64% | 0.646 |
| natasha | NATASHA | 50.05% | 79.11% | 2.46% | 0.676 |
| spacy-ru-lg | SPACY | 48.07% | 85.66% | 2.74% | 0.707 |
| gliner-urchade-ru | GLINER | 46.72% | 47.69% | 2.99% | 0.645 |
| gravitee-small | HF | 45.92% | 66.11% | 5.61% | 0.665 |
| opf-ru | OPF | 45.60% | 98.82% | 5.41% | 0.838 |
| gliner-stream-pii | GLINER | 45.11% | 77.39% | 6.24% | 0.697 |
| opf-kz-ru | OPF | 44.04% | 84.96% | 4.07% | 0.780 |
| mmbert32k | HF | 43.98% | 98.23% | 3.27% | 0.843 |
| gliner2-hivetrace-uni-ru | GLINER2 | 28.30% | 32.44% | 1.22% | 0.358 |
| kalyan-ettin | HF | 19.92% | 74.81% | 4.55% | 0.585 |
| nym-base | HF | 18.21% | 99.36% | 4.38% | 0.910 |
| nym-small | ONNX | 17.83% | 98.50% | 4.65% | 0.898 |
| openmed-nemotron | HF | 16.70% | 89.63% | 9.09% | 0.646 |
| openmed-multilingual | HF | 8.75% | 80.50% | 5.36% | 0.601 |
| ner-ru-gherman | HF | 1.77% | 96.19% | 2.51% | 0.839 |
| rules-ru | RULES | 0.00% | 0.00% | 2.46% | 0.000 |
| betterleaks | LEAKS | 0.00% | 0.00% | 0.00% | 0.000 |
| gitleaks | LEAKS | 0.00% | 0.00% | 0.00% | 0.000 |