RU · PII
alexen2 PII detection benchmark results
A frozen evaluation slice with 911 rows, 1,261 normalized gold annotations and source-level provenance.
911input rows
1,261gold annotations
37,262characters
49measured detectors
Dataset provenance
- Language group
- RU
- Task
- PII
- License
- not specified
- Data categories
- CONTACT, PERSON
- Project generated
- No
- Corrupted copy
- No
Rows without annotations are not verified clean. Reported extra masking is not a human-confirmed false-positive rate.
Detector outcomes
Sorted by untouched annotations. Training-source overlaps are excluded.
| Detector | Family | Untouched ↓ | Fully hidden ↑ | Extra masking ↓ | Char F1 ↑ |
|---|---|---|---|---|---|
| gliner2-vladlinv-ru | GLINER2 | 0.00% | 26.33% | 0.00% | 0.975 |
| gliner2-vladlinv | GLINER2 | 0.00% | 26.33% | 0.00% | 0.975 |
| ru-pii-ner | RUPII | 0.00% | 26.33% | 6.89% | 0.972 |
| gliner2-fastino | GLINER2 | 0.24% | 27.76% | 8.37% | 0.969 |
| gliner2-fastino-ru | GLINER2 | 0.32% | 27.36% | 4.31% | 0.972 |
| gliner2-hivetrace-omni | GLINER2 | 0.40% | 27.68% | 9.01% | 0.969 |
| gliner2-hivetrace-omni-ru | GLINER2 | 0.40% | 27.68% | 8.95% | 0.969 |
| gliner25-fastino | GLINER2 | 0.40% | 26.96% | 15.90% | 0.963 |
| gliner-urchade | GLINER | 0.56% | 27.99% | 7.08% | 0.970 |
| gliner25-fastino-ru | GLINER2 | 0.63% | 27.12% | 9.34% | 0.968 |
| nuner-zero | GLINER | 0.79% | 27.91% | 11.27% | 0.947 |
| nym-base | HF | 1.19% | 11.82% | 12.94% | 0.932 |
| gliner-nvidia | GLINER | 1.43% | 26.49% | 6.31% | 0.957 |
| mmbert32k | HF | 1.67% | 22.60% | 8.11% | 0.954 |
| gliner-nvidia-ru | GLINER | 1.98% | 23.47% | 8.63% | 0.949 |
| nym-small | ONNX | 3.01% | 10.23% | 12.49% | 0.943 |
| traciora | OPF | 3.25% | 25.85% | 12.30% | 0.941 |
| opf-ru | OPF | 4.28% | 23.47% | 11.46% | 0.942 |
| pii-shield-onnx | ONNX | 5.00% | 22.84% | 9.40% | 0.946 |
| pplx | PPLX | 5.23% | 55.59% | 5.80% | 0.905 |
| gliner-pii-base | GLINER | 5.47% | 24.43% | 10.62% | 0.945 |
| ru-legal-ner | HF | 5.87% | 23.79% | 6.83% | 0.917 |
| gliner2-large | GLINER2 | 6.50% | 21.73% | 6.57% | 0.923 |
| openmed-nemotron | HF | 6.66% | 11.18% | 16.10% | 0.886 |
| bardsai-eu | ONNX | 7.06% | 26.33% | 11.46% | 0.912 |
| gliner-pii-edge | GLINER | 7.14% | 21.97% | 18.22% | 0.904 |
| apararti | OPF | 7.38% | 22.05% | 11.20% | 0.937 |
| opf-kz-ru | OPF | 7.61% | 21.89% | 13.46% | 0.922 |
| opf-ru-v2 | OPF | 7.93% | 23.31% | 10.24% | 0.938 |
| kalyan-ettin | HF | 8.41% | 14.20% | 12.43% | 0.874 |
| openmed-multilingual | HF | 11.50% | 7.06% | 9.27% | 0.895 |
| openai-base | OPF | 12.13% | 20.86% | 8.63% | 0.917 |
| gliner-multi-v21 | GLINER | 12.45% | 26.96% | 6.12% | 0.855 |
| gliner2-hivetrace-uni | GLINER2 | 12.69% | 21.81% | 4.51% | 0.894 |
| gravitee-small | HF | 14.12% | 18.72% | 40.57% | 0.712 |
| gliner-stream-pii | GLINER | 15.07% | 22.13% | 20.99% | 0.873 |
| gliner-multi-v21-ru | GLINER | 15.94% | 26.72% | 3.48% | 0.831 |
| fef2-secret-ru | HF | 26.57% | 22.20% | 8.82% | 0.814 |
| gliner-urchade-ru | GLINER | 27.99% | 9.04% | 2.00% | 0.825 |
| ner-ru-yqelz | HF | 44.01% | 26.09% | 18.61% | 0.587 |
| rules-ru | RULES | 45.28% | 4.68% | 0.00% | 0.733 |
| ner-ru-gherman | HF | 47.82% | 4.76% | 9.53% | 0.577 |
| stanza-ru | STANZA | 48.85% | 21.33% | 14.94% | 0.600 |
| spacy-ru-lg | SPACY | 53.29% | 22.52% | 10.50% | 0.566 |
| davlan-xlmr | HF | 54.40% | 22.36% | 11.01% | 0.555 |
| davlan-mbert | HF | 55.11% | 20.86% | 10.05% | 0.552 |
| natasha | NATASHA | 57.89% | 21.25% | 13.33% | 0.520 |
| spacy-alrosait | SPACY | 61.78% | 18.32% | 11.78% | 0.504 |
| gliner2-hivetrace-uni-ru | GLINER2 | 83.74% | 5.15% | 0.00% | 0.239 |