RU · PII
nym-ru PII detection benchmark results
A frozen evaluation slice with 1,500 rows, 9,497 normalized gold annotations and source-level provenance.
1,500input rows
9,497gold annotations
601,331characters
69measured detectors
Dataset provenance
- Language group
- RU
- Task
- PII
- License
- mit
- Data categories
- ACCOUNT, ADDRESS, CONTACT, DATE, ID, NET, ORG, OTHER, PERSON, SECRET
- Project generated
- No
- Corrupted copy
- No
Rows without annotations are not verified clean. Reported extra masking is not a human-confirmed false-positive rate.
Detector outcomes
Sorted by untouched annotations. Training-source overlaps are excluded.
| Detector | Family | Untouched ↓ | Fully hidden ↑ | Extra masking ↓ | Char F1 ↑ |
|---|---|---|---|---|---|
| pplx+cpu-int8 | PPLX | 0.49% | 95.61% | — | 0.853 |
| pplx | PPLX | 3.94% | 94.01% | — | 0.911 |
| mmbert32k | HF | 8.49% | 63.43% | — | 0.884 |
| opf-ru | OPF | 11.54% | 75.66% | — | 0.894 |
| apararti | OPF | 11.55% | 81.98% | — | 0.862 |
| openmed-multilingual | HF | 11.87% | 76.77% | — | 0.881 |
| openai-base-onnx | ONNX | 12.32% | 82.43% | — | 0.852 |
| openai-base | OPF | 12.33% | 82.37% | — | 0.852 |
| bardsai-eu | ONNX | 13.90% | 74.20% | — | 0.872 |
| gliner-nvidia | GLINER | 14.14% | 82.17% | — | 0.891 |
| gliner-nvidia-ru | GLINER | 15.68% | 80.73% | — | 0.893 |
| ru-pii-ner | RUPII | 15.71% | 83.39% | — | 0.864 |
| gliner2-fastino-ru | GLINER2 | 17.86% | 77.68% | — | 0.870 |
| opf-kz-ru | OPF | 18.41% | 73.87% | — | 0.810 |
| gliner2-fastino | GLINER2 | 18.85% | 76.07% | — | 0.871 |
| gliner2-hivetrace-omni-ru | GLINER2 | 18.94% | 74.77% | — | 0.867 |
| ru-legal-ner+cpu-int8 | HF | 19.60% | 64.17% | — | 0.827 |
| ru-legal-ner | HF | 20.30% | 63.66% | — | 0.824 |
| ru-legal-ner+cpu | HF | 20.30% | 63.66% | — | 0.824 |
| gliner2-hivetrace-omni | GLINER2 | 20.42% | 72.82% | — | 0.867 |
| openmed-nemotron | HF | 22.02% | 63.78% | — | 0.739 |
| gliner-pii-edge | GLINER | 24.17% | 68.50% | — | 0.781 |
| pii-shield-onnx | ONNX | 27.08% | 58.92% | — | 0.784 |
| traciora | OPF | 28.70% | 60.56% | — | 0.775 |
| opf-ru-v2 | OPF | 29.59% | 61.97% | — | 0.786 |
| kalyan-ettin | HF | 30.42% | 53.39% | — | 0.745 |
| gliner2-vladlinv-ru | GLINER2 | 33.84% | 65.58% | — | 0.766 |
| nuner-zero | GLINER | 34.08% | 58.63% | — | 0.764 |
| gliner2-vladlinv | GLINER2 | 34.48% | 64.75% | — | 0.762 |
| gliner-stream-pii | GLINER | 35.53% | 54.12% | — | 0.717 |
| mmbert32k+cpu-int8 | HF | 36.19% | 27.20% | — | 0.648 |
| gliner2-large | GLINER2 | 36.70% | 59.01% | — | 0.745 |
| gliner-urchade | GLINER | 41.14% | 56.28% | — | 0.786 |
| fef2-secret-ru | HF | 41.84% | 48.04% | — | 0.682 |
| gliner25-fastino-ru | GLINER2 | 42.61% | 55.14% | — | 0.708 |
| gliner2-hivetrace-uni | GLINER2 | 44.29% | 49.67% | — | 0.723 |
| gliner-urchade-ru | GLINER | 47.12% | 51.69% | — | 0.742 |
| fef2-secret-ru+cpu-int8 | HF | 47.84% | 42.86% | — | 0.641 |
| gravitee-small+cpu-int8 | HF | 54.30% | 36.20% | — | 0.548 |
| stanza-ru | STANZA | 54.39% | 33.41% | — | 0.476 |
| gravitee-small | HF | 54.94% | 36.16% | — | 0.561 |
| gliner25-fastino | GLINER2 | 55.34% | 41.86% | — | 0.640 |
| gliner-multi-v21-ru | GLINER | 55.58% | 39.38% | — | 0.526 |
| gliner-multi-v21 | GLINER | 57.04% | 37.50% | — | 0.525 |
| gliner-pii-base | GLINER | 60.28% | 35.11% | — | 0.580 |
| ner-ru-yqelz | HF | 61.67% | 29.78% | — | 0.442 |
| ner-ru-gherman | HF | 62.15% | 25.38% | — | 0.441 |
| ner-ru-gherman-onnx | ONNX | 62.39% | 25.25% | — | 0.437 |
| kalyan-ettin+cpu-int8 | HF | 62.63% | 20.26% | — | 0.430 |
| gliner2-hivetrace-uni-ru | GLINER2 | 62.82% | 35.60% | — | 0.462 |
| spacy-ru-lg | SPACY | 63.34% | 30.50% | — | 0.442 |
| ner-ru-gherman+cpu-int8 | HF | 63.62% | 24.77% | — | 0.426 |
| davlan-xlmr | HF | 63.71% | 29.67% | — | 0.460 |
| davlan-mbert | HF | 64.09% | 28.46% | — | 0.438 |
| spacy-alrosait | SPACY | 65.96% | 31.10% | — | 0.418 |
| davlan-mbert+cpu-int8 | HF | 65.96% | 25.63% | — | 0.418 |
| natasha | NATASHA | 66.38% | 27.46% | — | 0.394 |
| davlan-xlmr+cpu-int8 | HF | 74.07% | 17.89% | — | 0.313 |
| rules-ru | RULES | 78.90% | 20.83% | — | 0.501 |
| gliner-pii-edge+cpu-int8 | GLINER | 79.04% | 18.26% | — | 0.320 |
| gliner-pii-base+cpu-int8 | GLINER | 99.99% | 0.01% | — | 0.000 |
| betterleaks | LEAKS | 100.00% | 0.00% | — | 0.000 |
| gitleaks | LEAKS | 100.00% | 0.00% | — | 0.000 |
| gliner-multi-v21+cpu-int8 | GLINER | 100.00% | 0.00% | — | 0.000 |
| gliner-nvidia+cpu-int8 | GLINER | 100.00% | 0.00% | — | 0.000 |
| gliner-urchade+cpu-int8 | GLINER | 100.00% | 0.00% | — | 0.000 |
| gliner-multi-v21-ru+cpu-int8 | GLINER | 100.00% | 0.00% | — | 0.000 |
| gliner-nvidia-ru+cpu-int8 | GLINER | 100.00% | 0.00% | — | 0.000 |
| gliner-urchade-ru+cpu-int8 | GLINER | 100.00% | 0.00% | — | 0.000 |