RU · PII
redact-ru PII detection benchmark results
A frozen evaluation slice with 500 rows, 9,230 normalized gold annotations and source-level provenance.
500input rows
9,230gold annotations
860,595characters
64measured detectors
Dataset provenance
- Language group
- RU
- Task
- PII
- License
- other (gated, terms accepted)
- Data categories
- ACCOUNT, ADDRESS, CONTACT, DATE, ID, NET, ORG, OTHER, PERSON, SECRET
- Project generated
- No
- Corrupted copy
- No
Rows without annotations are not verified clean. Reported extra masking is not a human-confirmed false-positive rate.
Detector outcomes
Sorted by untouched annotations. Training-source overlaps are excluded.
| Detector | Family | Untouched ↓ | Fully hidden ↑ | Extra masking ↓ | Char F1 ↑ |
|---|---|---|---|---|---|
| bardsai-eu | ONNX | 7.87% | 77.83% | 9.64% | 0.753 |
| pplx+ov100 | PPLX | 9.17% | 87.25% | 8.63% | 0.713 |
| pplx | PPLX | 9.54% | 87.12% | 9.50% | 0.709 |
| pplx+sent300 | PPLX | 9.98% | 84.31% | 8.67% | 0.688 |
| gliner-nvidia+sent300 | GLINER | 10.25% | 65.89% | 12.39% | 0.615 |
| gliner-nvidia | GLINER | 12.90% | 63.53% | 10.06% | 0.624 |
| gliner-urchade | GLINER | 12.98% | 80.55% | 16.19% | 0.670 |
| gliner-nvidia+ov100 | GLINER | 13.09% | 63.47% | 9.50% | 0.628 |
| nym-base+sent300 | HF | 14.34% | 61.37% | 9.54% | 0.670 |
| gliner2-fastino | GLINER2 | 14.36% | 76.74% | 16.60% | 0.685 |
| gliner2-hivetrace-omni | GLINER2 | 15.51% | 77.79% | 14.27% | 0.705 |
| nym-base+ov100 | HF | 15.60% | 60.85% | 9.99% | 0.675 |
| nym-base | HF | 15.75% | 60.60% | 9.40% | 0.674 |
| apararti | OPF | 16.85% | 77.54% | 12.88% | 0.648 |
| nym-small | ONNX | 17.23% | 59.90% | 8.67% | 0.675 |
| nuner-zero | GLINER | 17.83% | 73.86% | 12.84% | 0.682 |
| openai-base | OPF | 19.34% | 76.94% | 11.76% | 0.654 |
| opf-ru | OPF | 19.56% | 63.13% | 8.88% | 0.651 |
| ru-legal-ner+sent300 | HF | 20.13% | 61.37% | 19.32% | 0.616 |
| opf-kz-ru | OPF | 20.74% | 72.24% | 8.42% | 0.641 |
| gliner2-hivetrace-uni | GLINER2 | 20.86% | 72.42% | 6.93% | 0.685 |
| ru-legal-ner+ov100 | HF | 21.33% | 59.51% | 16.71% | 0.624 |
| gliner2-hivetrace-omni-ru | GLINER2 | 21.72% | 70.68% | 13.51% | 0.674 |
| mmbert32k | HF | 21.79% | 40.94% | 9.26% | 0.557 |
| openmed-multilingual | HF | 22.06% | 53.24% | 9.08% | 0.609 |
| ru-pii-ner | RUPII | 22.30% | 75.20% | 8.39% | 0.711 |
| ru-legal-ner | HF | 22.64% | 58.32% | 18.34% | 0.629 |
| openmed-nemotron | HF | 25.68% | 50.04% | 9.01% | 0.543 |
| gliner25-fastino+ov100 | GLINER2 | 26.08% | 69.19% | 5.81% | 0.702 |
| gliner2-fastino-ru | GLINER2 | 26.38% | 65.46% | 12.50% | 0.650 |
| gliner25-fastino | GLINER2 | 26.42% | 68.68% | 5.53% | 0.701 |
| opf-ru-v2+sent300 | OPF | 26.68% | 64.40% | 6.40% | 0.712 |
| gliner25-fastino+sent300 | GLINER2 | 27.00% | 66.78% | 6.54% | 0.685 |
| opf-ru-v2+ov100 | OPF | 27.13% | 64.10% | 6.09% | 0.713 |
| opf-ru-v2 | OPF | 27.77% | 63.42% | 6.89% | 0.711 |
| gliner-nvidia-ru | GLINER | 27.85% | 50.07% | 9.12% | 0.537 |
| kalyan-ettin | HF | 28.36% | 44.88% | 7.87% | 0.533 |
| traciora | OPF | 29.82% | 62.62% | 5.92% | 0.707 |
| pii-shield-onnx | ONNX | 29.90% | 55.51% | 6.61% | 0.535 |
| gliner25-fastino-ru | GLINER2 | 30.96% | 64.12% | 9.36% | 0.696 |
| gliner25-fastino+nochunk | GLINER2 | 31.17% | 64.78% | 7.10% | 0.707 |
| fef2-secret-ru | HF | 31.79% | 54.28% | 7.27% | 0.629 |
| gliner-multi-v21 | GLINER | 32.37% | 56.88% | 11.35% | 0.561 |
| gliner-pii-edge | GLINER | 32.41% | 56.38% | 14.06% | 0.531 |
| gliner2-large | GLINER2 | 33.16% | 58.33% | 6.96% | 0.592 |
| mmbert32k+nochunk | HF | 36.11% | 24.88% | 6.47% | 0.473 |
| stanza-ru | STANZA | 36.71% | 52.13% | 10.37% | 0.427 |
| gliner25-fastino-ru+nochunk | GLINER2 | 36.80% | 59.34% | 11.14% | 0.689 |
| ner-ru-gherman | HF | 39.54% | 32.86% | 3.79% | 0.532 |
| davlan-xlmr | HF | 40.34% | 50.02% | 5.19% | 0.546 |
| davlan-mbert | HF | 41.81% | 49.02% | 6.54% | 0.524 |
| ner-ru-yqelz | HF | 44.38% | 46.01% | 16.05% | 0.482 |
| gliner2-vladlinv | GLINER2 | 48.35% | 49.64% | 3.76% | 0.592 |
| gliner2-vladlinv-ru | GLINER2 | 49.22% | 48.43% | 6.02% | 0.592 |
| spacy-ru-lg | SPACY | 50.40% | 42.12% | 7.07% | 0.435 |
| natasha | NATASHA | 50.91% | 42.15% | 5.71% | 0.434 |
| gravitee-small | HF | 51.84% | 39.88% | 4.28% | 0.476 |
| spacy-alrosait | SPACY | 54.70% | 42.06% | 4.35% | 0.483 |
| gliner-stream-pii | GLINER | 56.24% | 30.16% | 4.42% | 0.445 |
| gliner-urchade-ru | GLINER | 56.51% | 37.45% | 10.69% | 0.508 |
| gliner-pii-base | GLINER | 64.27% | 27.41% | 3.41% | 0.417 |
| gliner-multi-v21-ru | GLINER | 67.92% | 23.95% | 2.54% | 0.391 |
| gliner2-hivetrace-uni-ru | GLINER2 | 80.25% | 16.67% | 0.80% | 0.237 |
| rules-ru | RULES | 81.27% | 18.02% | 2.44% | 0.363 |