RU · PII
corrupt-redmadrobot PII detection benchmark results
A frozen evaluation slice with 2,841 rows, 5,531 normalized gold annotations and source-level provenance.
2,841input rows
5,531gold annotations
598,076characters
56measured detectors
Dataset provenance
- Language group
- RU
- Task
- PII
- License
- mit
- Data categories
- ADDRESS, CONTACT, ID, NET, PERSON
- Project generated
- No
- Corrupted copy
- Yes
Rows without annotations are not verified clean. Reported extra masking is not a human-confirmed false-positive rate.
Detector outcomes
Sorted by untouched annotations. Training-source overlaps are excluded.
| Detector | Family | Untouched ↓ | Fully hidden ↑ | Extra masking ↓ | Char F1 ↑ |
|---|---|---|---|---|---|
| pplx+homoglyph | PPLX | 13.47% | 78.67% | 1.58% | 0.790 |
| pplx | PPLX | 13.52% | 78.65% | 1.57% | 0.787 |
| nym-base+homoglyph | HF | 16.31% | 72.03% | 1.95% | 0.773 |
| nym-base | HF | 16.98% | 71.27% | 1.92% | 0.768 |
| mmbert32k | HF | 20.70% | 50.99% | 2.83% | 0.657 |
| ru-pii-ner | RUPII | 21.50% | 72.93% | 5.89% | 0.701 |
| nym-small | ONNX | 21.53% | 62.34% | 2.21% | 0.730 |
| gliner2-fastino-ru | GLINER2 | 24.79% | 70.20% | 1.25% | 0.744 |
| ru-legal-ner | HF | 25.71% | 58.02% | 17.51% | 0.501 |
| ru-legal-ner+homoglyph | HF | 26.98% | 57.35% | 12.69% | 0.525 |
| apararti | OPF | 27.08% | 60.91% | 3.62% | 0.661 |
| gliner-nvidia-ru | GLINER | 30.30% | 65.32% | 1.25% | 0.713 |
| gliner2-fastino | GLINER2 | 30.59% | 62.19% | 1.11% | 0.721 |
| pii-shield-onnx | ONNX | 32.15% | 54.40% | 44.25% | 0.390 |
| opf-kz-ru | OPF | 32.56% | 54.28% | 3.25% | 0.627 |
| traciora | OPF | 34.66% | 50.84% | 2.56% | 0.631 |
| opf-ru | OPF | 34.88% | 42.27% | 5.95% | 0.552 |
| bardsai-eu | ONNX | 35.29% | 53.34% | 1.15% | 0.654 |
| gliner2-hivetrace-omni-ru | GLINER2 | 35.47% | 57.51% | 0.88% | 0.681 |
| gliner-nvidia+homoglyph | GLINER | 35.64% | 60.12% | 1.25% | 0.658 |
| gliner-nvidia | GLINER | 36.76% | 58.99% | 1.48% | 0.649 |
| gravitee-small | HF | 39.60% | 52.99% | 4.23% | 0.539 |
| gliner2-hivetrace-omni | GLINER2 | 40.48% | 52.31% | 0.89% | 0.640 |
| openai-base | OPF | 40.64% | 51.82% | 1.79% | 0.604 |
| opf-ru-v2+homoglyph | OPF | 41.10% | 44.71% | 0.86% | 0.608 |
| opf-ru-v2 | OPF | 41.31% | 44.31% | 1.06% | 0.606 |
| gliner-pii-edge | GLINER | 42.40% | 50.46% | 2.03% | 0.594 |
| gliner-urchade-ru | GLINER | 43.90% | 54.22% | 0.76% | 0.674 |
| gliner-urchade | GLINER | 44.04% | 53.35% | 1.06% | 0.670 |
| gliner2-large | GLINER2 | 44.42% | 50.23% | 1.05% | 0.626 |
| nuner-zero | GLINER | 44.55% | 45.98% | 0.73% | 0.659 |
| gliner2-hivetrace-uni | GLINER2 | 45.56% | 45.81% | 1.84% | 0.536 |
| gliner-stream-pii | GLINER | 45.67% | 32.47% | 1.03% | 0.498 |
| openmed-multilingual | HF | 47.32% | 36.14% | 3.67% | 0.552 |
| fef2-secret-ru | HF | 48.63% | 44.59% | 0.70% | 0.569 |
| gliner25-fastino-ru | GLINER2 | 49.45% | 47.46% | 0.50% | 0.599 |
| gliner2-vladlinv-ru | GLINER2 | 51.00% | 47.89% | 0.14% | 0.587 |
| stanza-ru | STANZA | 51.08% | 40.14% | 14.14% | 0.277 |
| openmed-nemotron | HF | 51.46% | 32.98% | 6.29% | 0.411 |
| kalyan-ettin | HF | 56.36% | 30.34% | 1.65% | 0.495 |
| gliner2-vladlinv+homoglyph | GLINER2 | 56.66% | 42.38% | 0.10% | 0.523 |
| gliner2-vladlinv | GLINER2 | 57.73% | 41.31% | 0.10% | 0.515 |
| ner-ru-yqelz | HF | 57.73% | 32.53% | 8.18% | 0.329 |
| ner-ru-gherman+homoglyph | HF | 59.66% | 31.24% | 0.28% | 0.425 |
| ner-ru-gherman | HF | 60.37% | 30.65% | 0.27% | 0.418 |
| davlan-xlmr | HF | 61.78% | 33.39% | 0.61% | 0.399 |
| gliner25-fastino | GLINER2 | 63.39% | 32.92% | 1.50% | 0.467 |
| davlan-mbert | HF | 63.82% | 32.60% | 0.73% | 0.386 |
| gliner-pii-base | GLINER | 63.84% | 32.67% | 0.60% | 0.471 |
| gliner-multi-v21-ru | GLINER | 68.38% | 27.93% | 0.62% | 0.355 |
| gliner-multi-v21 | GLINER | 70.96% | 25.04% | 0.75% | 0.326 |
| gliner2-hivetrace-uni-ru | GLINER2 | 72.59% | 24.46% | 0.53% | 0.300 |
| spacy-ru-lg | SPACY | 74.67% | 21.73% | 6.20% | 0.230 |
| natasha | NATASHA | 78.14% | 18.79% | 1.32% | 0.227 |
| rules-ru | RULES | 88.05% | 9.65% | 0.18% | 0.259 |
| spacy-alrosait | SPACY | 88.81% | 10.05% | 0.18% | 0.140 |