RU · PII
corrupt-redmadrobot PII detection benchmark results
A frozen evaluation slice with 2,841 rows, 5,531 normalized gold annotations and source-level provenance.
2,841input rows
5,531gold annotations
598,076characters
56measured detectors
Dataset provenance
- Language group
- RU
- Task
- PII
- License
- mit
- Data categories
- ADDRESS, CONTACT, ID, NET, PERSON
- Project generated
- No
- Corrupted copy
- Yes
Rows without annotations are not verified clean. Reported extra masking is not a human-confirmed false-positive rate.
Detector outcomes
Sorted by fully hidden annotations. Training-source overlaps are excluded.
| Detector | Family | Fully hidden ↑ | Detected / any overlap ↑ | Extra masking ↓ | Char F1 ↑ |
|---|---|---|---|---|---|
| pplx+homoglyph | PPLX | 78.67% | 86.53% | 1.58% | 0.790 |
| pplx | PPLX | 78.65% | 86.48% | 1.57% | 0.787 |
| ru-pii-ner | RUPII | 72.93% | 78.50% | 5.89% | 0.701 |
| nym-base+homoglyph | HF | 72.03% | 83.69% | 1.95% | 0.773 |
| nym-base | HF | 71.27% | 83.02% | 1.92% | 0.768 |
| gliner2-fastino-ru | GLINER2 | 70.20% | 75.21% | 1.25% | 0.744 |
| gliner-nvidia-ru | GLINER | 65.32% | 69.70% | 1.25% | 0.713 |
| nym-small | ONNX | 62.34% | 78.47% | 2.21% | 0.730 |
| gliner2-fastino | GLINER2 | 62.19% | 69.41% | 1.11% | 0.721 |
| apararti | OPF | 60.91% | 72.92% | 3.62% | 0.661 |
| gliner-nvidia+homoglyph | GLINER | 60.12% | 64.36% | 1.25% | 0.658 |
| gliner-nvidia | GLINER | 58.99% | 63.24% | 1.48% | 0.649 |
| ru-legal-ner | HF | 58.02% | 74.29% | 17.51% | 0.501 |
| gliner2-hivetrace-omni-ru | GLINER2 | 57.51% | 64.53% | 0.88% | 0.681 |
| ru-legal-ner+homoglyph | HF | 57.35% | 73.02% | 12.69% | 0.525 |
| pii-shield-onnx | ONNX | 54.40% | 67.85% | 44.25% | 0.390 |
| opf-kz-ru | OPF | 54.28% | 67.44% | 3.25% | 0.627 |
| gliner-urchade-ru | GLINER | 54.22% | 56.10% | 0.76% | 0.674 |
| gliner-urchade | GLINER | 53.35% | 55.96% | 1.06% | 0.670 |
| bardsai-eu | ONNX | 53.34% | 64.71% | 1.15% | 0.654 |
| gravitee-small | HF | 52.99% | 60.40% | 4.23% | 0.539 |
| gliner2-hivetrace-omni | GLINER2 | 52.31% | 59.52% | 0.89% | 0.640 |
| openai-base | OPF | 51.82% | 59.36% | 1.79% | 0.604 |
| mmbert32k | HF | 50.99% | 79.30% | 2.83% | 0.657 |
| traciora | OPF | 50.84% | 65.34% | 2.56% | 0.631 |
| gliner-pii-edge | GLINER | 50.46% | 57.60% | 2.03% | 0.594 |
| gliner2-large | GLINER2 | 50.23% | 55.58% | 1.05% | 0.626 |
| gliner2-vladlinv-ru | GLINER2 | 47.89% | 49.00% | 0.14% | 0.587 |
| gliner25-fastino-ru | GLINER2 | 47.46% | 50.55% | 0.50% | 0.599 |
| nuner-zero | GLINER | 45.98% | 55.45% | 0.73% | 0.659 |
| gliner2-hivetrace-uni | GLINER2 | 45.81% | 54.44% | 1.84% | 0.536 |
| opf-ru-v2+homoglyph | OPF | 44.71% | 58.90% | 0.86% | 0.608 |
| fef2-secret-ru | HF | 44.59% | 51.37% | 0.70% | 0.569 |
| opf-ru-v2 | OPF | 44.31% | 58.69% | 1.06% | 0.606 |
| gliner2-vladlinv+homoglyph | GLINER2 | 42.38% | 43.34% | 0.10% | 0.523 |
| opf-ru | OPF | 42.27% | 65.12% | 5.95% | 0.552 |
| gliner2-vladlinv | GLINER2 | 41.31% | 42.27% | 0.10% | 0.515 |
| stanza-ru | STANZA | 40.14% | 48.92% | 14.14% | 0.277 |
| openmed-multilingual | HF | 36.14% | 52.68% | 3.67% | 0.552 |
| davlan-xlmr | HF | 33.39% | 38.22% | 0.61% | 0.399 |
| openmed-nemotron | HF | 32.98% | 48.54% | 6.29% | 0.411 |
| gliner25-fastino | GLINER2 | 32.92% | 36.61% | 1.50% | 0.467 |
| gliner-pii-base | GLINER | 32.67% | 36.16% | 0.60% | 0.471 |
| davlan-mbert | HF | 32.60% | 36.18% | 0.73% | 0.386 |
| ner-ru-yqelz | HF | 32.53% | 42.27% | 8.18% | 0.329 |
| gliner-stream-pii | GLINER | 32.47% | 54.33% | 1.03% | 0.498 |
| ner-ru-gherman+homoglyph | HF | 31.24% | 40.34% | 0.28% | 0.425 |
| ner-ru-gherman | HF | 30.65% | 39.63% | 0.27% | 0.418 |
| kalyan-ettin | HF | 30.34% | 43.64% | 1.65% | 0.495 |
| gliner-multi-v21-ru | GLINER | 27.93% | 31.62% | 0.62% | 0.355 |
| gliner-multi-v21 | GLINER | 25.04% | 29.04% | 0.75% | 0.326 |
| gliner2-hivetrace-uni-ru | GLINER2 | 24.46% | 27.41% | 0.53% | 0.300 |
| spacy-ru-lg | SPACY | 21.73% | 25.33% | 6.20% | 0.230 |
| natasha | NATASHA | 18.79% | 21.86% | 1.32% | 0.227 |
| spacy-alrosait | SPACY | 10.05% | 11.19% | 0.18% | 0.140 |
| rules-ru | RULES | 9.65% | 11.95% | 0.18% | 0.259 |