RU · PII
scanpatch PII detection benchmark results
A frozen evaluation slice with 1,500 rows, 8,708 normalized gold annotations and source-level provenance.
1,500input rows
8,708gold annotations
521,056characters
51measured detectors
Dataset provenance
- Language group
- RU
- Task
- PII
- License
- mit
- Data categories
- ADDRESS, CONTACT, ID, NET, ORG, OTHER, PERSON
- Project generated
- No
- Corrupted copy
- No
Rows without annotations are not verified clean. Reported extra masking is not a human-confirmed false-positive rate.
Detector outcomes
Sorted by fully hidden annotations. Training-source overlaps are excluded.
| Detector | Family | Fully hidden ↑ | Detected / any overlap ↑ | Extra masking ↓ | Char F1 ↑ |
|---|---|---|---|---|---|
| pplx | PPLX | 85.54% | 87.55% | 1.29% | 0.862 |
| nuner-zero | GLINER | 76.22% | 82.44% | 7.76% | 0.803 |
| apararti | OPF | 74.44% | 81.14% | 2.32% | 0.817 |
| gliner2-fastino | GLINER2 | 74.23% | 81.19% | 3.58% | 0.781 |
| bardsai-eu | ONNX | 72.58% | 81.73% | 1.26% | 0.801 |
| nym-small | ONNX | 71.30% | 89.62% | 1.33% | 0.846 |
| nym-base | HF | 70.69% | 91.09% | 1.45% | 0.856 |
| openai-base | OPF | 70.22% | 74.39% | 1.30% | 0.775 |
| gliner-urchade | GLINER | 66.69% | 72.57% | 7.05% | 0.696 |
| ru-pii-ner | RUPII | 65.94% | 67.88% | 1.33% | 0.707 |
| ru-legal-ner | HF | 62.21% | 80.20% | 1.70% | 0.743 |
| ru-legal-ner+cpu | HF | 62.21% | 80.20% | 1.70% | 0.743 |
| gliner2-fastino-ru | GLINER2 | 61.50% | 69.30% | 3.23% | 0.719 |
| gliner25-fastino | GLINER2 | 61.04% | 65.14% | 3.00% | 0.723 |
| fef2-secret-ru | HF | 59.46% | 67.26% | 1.14% | 0.680 |
| opf-kz-ru | OPF | 59.30% | 68.73% | 1.90% | 0.760 |
| traciora | OPF | 59.18% | 67.50% | 3.09% | 0.685 |
| gliner2-hivetrace-omni | GLINER2 | 59.11% | 66.69% | 2.22% | 0.695 |
| pii-shield-onnx | ONNX | 58.23% | 77.45% | 1.56% | 0.789 |
| davlan-xlmr | HF | 58.21% | 62.23% | 1.11% | 0.636 |
| stanza-ru | STANZA | 57.82% | 65.87% | 3.64% | 0.624 |
| gliner-nvidia | GLINER | 57.30% | 75.06% | 4.25% | 0.718 |
| gliner-pii-edge | GLINER | 56.99% | 67.31% | 7.81% | 0.666 |
| opf-ru-v2 | OPF | 56.45% | 67.19% | 1.03% | 0.715 |
| davlan-mbert | HF | 55.81% | 60.51% | 1.12% | 0.622 |
| opf-ru | OPF | 54.67% | 76.53% | 2.73% | 0.712 |
| gliner2-hivetrace-uni | GLINER2 | 54.16% | 58.68% | 1.41% | 0.632 |
| gliner2-hivetrace-omni-ru | GLINER2 | 54.09% | 62.26% | 2.13% | 0.664 |
| gliner-multi-v21 | GLINER | 53.55% | 59.62% | 3.41% | 0.600 |
| gliner25-fastino-ru | GLINER2 | 52.85% | 56.45% | 2.15% | 0.660 |
| openmed-multilingual | HF | 51.40% | 76.22% | 2.34% | 0.775 |
| spacy-ru-lg | SPACY | 50.93% | 57.44% | 1.90% | 0.589 |
| mmbert32k | HF | 50.42% | 83.77% | 1.34% | 0.758 |
| gliner-nvidia-ru | GLINER | 49.48% | 66.59% | 1.64% | 0.682 |
| natasha | NATASHA | 49.31% | 54.87% | 1.55% | 0.566 |
| gliner2-large | GLINER2 | 48.97% | 54.96% | 7.18% | 0.576 |
| openmed-nemotron | HF | 48.85% | 72.85% | 3.79% | 0.691 |
| gliner-urchade-ru | GLINER | 47.00% | 52.18% | 5.52% | 0.614 |
| gliner2-vladlinv | GLINER2 | 46.41% | 48.11% | 0.57% | 0.558 |
| gliner-multi-v21-ru | GLINER | 45.99% | 50.71% | 2.71% | 0.545 |
| ner-ru-yqelz | HF | 44.89% | 52.04% | 4.12% | 0.531 |
| kalyan-ettin | HF | 42.55% | 66.32% | 1.79% | 0.698 |
| gliner-stream-pii | GLINER | 38.81% | 51.62% | 3.94% | 0.539 |
| ner-ru-gherman | HF | 36.15% | 58.41% | 0.51% | 0.549 |
| gliner2-vladlinv-ru | GLINER2 | 35.38% | 36.68% | 0.56% | 0.473 |
| gliner-pii-base | GLINER | 26.19% | 32.46% | 3.29% | 0.447 |
| gravitee-small | HF | 24.82% | 35.94% | 5.96% | 0.460 |
| gliner2-hivetrace-uni-ru | GLINER2 | 19.09% | 20.64% | 0.54% | 0.286 |
| rules-ru | RULES | 11.66% | 14.54% | 0.18% | 0.364 |
| betterleaks | LEAKS | 0.00% | 0.00% | 0.00% | 0.000 |
| gitleaks | LEAKS | 0.00% | 0.00% | 0.00% | 0.000 |