RU · PII
synth-jira-comments PII detection benchmark results
A frozen evaluation slice with 300 rows, 2,705 normalized gold annotations and source-level provenance.
300input rows
2,705gold annotations
201,437characters
49measured detectors
Dataset provenance
- Language group
- RU
- Task
- PII
- License
- cc-by-4.0
- Data categories
- ACCOUNT, CONTACT, NET, PERSON, SECRET
- Project generated
- Yes
- Corrupted copy
- No
Rows without annotations are not verified clean. Reported extra masking is not a human-confirmed false-positive rate.
Detector outcomes
Sorted by fully hidden annotations. Training-source overlaps are excluded.
| Detector | Family | Fully hidden ↑ | Detected / any overlap ↑ | Extra masking ↓ | Char F1 ↑ |
|---|---|---|---|---|---|
| pplx | PPLX | 99.59% | 99.93% | — | 0.818 |
| gliner2-hivetrace-omni | GLINER2 | 88.65% | 89.39% | — | 0.898 |
| pii-shield-onnx | ONNX | 85.62% | 91.20% | — | 0.667 |
| gliner2-fastino | GLINER2 | 84.92% | 86.28% | — | 0.801 |
| gliner2-fastino-ru | GLINER2 | 83.84% | 84.73% | — | 0.803 |
| gliner-nvidia | GLINER | 81.44% | 86.36% | — | 0.895 |
| gliner25-fastino | GLINER2 | 81.11% | 81.89% | — | 0.807 |
| nuner-zero | GLINER | 79.00% | 82.07% | — | 0.704 |
| gliner2-hivetrace-omni-ru | GLINER2 | 76.75% | 77.41% | — | 0.784 |
| gliner25-fastino-ru | GLINER2 | 71.65% | 72.31% | — | 0.728 |
| gliner2-large | GLINER2 | 70.72% | 73.64% | — | 0.738 |
| rules-ru | RULES | 70.17% | 70.17% | — | 0.728 |
| opf-kz-ru | OPF | 67.65% | 76.38% | — | 0.713 |
| gliner-urchade | GLINER | 67.13% | 68.72% | — | 0.723 |
| gliner-pii-edge | GLINER | 67.06% | 73.83% | — | 0.752 |
| opf-ru-v2 | OPF | 65.06% | 71.24% | — | 0.778 |
| apararti | OPF | 63.59% | 75.12% | — | 0.727 |
| openai-base | OPF | 60.78% | 66.77% | — | 0.731 |
| traciora | OPF | 56.67% | 64.14% | — | 0.751 |
| gliner-nvidia-ru | GLINER | 55.45% | 61.55% | — | 0.619 |
| gliner-stream-pii | GLINER | 54.82% | 60.48% | — | 0.609 |
| gravitee-small | HF | 54.75% | 62.74% | — | 0.624 |
| openmed-nemotron | HF | 52.31% | 74.34% | — | 0.661 |
| openmed-multilingual | HF | 51.87% | 66.84% | — | 0.612 |
| opf-ru | OPF | 51.68% | 68.39% | — | 0.730 |
| kalyan-ettin | HF | 49.54% | 76.56% | — | 0.731 |
| mmbert32k | HF | 47.28% | 88.54% | — | 0.724 |
| gliner-pii-base | GLINER | 45.80% | 47.28% | — | 0.533 |
| bardsai-eu | ONNX | 44.81% | 60.96% | — | 0.689 |
| ru-pii-ner | RUPII | 43.81% | 44.10% | — | 0.505 |
| ru-legal-ner | HF | 43.44% | 77.93% | — | 0.644 |
| gliner2-vladlinv-ru | GLINER2 | 39.96% | 40.63% | — | 0.539 |
| gliner-multi-v21-ru | GLINER | 39.85% | 46.95% | — | 0.461 |
| gliner2-vladlinv | GLINER2 | 39.33% | 39.93% | — | 0.528 |
| gliner-multi-v21 | GLINER | 38.08% | 44.88% | — | 0.442 |
| nym-base | HF | 37.74% | 68.17% | — | 0.742 |
| nym-small | ONNX | 35.97% | 69.94% | — | 0.753 |
| gliner2-hivetrace-uni | GLINER2 | 35.53% | 36.56% | — | 0.459 |
| gliner-urchade-ru | GLINER | 33.79% | 34.57% | — | 0.439 |
| fef2-secret-ru | HF | 30.13% | 33.42% | — | 0.548 |
| gliner2-hivetrace-uni-ru | GLINER2 | 24.44% | 25.25% | — | 0.372 |
| stanza-ru | STANZA | 22.85% | 26.36% | — | 0.264 |
| ner-ru-yqelz | HF | 21.74% | 24.62% | — | 0.288 |
| davlan-xlmr | HF | 21.00% | 21.77% | — | 0.291 |
| davlan-mbert | HF | 20.00% | 20.78% | — | 0.282 |
| spacy-alrosait | SPACY | 14.12% | 14.16% | — | 0.225 |
| natasha | NATASHA | 12.13% | 13.20% | — | 0.191 |
| spacy-ru-lg | SPACY | 5.84% | 10.02% | — | 0.129 |
| ner-ru-gherman | HF | 2.26% | 27.02% | — | 0.307 |