RU · PII
synth-ru-tickets PII detection benchmark results
A frozen evaluation slice with 400 rows, 32,099 normalized gold annotations and source-level provenance.
400input rows
32,099gold annotations
1,714,199characters
84measured detectors
Dataset provenance
- Language group
- RU
- Task
- PII
- License
- cc-by-4.0
- Data categories
- ACCOUNT, ADDRESS, CONTACT, NET, ORG, PERSON, SECRET
- Project generated
- Yes
- Corrupted copy
- No
Rows without annotations are not verified clean. Reported extra masking is not a human-confirmed false-positive rate.
Detector outcomes
Sorted by untouched annotations. Training-source overlaps are excluded.
| Detector | Family | Untouched ↓ | Fully hidden ↑ | Extra masking ↓ | Char F1 ↑ |
|---|---|---|---|---|---|
| pplx+cpu-int8 | PPLX | 0.09% | 97.19% | — | 0.767 |
| pplx+sent300 | PPLX | 2.36% | 95.11% | — | 0.837 |
| pplx | PPLX | 2.64% | 95.59% | — | 0.833 |
| pplx+ov100 | PPLX | 2.70% | 95.45% | — | 0.834 |
| nuner-zero | GLINER | 3.93% | 93.41% | — | 0.971 |
| gliner2-fastino-ru | GLINER2 | 4.08% | 82.63% | — | 0.861 |
| gliner2-fastino | GLINER2 | 4.09% | 83.88% | — | 0.917 |
| gliner2-hivetrace-omni | GLINER2 | 5.99% | 91.21% | — | 0.922 |
| pii-shield-onnx | ONNX | 6.63% | 75.35% | — | 0.633 |
| gliner2-hivetrace-omni-ru | GLINER2 | 10.05% | 87.42% | — | 0.922 |
| gliner-nvidia+sent300 | GLINER | 11.55% | 84.64% | — | 0.865 |
| apararti | OPF | 13.19% | 76.16% | — | 0.717 |
| openmed-nemotron | HF | 13.64% | 55.14% | — | 0.650 |
| gliner-urchade | GLINER | 14.06% | 64.00% | — | 0.821 |
| openmed-multilingual | HF | 15.31% | 53.21% | — | 0.670 |
| openai-base-onnx | ONNX | 16.95% | 73.82% | — | 0.751 |
| opf-kz-ru | OPF | 17.01% | 68.95% | — | 0.684 |
| openai-base | OPF | 17.04% | 73.68% | — | 0.750 |
| gliner25-fastino+ov100 | GLINER2 | 17.39% | 69.97% | — | 0.859 |
| gliner25-fastino-ru | GLINER2 | 18.49% | 67.32% | — | 0.865 |
| nym-base+sent300 | HF | 18.51% | 58.50% | — | 0.665 |
| mmbert32k | HF | 19.44% | 39.99% | — | 0.553 |
| gliner2-large | GLINER2 | 20.69% | 73.75% | — | 0.822 |
| gliner25-fastino | GLINER2 | 20.96% | 66.65% | — | 0.848 |
| ru-legal-ner+sent300 | HF | 21.37% | 34.37% | — | 0.525 |
| gliner25-fastino+sent300 | GLINER2 | 24.16% | 70.79% | — | 0.832 |
| rules-ru | RULES | 24.73% | 75.27% | — | 0.889 |
| ru-legal-ner+cpu-int8 | HF | 27.33% | 27.61% | — | 0.487 |
| gliner-stream-pii | GLINER | 27.39% | 55.16% | — | 0.633 |
| ru-legal-ner+ov100 | HF | 27.89% | 29.24% | — | 0.473 |
| ru-legal-ner | HF | 30.32% | 27.13% | — | 0.481 |
| gliner-pii-edge | GLINER | 33.77% | 45.22% | — | 0.636 |
| kalyan-ettin | HF | 35.28% | 39.28% | — | 0.511 |
| mmbert32k+cpu-int8 | HF | 35.31% | 7.97% | — | 0.300 |
| opf-ru-v2+sent300 | OPF | 35.38% | 53.38% | — | 0.606 |
| gliner-urchade-ru | GLINER | 36.28% | 43.32% | — | 0.690 |
| nym-base+cpu-int8 | HF | 36.67% | 45.26% | — | 0.543 |
| opf-ru-v2+ov100 | OPF | 40.15% | 45.31% | — | 0.569 |
| opf-ru-v2 | OPF | 41.27% | 44.75% | — | 0.563 |
| nym-base | HF | 41.51% | 42.60% | — | 0.525 |
| mmbert32k+nochunk | HF | 41.71% | 10.16% | — | 0.322 |
| gliner-pii-base | GLINER | 42.53% | 49.48% | — | 0.564 |
| opf-ru | OPF | 43.22% | 34.56% | — | 0.498 |
| traciora | OPF | 44.48% | 35.74% | — | 0.592 |
| bardsai-eu | ONNX | 44.48% | 35.09% | — | 0.544 |
| nym-small | ONNX | 44.52% | 38.40% | — | 0.524 |
| nym-base+ov100 | HF | 45.20% | 40.70% | — | 0.504 |
| gliner-multi-v21 | GLINER | 45.65% | 38.43% | — | 0.505 |
| gliner-nvidia | GLINER | 46.28% | 50.44% | — | 0.581 |
| gliner-nvidia+ov100 | GLINER | 46.48% | 49.83% | — | 0.575 |
| gliner-multi-v21-ru | GLINER | 48.20% | 39.08% | — | 0.502 |
| gliner2-hivetrace-uni | GLINER2 | 56.57% | 39.77% | — | 0.488 |
| fef2-secret-ru | HF | 57.10% | 34.92% | — | 0.476 |
| fef2-secret-ru+cpu-int8 | HF | 58.47% | 32.06% | — | 0.456 |
| ru-pii-ner | RUPII | 58.71% | 39.14% | — | 0.457 |
| gliner-nvidia-ru | GLINER | 61.06% | 35.18% | — | 0.468 |
| gravitee-small | HF | 62.55% | 28.28% | — | 0.432 |
| gravitee-small+cpu-int8 | HF | 63.20% | 27.55% | — | 0.427 |
| kalyan-ettin+cpu-int8 | HF | 65.86% | 17.72% | — | 0.285 |
| ner-ru-yqelz | HF | 70.15% | 10.54% | — | 0.337 |
| gliner25-fastino-ru+nochunk | GLINER2 | 70.58% | 27.76% | — | 0.420 |
| gliner2-vladlinv | GLINER2 | 71.77% | 26.50% | — | 0.373 |
| ner-ru-gherman | HF | 72.81% | 4.66% | — | 0.305 |
| ner-ru-gherman-onnx | ONNX | 72.88% | 4.70% | — | 0.305 |
| gliner2-vladlinv-ru | GLINER2 | 75.49% | 22.74% | — | 0.345 |
| gliner2-hivetrace-uni-ru | GLINER2 | 76.43% | 22.02% | — | 0.249 |
| gliner25-fastino+nochunk | GLINER2 | 79.11% | 19.75% | — | 0.325 |
| ner-ru-gherman+cpu-int8 | HF | 79.20% | 2.65% | — | 0.256 |
| stanza-ru | STANZA | 83.53% | 11.73% | — | 0.211 |
| davlan-xlmr | HF | 83.85% | 10.24% | — | 0.238 |
| spacy-ru-lg | SPACY | 87.37% | 10.01% | — | 0.228 |
| davlan-mbert | HF | 88.30% | 8.24% | — | 0.207 |
| davlan-mbert+cpu-int8 | HF | 88.68% | 7.25% | — | 0.196 |
| natasha | NATASHA | 89.43% | 8.09% | — | 0.184 |
| davlan-xlmr+cpu-int8 | HF | 90.86% | 4.52% | — | 0.143 |
| spacy-alrosait | SPACY | 91.20% | 6.88% | — | 0.186 |
| gliner-pii-edge+cpu-int8 | GLINER | 97.24% | 1.24% | — | 0.032 |
| gliner-pii-base+cpu-int8 | GLINER | 100.00% | 0.00% | — | 0.000 |
| gliner-multi-v21+cpu-int8 | GLINER | 100.00% | 0.00% | — | 0.000 |
| gliner-nvidia+cpu-int8 | GLINER | 100.00% | 0.00% | — | 0.000 |
| gliner-urchade+cpu-int8 | GLINER | 100.00% | 0.00% | — | 0.000 |
| gliner-multi-v21-ru+cpu-int8 | GLINER | 100.00% | 0.00% | — | 0.000 |
| gliner-nvidia-ru+cpu-int8 | GLINER | 100.00% | 0.00% | — | 0.000 |
| gliner-urchade-ru+cpu-int8 | GLINER | 100.00% | 0.00% | — | 0.000 |