RU · PII
redmadrobot PII detection benchmark results
A frozen evaluation slice with 2,841 rows, 5,516 normalized gold annotations and source-level provenance.
2,841input rows
5,516gold annotations
576,873characters
72measured detectors
Dataset provenance
- Language group
- RU
- Task
- PII
- License
- mit
- Data categories
- ADDRESS, CONTACT, ID, NET, PERSON
- Project generated
- No
- Corrupted copy
- No
Rows without annotations are not verified clean. Reported extra masking is not a human-confirmed false-positive rate.
Detector outcomes
Sorted by untouched annotations. Training-source overlaps are excluded.
| Detector | Family | Untouched ↓ | Fully hidden ↑ | Extra masking ↓ | Char F1 ↑ |
|---|---|---|---|---|---|
| pplx+cpu-int8 | PPLX | 5.69% | 87.71% | 4.07% | 0.756 |
| nym-base | HF | 10.88% | 80.53% | 2.10% | 0.796 |
| pplx | PPLX | 14.05% | 78.86% | 1.59% | 0.800 |
| nym-base+cpu-int8 | HF | 14.94% | 76.40% | 1.78% | 0.788 |
| nym-small | ONNX | 15.05% | 75.49% | 2.03% | 0.781 |
| gliner2-fastino-ru | GLINER2 | 16.55% | 80.13% | 1.25% | 0.810 |
| mmbert32k | HF | 18.76% | 59.30% | 2.54% | 0.733 |
| gliner-nvidia-ru | GLINER | 19.29% | 77.61% | 0.83% | 0.802 |
| ru-pii-ner | RUPII | 20.12% | 76.63% | 2.63% | 0.763 |
| apararti | OPF | 21.79% | 71.23% | 2.48% | 0.714 |
| gliner2-fastino | GLINER2 | 22.30% | 73.95% | 0.95% | 0.797 |
| ru-legal-ner | HF | 24.64% | 59.86% | 8.61% | 0.577 |
| ru-legal-ner+cpu-int8 | HF | 24.84% | 60.03% | 8.78% | 0.572 |
| gliner-nvidia | GLINER | 25.87% | 72.10% | 0.97% | 0.747 |
| bardsai-eu | ONNX | 26.03% | 62.89% | 1.84% | 0.700 |
| opf-kz-ru | OPF | 27.23% | 64.54% | 2.26% | 0.679 |
| gliner2-hivetrace-omni-ru | GLINER2 | 27.97% | 66.30% | 0.78% | 0.755 |
| opf-ru | OPF | 28.43% | 52.83% | 1.85% | 0.663 |
| openai-base | OPF | 29.42% | 65.17% | 1.39% | 0.680 |
| openai-base-onnx | ONNX | 29.57% | 65.19% | 1.39% | 0.679 |
| gliner-stream-pii | GLINER | 30.64% | 50.80% | 1.06% | 0.651 |
| traciora | OPF | 31.16% | 59.28% | 1.15% | 0.715 |
| gliner2-hivetrace-omni | GLINER2 | 31.56% | 63.51% | 0.61% | 0.731 |
| pii-shield-onnx | ONNX | 32.05% | 59.05% | 10.35% | 0.624 |
| opf-ru-v2 | OPF | 32.31% | 57.43% | 0.76% | 0.695 |
| gravitee-small+cpu-int8 | HF | 32.36% | 60.68% | 4.61% | 0.551 |
| gliner2-large | GLINER2 | 34.64% | 61.80% | 1.07% | 0.722 |
| gravitee-small | HF | 34.86% | 58.83% | 4.19% | 0.565 |
| nuner-zero | GLINER | 34.95% | 62.20% | 0.54% | 0.727 |
| gliner-pii-edge | GLINER | 35.48% | 59.43% | 1.45% | 0.660 |
| openmed-multilingual | HF | 38.07% | 47.86% | 2.84% | 0.641 |
| gliner-urchade | GLINER | 38.47% | 60.10% | 0.96% | 0.721 |
| gliner-urchade-ru | GLINER | 38.98% | 59.97% | 1.09% | 0.721 |
| mmbert32k+cpu-int8 | HF | 39.12% | 34.45% | 2.50% | 0.580 |
| fef2-secret-ru | HF | 39.29% | 55.00% | 1.12% | 0.644 |
| gliner25-fastino-ru | GLINER2 | 39.74% | 57.92% | 0.45% | 0.698 |
| gliner2-hivetrace-uni | GLINER2 | 40.05% | 56.74% | 1.11% | 0.631 |
| kalyan-ettin | HF | 43.26% | 44.18% | 1.24% | 0.604 |
| openmed-nemotron | HF | 44.29% | 45.25% | 2.89% | 0.555 |
| gliner2-vladlinv-ru | GLINER2 | 44.47% | 55.00% | 0.13% | 0.641 |
| fef2-secret-ru+cpu-int8 | HF | 45.41% | 47.81% | 1.03% | 0.579 |
| ner-ru-yqelz | HF | 49.47% | 41.53% | 9.74% | 0.377 |
| gliner2-vladlinv | GLINER2 | 50.09% | 49.31% | 0.10% | 0.588 |
| stanza-ru | STANZA | 50.54% | 42.98% | 9.48% | 0.361 |
| gliner-pii-base | GLINER | 52.25% | 44.14% | 0.53% | 0.578 |
| presidio-ru | PRESIDIO | 54.86% | 41.70% | 3.35% | 0.521 |
| ner-ru-gherman | HF | 55.71% | 34.97% | 0.19% | 0.462 |
| ner-ru-gherman-onnx | ONNX | 55.71% | 34.86% | 0.19% | 0.462 |
| gliner25-fastino | GLINER2 | 55.98% | 42.22% | 1.59% | 0.562 |
| ner-ru-gherman+cpu-int8 | HF | 57.16% | 33.30% | 0.18% | 0.449 |
| davlan-xlmr | HF | 57.40% | 39.63% | 0.47% | 0.446 |
| gliner-multi-v21-ru | GLINER | 58.18% | 38.81% | 0.93% | 0.465 |
| davlan-mbert | HF | 58.85% | 38.23% | 0.53% | 0.440 |
| gliner-multi-v21 | GLINER | 60.62% | 35.57% | 0.95% | 0.436 |
| davlan-mbert+cpu-int8 | HF | 60.84% | 36.11% | 0.40% | 0.423 |
| spacy-ru-lg | SPACY | 65.77% | 30.89% | 2.98% | 0.369 |
| natasha | NATASHA | 66.28% | 30.42% | 1.17% | 0.360 |
| gliner2-hivetrace-uni-ru | GLINER2 | 67.53% | 31.45% | 0.27% | 0.384 |
| davlan-xlmr+cpu-int8 | HF | 67.69% | 28.41% | 0.27% | 0.371 |
| kalyan-ettin+cpu-int8 | HF | 72.70% | 17.46% | 0.58% | 0.317 |
| spacy-alrosait | SPACY | 73.46% | 24.38% | 0.30% | 0.314 |
| gliner-pii-edge+cpu-int8 | GLINER | 76.05% | 19.07% | 0.42% | 0.318 |
| rules-ru | RULES | 84.43% | 14.58% | 0.18% | 0.360 |
| gliner-pii-base+cpu-int8 | GLINER | 99.69% | 0.29% | 0.00% | 0.007 |
| betterleaks | LEAKS | 100.00% | 0.00% | 0.00% | 0.000 |
| gitleaks | LEAKS | 100.00% | 0.00% | 0.00% | 0.000 |
| gliner-multi-v21+cpu-int8 | GLINER | 100.00% | 0.00% | 0.00% | 0.000 |
| gliner-nvidia+cpu-int8 | GLINER | 100.00% | 0.00% | 0.00% | 0.000 |
| gliner-urchade+cpu-int8 | GLINER | 100.00% | 0.00% | 0.00% | 0.000 |
| gliner-multi-v21-ru+cpu-int8 | GLINER | 100.00% | 0.00% | 0.00% | 0.000 |
| gliner-nvidia-ru+cpu-int8 | GLINER | 100.00% | 0.00% | 0.00% | 0.000 |
| gliner-urchade-ru+cpu-int8 | GLINER | 100.00% | 0.00% | 0.00% | 0.000 |