RU · PII
hivetrace PII detection benchmark results
A frozen evaluation slice with 1,810 rows, 1,667 normalized gold annotations and source-level provenance.
1,810input rows
1,667gold annotations
158,283characters
80measured detectors
Dataset provenance
- Language group
- RU
- Task
- PII
- License
- apache-2.0
- Data categories
- ADDRESS, CONTACT, ID, PERSON, SECRET
- Project generated
- No
- Corrupted copy
- No
Rows without annotations are not verified clean. Reported extra masking is not a human-confirmed false-positive rate.
Detector outcomes
Sorted by untouched annotations. Training-source overlaps are excluded.
| Detector | Family | Untouched ↓ | Fully hidden ↑ | Extra masking ↓ | Char F1 ↑ |
|---|---|---|---|---|---|
| pplx+cpu-int8 | PPLX | 0.84% | 97.90% | 5.27% | 0.812 |
| nym-small | ONNX | 0.90% | 75.94% | 0.34% | 0.940 |
| nym-base | HF | 1.02% | 74.51% | 0.31% | 0.947 |
| nym-base+cpu-int8 | HF | 1.32% | 74.75% | 0.36% | 0.948 |
| pplx | PPLX | 2.70% | 95.14% | 0.97% | 0.915 |
| mmbert32k | HF | 3.30% | 74.75% | 0.37% | 0.938 |
| opf-ru | OPF | 4.98% | 82.00% | 1.42% | 0.917 |
| gliner-nvidia-ru | GLINER | 6.48% | 90.64% | 0.75% | 0.917 |
| apararti | OPF | 6.48% | 89.74% | 1.53% | 0.922 |
| opf-kz-ru | OPF | 7.50% | 83.80% | 0.90% | 0.889 |
| opf-ru-v2 | OPF | 7.50% | 86.62% | 0.38% | 0.946 |
| openmed-multilingual | HF | 7.80% | 69.77% | 1.82% | 0.871 |
| openai-base | OPF | 9.90% | 86.86% | 1.70% | 0.909 |
| openai-base-onnx | ONNX | 9.90% | 86.98% | 1.66% | 0.910 |
| ru-pii-ner | RUPII | 9.96% | 88.42% | 0.41% | 0.856 |
| traciora | OPF | 10.20% | 85.66% | 1.57% | 0.928 |
| pii-shield-onnx | ONNX | 10.26% | 78.82% | 0.28% | 0.941 |
| gliner2-fastino-ru | GLINER2 | 10.32% | 87.94% | 0.12% | 0.822 |
| ru-legal-ner | HF | 11.58% | 71.75% | 0.68% | 0.892 |
| ru-legal-ner+cpu-int8 | HF | 11.82% | 71.03% | 1.02% | 0.888 |
| nuner-zero | GLINER | 11.88% | 82.72% | 2.52% | 0.806 |
| gliner-nvidia | GLINER | 12.00% | 84.64% | 7.49% | 0.796 |
| gliner2-hivetrace-omni-ru | GLINER2 | 12.18% | 84.04% | 0.59% | 0.794 |
| mmbert32k+cpu-int8 | HF | 13.32% | 51.29% | 0.37% | 0.825 |
| gliner-stream-pii | GLINER | 13.80% | 69.41% | 1.15% | 0.835 |
| bardsai-eu | ONNX | 14.46% | 67.07% | 0.31% | 0.884 |
| gliner-pii-edge | GLINER | 16.02% | 77.56% | 2.70% | 0.734 |
| gliner2-vladlinv-ru | GLINER2 | 21.48% | 76.78% | 0.13% | 0.816 |
| gravitee-small+cpu-int8 | HF | 21.78% | 69.65% | 11.07% | 0.541 |
| openmed-nemotron | HF | 22.68% | 53.27% | 4.57% | 0.773 |
| gliner-urchade-ru | GLINER | 22.92% | 76.06% | 0.58% | 0.770 |
| gravitee-small | HF | 23.52% | 67.55% | 7.93% | 0.567 |
| presidio-ru | PRESIDIO | 24.00% | 67.25% | 0.54% | 0.753 |
| gliner25-fastino-ru | GLINER2 | 25.19% | 72.17% | 0.26% | 0.770 |
| gliner2-fastino | GLINER2 | 27.05% | 71.69% | 1.14% | 0.732 |
| kalyan-ettin | HF | 27.23% | 51.41% | 1.06% | 0.795 |
| gliner2-hivetrace-uni | GLINER2 | 28.07% | 68.99% | 0.51% | 0.683 |
| gliner-urchade | GLINER | 28.79% | 70.31% | 2.21% | 0.725 |
| gliner2-vladlinv | GLINER2 | 29.21% | 68.87% | 0.17% | 0.777 |
| gliner2-hivetrace-omni | GLINER2 | 31.37% | 65.87% | 0.42% | 0.743 |
| fef2-secret-ru | HF | 32.21% | 56.39% | 0.22% | 0.765 |
| gliner2-large | GLINER2 | 33.05% | 59.21% | 3.33% | 0.648 |
| rules-ru | RULES | 35.69% | 64.31% | 0.00% | 0.732 |
| fef2-secret-ru+cpu-int8 | HF | 41.39% | 46.49% | 0.20% | 0.701 |
| gliner25-fastino | GLINER2 | 41.81% | 55.79% | 1.14% | 0.687 |
| gliner-multi-v21-ru | GLINER | 44.27% | 41.63% | 1.06% | 0.568 |
| gliner-multi-v21 | GLINER | 47.93% | 37.85% | 3.04% | 0.535 |
| kalyan-ettin+cpu-int8 | HF | 50.57% | 32.03% | 0.75% | 0.648 |
| gliner-pii-edge+cpu-int8 | GLINER | 56.27% | 33.53% | 0.43% | 0.445 |
| gliner-pii-base | GLINER | 57.23% | 41.03% | 0.84% | 0.585 |
| ner-ru-yqelz | HF | 62.21% | 26.87% | 5.96% | 0.422 |
| stanza-ru | STANZA | 68.27% | 22.98% | 1.84% | 0.403 |
| ner-ru-gherman | HF | 69.71% | 0.90% | 0.11% | 0.423 |
| ner-ru-gherman-onnx | ONNX | 69.83% | 0.84% | 0.09% | 0.420 |
| ner-ru-gherman+cpu-int8 | HF | 70.85% | 0.84% | 0.08% | 0.400 |
| gliner2-hivetrace-uni-ru | GLINER2 | 70.91% | 28.97% | 0.24% | 0.327 |
| spacy-ru-lg | SPACY | 74.81% | 15.72% | 0.64% | 0.330 |
| davlan-mbert | HF | 75.40% | 14.10% | 0.18% | 0.341 |
| davlan-xlmr | HF | 75.88% | 14.58% | 0.11% | 0.356 |
| davlan-mbert+cpu-int8 | HF | 76.54% | 13.56% | 0.21% | 0.330 |
| spacy-alrosait | SPACY | 77.44% | 21.78% | 0.16% | 0.418 |
| davlan-xlmr+cpu-int8 | HF | 78.70% | 12.42% | 0.10% | 0.292 |
| natasha | NATASHA | 79.06% | 14.10% | 0.19% | 0.272 |
| gliner-pii-base+cpu-int8 | GLINER | 96.52% | 3.48% | 0.00% | 0.049 |
| detect-secrets | LEAKS | 98.44% | 1.56% | 0.00% | 0.190 |
| betterleaks | LEAKS | 98.98% | 1.02% | 0.00% | 0.175 |
| gitleaks | LEAKS | 98.98% | 1.02% | 0.00% | 0.175 |
| kingfisher | LEAKS | 98.98% | 1.02% | 0.00% | 0.175 |
| noseyparker | LEAKS | 98.98% | 1.02% | 0.00% | 0.175 |
| titus | LEAKS | 98.98% | 1.02% | 0.00% | 0.175 |
| credsweeper-noml | LEAKS | 99.34% | 0.66% | 0.00% | 0.091 |
| credsweeper | LEAKS | 99.52% | 0.48% | 0.00% | 0.083 |
| trufflehog | LEAKS | 99.94% | 0.06% | 0.00% | 0.011 |
| deepsecrets | LEAKS | 99.94% | 0.06% | 0.00% | 0.011 |
| gliner-multi-v21+cpu-int8 | GLINER | 100.00% | 0.00% | 0.00% | 0.000 |
| gliner-nvidia+cpu-int8 | GLINER | 100.00% | 0.00% | 0.00% | 0.000 |
| gliner-urchade+cpu-int8 | GLINER | 100.00% | 0.00% | 0.00% | 0.000 |
| gliner-multi-v21-ru+cpu-int8 | GLINER | 100.00% | 0.00% | 0.00% | 0.000 |
| gliner-nvidia-ru+cpu-int8 | GLINER | 100.00% | 0.00% | 0.00% | 0.000 |
| gliner-urchade-ru+cpu-int8 | GLINER | 100.00% | 0.00% | 0.00% | 0.000 |