RU · PII
hivetrace PII detection benchmark results
A frozen evaluation slice with 1,810 rows, 1,667 normalized gold annotations and source-level provenance.
1,810input rows
1,667gold annotations
158,283characters
80measured detectors
Dataset provenance
- Language group
- RU
- Task
- PII
- License
- apache-2.0
- Data categories
- ADDRESS, CONTACT, ID, PERSON, SECRET
- Project generated
- No
- Corrupted copy
- No
Rows without annotations are not verified clean. Reported extra masking is not a human-confirmed false-positive rate.
Detector outcomes
Sorted by fully hidden annotations. Training-source overlaps are excluded.
| Detector | Family | Fully hidden ↑ | Detected / any overlap ↑ | Extra masking ↓ | Char F1 ↑ |
|---|---|---|---|---|---|
| pplx+cpu-int8 | PPLX | 97.90% | 99.16% | 5.27% | 0.812 |
| pplx | PPLX | 95.14% | 97.30% | 0.97% | 0.915 |
| gliner-nvidia-ru | GLINER | 90.64% | 93.52% | 0.75% | 0.917 |
| apararti | OPF | 89.74% | 93.52% | 1.53% | 0.922 |
| ru-pii-ner | RUPII | 88.42% | 90.04% | 0.41% | 0.856 |
| gliner2-fastino-ru | GLINER2 | 87.94% | 89.68% | 0.12% | 0.822 |
| openai-base-onnx | ONNX | 86.98% | 90.10% | 1.66% | 0.910 |
| openai-base | OPF | 86.86% | 90.10% | 1.70% | 0.909 |
| opf-ru-v2 | OPF | 86.62% | 92.50% | 0.38% | 0.946 |
| traciora | OPF | 85.66% | 89.80% | 1.57% | 0.928 |
| gliner-nvidia | GLINER | 84.64% | 88.00% | 7.49% | 0.796 |
| gliner2-hivetrace-omni-ru | GLINER2 | 84.04% | 87.82% | 0.59% | 0.794 |
| opf-kz-ru | OPF | 83.80% | 92.50% | 0.90% | 0.889 |
| nuner-zero | GLINER | 82.72% | 88.12% | 2.52% | 0.806 |
| opf-ru | OPF | 82.00% | 95.02% | 1.42% | 0.917 |
| pii-shield-onnx | ONNX | 78.82% | 89.74% | 0.28% | 0.941 |
| gliner-pii-edge | GLINER | 77.56% | 83.98% | 2.70% | 0.734 |
| gliner2-vladlinv-ru | GLINER2 | 76.78% | 78.52% | 0.13% | 0.816 |
| gliner-urchade-ru | GLINER | 76.06% | 77.08% | 0.58% | 0.770 |
| nym-small | ONNX | 75.94% | 99.10% | 0.34% | 0.940 |
| mmbert32k | HF | 74.75% | 96.70% | 0.37% | 0.938 |
| nym-base+cpu-int8 | HF | 74.75% | 98.68% | 0.36% | 0.948 |
| nym-base | HF | 74.51% | 98.98% | 0.31% | 0.947 |
| gliner25-fastino-ru | GLINER2 | 72.17% | 74.81% | 0.26% | 0.770 |
| ru-legal-ner | HF | 71.75% | 88.42% | 0.68% | 0.892 |
| gliner2-fastino | GLINER2 | 71.69% | 72.95% | 1.14% | 0.732 |
| ru-legal-ner+cpu-int8 | HF | 71.03% | 88.18% | 1.02% | 0.888 |
| gliner-urchade | GLINER | 70.31% | 71.21% | 2.21% | 0.725 |
| openmed-multilingual | HF | 69.77% | 92.20% | 1.82% | 0.871 |
| gravitee-small+cpu-int8 | HF | 69.65% | 78.22% | 11.07% | 0.541 |
| gliner-stream-pii | GLINER | 69.41% | 86.20% | 1.15% | 0.835 |
| gliner2-hivetrace-uni | GLINER2 | 68.99% | 71.93% | 0.51% | 0.683 |
| gliner2-vladlinv | GLINER2 | 68.87% | 70.79% | 0.17% | 0.777 |
| gravitee-small | HF | 67.55% | 76.48% | 7.93% | 0.567 |
| presidio-ru | PRESIDIO | 67.25% | 76.00% | 0.54% | 0.753 |
| bardsai-eu | ONNX | 67.07% | 85.54% | 0.31% | 0.884 |
| gliner2-hivetrace-omni | GLINER2 | 65.87% | 68.63% | 0.42% | 0.743 |
| rules-ru | RULES | 64.31% | 64.31% | 0.00% | 0.732 |
| gliner2-large | GLINER2 | 59.21% | 66.95% | 3.33% | 0.648 |
| fef2-secret-ru | HF | 56.39% | 67.79% | 0.22% | 0.765 |
| gliner25-fastino | GLINER2 | 55.79% | 58.19% | 1.14% | 0.687 |
| openmed-nemotron | HF | 53.27% | 77.32% | 4.57% | 0.773 |
| kalyan-ettin | HF | 51.41% | 72.77% | 1.06% | 0.795 |
| mmbert32k+cpu-int8 | HF | 51.29% | 86.68% | 0.37% | 0.825 |
| fef2-secret-ru+cpu-int8 | HF | 46.49% | 58.61% | 0.20% | 0.701 |
| gliner-multi-v21-ru | GLINER | 41.63% | 55.73% | 1.06% | 0.568 |
| gliner-pii-base | GLINER | 41.03% | 42.77% | 0.84% | 0.585 |
| gliner-multi-v21 | GLINER | 37.85% | 52.07% | 3.04% | 0.535 |
| gliner-pii-edge+cpu-int8 | GLINER | 33.53% | 43.73% | 0.43% | 0.445 |
| kalyan-ettin+cpu-int8 | HF | 32.03% | 49.43% | 0.75% | 0.648 |
| gliner2-hivetrace-uni-ru | GLINER2 | 28.97% | 29.09% | 0.24% | 0.327 |
| ner-ru-yqelz | HF | 26.87% | 37.79% | 5.96% | 0.422 |
| stanza-ru | STANZA | 22.98% | 31.73% | 1.84% | 0.403 |
| spacy-alrosait | SPACY | 21.78% | 22.56% | 0.16% | 0.418 |
| spacy-ru-lg | SPACY | 15.72% | 25.19% | 0.64% | 0.330 |
| davlan-xlmr | HF | 14.58% | 24.12% | 0.11% | 0.356 |
| davlan-mbert | HF | 14.10% | 24.60% | 0.18% | 0.341 |
| natasha | NATASHA | 14.10% | 20.94% | 0.19% | 0.272 |
| davlan-mbert+cpu-int8 | HF | 13.56% | 23.46% | 0.21% | 0.330 |
| davlan-xlmr+cpu-int8 | HF | 12.42% | 21.30% | 0.10% | 0.292 |
| gliner-pii-base+cpu-int8 | GLINER | 3.48% | 3.48% | 0.00% | 0.049 |
| detect-secrets | LEAKS | 1.56% | 1.56% | 0.00% | 0.190 |
| betterleaks | LEAKS | 1.02% | 1.02% | 0.00% | 0.175 |
| gitleaks | LEAKS | 1.02% | 1.02% | 0.00% | 0.175 |
| kingfisher | LEAKS | 1.02% | 1.02% | 0.00% | 0.175 |
| noseyparker | LEAKS | 1.02% | 1.02% | 0.00% | 0.175 |
| titus | LEAKS | 1.02% | 1.02% | 0.00% | 0.175 |
| ner-ru-gherman | HF | 0.90% | 30.29% | 0.11% | 0.423 |
| ner-ru-gherman-onnx | ONNX | 0.84% | 30.17% | 0.09% | 0.420 |
| ner-ru-gherman+cpu-int8 | HF | 0.84% | 29.15% | 0.08% | 0.400 |
| credsweeper-noml | LEAKS | 0.66% | 0.66% | 0.00% | 0.091 |
| credsweeper | LEAKS | 0.48% | 0.48% | 0.00% | 0.083 |
| trufflehog | LEAKS | 0.06% | 0.06% | 0.00% | 0.011 |
| deepsecrets | LEAKS | 0.06% | 0.06% | 0.00% | 0.011 |
| gliner-multi-v21+cpu-int8 | GLINER | 0.00% | 0.00% | 0.00% | 0.000 |
| gliner-nvidia+cpu-int8 | GLINER | 0.00% | 0.00% | 0.00% | 0.000 |
| gliner-urchade+cpu-int8 | GLINER | 0.00% | 0.00% | 0.00% | 0.000 |
| gliner-multi-v21-ru+cpu-int8 | GLINER | 0.00% | 0.00% | 0.00% | 0.000 |
| gliner-nvidia-ru+cpu-int8 | GLINER | 0.00% | 0.00% | 0.00% | 0.000 |
| gliner-urchade-ru+cpu-int8 | GLINER | 0.00% | 0.00% | 0.00% | 0.000 |