EN · PII
tonicai PII detection benchmark results
A frozen evaluation slice with 1,500 rows, 2,417 normalized gold annotations and source-level provenance.
1,500input rows
2,417gold annotations
259,595characters
41measured detectors
Dataset provenance
- Language group
- EN
- Task
- PII
- License
- cc-by-4.0
- Data categories
- ACCOUNT, CONTACT, ORG, PERSON
- Project generated
- No
- Corrupted copy
- No
Rows without annotations are not verified clean. Reported extra masking is not a human-confirmed false-positive rate.
Detector outcomes
Sorted by fully hidden annotations. Training-source overlaps are excluded.
| Detector | Family | Fully hidden ↑ | Detected / any overlap ↑ | Extra masking ↓ | Char F1 ↑ |
|---|---|---|---|---|---|
| gliner2-fastino | GLINER2 | 92.18% | 95.53% | 2.79% | 0.885 |
| gliner2-large | GLINER2 | 91.64% | 94.37% | 5.65% | 0.844 |
| gliner2-hivetrace-omni | GLINER2 | 89.33% | 92.93% | 2.08% | 0.891 |
| gliner-nvidia | GLINER | 88.75% | 92.93% | 1.45% | 0.915 |
| gravitee-small | HF | 82.25% | 86.22% | 3.70% | 0.788 |
| gliner-pii-edge | GLINER | 80.47% | 88.58% | 2.86% | 0.836 |
| pplx | PPLX | 75.51% | 79.23% | 0.75% | 0.848 |
| gliner2-vladlinv | GLINER2 | 74.27% | 76.42% | 0.42% | 0.859 |
| gliner25-fastino | GLINER2 | 72.45% | 73.98% | 2.65% | 0.791 |
| kalyan-ettin | HF | 69.01% | 72.78% | 1.28% | 0.816 |
| nuner-zero | GLINER | 67.48% | 71.49% | 5.26% | 0.794 |
| gliner2-hivetrace-uni | GLINER2 | 67.44% | 68.76% | 1.23% | 0.814 |
| openmed-nemotron | HF | 67.31% | 71.00% | 0.75% | 0.818 |
| gliner-multi-v21 | GLINER | 66.16% | 82.13% | 2.43% | 0.761 |
| openai-base | OPF | 65.37% | 68.51% | 0.30% | 0.841 |
| openmed-multilingual | HF | 63.43% | 68.47% | 1.37% | 0.815 |
| mmbert32k | HF | 62.10% | 73.85% | 0.40% | 0.830 |
| nym-small | ONNX | 62.02% | 64.75% | 0.28% | 0.849 |
| gliner-stream-pii | GLINER | 59.62% | 74.10% | 5.36% | 0.670 |
| opf-ru | OPF | 59.45% | 63.14% | 0.27% | 0.816 |
| apararti | OPF | 59.33% | 62.72% | 0.36% | 0.815 |
| ner-ru-yqelz | HF | 57.34% | 64.63% | 5.25% | 0.514 |
| davlan-xlmr | HF | 55.73% | 60.16% | 0.17% | 0.549 |
| nym-base | HF | 55.44% | 58.50% | 0.40% | 0.816 |
| bardsai-eu | ONNX | 53.58% | 69.47% | 0.25% | 0.732 |
| opf-kz-ru | OPF | 53.37% | 56.60% | 0.21% | 0.794 |
| traciora | OPF | 48.99% | 52.05% | 0.23% | 0.783 |
| ru-pii-ner | RUPII | 48.90% | 51.26% | 0.88% | 0.737 |
| stanza-ru | STANZA | 44.60% | 45.01% | 3.36% | 0.275 |
| davlan-mbert | HF | 39.47% | 44.68% | 0.05% | 0.477 |
| gliner-pii-base | GLINER | 39.35% | 42.28% | 2.29% | 0.560 |
| ner-ru-gherman | HF | 38.85% | 49.86% | 0.08% | 0.493 |
| opf-ru-v2 | OPF | 38.39% | 41.58% | 0.02% | 0.748 |
| gliner-urchade | GLINER | 37.73% | 42.20% | 2.93% | 0.670 |
| pii-shield-onnx | ONNX | 25.69% | 27.84% | 0.56% | 0.652 |
| ru-legal-ner | HF | 25.16% | 31.86% | 3.74% | 0.554 |
| rules-ru | RULES | 15.56% | 19.16% | 0.00% | 0.651 |
| spacy-ru-lg | SPACY | 14.11% | 14.11% | 0.64% | 0.154 |
| natasha | NATASHA | 11.25% | 12.99% | <0.01% | 0.186 |
| fef2-secret-ru | HF | 10.92% | 14.23% | 0.06% | 0.484 |
| spacy-alrosait | SPACY | 0.04% | 0.04% | 0.00% | 0.000 |