MULTI · PII
gretel-multi PII detection benchmark results
A frozen evaluation slice with 697 rows, 4,484 normalized gold annotations and source-level provenance.
697input rows
4,484gold annotations
916,566characters
38measured detectors
Dataset provenance
- Language group
- MULTI
- Task
- PII
- License
- apache-2.0
- Data categories
- ACCOUNT, ADDRESS, CONTACT, DATE, ID, NET, ORG, PERSON, SECRET
- Project generated
- No
- Corrupted copy
- No
Rows without annotations are not verified clean. Reported extra masking is not a human-confirmed false-positive rate.
Detector outcomes
Sorted by fully hidden annotations. Training-source overlaps are excluded.
| Detector | Family | Fully hidden ↑ | Detected / any overlap ↑ | Extra masking ↓ | Char F1 ↑ |
|---|---|---|---|---|---|
| gravitee-small | HF | 79.66% | 83.76% | 2.73% | 0.716 |
| pplx | PPLX | 79.55% | 81.76% | 1.45% | 0.720 |
| gliner2-fastino | GLINER2 | 74.49% | 82.67% | 0.75% | 0.765 |
| gliner-urchade | GLINER | 73.75% | 76.09% | 2.79% | 0.694 |
| gliner25-fastino | GLINER2 | 70.56% | 76.61% | 0.76% | 0.784 |
| nuner-zero | GLINER | 69.11% | 73.57% | 2.32% | 0.720 |
| bardsai-eu | ONNX | 66.57% | 81.51% | 2.09% | 0.752 |
| gliner2-large | GLINER2 | 65.77% | 77.68% | 3.06% | 0.678 |
| apararti | OPF | 65.66% | 73.19% | 1.54% | 0.705 |
| openai-base | OPF | 64.74% | 71.19% | 1.44% | 0.716 |
| opf-kz-ru | OPF | 61.71% | 70.25% | 1.54% | 0.689 |
| stanza-ru | STANZA | 56.67% | 74.00% | 20.56% | 0.262 |
| mmbert32k | HF | 56.31% | 77.30% | 2.93% | 0.645 |
| ru-pii-ner | RUPII | 55.93% | 60.53% | 0.61% | 0.652 |
| gliner-pii-edge | GLINER | 55.71% | 72.17% | 1.29% | 0.646 |
| traciora | OPF | 54.35% | 64.47% | 0.10% | 0.757 |
| gliner-multi-v21 | GLINER | 53.86% | 63.31% | 1.93% | 0.607 |
| opf-ru-v2 | OPF | 52.65% | 62.58% | 0.12% | 0.747 |
| opf-ru | OPF | 51.90% | 74.11% | 0.55% | 0.699 |
| gliner-nvidia | GLINER | 50.87% | 83.07% | 2.52% | 0.707 |
| nym-small | ONNX | 46.83% | 82.67% | 1.68% | 0.709 |
| nym-base | HF | 45.63% | 82.25% | 2.02% | 0.728 |
| gliner2-vladlinv | GLINER2 | 45.00% | 49.42% | 0.18% | 0.590 |
| davlan-xlmr | HF | 44.96% | 62.44% | 0.41% | 0.658 |
| kalyan-ettin | HF | 43.09% | 79.71% | 2.32% | 0.706 |
| davlan-mbert | HF | 42.28% | 60.66% | 0.29% | 0.642 |
| gliner-stream-pii | GLINER | 41.86% | 70.81% | 0.45% | 0.723 |
| openmed-nemotron | HF | 40.63% | 78.86% | 2.67% | 0.641 |
| gliner-pii-base | GLINER | 39.12% | 45.81% | 0.69% | 0.574 |
| pii-shield-onnx | ONNX | 34.72% | 53.88% | 15.13% | 0.286 |
| ner-ru-yqelz | HF | 29.88% | 47.26% | 4.21% | 0.447 |
| ru-legal-ner | HF | 27.99% | 56.22% | 16.63% | 0.239 |
| rules-ru | RULES | 14.41% | 14.72% | 0.04% | 0.306 |
| ner-ru-gherman | HF | 13.20% | 52.45% | 0.08% | 0.536 |
| fef2-secret-ru | HF | 9.63% | 12.93% | 0.07% | 0.253 |
| spacy-ru-lg | SPACY | 7.83% | 13.80% | 1.56% | 0.117 |
| natasha | NATASHA | 4.77% | 10.64% | 0.27% | 0.125 |
| spacy-alrosait | SPACY | 0.00% | 0.00% | 0.00% | 0.000 |