EN · PII
dialogpii-en PII detection benchmark results
A frozen evaluation slice with 147 rows, 3,087 normalized gold annotations and source-level provenance.
147input rows
3,087gold annotations
569,190characters
55measured detectors
Dataset provenance
- Language group
- EN
- Task
- PII
- License
- cc-by-4.0
- Data categories
- ADDRESS, CONTACT, ID, NET, ORG, PERSON
- Project generated
- No
- Corrupted copy
- No
Rows without annotations are not verified clean. Reported extra masking is not a human-confirmed false-positive rate.
Detector outcomes
Sorted by fully hidden annotations. Training-source overlaps are excluded.
| Detector | Family | Fully hidden ↑ | Detected / any overlap ↑ | Extra masking ↓ | Char F1 ↑ |
|---|---|---|---|---|---|
| gliner2-fastino | GLINER2 | 81.92% | 89.86% | 10.71% | 0.602 |
| nuner-zero | GLINER | 80.24% | 85.36% | 12.29% | 0.535 |
| stanza-ru | STANZA | 78.81% | 82.99% | 40.89% | 0.187 |
| gliner2-large | GLINER2 | 78.00% | 85.84% | 9.92% | 0.571 |
| gliner-nvidia+sent300 | GLINER | 77.52% | 86.72% | 11.20% | 0.587 |
| gliner-urchade | GLINER | 75.38% | 81.54% | 13.79% | 0.507 |
| gliner2-hivetrace-omni | GLINER2 | 75.25% | 83.22% | 6.73% | 0.691 |
| gliner-multi-v21 | GLINER | 75.06% | 82.38% | 12.48% | 0.531 |
| gliner-nvidia+ov100 | GLINER | 73.31% | 82.80% | 8.64% | 0.635 |
| gliner-nvidia | GLINER | 73.28% | 82.57% | 8.38% | 0.608 |
| bardsai-eu | ONNX | 71.66% | 82.93% | 5.86% | 0.799 |
| gliner-pii-base | GLINER | 71.59% | 80.01% | 5.15% | 0.643 |
| pplx+ov100 | PPLX | 71.36% | 75.64% | 6.13% | 0.756 |
| gliner-pii-edge | GLINER | 71.17% | 79.79% | 2.52% | 0.723 |
| pplx | PPLX | 71.01% | 75.90% | 5.64% | 0.761 |
| gliner25-fastino+ov100 | GLINER2 | 70.10% | 77.26% | 6.65% | 0.674 |
| pplx+sent300 | PPLX | 69.97% | 75.83% | 5.37% | 0.762 |
| gliner25-fastino | GLINER2 | 69.00% | 75.96% | 8.12% | 0.655 |
| gliner25-fastino+sent300 | GLINER2 | 68.90% | 76.29% | 9.36% | 0.611 |
| davlan-xlmr | HF | 66.41% | 76.74% | 2.33% | 0.780 |
| gravitee-small | HF | 65.95% | 74.21% | 4.06% | 0.707 |
| gliner2-hivetrace-uni | GLINER2 | 64.20% | 73.53% | 5.04% | 0.731 |
| davlan-mbert | HF | 62.97% | 72.92% | 2.33% | 0.759 |
| gliner25-fastino+nochunk | GLINER2 | 60.87% | 67.74% | 3.19% | 0.758 |
| ner-ru-yqelz | HF | 60.12% | 66.76% | 4.06% | 0.665 |
| nym-base+sent300 | HF | 58.31% | 77.49% | 3.38% | 0.754 |
| nym-small | ONNX | 58.28% | 77.97% | 3.83% | 0.757 |
| nym-base | HF | 57.60% | 76.71% | 3.38% | 0.750 |
| nym-base+ov100 | HF | 56.59% | 75.57% | 3.31% | 0.738 |
| openmed-multilingual | HF | 56.24% | 78.62% | 6.43% | 0.603 |
| gliner2-vladlinv | GLINER2 | 55.88% | 61.81% | 3.80% | 0.633 |
| openai-base | OPF | 54.13% | 57.60% | 12.89% | 0.415 |
| ru-pii-ner | RUPII | 53.74% | 57.95% | 8.08% | 0.476 |
| gliner-stream-pii | GLINER | 53.35% | 60.06% | 1.99% | 0.685 |
| apararti | OPF | 51.96% | 56.79% | 9.13% | 0.455 |
| openmed-nemotron | HF | 51.15% | 70.65% | 8.76% | 0.523 |
| kalyan-ettin | HF | 50.31% | 68.71% | 5.45% | 0.616 |
| mmbert32k | HF | 46.65% | 64.53% | 4.85% | 0.543 |
| ner-ru-gherman | HF | 46.10% | 65.89% | 2.07% | 0.634 |
| opf-ru | OPF | 45.19% | 56.30% | 10.26% | 0.392 |
| opf-kz-ru | OPF | 43.34% | 48.36% | 6.39% | 0.443 |
| traciora | OPF | 40.30% | 46.39% | 4.43% | 0.580 |
| opf-ru-v2+ov100 | OPF | 33.56% | 38.32% | 5.41% | 0.480 |
| opf-ru-v2+sent300 | OPF | 32.85% | 37.64% | 4.36% | 0.483 |
| opf-ru-v2 | OPF | 32.30% | 37.29% | 5.04% | 0.483 |
| mmbert32k+nochunk | HF | 26.50% | 41.53% | 3.53% | 0.487 |
| pii-shield-onnx | ONNX | 17.65% | 27.37% | 7.48% | 0.321 |
| ru-legal-ner+sent300 | HF | 16.65% | 27.31% | 2.33% | 0.344 |
| spacy-ru-lg | SPACY | 13.74% | 14.35% | 1.58% | 0.180 |
| natasha | NATASHA | 9.59% | 10.01% | 0.60% | 0.124 |
| ru-legal-ner+ov100 | HF | 7.52% | 16.33% | 0.75% | 0.267 |
| ru-legal-ner | HF | 6.51% | 14.74% | 1.47% | 0.244 |
| fef2-secret-ru | HF | 1.17% | 1.78% | 0.00% | 0.038 |
| rules-ru | RULES | 0.32% | 3.56% | 0.00% | 0.096 |
| spacy-alrosait | SPACY | 0.13% | 0.13% | 0.00% | 0.002 |