EN · PII
ameau01 PII detection benchmark results
A frozen evaluation slice with 1,452 rows, 2,242 normalized gold annotations and source-level provenance.
1,452input rows
2,242gold annotations
376,930characters
58measured detectors
Dataset provenance
- Language group
- EN
- Task
- PII
- License
- mit
- Data categories
- ACCOUNT, ADDRESS, CONTACT, NET, PERSON
- Project generated
- No
- Corrupted copy
- No
Rows without annotations are not verified clean. Reported extra masking is not a human-confirmed false-positive rate.
Detector outcomes
Sorted by fully hidden annotations. Training-source overlaps are excluded.
| Detector | Family | Fully hidden ↑ | Detected / any overlap ↑ | Extra masking ↓ | Char F1 ↑ |
|---|---|---|---|---|---|
| gliner2-hivetrace-omni | GLINER2 | 94.60% | 94.65% | 6.48% | 0.757 |
| pplx+cpu-int8 | PPLX | 94.47% | 95.32% | 6.98% | 0.650 |
| gliner2-fastino | GLINER2 | 92.82% | 92.86% | 4.37% | 0.765 |
| nuner-zero | GLINER | 84.34% | 84.52% | 6.68% | 0.669 |
| gliner-nvidia | GLINER | 82.87% | 83.72% | 5.17% | 0.686 |
| gliner-stream-pii | GLINER | 82.25% | 84.26% | 6.72% | 0.700 |
| pplx | PPLX | 81.62% | 82.47% | 3.77% | 0.688 |
| gliner-urchade | GLINER | 77.16% | 78.06% | 5.14% | 0.682 |
| gliner2-large | GLINER2 | 76.14% | 76.23% | 6.03% | 0.630 |
| gliner-pii-base | GLINER | 75.69% | 75.74% | 4.74% | 0.700 |
| gliner25-fastino | GLINER2 | 72.48% | 72.52% | 2.75% | 0.669 |
| gliner-pii-edge | GLINER | 72.26% | 72.57% | 3.80% | 0.677 |
| gliner-multi-v21 | GLINER | 62.00% | 64.63% | 2.51% | 0.611 |
| apararti | OPF | 57.76% | 59.95% | 3.96% | 0.517 |
| openai-base | OPF | 53.70% | 55.04% | 2.58% | 0.528 |
| openai-base-onnx | ONNX | 53.30% | 54.86% | 2.58% | 0.527 |
| openmed-multilingual | HF | 52.59% | 71.72% | 4.37% | 0.570 |
| mmbert32k | HF | 52.05% | 77.79% | 4.59% | 0.597 |
| opf-kz-ru | OPF | 50.80% | 53.79% | 4.04% | 0.485 |
| opf-ru | OPF | 50.22% | 60.17% | 3.25% | 0.518 |
| pii-shield-onnx | ONNX | 46.79% | 58.83% | 6.95% | 0.550 |
| gravitee-small+cpu-int8 | HF | 46.74% | 47.68% | 1.74% | 0.523 |
| gravitee-small | HF | 46.65% | 47.73% | 1.81% | 0.520 |
| kalyan-ettin | HF | 45.67% | 68.29% | 2.63% | 0.573 |
| nym-base | HF | 45.05% | 63.07% | 1.77% | 0.572 |
| traciora | OPF | 44.78% | 49.60% | 1.29% | 0.550 |
| bardsai-eu | ONNX | 44.69% | 54.82% | 3.27% | 0.518 |
| ru-pii-ner | RUPII | 44.47% | 44.74% | 1.09% | 0.571 |
| openmed-nemotron | HF | 43.00% | 63.83% | 3.19% | 0.542 |
| opf-ru-v2 | OPF | 42.51% | 45.58% | 1.00% | 0.552 |
| gliner2-hivetrace-uni | GLINER2 | 41.44% | 41.53% | 0.82% | 0.534 |
| nym-base+cpu-int8 | HF | 39.56% | 58.16% | 1.59% | 0.552 |
| gliner2-vladlinv | GLINER2 | 39.12% | 39.16% | 0.05% | 0.527 |
| ner-ru-yqelz | HF | 38.76% | 42.69% | 12.88% | 0.302 |
| nym-small | ONNX | 38.40% | 55.66% | 1.85% | 0.538 |
| stanza-ru | STANZA | 37.73% | 51.43% | 16.65% | 0.269 |
| davlan-xlmr | HF | 34.26% | 35.41% | 2.79% | 0.358 |
| davlan-mbert | HF | 29.17% | 33.76% | 3.48% | 0.333 |
| davlan-mbert+cpu-int8 | HF | 26.45% | 30.51% | 2.87% | 0.323 |
| mmbert32k+cpu-int8 | HF | 19.45% | 53.93% | 3.41% | 0.415 |
| davlan-xlmr+cpu-int8 | HF | 18.73% | 20.96% | 1.02% | 0.275 |
| kalyan-ettin+cpu-int8 | HF | 17.62% | 37.78% | 1.37% | 0.377 |
| ru-legal-ner+cpu-int8 | HF | 17.13% | 32.07% | 1.90% | 0.331 |
| ru-legal-ner | HF | 16.37% | 30.78% | 1.87% | 0.323 |
| rules-ru | RULES | 16.32% | 16.32% | 3.68% | 0.247 |
| fef2-secret-ru | HF | 10.97% | 12.76% | 1.21% | 0.233 |
| ner-ru-gherman | HF | 10.48% | 29.79% | 0.07% | 0.378 |
| ner-ru-gherman-onnx | ONNX | 10.26% | 29.30% | 0.06% | 0.375 |
| fef2-secret-ru+cpu-int8 | HF | 10.04% | 12.62% | 0.87% | 0.238 |
| ner-ru-gherman+cpu-int8 | HF | 9.23% | 27.88% | 0.05% | 0.361 |
| gliner-pii-edge+cpu-int8 | GLINER | 5.93% | 6.42% | 0.38% | 0.088 |
| spacy-ru-lg | SPACY | 5.49% | 5.49% | 3.74% | 0.062 |
| natasha | NATASHA | 3.93% | 3.97% | 0.44% | 0.071 |
| gliner-pii-base+cpu-int8 | GLINER | 0.67% | 0.67% | 0.02% | 0.012 |
| spacy-alrosait | SPACY | 0.00% | 0.00% | 0.00% | 0.000 |
| gliner-multi-v21+cpu-int8 | GLINER | 0.00% | 0.00% | 0.00% | 0.000 |
| gliner-nvidia+cpu-int8 | GLINER | 0.00% | 0.00% | 0.00% | 0.000 |
| gliner-urchade+cpu-int8 | GLINER | 0.00% | 0.00% | 0.00% | 0.000 |