EN · PII
ameau01 PII detection benchmark results
A frozen evaluation slice with 1,452 rows, 2,242 normalized gold annotations and source-level provenance.
1,452input rows
2,242gold annotations
376,930characters
58measured detectors
Dataset provenance
- Language group
- EN
- Task
- PII
- License
- mit
- Data categories
- ACCOUNT, ADDRESS, CONTACT, NET, PERSON
- Project generated
- No
- Corrupted copy
- No
Rows without annotations are not verified clean. Reported extra masking is not a human-confirmed false-positive rate.
Detector outcomes
Sorted by untouched annotations. Training-source overlaps are excluded.
| Detector | Family | Untouched ↓ | Fully hidden ↑ | Extra masking ↓ | Char F1 ↑ |
|---|---|---|---|---|---|
| pplx+cpu-int8 | PPLX | 4.68% | 94.47% | 6.98% | 0.650 |
| gliner2-hivetrace-omni | GLINER2 | 5.35% | 94.60% | 6.48% | 0.757 |
| gliner2-fastino | GLINER2 | 7.14% | 92.82% | 4.37% | 0.765 |
| nuner-zero | GLINER | 15.48% | 84.34% | 6.68% | 0.669 |
| gliner-stream-pii | GLINER | 15.74% | 82.25% | 6.72% | 0.700 |
| gliner-nvidia | GLINER | 16.28% | 82.87% | 5.17% | 0.686 |
| pplx | PPLX | 17.53% | 81.62% | 3.77% | 0.688 |
| gliner-urchade | GLINER | 21.94% | 77.16% | 5.14% | 0.682 |
| mmbert32k | HF | 22.21% | 52.05% | 4.59% | 0.597 |
| gliner2-large | GLINER2 | 23.77% | 76.14% | 6.03% | 0.630 |
| gliner-pii-base | GLINER | 24.26% | 75.69% | 4.74% | 0.700 |
| gliner-pii-edge | GLINER | 27.43% | 72.26% | 3.80% | 0.677 |
| gliner25-fastino | GLINER2 | 27.48% | 72.48% | 2.75% | 0.669 |
| openmed-multilingual | HF | 28.28% | 52.59% | 4.37% | 0.570 |
| kalyan-ettin | HF | 31.71% | 45.67% | 2.63% | 0.573 |
| gliner-multi-v21 | GLINER | 35.37% | 62.00% | 2.51% | 0.611 |
| openmed-nemotron | HF | 36.17% | 43.00% | 3.19% | 0.542 |
| nym-base | HF | 36.93% | 45.05% | 1.77% | 0.572 |
| opf-ru | OPF | 39.83% | 50.22% | 3.25% | 0.518 |
| apararti | OPF | 40.05% | 57.76% | 3.96% | 0.517 |
| pii-shield-onnx | ONNX | 41.17% | 46.79% | 6.95% | 0.550 |
| nym-base+cpu-int8 | HF | 41.84% | 39.56% | 1.59% | 0.552 |
| nym-small | ONNX | 44.34% | 38.40% | 1.85% | 0.538 |
| openai-base | OPF | 44.96% | 53.70% | 2.58% | 0.528 |
| openai-base-onnx | ONNX | 45.14% | 53.30% | 2.58% | 0.527 |
| bardsai-eu | ONNX | 45.18% | 44.69% | 3.27% | 0.518 |
| mmbert32k+cpu-int8 | HF | 46.07% | 19.45% | 3.41% | 0.415 |
| opf-kz-ru | OPF | 46.21% | 50.80% | 4.04% | 0.485 |
| stanza-ru | STANZA | 48.57% | 37.73% | 16.65% | 0.269 |
| traciora | OPF | 50.40% | 44.78% | 1.29% | 0.550 |
| gravitee-small | HF | 52.27% | 46.65% | 1.81% | 0.520 |
| gravitee-small+cpu-int8 | HF | 52.32% | 46.74% | 1.74% | 0.523 |
| opf-ru-v2 | OPF | 54.42% | 42.51% | 1.00% | 0.552 |
| ru-pii-ner | RUPII | 55.26% | 44.47% | 1.09% | 0.571 |
| ner-ru-yqelz | HF | 57.31% | 38.76% | 12.88% | 0.302 |
| gliner2-hivetrace-uni | GLINER2 | 58.47% | 41.44% | 0.82% | 0.534 |
| gliner2-vladlinv | GLINER2 | 60.84% | 39.12% | 0.05% | 0.527 |
| kalyan-ettin+cpu-int8 | HF | 62.22% | 17.62% | 1.37% | 0.377 |
| davlan-xlmr | HF | 64.59% | 34.26% | 2.79% | 0.358 |
| davlan-mbert | HF | 66.24% | 29.17% | 3.48% | 0.333 |
| ru-legal-ner+cpu-int8 | HF | 67.93% | 17.13% | 1.90% | 0.331 |
| ru-legal-ner | HF | 69.22% | 16.37% | 1.87% | 0.323 |
| davlan-mbert+cpu-int8 | HF | 69.49% | 26.45% | 2.87% | 0.323 |
| ner-ru-gherman | HF | 70.21% | 10.48% | 0.07% | 0.378 |
| ner-ru-gherman-onnx | ONNX | 70.70% | 10.26% | 0.06% | 0.375 |
| ner-ru-gherman+cpu-int8 | HF | 72.12% | 9.23% | 0.05% | 0.361 |
| davlan-xlmr+cpu-int8 | HF | 79.04% | 18.73% | 1.02% | 0.275 |
| rules-ru | RULES | 83.68% | 16.32% | 3.68% | 0.247 |
| fef2-secret-ru | HF | 87.24% | 10.97% | 1.21% | 0.233 |
| fef2-secret-ru+cpu-int8 | HF | 87.38% | 10.04% | 0.87% | 0.238 |
| gliner-pii-edge+cpu-int8 | GLINER | 93.58% | 5.93% | 0.38% | 0.088 |
| spacy-ru-lg | SPACY | 94.51% | 5.49% | 3.74% | 0.062 |
| natasha | NATASHA | 96.03% | 3.93% | 0.44% | 0.071 |
| gliner-pii-base+cpu-int8 | GLINER | 99.33% | 0.67% | 0.02% | 0.012 |
| spacy-alrosait | SPACY | 100.00% | 0.00% | 0.00% | 0.000 |
| gliner-multi-v21+cpu-int8 | GLINER | 100.00% | 0.00% | 0.00% | 0.000 |
| gliner-nvidia+cpu-int8 | GLINER | 100.00% | 0.00% | 0.00% | 0.000 |
| gliner-urchade+cpu-int8 | GLINER | 100.00% | 0.00% | 0.00% | 0.000 |