EN · PII
tab-echr PII detection benchmark results
A frozen evaluation slice with 127 rows, 3,830 normalized gold annotations and source-level provenance.
127input rows
3,830gold annotations
647,638characters
72measured detectors
Dataset provenance
- Language group
- EN
- Task
- PII
- License
- mit
- Data categories
- ADDRESS, ID, ORG, PERSON
- Project generated
- No
- Corrupted copy
- No
Rows without annotations are not verified clean. Reported extra masking is not a human-confirmed false-positive rate.
Detector outcomes
Sorted by fully hidden annotations. Training-source overlaps are excluded.
| Detector | Family | Fully hidden ↑ | Detected / any overlap ↑ | Extra masking ↓ | Char F1 ↑ |
|---|---|---|---|---|---|
| gliner25-fastino+ov100 | GLINER2 | 87.68% | 95.87% | — | 0.701 |
| gliner25-fastino | GLINER2 | 86.84% | 96.01% | — | 0.695 |
| gliner25-fastino+sent300 | GLINER2 | 85.09% | 96.92% | — | 0.671 |
| nuner-zero | GLINER | 84.60% | 96.14% | — | 0.729 |
| gliner-multi-v21 | GLINER | 83.63% | 90.21% | — | 0.690 |
| gliner2-large | GLINER2 | 83.42% | 93.71% | — | 0.650 |
| gliner2-fastino | GLINER2 | 81.31% | 98.43% | — | 0.635 |
| gliner-pii-edge | GLINER | 77.91% | 86.16% | — | 0.778 |
| gliner-pii-base | GLINER | 77.65% | 83.29% | — | 0.744 |
| stanza-ru | STANZA | 77.26% | 83.99% | — | 0.370 |
| gliner-urchade | GLINER | 76.87% | 79.69% | — | 0.679 |
| gliner2-hivetrace-omni | GLINER2 | 71.44% | 89.35% | — | 0.717 |
| gliner-stream-pii | GLINER | 68.15% | 80.63% | — | 0.721 |
| gliner-nvidia+sent300 | GLINER | 65.59% | 83.37% | — | 0.786 |
| bardsai-eu | ONNX | 65.46% | 86.55% | — | 0.819 |
| gliner-nvidia | GLINER | 58.17% | 76.06% | — | 0.763 |
| gliner-nvidia+ov100 | GLINER | 56.92% | 75.38% | — | 0.757 |
| gliner25-fastino+nochunk | GLINER2 | 56.19% | 63.05% | — | 0.737 |
| ner-ru-yqelz | HF | 55.46% | 75.25% | — | 0.628 |
| davlan-xlmr | HF | 54.60% | 86.58% | — | 0.834 |
| davlan-mbert+cpu-int8 | HF | 54.49% | 87.15% | — | 0.829 |
| davlan-mbert | HF | 53.81% | 87.10% | — | 0.823 |
| pplx+cpu-int8 | PPLX | 47.91% | 57.31% | — | 0.420 |
| nym-base+ov100 | HF | 46.16% | 76.97% | — | 0.560 |
| nym-small | ONNX | 44.26% | 77.13% | — | 0.534 |
| nym-base | HF | 43.73% | 76.06% | — | 0.551 |
| nym-base+cpu-int8 | HF | 41.49% | 74.83% | — | 0.533 |
| gravitee-small | HF | 40.94% | 56.48% | — | 0.494 |
| gravitee-small+cpu-int8 | HF | 40.16% | 55.69% | — | 0.495 |
| nym-base+sent300 | HF | 39.32% | 73.79% | — | 0.530 |
| davlan-xlmr+cpu-int8 | HF | 36.21% | 78.64% | — | 0.757 |
| pplx+ov100 | PPLX | 29.66% | 44.23% | — | 0.323 |
| pplx+sent300 | PPLX | 28.41% | 47.36% | — | 0.331 |
| pplx | PPLX | 28.36% | 39.58% | — | 0.306 |
| apararti | OPF | 26.37% | 28.85% | — | 0.281 |
| spacy-ru-lg | SPACY | 25.35% | 26.58% | — | 0.260 |
| gliner2-hivetrace-uni | GLINER2 | 24.65% | 33.29% | — | 0.465 |
| openmed-multilingual | HF | 24.15% | 64.26% | — | 0.433 |
| opf-kz-ru | OPF | 23.32% | 26.79% | — | 0.254 |
| openai-base-onnx | ONNX | 22.35% | 23.16% | — | 0.259 |
| openai-base | OPF | 22.22% | 23.13% | — | 0.258 |
| opf-ru-v2+ov100 | OPF | 19.77% | 22.77% | — | 0.296 |
| opf-ru | OPF | 19.61% | 27.05% | — | 0.267 |
| opf-ru-v2 | OPF | 19.19% | 21.67% | — | 0.287 |
| gliner2-vladlinv | GLINER2 | 19.14% | 31.02% | — | 0.344 |
| opf-ru-v2+sent300 | OPF | 19.06% | 22.79% | — | 0.293 |
| traciora | OPF | 16.95% | 20.63% | — | 0.271 |
| ru-pii-ner | RUPII | 15.74% | 30.34% | — | 0.265 |
| ner-ru-gherman | HF | 15.20% | 56.06% | — | 0.496 |
| openmed-nemotron | HF | 14.96% | 54.60% | — | 0.355 |
| mmbert32k | HF | 14.54% | 47.39% | — | 0.351 |
| ner-ru-gherman-onnx | ONNX | 14.39% | 55.95% | — | 0.492 |
| natasha | NATASHA | 14.33% | 15.59% | — | 0.223 |
| ner-ru-gherman+cpu-int8 | HF | 13.81% | 55.56% | — | 0.473 |
| pii-shield-onnx | ONNX | 12.40% | 30.60% | — | 0.216 |
| kalyan-ettin | HF | 12.27% | 52.27% | — | 0.329 |
| mmbert32k+nochunk | HF | 8.72% | 38.17% | — | 0.285 |
| kalyan-ettin+cpu-int8 | HF | 7.81% | 34.60% | — | 0.240 |
| ru-legal-ner+sent300 | HF | 7.73% | 26.27% | — | 0.185 |
| ru-legal-ner+ov100 | HF | 6.32% | 19.19% | — | 0.133 |
| ru-legal-ner+cpu-int8 | HF | 6.08% | 19.92% | — | 0.140 |
| ru-legal-ner | HF | 5.93% | 19.58% | — | 0.138 |
| mmbert32k+cpu-int8 | HF | 5.93% | 35.22% | — | 0.258 |
| gliner-pii-edge+cpu-int8 | GLINER | 3.29% | 3.81% | — | 0.057 |
| gliner-pii-base+cpu-int8 | GLINER | 2.35% | 2.45% | — | 0.067 |
| fef2-secret-ru | HF | 2.06% | 9.09% | — | 0.114 |
| fef2-secret-ru+cpu-int8 | HF | 2.06% | 10.31% | — | 0.131 |
| rules-ru | RULES | 0.00% | 0.00% | — | 0.000 |
| spacy-alrosait | SPACY | 0.00% | 0.03% | — | 0.000 |
| gliner-multi-v21+cpu-int8 | GLINER | 0.00% | 0.00% | — | 0.000 |
| gliner-nvidia+cpu-int8 | GLINER | 0.00% | 0.00% | — | 0.000 |
| gliner-urchade+cpu-int8 | GLINER | 0.00% | 0.00% | — | 0.000 |