EN · PII
tab-echr PII detection benchmark results
A frozen evaluation slice with 127 rows, 3,830 normalized gold annotations and source-level provenance.
127input rows
3,830gold annotations
647,638characters
72measured detectors
Dataset provenance
- Language group
- EN
- Task
- PII
- License
- mit
- Data categories
- ADDRESS, ID, ORG, PERSON
- Project generated
- No
- Corrupted copy
- No
Rows without annotations are not verified clean. Reported extra masking is not a human-confirmed false-positive rate.
Detector outcomes
Sorted by untouched annotations. Training-source overlaps are excluded.
| Detector | Family | Untouched ↓ | Fully hidden ↑ | Extra masking ↓ | Char F1 ↑ |
|---|---|---|---|---|---|
| gliner2-fastino | GLINER2 | 1.57% | 81.31% | — | 0.635 |
| gliner25-fastino+sent300 | GLINER2 | 3.08% | 85.09% | — | 0.671 |
| nuner-zero | GLINER | 3.86% | 84.60% | — | 0.729 |
| gliner25-fastino | GLINER2 | 3.99% | 86.84% | — | 0.695 |
| gliner25-fastino+ov100 | GLINER2 | 4.13% | 87.68% | — | 0.701 |
| gliner2-large | GLINER2 | 6.29% | 83.42% | — | 0.650 |
| gliner-multi-v21 | GLINER | 9.79% | 83.63% | — | 0.690 |
| gliner2-hivetrace-omni | GLINER2 | 10.65% | 71.44% | — | 0.717 |
| davlan-mbert+cpu-int8 | HF | 12.85% | 54.49% | — | 0.829 |
| davlan-mbert | HF | 12.90% | 53.81% | — | 0.823 |
| davlan-xlmr | HF | 13.42% | 54.60% | — | 0.834 |
| bardsai-eu | ONNX | 13.45% | 65.46% | — | 0.819 |
| gliner-pii-edge | GLINER | 13.84% | 77.91% | — | 0.778 |
| stanza-ru | STANZA | 16.01% | 77.26% | — | 0.370 |
| gliner-nvidia+sent300 | GLINER | 16.63% | 65.59% | — | 0.786 |
| gliner-pii-base | GLINER | 16.71% | 77.65% | — | 0.744 |
| gliner-stream-pii | GLINER | 19.37% | 68.15% | — | 0.721 |
| gliner-urchade | GLINER | 20.31% | 76.87% | — | 0.679 |
| davlan-xlmr+cpu-int8 | HF | 21.36% | 36.21% | — | 0.757 |
| nym-small | ONNX | 22.87% | 44.26% | — | 0.534 |
| nym-base+ov100 | HF | 23.03% | 46.16% | — | 0.560 |
| nym-base | HF | 23.94% | 43.73% | — | 0.551 |
| gliner-nvidia | GLINER | 23.94% | 58.17% | — | 0.763 |
| gliner-nvidia+ov100 | GLINER | 24.62% | 56.92% | — | 0.757 |
| ner-ru-yqelz | HF | 24.75% | 55.46% | — | 0.628 |
| nym-base+cpu-int8 | HF | 25.17% | 41.49% | — | 0.533 |
| nym-base+sent300 | HF | 26.21% | 39.32% | — | 0.530 |
| openmed-multilingual | HF | 35.74% | 24.15% | — | 0.433 |
| gliner25-fastino+nochunk | GLINER2 | 36.95% | 56.19% | — | 0.737 |
| pplx+cpu-int8 | PPLX | 42.69% | 47.91% | — | 0.420 |
| gravitee-small | HF | 43.52% | 40.94% | — | 0.494 |
| ner-ru-gherman | HF | 43.94% | 15.20% | — | 0.496 |
| ner-ru-gherman-onnx | ONNX | 44.05% | 14.39% | — | 0.492 |
| gravitee-small+cpu-int8 | HF | 44.31% | 40.16% | — | 0.495 |
| ner-ru-gherman+cpu-int8 | HF | 44.44% | 13.81% | — | 0.473 |
| openmed-nemotron | HF | 45.40% | 14.96% | — | 0.355 |
| kalyan-ettin | HF | 47.73% | 12.27% | — | 0.329 |
| mmbert32k | HF | 52.61% | 14.54% | — | 0.351 |
| pplx+sent300 | PPLX | 52.64% | 28.41% | — | 0.331 |
| pplx+ov100 | PPLX | 55.77% | 29.66% | — | 0.323 |
| pplx | PPLX | 60.42% | 28.36% | — | 0.306 |
| mmbert32k+nochunk | HF | 61.83% | 8.72% | — | 0.285 |
| mmbert32k+cpu-int8 | HF | 64.78% | 5.93% | — | 0.258 |
| kalyan-ettin+cpu-int8 | HF | 65.40% | 7.81% | — | 0.240 |
| gliner2-hivetrace-uni | GLINER2 | 66.71% | 24.65% | — | 0.465 |
| gliner2-vladlinv | GLINER2 | 68.98% | 19.14% | — | 0.344 |
| pii-shield-onnx | ONNX | 69.40% | 12.40% | — | 0.216 |
| ru-pii-ner | RUPII | 69.66% | 15.74% | — | 0.265 |
| apararti | OPF | 71.15% | 26.37% | — | 0.281 |
| opf-ru | OPF | 72.95% | 19.61% | — | 0.267 |
| opf-kz-ru | OPF | 73.21% | 23.32% | — | 0.254 |
| spacy-ru-lg | SPACY | 73.42% | 25.35% | — | 0.260 |
| ru-legal-ner+sent300 | HF | 73.73% | 7.73% | — | 0.185 |
| openai-base-onnx | ONNX | 76.84% | 22.35% | — | 0.259 |
| openai-base | OPF | 76.87% | 22.22% | — | 0.258 |
| opf-ru-v2+sent300 | OPF | 77.21% | 19.06% | — | 0.293 |
| opf-ru-v2+ov100 | OPF | 77.23% | 19.77% | — | 0.296 |
| opf-ru-v2 | OPF | 78.33% | 19.19% | — | 0.287 |
| traciora | OPF | 79.37% | 16.95% | — | 0.271 |
| ru-legal-ner+cpu-int8 | HF | 80.08% | 6.08% | — | 0.140 |
| ru-legal-ner | HF | 80.42% | 5.93% | — | 0.138 |
| ru-legal-ner+ov100 | HF | 80.81% | 6.32% | — | 0.133 |
| natasha | NATASHA | 84.41% | 14.33% | — | 0.223 |
| fef2-secret-ru+cpu-int8 | HF | 89.69% | 2.06% | — | 0.131 |
| fef2-secret-ru | HF | 90.91% | 2.06% | — | 0.114 |
| gliner-pii-edge+cpu-int8 | GLINER | 96.19% | 3.29% | — | 0.057 |
| gliner-pii-base+cpu-int8 | GLINER | 97.55% | 2.35% | — | 0.067 |
| spacy-alrosait | SPACY | 99.97% | 0.00% | — | 0.000 |
| rules-ru | RULES | 100.00% | 0.00% | — | 0.000 |
| gliner-multi-v21+cpu-int8 | GLINER | 100.00% | 0.00% | — | 0.000 |
| gliner-nvidia+cpu-int8 | GLINER | 100.00% | 0.00% | — | 0.000 |
| gliner-urchade+cpu-int8 | GLINER | 100.00% | 0.00% | — | 0.000 |