EN · PII
nemotron-pii PII detection benchmark results
A frozen evaluation slice with 1,491 rows, 9,391 normalized gold annotations and source-level provenance.
1,491input rows
9,391gold annotations
1,459,456characters
62measured detectors
Dataset provenance
- Language group
- EN
- Task
- PII
- License
- cc-by-4.0
- Data categories
- ACCOUNT, ADDRESS, CONTACT, DATE, ID, NET, ORG, PERSON, SECRET
- Project generated
- No
- Corrupted copy
- No
Rows without annotations are not verified clean. Reported extra masking is not a human-confirmed false-positive rate.
Detector outcomes
Sorted by untouched annotations. Training-source overlaps are excluded.
| Detector | Family | Untouched ↓ | Fully hidden ↑ | Extra masking ↓ | Char F1 ↑ |
|---|---|---|---|---|---|
| pplx+cpu-int8 | PPLX | 4.45% | 92.91% | 13.67% | 0.812 |
| gliner-stream-pii | GLINER | 5.88% | 90.08% | 1.40% | 0.867 |
| gliner2-large | GLINER2 | 7.08% | 91.18% | 0.36% | 0.881 |
| gliner2-fastino | GLINER2 | 7.49% | 90.41% | 0.67% | 0.866 |
| bardsai-eu | ONNX | 7.61% | 78.42% | 6.68% | 0.778 |
| nym-base+sent300 | HF | 8.01% | 84.04% | 5.53% | 0.793 |
| nym-base | HF | 9.24% | 82.99% | 5.22% | 0.782 |
| nym-small | ONNX | 9.45% | 83.19% | 5.22% | 0.786 |
| nym-base+ov100 | HF | 9.46% | 82.76% | 5.22% | 0.779 |
| nym-base+cpu-int8 | HF | 9.85% | 81.18% | 5.22% | 0.783 |
| pplx+sent300 | PPLX | 11.38% | 85.65% | 7.23% | 0.808 |
| pplx+ov100 | PPLX | 11.75% | 86.50% | 6.93% | 0.828 |
| pplx | PPLX | 12.24% | 86.19% | 6.93% | 0.829 |
| mmbert32k | HF | 13.60% | 62.01% | 3.10% | 0.763 |
| mmbert32k+nochunk | HF | 17.05% | 56.77% | 3.10% | 0.728 |
| gliner-pii-base | GLINER | 18.66% | 78.46% | 1.09% | 0.793 |
| gliner-pii-edge | GLINER | 19.30% | 73.59% | 0.61% | 0.808 |
| nuner-zero | GLINER | 19.87% | 78.33% | 2.13% | 0.857 |
| gravitee-small | HF | 23.06% | 71.23% | 5.71% | 0.753 |
| gravitee-small+cpu-int8 | HF | 23.95% | 70.33% | 4.56% | 0.747 |
| gliner25-fastino+nochunk | GLINER2 | 24.21% | 74.20% | 0.36% | 0.798 |
| apararti | OPF | 25.10% | 72.40% | 2.55% | 0.762 |
| opf-kz-ru | OPF | 25.56% | 71.39% | 2.55% | 0.772 |
| gliner25-fastino+ov100 | GLINER2 | 26.74% | 71.23% | 0.36% | 0.767 |
| gliner25-fastino | GLINER2 | 27.70% | 70.39% | 0.36% | 0.763 |
| gliner-urchade | GLINER | 27.81% | 69.91% | 0.00% | 0.761 |
| opf-ru | OPF | 27.98% | 62.40% | 1.76% | 0.701 |
| openai-base-onnx | ONNX | 29.62% | 68.76% | 2.55% | 0.719 |
| openai-base | OPF | 29.73% | 68.64% | 2.55% | 0.718 |
| gliner25-fastino+sent300 | GLINER2 | 30.07% | 67.77% | 0.36% | 0.722 |
| mmbert32k+cpu-int8 | HF | 32.15% | 34.33% | 2.25% | 0.594 |
| ru-pii-ner | RUPII | 34.01% | 65.20% | 1.03% | 0.630 |
| gliner-multi-v21 | GLINER | 34.09% | 59.01% | 0.61% | 0.503 |
| gliner2-vladlinv | GLINER2 | 36.09% | 63.49% | 0.36% | 0.639 |
| opf-ru-v2+sent300 | OPF | 37.07% | 57.01% | 0.00% | 0.680 |
| opf-ru-v2 | OPF | 38.10% | 56.06% | 0.00% | 0.676 |
| opf-ru-v2+ov100 | OPF | 38.43% | 55.72% | 0.00% | 0.673 |
| traciora | OPF | 40.65% | 52.49% | 0.00% | 0.658 |
| ru-legal-ner+sent300 | HF | 42.82% | 35.14% | 21.99% | 0.516 |
| stanza-ru | STANZA | 47.85% | 47.07% | 42.47% | 0.193 |
| pii-shield-onnx | ONNX | 49.22% | 39.93% | 9.96% | 0.636 |
| davlan-xlmr | HF | 50.39% | 44.55% | 0.00% | 0.462 |
| davlan-mbert | HF | 52.31% | 42.95% | 0.00% | 0.442 |
| ru-legal-ner+cpu-int8 | HF | 52.56% | 26.64% | 21.26% | 0.463 |
| ru-legal-ner | HF | 52.88% | 26.50% | 21.69% | 0.464 |
| ru-legal-ner+ov100 | HF | 53.13% | 26.39% | 21.32% | 0.455 |
| ner-ru-yqelz | HF | 53.19% | 40.52% | 14.58% | 0.379 |
| davlan-mbert+cpu-int8 | HF | 55.04% | 41.11% | 0.00% | 0.421 |
| ner-ru-gherman | HF | 60.17% | 31.91% | 0.00% | 0.305 |
| ner-ru-gherman-onnx | ONNX | 60.54% | 31.80% | 0.00% | 0.302 |
| ner-ru-gherman+cpu-int8 | HF | 63.04% | 30.70% | 0.00% | 0.281 |
| davlan-xlmr+cpu-int8 | HF | 65.59% | 30.24% | 0.00% | 0.334 |
| rules-ru | RULES | 81.25% | 18.06% | 0.00% | 0.580 |
| gliner-pii-edge+cpu-int8 | GLINER | 81.95% | 16.51% | 0.00% | 0.222 |
| fef2-secret-ru | HF | 82.28% | 14.94% | 0.00% | 0.322 |
| fef2-secret-ru+cpu-int8 | HF | 84.03% | 11.89% | 0.00% | 0.276 |
| spacy-ru-lg | SPACY | 88.82% | 10.89% | 0.43% | 0.104 |
| natasha | NATASHA | 92.30% | 7.32% | 0.00% | 0.077 |
| gliner-pii-base+cpu-int8 | GLINER | 97.27% | 2.72% | 0.00% | 0.038 |
| spacy-alrosait | SPACY | 99.99% | 0.00% | 0.00% | 0.000 |
| gliner-multi-v21+cpu-int8 | GLINER | 100.00% | 0.00% | 0.00% | 0.000 |
| gliner-urchade+cpu-int8 | GLINER | 100.00% | 0.00% | 0.00% | 0.000 |