EN · PII
nemotron-pii PII detection benchmark results
A frozen evaluation slice with 1,491 rows, 9,391 normalized gold annotations and source-level provenance.
1,491input rows
9,391gold annotations
1,459,456characters
62measured detectors
Dataset provenance
- Language group
- EN
- Task
- PII
- License
- cc-by-4.0
- Data categories
- ACCOUNT, ADDRESS, CONTACT, DATE, ID, NET, ORG, PERSON, SECRET
- Project generated
- No
- Corrupted copy
- No
Rows without annotations are not verified clean. Reported extra masking is not a human-confirmed false-positive rate.
Detector outcomes
Sorted by fully hidden annotations. Training-source overlaps are excluded.
| Detector | Family | Fully hidden ↑ | Detected / any overlap ↑ | Extra masking ↓ | Char F1 ↑ |
|---|---|---|---|---|---|
| pplx+cpu-int8 | PPLX | 92.91% | 95.55% | 13.67% | 0.812 |
| gliner2-large | GLINER2 | 91.18% | 92.92% | 0.36% | 0.881 |
| gliner2-fastino | GLINER2 | 90.41% | 92.51% | 0.67% | 0.866 |
| gliner-stream-pii | GLINER | 90.08% | 94.12% | 1.40% | 0.867 |
| pplx+ov100 | PPLX | 86.50% | 88.25% | 6.93% | 0.828 |
| pplx | PPLX | 86.19% | 87.76% | 6.93% | 0.829 |
| pplx+sent300 | PPLX | 85.65% | 88.62% | 7.23% | 0.808 |
| nym-base+sent300 | HF | 84.04% | 91.99% | 5.53% | 0.793 |
| nym-small | ONNX | 83.19% | 90.55% | 5.22% | 0.786 |
| nym-base | HF | 82.99% | 90.76% | 5.22% | 0.782 |
| nym-base+ov100 | HF | 82.76% | 90.54% | 5.22% | 0.779 |
| nym-base+cpu-int8 | HF | 81.18% | 90.15% | 5.22% | 0.783 |
| gliner-pii-base | GLINER | 78.46% | 81.34% | 1.09% | 0.793 |
| bardsai-eu | ONNX | 78.42% | 92.39% | 6.68% | 0.778 |
| nuner-zero | GLINER | 78.33% | 80.13% | 2.13% | 0.857 |
| gliner25-fastino+nochunk | GLINER2 | 74.20% | 75.79% | 0.36% | 0.798 |
| gliner-pii-edge | GLINER | 73.59% | 80.70% | 0.61% | 0.808 |
| apararti | OPF | 72.40% | 74.90% | 2.55% | 0.762 |
| opf-kz-ru | OPF | 71.39% | 74.44% | 2.55% | 0.772 |
| gravitee-small | HF | 71.23% | 76.94% | 5.71% | 0.753 |
| gliner25-fastino+ov100 | GLINER2 | 71.23% | 73.26% | 0.36% | 0.767 |
| gliner25-fastino | GLINER2 | 70.39% | 72.30% | 0.36% | 0.763 |
| gravitee-small+cpu-int8 | HF | 70.33% | 76.05% | 4.56% | 0.747 |
| gliner-urchade | GLINER | 69.91% | 72.19% | 0.00% | 0.761 |
| openai-base-onnx | ONNX | 68.76% | 70.38% | 2.55% | 0.719 |
| openai-base | OPF | 68.64% | 70.27% | 2.55% | 0.718 |
| gliner25-fastino+sent300 | GLINER2 | 67.77% | 69.93% | 0.36% | 0.722 |
| ru-pii-ner | RUPII | 65.20% | 65.99% | 1.03% | 0.630 |
| gliner2-vladlinv | GLINER2 | 63.49% | 63.91% | 0.36% | 0.639 |
| opf-ru | OPF | 62.40% | 72.02% | 1.76% | 0.701 |
| mmbert32k | HF | 62.01% | 86.40% | 3.10% | 0.763 |
| gliner-multi-v21 | GLINER | 59.01% | 65.91% | 0.61% | 0.503 |
| opf-ru-v2+sent300 | OPF | 57.01% | 62.93% | 0.00% | 0.680 |
| mmbert32k+nochunk | HF | 56.77% | 82.95% | 3.10% | 0.728 |
| opf-ru-v2 | OPF | 56.06% | 61.90% | 0.00% | 0.676 |
| opf-ru-v2+ov100 | OPF | 55.72% | 61.57% | 0.00% | 0.673 |
| traciora | OPF | 52.49% | 59.35% | 0.00% | 0.658 |
| stanza-ru | STANZA | 47.07% | 52.15% | 42.47% | 0.193 |
| davlan-xlmr | HF | 44.55% | 49.61% | 0.00% | 0.462 |
| davlan-mbert | HF | 42.95% | 47.69% | 0.00% | 0.442 |
| davlan-mbert+cpu-int8 | HF | 41.11% | 44.96% | 0.00% | 0.421 |
| ner-ru-yqelz | HF | 40.52% | 46.81% | 14.58% | 0.379 |
| pii-shield-onnx | ONNX | 39.93% | 50.78% | 9.96% | 0.636 |
| ru-legal-ner+sent300 | HF | 35.14% | 57.18% | 21.99% | 0.516 |
| mmbert32k+cpu-int8 | HF | 34.33% | 67.85% | 2.25% | 0.594 |
| ner-ru-gherman | HF | 31.91% | 39.83% | 0.00% | 0.305 |
| ner-ru-gherman-onnx | ONNX | 31.80% | 39.46% | 0.00% | 0.302 |
| ner-ru-gherman+cpu-int8 | HF | 30.70% | 36.96% | 0.00% | 0.281 |
| davlan-xlmr+cpu-int8 | HF | 30.24% | 34.41% | 0.00% | 0.334 |
| ru-legal-ner+cpu-int8 | HF | 26.64% | 47.44% | 21.26% | 0.463 |
| ru-legal-ner | HF | 26.50% | 47.12% | 21.69% | 0.464 |
| ru-legal-ner+ov100 | HF | 26.39% | 46.87% | 21.32% | 0.455 |
| rules-ru | RULES | 18.06% | 18.75% | 0.00% | 0.580 |
| gliner-pii-edge+cpu-int8 | GLINER | 16.51% | 18.05% | 0.00% | 0.222 |
| fef2-secret-ru | HF | 14.94% | 17.72% | 0.00% | 0.322 |
| fef2-secret-ru+cpu-int8 | HF | 11.89% | 15.97% | 0.00% | 0.276 |
| spacy-ru-lg | SPACY | 10.89% | 11.18% | 0.43% | 0.104 |
| natasha | NATASHA | 7.32% | 7.70% | 0.00% | 0.077 |
| gliner-pii-base+cpu-int8 | GLINER | 2.72% | 2.73% | 0.00% | 0.038 |
| spacy-alrosait | SPACY | 0.00% | 0.01% | 0.00% | 0.000 |
| gliner-multi-v21+cpu-int8 | GLINER | 0.00% | 0.00% | 0.00% | 0.000 |
| gliner-urchade+cpu-int8 | GLINER | 0.00% | 0.00% | 0.00% | 0.000 |