EN · SECRETS
corrupt-secrets-issues PII detection benchmark results
A frozen evaluation slice with 500 rows, 288 normalized gold annotations and source-level provenance.
500input rows
288gold annotations
1,191,638characters
48measured detectors
Dataset provenance
- Language group
- EN
- Task
- SECRETS
- License
- cc-by-4.0
- Data categories
- SECRET
- Project generated
- No
- Corrupted copy
- Yes
Rows without annotations are not verified clean. Reported extra masking is not a human-confirmed false-positive rate.
Detector outcomes
Sorted by untouched annotations. Training-source overlaps are excluded.
| Detector | Family | Untouched ↓ | Fully hidden ↑ | Extra masking ↓ | Char F1 ↑ |
|---|---|---|---|---|---|
| pii-shield-onnx | ONNX | 0.00% | 84.72% | 53.05% | 0.101 |
| opf-ru | OPF | 2.43% | 70.83% | 8.62% | 0.340 |
| apararti | OPF | 2.78% | 72.92% | 7.81% | 0.335 |
| nym-base | HF | 3.82% | 63.19% | 6.33% | 0.356 |
| nym-base+homoglyph | HF | 3.82% | 63.19% | 6.30% | 0.357 |
| nym-small | ONNX | 4.17% | 55.90% | 7.31% | 0.329 |
| pplx | PPLX | 4.17% | 75.69% | 10.10% | 0.306 |
| pplx+homoglyph | PPLX | 4.17% | 75.69% | 10.28% | 0.304 |
| opf-kz-ru | OPF | 4.51% | 73.26% | 8.23% | 0.319 |
| traciora | OPF | 5.56% | 69.44% | 4.55% | 0.404 |
| bardsai-eu | ONNX | 5.56% | 70.83% | 5.73% | 0.360 |
| opf-ru-v2 | OPF | 6.94% | 70.14% | 3.73% | 0.414 |
| opf-ru-v2+homoglyph | OPF | 7.29% | 70.14% | 3.57% | 0.417 |
| openmed-nemotron | HF | 9.72% | 62.15% | 11.89% | 0.273 |
| openmed-multilingual | HF | 10.42% | 53.82% | 9.59% | 0.291 |
| openai-base | OPF | 10.42% | 68.06% | 4.41% | 0.408 |
| kalyan-ettin | HF | 13.19% | 53.47% | 6.49% | 0.345 |
| gliner-pii-edge | GLINER | 13.54% | 52.78% | 9.04% | 0.332 |
| mmbert32k | HF | 16.67% | 35.07% | 8.84% | 0.305 |
| ru-legal-ner | HF | 22.57% | 41.67% | 11.76% | 0.137 |
| ru-legal-ner+homoglyph | HF | 22.92% | 41.32% | 10.02% | 0.144 |
| nuner-zero | GLINER | 29.51% | 40.97% | 2.23% | 0.442 |
| gliner2-fastino | GLINER2 | 35.42% | 35.76% | 5.76% | 0.332 |
| rules-ru | RULES | 40.28% | 40.97% | 7.35% | 0.196 |
| gliner-stream-pii | GLINER | 44.10% | 27.78% | 2.39% | 0.453 |
| gliner-urchade | GLINER | 44.79% | 34.38% | 2.86% | 0.246 |
| fef2-secret-ru | HF | 48.96% | 33.33% | 0.43% | 0.546 |
| gliner-nvidia | GLINER | 52.43% | 29.86% | 3.28% | 0.418 |
| gliner-nvidia+homoglyph | GLINER | 52.43% | 29.86% | 3.29% | 0.417 |
| stanza-ru | STANZA | 52.78% | 20.83% | 20.76% | 0.144 |
| gliner25-fastino | GLINER2 | 57.64% | 23.26% | 5.64% | 0.129 |
| ner-ru-yqelz | HF | 66.32% | 19.79% | 7.56% | 0.102 |
| gliner2-hivetrace-omni | GLINER2 | 69.79% | 16.32% | 1.30% | 0.248 |
| gliner2-large | GLINER2 | 70.14% | 11.46% | 2.04% | 0.086 |
| gravitee-small | HF | 72.92% | 11.11% | 3.94% | 0.078 |
| ru-pii-ner | RUPII | 73.61% | 19.44% | 1.74% | 0.250 |
| gliner-multi-v21 | GLINER | 73.61% | 8.33% | 1.88% | 0.074 |
| gliner2-hivetrace-uni | GLINER2 | 85.07% | 5.21% | 0.44% | 0.055 |
| gliner-pii-base | GLINER | 86.46% | 7.64% | 0.56% | 0.155 |
| gliner2-vladlinv | GLINER2 | 90.28% | 4.17% | 0.06% | 0.046 |
| gliner2-vladlinv+homoglyph | GLINER2 | 90.28% | 4.17% | 0.04% | 0.047 |
| spacy-ru-lg | SPACY | 94.44% | 2.78% | 3.18% | 0.384 |
| natasha | NATASHA | 97.57% | 0.00% | 0.81% | 0.180 |
| davlan-mbert | HF | 98.96% | 0.00% | 0.92% | 0.001 |
| ner-ru-gherman | HF | 100.00% | 0.00% | 0.10% | 0.000 |
| davlan-xlmr | HF | 100.00% | 0.00% | 0.45% | 0.000 |
| spacy-alrosait | SPACY | 100.00% | 0.00% | 0.02% | 0.000 |
| ner-ru-gherman+homoglyph | HF | 100.00% | 0.00% | 0.12% | 0.000 |