EN · SECRETS
synth-secrets-en PII detection benchmark results
A frozen evaluation slice with 600 rows, 581 normalized gold annotations and source-level provenance.
600input rows
581gold annotations
273,798characters
41measured detectors
Dataset provenance
- Language group
- EN
- Task
- SECRETS
- License
- cc-by-4.0
- Data categories
- SECRET
- Project generated
- Yes
- Corrupted copy
- No
Rows without annotations are not verified clean. Reported extra masking is not a human-confirmed false-positive rate.
Detector outcomes
Sorted by untouched annotations. Training-source overlaps are excluded.
| Detector | Family | Untouched ↓ | Fully hidden ↑ | Extra masking ↓ | Char F1 ↑ |
|---|---|---|---|---|---|
| pplx | PPLX | 0.17% | 97.42% | 43.92% | 0.330 |
| pii-shield-onnx | ONNX | 0.34% | 97.76% | 70.06% | 0.241 |
| openmed-multilingual | HF | 0.86% | 82.44% | 41.95% | 0.335 |
| opf-ru | OPF | 1.72% | 77.45% | 29.14% | 0.404 |
| opf-kz-ru | OPF | 1.72% | 91.39% | 47.61% | 0.319 |
| apararti | OPF | 2.93% | 87.95% | 50.54% | 0.304 |
| opf-ru-v2 | OPF | 3.96% | 78.66% | 32.22% | 0.378 |
| traciora | OPF | 5.51% | 70.57% | 30.64% | 0.396 |
| nym-base | HF | 6.02% | 62.48% | 32.00% | 0.354 |
| nym-small | ONNX | 6.71% | 57.31% | 30.86% | 0.352 |
| bardsai-eu | ONNX | 7.06% | 73.49% | 27.99% | 0.398 |
| openai-base | OPF | 7.06% | 84.51% | 49.46% | 0.300 |
| ru-legal-ner | HF | 10.84% | 33.56% | 27.21% | 0.368 |
| openmed-nemotron | HF | 12.91% | 57.14% | 33.81% | 0.353 |
| kalyan-ettin | HF | 14.46% | 48.02% | 25.69% | 0.379 |
| gliner-pii-edge | GLINER | 16.35% | 70.57% | 24.36% | 0.400 |
| rules-ru | RULES | 17.73% | 81.76% | 16.69% | 0.519 |
| mmbert32k | HF | 21.69% | 20.83% | 33.00% | 0.255 |
| fef2-secret-ru | HF | 28.92% | 53.18% | 4.40% | 0.574 |
| gravitee-small | HF | 29.09% | 46.30% | 11.10% | 0.356 |
| gliner2-fastino | GLINER2 | 35.46% | 58.00% | 4.59% | 0.466 |
| nuner-zero | GLINER | 35.63% | 53.18% | 4.00% | 0.483 |
| gliner-nvidia | GLINER | 35.63% | 61.96% | 11.22% | 0.473 |
| gliner25-fastino | GLINER2 | 43.20% | 54.04% | 22.91% | 0.261 |
| gliner2-hivetrace-omni | GLINER2 | 45.44% | 54.22% | 6.50% | 0.422 |
| gliner-stream-pii | GLINER | 51.46% | 41.31% | 4.13% | 0.390 |
| stanza-ru | STANZA | 54.91% | 20.65% | 15.70% | 0.227 |
| gliner-pii-base | GLINER | 65.40% | 31.15% | 2.63% | 0.319 |
| gliner-urchade | GLINER | 69.36% | 27.88% | 1.31% | 0.258 |
| gliner2-vladlinv | GLINER2 | 72.98% | 25.13% | 3.28% | 0.189 |
| gliner-multi-v21 | GLINER | 74.87% | 18.24% | 1.95% | 0.131 |
| gliner2-large | GLINER2 | 80.55% | 17.73% | 2.10% | 0.141 |
| ru-pii-ner | RUPII | 85.37% | 10.67% | 4.62% | 0.111 |
| ner-ru-yqelz | HF | 88.64% | 5.68% | 14.06% | 0.080 |
| gliner2-hivetrace-uni | GLINER2 | 99.14% | 0.86% | 0.09% | 0.006 |
| ner-ru-gherman | HF | 100.00% | 0.00% | 0.01% | 0.000 |
| spacy-ru-lg | SPACY | 100.00% | 0.00% | 0.78% | 0.000 |
| davlan-xlmr | HF | 100.00% | 0.00% | 0.00% | 0.000 |
| davlan-mbert | HF | 100.00% | 0.00% | 0.01% | 0.000 |
| natasha | NATASHA | 100.00% | 0.00% | 0.35% | 0.000 |
| spacy-alrosait | SPACY | 100.00% | 0.00% | 0.00% | 0.000 |