EN · SECRETS
leak-museum PII detection benchmark results
A frozen evaluation slice with 97 rows, 101 normalized gold annotations and source-level provenance.
97input rows
101gold annotations
75,730characters
55measured detectors
Dataset provenance
- Language group
- EN
- Task
- SECRETS
- License
- mit
- Data categories
- SECRET
- Project generated
- No
- Corrupted copy
- No
Rows without annotations are not verified clean. Reported extra masking is not a human-confirmed false-positive rate.
Detector outcomes
Sorted by fully hidden annotations. Training-source overlaps are excluded.
| Detector | Family | Fully hidden ↑ | Detected / any overlap ↑ | Extra masking ↓ | Char F1 ↑ |
|---|---|---|---|---|---|
| pplx+ov100 | PPLX | 86.14% | 88.12% | 3.90% | 0.643 |
| pii-shield-onnx | ONNX | 83.17% | 90.10% | 9.91% | 0.381 |
| pplx | PPLX | 82.18% | 83.17% | 4.73% | 0.604 |
| pplx+sent300 | PPLX | 82.18% | 83.17% | 3.45% | 0.623 |
| opf-ru | OPF | 77.23% | 85.15% | 4.79% | 0.668 |
| apararti | OPF | 74.26% | 75.25% | 3.59% | 0.683 |
| gliner2-fastino | GLINER2 | 72.28% | 80.20% | 10.94% | 0.414 |
| opf-kz-ru | OPF | 70.30% | 74.26% | 3.74% | 0.646 |
| nuner-zero | GLINER | 64.36% | 70.30% | 5.14% | 0.446 |
| traciora | OPF | 63.37% | 71.29% | 3.16% | 0.695 |
| opf-ru-v2+sent300 | OPF | 63.37% | 73.27% | 2.17% | 0.690 |
| opf-ru-v2+ov100 | OPF | 62.38% | 72.28% | 2.75% | 0.664 |
| opf-ru-v2 | OPF | 61.39% | 71.29% | 2.23% | 0.680 |
| rules-ru | RULES | 61.39% | 63.37% | 1.34% | 0.658 |
| gliner-pii-edge | GLINER | 59.41% | 75.25% | 7.23% | 0.446 |
| gliner-nvidia | GLINER | 56.44% | 60.40% | 2.29% | 0.602 |
| openai-base | OPF | 56.44% | 63.37% | 1.15% | 0.671 |
| gliner-nvidia+sent300 | GLINER | 56.44% | 61.39% | 3.70% | 0.554 |
| openmed-multilingual | HF | 55.45% | 62.38% | 5.07% | 0.419 |
| gliner-nvidia+ov100 | GLINER | 55.45% | 59.41% | 2.33% | 0.595 |
| gliner-stream-pii | GLINER | 54.46% | 61.39% | 2.75% | 0.546 |
| gliner25-fastino+sent300 | GLINER2 | 54.46% | 58.42% | 10.53% | 0.287 |
| gliner25-fastino+ov100 | GLINER2 | 53.47% | 55.45% | 8.23% | 0.343 |
| gliner25-fastino | GLINER2 | 52.48% | 54.46% | 8.11% | 0.339 |
| fef2-secret-ru | HF | 51.49% | 59.41% | 0.37% | 0.597 |
| gliner25-fastino+nochunk | GLINER2 | 51.49% | 53.47% | 5.51% | 0.450 |
| gliner-urchade | GLINER | 45.54% | 49.50% | 9.10% | 0.283 |
| gliner2-hivetrace-omni | GLINER2 | 43.56% | 44.55% | 2.83% | 0.413 |
| gliner2-large | GLINER2 | 40.59% | 44.55% | 6.04% | 0.256 |
| nym-small | ONNX | 38.61% | 48.51% | 4.00% | 0.401 |
| kalyan-ettin | HF | 38.61% | 46.53% | 3.81% | 0.364 |
| nym-base+sent300 | HF | 35.64% | 48.51% | 3.78% | 0.357 |
| nym-base | HF | 34.65% | 46.53% | 3.29% | 0.370 |
| nym-base+ov100 | HF | 34.65% | 46.53% | 3.16% | 0.372 |
| openmed-nemotron | HF | 30.69% | 39.60% | 4.25% | 0.325 |
| gravitee-small | HF | 27.72% | 36.63% | 1.27% | 0.324 |
| ru-legal-ner | HF | 26.73% | 49.50% | 5.36% | 0.276 |
| bardsai-eu | ONNX | 26.73% | 38.61% | 4.46% | 0.317 |
| ru-legal-ner+ov100 | HF | 25.74% | 48.51% | 5.86% | 0.264 |
| ru-legal-ner+sent300 | HF | 24.75% | 48.51% | 7.87% | 0.223 |
| mmbert32k | HF | 22.77% | 42.57% | 2.71% | 0.329 |
| gliner-multi-v21 | GLINER | 22.77% | 28.71% | 3.67% | 0.195 |
| mmbert32k+nochunk | HF | 21.78% | 41.58% | 2.51% | 0.316 |
| gliner2-hivetrace-uni | GLINER2 | 18.81% | 18.81% | 0.54% | 0.267 |
| gliner-pii-base | GLINER | 16.83% | 16.83% | 0.96% | 0.268 |
| stanza-ru | STANZA | 14.85% | 28.71% | 20.40% | 0.114 |
| ru-pii-ner | RUPII | 11.88% | 16.83% | 0.76% | 0.254 |
| gliner2-vladlinv | GLINER2 | 8.91% | 10.89% | 0.00% | 0.093 |
| ner-ru-yqelz | HF | 5.94% | 7.92% | 8.55% | 0.034 |
| spacy-ru-lg | SPACY | 4.95% | 4.95% | 3.43% | 0.061 |
| natasha | NATASHA | 3.96% | 3.96% | 0.55% | 0.079 |
| davlan-mbert | HF | 0.99% | 0.99% | 0.79% | 0.011 |
| ner-ru-gherman | HF | 0.00% | 0.00% | 0.09% | 0.000 |
| davlan-xlmr | HF | 0.00% | 0.00% | 0.88% | 0.000 |
| spacy-alrosait | SPACY | 0.00% | 0.00% | 0.00% | 0.000 |