EN · SECRETS
secrets-rules PII detection benchmark results
A frozen evaluation slice with 1,496 rows, 746 normalized gold annotations and source-level provenance.
1,496input rows
746gold annotations
113,154characters
47measured detectors
Dataset provenance
- Language group
- EN
- Task
- SECRETS
- License
- mit
- Data categories
- SECRET
- Project generated
- No
- Corrupted copy
- No
Rows without annotations are not verified clean. Reported extra masking is not a human-confirmed false-positive rate.
Detector outcomes
Sorted by untouched annotations. Training-source overlaps are excluded.
| Detector | Family | Untouched ↓ | Fully hidden ↑ | Extra masking ↓ | Char F1 ↑ |
|---|---|---|---|---|---|
| traciora | OPF | 0.13% | 97.45% | 48.01% | 0.728 |
| pii-shield-onnx | ONNX | 0.13% | 98.53% | 80.36% | 0.602 |
| opf-ru | OPF | 0.40% | 98.39% | 49.17% | 0.716 |
| apararti | OPF | 0.40% | 98.79% | 54.66% | 0.697 |
| opf-kz-ru | OPF | 0.67% | 98.39% | 51.19% | 0.700 |
| openai-base | OPF | 0.94% | 97.99% | 45.69% | 0.718 |
| nym-base | HF | 1.07% | 83.24% | 42.42% | 0.743 |
| opf-ru-v2 | OPF | 1.21% | 97.18% | 40.24% | 0.754 |
| gliner-pii-edge | GLINER | 1.74% | 88.61% | 53.41% | 0.666 |
| nym-small | ONNX | 2.68% | 79.09% | 46.28% | 0.713 |
| ru-legal-ner | HF | 3.08% | 65.01% | 36.25% | 0.695 |
| pplx | PPLX | 3.89% | 93.43% | 36.71% | 0.753 |
| gliner2-fastino | GLINER2 | 4.56% | 87.40% | 45.41% | 0.684 |
| gliner-stream-pii | GLINER | 4.96% | 78.28% | 32.70% | 0.718 |
| gliner25-fastino | GLINER2 | 5.76% | 89.95% | 40.18% | 0.691 |
| mmbert32k | HF | 6.17% | 56.43% | 48.11% | 0.626 |
| bardsai-eu | ONNX | 9.79% | 82.17% | 37.30% | 0.741 |
| openmed-multilingual | HF | 12.06% | 74.13% | 47.26% | 0.669 |
| kalyan-ettin | HF | 14.61% | 57.51% | 39.29% | 0.654 |
| openmed-nemotron | HF | 14.75% | 64.08% | 48.37% | 0.655 |
| credsweeper-noml | LEAKS | 16.89% | 82.17% | 17.26% | 0.773 |
| credsweeper | LEAKS | 22.79% | 76.41% | 12.45% | 0.769 |
| rules-ru | RULES | 24.40% | 74.53% | 32.13% | 0.641 |
| gravitee-small | HF | 27.08% | 58.18% | 25.36% | 0.676 |
| nuner-zero | GLINER | 27.48% | 65.68% | 37.52% | 0.559 |
| gliner-nvidia | GLINER | 33.38% | 65.55% | 32.61% | 0.607 |
| gliner-urchade | GLINER | 49.46% | 46.65% | 27.53% | 0.471 |
| fef2-secret-ru | HF | 49.60% | 43.03% | 28.08% | 0.436 |
| detect-secrets | LEAKS | 54.29% | 45.71% | 30.78% | 0.452 |
| gliner2-vladlinv | GLINER2 | 55.76% | 41.02% | 10.30% | 0.392 |
| deepsecrets | LEAKS | 57.91% | 40.88% | 7.19% | 0.519 |
| ner-ru-yqelz | HF | 71.98% | 18.77% | 27.26% | 0.247 |
| trufflehog | LEAKS | 74.80% | 23.59% | 4.59% | 0.360 |
| gliner-pii-base | GLINER | 77.88% | 20.78% | 19.04% | 0.216 |
| stanza-ru | STANZA | 80.03% | 9.92% | 44.34% | 0.172 |
| gliner2-hivetrace-omni | GLINER2 | 82.04% | 17.96% | 14.38% | 0.253 |
| noseyparker | LEAKS | 83.78% | 16.22% | 10.97% | 0.245 |
| gliner2-hivetrace-uni | GLINER2 | 85.12% | 13.81% | 4.30% | 0.149 |
| ru-pii-ner | RUPII | 85.66% | 9.92% | 11.96% | 0.129 |
| spacy-ru-lg | SPACY | 92.76% | 6.70% | 12.49% | 0.155 |
| gliner2-large | GLINER2 | 94.64% | 4.29% | 20.69% | 0.049 |
| gliner-multi-v21 | GLINER | 96.78% | 1.47% | 10.36% | 0.034 |
| ner-ru-gherman | HF | 99.87% | 0.13% | 0.13% | 0.001 |
| davlan-mbert | HF | 99.87% | 0.13% | 0.80% | 0.002 |
| davlan-xlmr | HF | 100.00% | 0.00% | 0.09% | 0.000 |
| natasha | NATASHA | 100.00% | 0.00% | 1.87% | 0.000 |
| spacy-alrosait | SPACY | 100.00% | 0.00% | 0.00% | 0.000 |