EN · SECRETS
secrets-rules PII detection benchmark results
A frozen evaluation slice with 1,496 rows, 746 normalized gold annotations and source-level provenance.
1,496input rows
746gold annotations
113,154characters
47measured detectors
Dataset provenance
- Language group
- EN
- Task
- SECRETS
- License
- mit
- Data categories
- SECRET
- Project generated
- No
- Corrupted copy
- No
Rows without annotations are not verified clean. Reported extra masking is not a human-confirmed false-positive rate.
Detector outcomes
Sorted by fully hidden annotations. Training-source overlaps are excluded.
| Detector | Family | Fully hidden ↑ | Detected / any overlap ↑ | Extra masking ↓ | Char F1 ↑ |
|---|---|---|---|---|---|
| apararti | OPF | 98.79% | 99.60% | 54.66% | 0.697 |
| pii-shield-onnx | ONNX | 98.53% | 99.87% | 80.36% | 0.602 |
| opf-ru | OPF | 98.39% | 99.60% | 49.17% | 0.716 |
| opf-kz-ru | OPF | 98.39% | 99.33% | 51.19% | 0.700 |
| openai-base | OPF | 97.99% | 99.06% | 45.69% | 0.718 |
| traciora | OPF | 97.45% | 99.87% | 48.01% | 0.728 |
| opf-ru-v2 | OPF | 97.18% | 98.79% | 40.24% | 0.754 |
| pplx | PPLX | 93.43% | 96.11% | 36.71% | 0.753 |
| gliner25-fastino | GLINER2 | 89.95% | 94.24% | 40.18% | 0.691 |
| gliner-pii-edge | GLINER | 88.61% | 98.26% | 53.41% | 0.666 |
| gliner2-fastino | GLINER2 | 87.40% | 95.44% | 45.41% | 0.684 |
| nym-base | HF | 83.24% | 98.93% | 42.42% | 0.743 |
| bardsai-eu | ONNX | 82.17% | 90.21% | 37.30% | 0.741 |
| credsweeper-noml | LEAKS | 82.17% | 83.11% | 17.26% | 0.773 |
| nym-small | ONNX | 79.09% | 97.32% | 46.28% | 0.713 |
| gliner-stream-pii | GLINER | 78.28% | 95.04% | 32.70% | 0.718 |
| credsweeper | LEAKS | 76.41% | 77.21% | 12.45% | 0.769 |
| rules-ru | RULES | 74.53% | 75.60% | 32.13% | 0.641 |
| openmed-multilingual | HF | 74.13% | 87.94% | 47.26% | 0.669 |
| nuner-zero | GLINER | 65.68% | 72.52% | 37.52% | 0.559 |
| gliner-nvidia | GLINER | 65.55% | 66.62% | 32.61% | 0.607 |
| ru-legal-ner | HF | 65.01% | 96.92% | 36.25% | 0.695 |
| openmed-nemotron | HF | 64.08% | 85.25% | 48.37% | 0.655 |
| gravitee-small | HF | 58.18% | 72.92% | 25.36% | 0.676 |
| kalyan-ettin | HF | 57.51% | 85.39% | 39.29% | 0.654 |
| mmbert32k | HF | 56.43% | 93.83% | 48.11% | 0.626 |
| gliner-urchade | GLINER | 46.65% | 50.54% | 27.53% | 0.471 |
| detect-secrets | LEAKS | 45.71% | 45.71% | 30.78% | 0.452 |
| fef2-secret-ru | HF | 43.03% | 50.40% | 28.08% | 0.436 |
| gliner2-vladlinv | GLINER2 | 41.02% | 44.24% | 10.30% | 0.392 |
| deepsecrets | LEAKS | 40.88% | 42.09% | 7.19% | 0.519 |
| trufflehog | LEAKS | 23.59% | 25.20% | 4.59% | 0.360 |
| gliner-pii-base | GLINER | 20.78% | 22.12% | 19.04% | 0.216 |
| ner-ru-yqelz | HF | 18.77% | 28.02% | 27.26% | 0.247 |
| gliner2-hivetrace-omni | GLINER2 | 17.96% | 17.96% | 14.38% | 0.253 |
| noseyparker | LEAKS | 16.22% | 16.22% | 10.97% | 0.245 |
| gliner2-hivetrace-uni | GLINER2 | 13.81% | 14.88% | 4.30% | 0.149 |
| ru-pii-ner | RUPII | 9.92% | 14.34% | 11.96% | 0.129 |
| stanza-ru | STANZA | 9.92% | 19.97% | 44.34% | 0.172 |
| spacy-ru-lg | SPACY | 6.70% | 7.24% | 12.49% | 0.155 |
| gliner2-large | GLINER2 | 4.29% | 5.36% | 20.69% | 0.049 |
| gliner-multi-v21 | GLINER | 1.47% | 3.22% | 10.36% | 0.034 |
| ner-ru-gherman | HF | 0.13% | 0.13% | 0.13% | 0.001 |
| davlan-mbert | HF | 0.13% | 0.13% | 0.80% | 0.002 |
| davlan-xlmr | HF | 0.00% | 0.00% | 0.09% | 0.000 |
| natasha | NATASHA | 0.00% | 0.00% | 1.87% | 0.000 |
| spacy-alrosait | SPACY | 0.00% | 0.00% | 0.00% | 0.000 |