EN · SECRETS
synth-env-configs PII detection benchmark results
A frozen evaluation slice with 400 rows, 392 normalized gold annotations and source-level provenance.
400input rows
392gold annotations
201,057characters
41measured detectors
Dataset provenance
- Language group
- EN
- Task
- SECRETS
- License
- cc-by-4.0
- Data categories
- SECRET
- Project generated
- Yes
- Corrupted copy
- No
Rows without annotations are not verified clean. Reported extra masking is not a human-confirmed false-positive rate.
Detector outcomes
Sorted by untouched annotations. Training-source overlaps are excluded.
| Detector | Family | Untouched ↓ | Fully hidden ↑ | Extra masking ↓ | Char F1 ↑ |
|---|---|---|---|---|---|
| pii-shield-onnx | ONNX | 0.00% | 99.23% | 76.71% | 0.214 |
| pplx | PPLX | 0.00% | 98.21% | 29.25% | 0.418 |
| opf-kz-ru | OPF | 0.26% | 83.16% | 22.84% | 0.463 |
| traciora | OPF | 0.51% | 67.09% | 21.28% | 0.466 |
| opf-ru | OPF | 0.51% | 67.35% | 23.09% | 0.375 |
| apararti | OPF | 0.77% | 78.32% | 21.29% | 0.472 |
| openmed-multilingual | HF | 1.02% | 64.29% | 22.80% | 0.391 |
| opf-ru-v2 | OPF | 2.04% | 66.58% | 20.78% | 0.440 |
| nym-small | ONNX | 2.81% | 51.53% | 28.19% | 0.292 |
| nym-base | HF | 3.06% | 56.38% | 24.79% | 0.314 |
| rules-ru | RULES | 4.08% | 95.66% | 11.63% | 0.650 |
| openai-base | OPF | 4.85% | 77.30% | 14.20% | 0.549 |
| kalyan-ettin | HF | 7.65% | 46.68% | 15.88% | 0.435 |
| openmed-nemotron | HF | 8.67% | 54.08% | 22.75% | 0.354 |
| fef2-secret-ru | HF | 8.93% | 57.40% | 14.09% | 0.441 |
| bardsai-eu | ONNX | 10.20% | 56.89% | 23.30% | 0.348 |
| mmbert32k | HF | 13.01% | 25.26% | 23.32% | 0.337 |
| ru-legal-ner | HF | 13.78% | 28.57% | 21.58% | 0.359 |
| gravitee-small | HF | 23.21% | 40.56% | 10.81% | 0.333 |
| gliner-pii-edge | GLINER | 31.38% | 63.01% | 19.45% | 0.321 |
| gliner2-hivetrace-omni | GLINER2 | 45.92% | 54.08% | 7.52% | 0.347 |
| gliner2-fastino | GLINER2 | 46.17% | 48.72% | 11.49% | 0.287 |
| gliner25-fastino | GLINER2 | 49.74% | 49.49% | 12.58% | 0.271 |
| stanza-ru | STANZA | 51.28% | 18.62% | 22.58% | 0.150 |
| gliner-stream-pii | GLINER | 51.79% | 42.35% | 3.96% | 0.338 |
| gliner-nvidia | GLINER | 54.85% | 44.13% | 6.60% | 0.335 |
| nuner-zero | GLINER | 58.93% | 37.50% | 9.37% | 0.203 |
| gliner2-vladlinv | GLINER2 | 67.86% | 30.36% | 0.45% | 0.291 |
| gliner-urchade | GLINER | 72.19% | 27.81% | 5.36% | 0.175 |
| gliner-multi-v21 | GLINER | 76.79% | 20.66% | 4.45% | 0.146 |
| gliner-pii-base | GLINER | 79.34% | 18.11% | 3.26% | 0.186 |
| ner-ru-yqelz | HF | 84.44% | 1.53% | 8.55% | 0.067 |
| ru-pii-ner | RUPII | 87.76% | 10.20% | 4.32% | 0.075 |
| gliner2-large | GLINER2 | 92.60% | 7.40% | 5.54% | 0.029 |
| spacy-ru-lg | SPACY | 98.72% | 1.28% | 0.41% | 0.019 |
| gliner2-hivetrace-uni | GLINER2 | 99.49% | 0.51% | 0.14% | 0.005 |
| ner-ru-gherman | HF | 99.74% | 0.26% | 0.13% | 0.002 |
| natasha | NATASHA | 99.74% | 0.00% | 1.44% | 0.002 |
| davlan-xlmr | HF | 100.00% | 0.00% | 0.00% | 0.000 |
| davlan-mbert | HF | 100.00% | 0.00% | 0.07% | 0.000 |
| spacy-alrosait | SPACY | 100.00% | 0.00% | 0.00% | 0.000 |