GLINER2 detector
gliner2-fastino PII detection benchmark
Measured on 41 of 41 retained datasets under the same frozen scoring and masking protocol.
79.86%fully hidden annotations
86.81%detected / overlapped
5.88%extra masking
670CPU characters / second
Strengths
Highest complete-masking rates by normalized data type.
Logins & usernames98.46%11,207 / 11,382
Phone numbers & email91.90%20,201 / 21,981
People's names85.75%56,370 / 65,736
Watch list
Lowest observed complete-masking rates; inspect before deployment.
Other sensitive attributes48.39%1,552 / 3,207
Customer & employee IDs64.66%5,169 / 7,994
Bank accounts & cards66.90%3,514 / 5,253
Language coverage
The overall leader can differ from the best choice for one language slice.
| Language | Datasets | Fully hidden ↑ | Detected ↑ | Extra masking ↓ |
|---|---|---|---|---|
| English | 17 | 86.51% | 91.10% | 7.21% |
| Russian | 19 | 78.55% | 87.00% | 2.98% |
| Multilingual | 5 | 78.50% | 83.30% | 0.75% |
Configuration, source and version
- Family
- GLINER2
- Revision
- c153999da5f4c509df4322b0c6a1baf3d2c284d7
- Eligible datasets
- 41 / 41
- Character F1
- 0.763
- Untouched diagnostic
- 13.19% · 30,011 / 227,466
- Benchmark version
- 1.0.3 · 2026-09-09
- CPU seconds / 10k chars
- 14.925
- GPU seconds / 10k chars
- 0.265
Results by dataset
Complete masking is primary; detection shows whether any character overlapped.
| Dataset | Gold annotations | Fully hidden ↑ | Detected ↑ | Extra masking ↓ |
|---|---|---|---|---|
| rubai-ru | 3,458 | 7.29% | 69.38% | — |
| alexen2 | 1,261 | 27.76% | 99.76% | 8.37% |
| corrupt-secrets-issues | 288 | 35.76% | 64.58% | 5.76% |
| secrets-issues | 288 | 42.71% | 65.28% | 5.70% |
| synth-env-configs | 392 | 48.72% | 53.83% | 11.49% |
| synth-secrets-en | 581 | 58.00% | 64.54% | 4.59% |
| synth-secrets-ru | 581 | 59.55% | 64.89% | 4.45% |
| corrupt-redmadrobot | 5,531 | 62.19% | 69.41% | 1.11% |
| leaky-repo | 95 | 63.16% | 82.11% | 8.41% |
| corrupt-hivetrace | 1,667 | 64.43% | 69.71% | 0.95% |
| hivetrace | 1,667 | 71.69% | 72.95% | 1.14% |
| dialogpii-multi | 10,345 | 71.70% | 77.90% | — |
| leak-museum | 101 | 72.28% | 80.20% | 10.94% |
| nym-multi | 8,169 | 73.14% | 75.43% | 1.12% |
| multiconer-ru | 1,208 | 73.76% | 92.14% | 17.04% |
| redmadrobot | 5,516 | 73.95% | 77.70% | 0.95% |
| scanpatch | 8,708 | 74.23% | 81.19% | 3.58% |
| gretel-multi | 4,484 | 74.49% | 82.67% | 0.75% |
| nym-ru | 9,497 | 76.07% | 81.15% | — |
| redact-ru | 9,230 | 76.74% | 85.64% | 16.60% |
| privy | 1,899 | 77.46% | 79.94% | 4.19% |
| jayguard | 1,195 | 77.57% | 89.46% | 2.51% |
| creddata | 776 | 77.96% | 85.70% | 10.83% |
| alrosait | 1,862 | 78.46% | 87.76% | 11.35% |
| redact-multi | 22,864 | 78.92% | 84.54% | — |
| tab-echr | 3,830 | 81.31% | 98.43% | — |
| nym-en | 3,584 | 81.89% | 84.38% | 1.68% |
| factrueval | 7,966 | 81.91% | 82.90% | — |
| dialogpii-en | 3,087 | 81.92% | 89.86% | 10.71% |
| arthur-passwords | 280 | 82.50% | 82.50% | 1.73% |
| synth-ru-tickets | 32,099 | 83.88% | 95.91% | — |
| synth-jira-comments | 2,705 | 84.92% | 86.28% | — |
| synth-wiki-tables | 13,094 | 85.69% | 88.17% | — |
| nerel | 24,369 | 86.08% | 89.52% | — |
| secrets-rules | 746 | 87.40% | 95.44% | 45.41% |
| nemotron-pii | 9,391 | 90.41% | 92.51% | 0.67% |
| tonicai | 2,417 | 92.18% | 95.53% | 2.79% |
| russian-pii-66k | 4,805 | 92.26% | 94.94% | — |
| ameau01 | 2,242 | 92.82% | 92.86% | 4.37% |
| kiji-multi | 7,565 | 94.71% | 95.78% | — |
| kiji-en | 7,623 | 96.05% | 96.79% | — |