HF detector
gravitee-small+cpu-int8 PII detection benchmark
Measured on 9 of 41 retained datasets under the same frozen scoring and masking protocol.
43.54%fully hidden annotations
51.52%detected / overlapped
3.65%extra masking
—CPU characters / second
Strengths
Highest complete-masking rates by normalized data type.
Dates & times83.45%1,553 / 1,861
Phone numbers & email68.85%4,468 / 6,489
Bank accounts & cards68.83%1,294 / 1,880
Watch list
Lowest observed complete-masking rates; inspect before deployment.
Logins & usernames2.96%260 / 8,791
Customer & employee IDs4.12%75 / 1,819
Other sensitive attributes20.09%45 / 224
Language coverage
The overall leader can differ from the best choice for one language slice.
| Language | Datasets | Fully hidden ↑ | Detected ↑ | Extra masking ↓ |
|---|---|---|---|---|
| English | 4 | 58.56% | 66.12% | 2.99% |
| Russian | 4 | 34.42% | 43.43% | 5.46% |
| Multilingual | 1 | 71.09% | 73.30% | — |
Configuration, source and version
- Family
- HF
- Revision
- f8c27a85c51c0168f07b9dcf00265bf0a4097939
- Eligible datasets
- 9 / 41
- Character F1
- 0.506
- Untouched diagnostic
- 48.48% · 34,949 / 72,095
- Benchmark version
- 1.0.3 · 2026-09-09
- CPU seconds / 10k chars
- Not measured
- GPU seconds / 10k chars
- Not measured
Results by dataset
Complete masking is primary; detection shows whether any character overlapped.
| Dataset | Gold annotations | Fully hidden ↑ | Detected ↑ | Extra masking ↓ |
|---|---|---|---|---|
| secrets-issues | 288 | 11.46% | 24.65% | 3.23% |
| synth-ru-tickets | 32,099 | 27.55% | 36.80% | — |
| nym-ru | 9,497 | 36.20% | 45.70% | — |
| tab-echr | 3,830 | 40.16% | 55.69% | — |
| ameau01 | 2,242 | 46.74% | 47.68% | 1.74% |
| redmadrobot | 5,516 | 60.68% | 67.64% | 4.61% |
| hivetrace | 1,667 | 69.65% | 78.22% | 11.07% |
| nemotron-pii | 9,391 | 70.33% | 76.05% | 4.56% |
| kiji-multi | 7,565 | 71.09% | 73.30% | — |