RU · PII
jayguard PII detection benchmark results
A frozen evaluation slice with 850 rows, 1,195 normalized gold annotations and source-level provenance.
850input rows
1,195gold annotations
427,476characters
66measured detectors
Dataset provenance
- Language group
- RU
- Task
- PII
- License
- mit (yaml) / apache-2.0 (card text)
- Data categories
- ADDRESS, PERSON
- Project generated
- No
- Corrupted copy
- No
Rows without annotations are not verified clean. Reported extra masking is not a human-confirmed false-positive rate.
Detector outcomes
Sorted by untouched annotations. Training-source overlaps are excluded.
| Detector | Family | Untouched ↓ | Fully hidden ↑ | Extra masking ↓ | Char F1 ↑ |
|---|---|---|---|---|---|
| gliner2-fastino | GLINER2 | 10.54% | 77.57% | 2.51% | 0.585 |
| gliner2-fastino-ru | GLINER2 | 11.63% | 76.90% | 1.27% | 0.666 |
| gliner25-fastino+sent300 | GLINER2 | 12.89% | 74.98% | 2.46% | 0.560 |
| nym-base | HF | 13.05% | 56.32% | 2.62% | 0.546 |
| gliner-urchade | GLINER | 13.14% | 76.40% | 2.37% | 0.567 |
| nym-base+ov100 | HF | 13.14% | 56.40% | 2.69% | 0.544 |
| gliner-multi-v21 | GLINER | 13.22% | 73.22% | 2.48% | 0.556 |
| nym-base+sent300 | HF | 13.22% | 56.32% | 2.75% | 0.540 |
| gliner25-fastino+nochunk | GLINER2 | 13.22% | 74.64% | 1.61% | 0.615 |
| gliner25-fastino+ov100 | GLINER2 | 13.39% | 74.73% | 2.03% | 0.589 |
| gliner25-fastino | GLINER2 | 13.56% | 74.48% | 1.85% | 0.597 |
| gliner2-hivetrace-omni | GLINER2 | 13.81% | 73.72% | 2.38% | 0.588 |
| gliner25-fastino-ru | GLINER2 | 14.23% | 73.14% | 1.29% | 0.623 |
| gliner25-fastino-ru+nochunk | GLINER2 | 14.31% | 72.97% | 1.35% | 0.632 |
| gliner2-hivetrace-omni-ru | GLINER2 | 15.23% | 71.21% | 1.89% | 0.601 |
| nuner-zero | GLINER | 15.31% | 71.05% | 1.71% | 0.608 |
| pplx+sent300 | PPLX | 15.31% | 72.97% | 2.37% | 0.552 |
| pplx+ov100 | PPLX | 16.07% | 72.30% | 2.16% | 0.553 |
| pplx | PPLX | 16.49% | 71.97% | 2.11% | 0.555 |
| davlan-xlmr | HF | 17.07% | 67.20% | 1.24% | 0.617 |
| bardsai-eu | ONNX | 17.15% | 68.95% | 2.20% | 0.525 |
| gliner-multi-v21-ru | GLINER | 17.32% | 69.29% | 1.39% | 0.613 |
| ner-ru-yqelz | HF | 17.41% | 60.33% | 6.22% | 0.443 |
| ru-legal-ner+sent300 | HF | 19.75% | 61.67% | 4.64% | 0.445 |
| fef2-secret-ru | HF | 20.33% | 54.48% | 1.22% | 0.563 |
| mmbert32k | HF | 20.59% | 48.79% | 3.12% | 0.486 |
| spacy-ru-lg | SPACY | 20.75% | 52.55% | 3.26% | 0.488 |
| ru-pii-ner | RUPII | 20.92% | 67.78% | 1.45% | 0.556 |
| ner-ru-gherman | HF | 21.00% | 37.15% | 0.88% | 0.595 |
| nym-small | ONNX | 21.51% | 48.79% | 2.66% | 0.508 |
| ru-legal-ner+ov100 | HF | 21.67% | 59.41% | 4.17% | 0.461 |
| ru-legal-ner | HF | 22.18% | 59.00% | 3.99% | 0.467 |
| gliner-nvidia+sent300 | GLINER | 22.93% | 62.68% | 1.98% | 0.574 |
| mmbert32k+nochunk | HF | 24.10% | 45.86% | 3.01% | 0.480 |
| gliner-nvidia+ov100 | GLINER | 24.18% | 61.76% | 1.56% | 0.602 |
| gliner-nvidia | GLINER | 24.60% | 61.09% | 1.39% | 0.611 |
| davlan-mbert | HF | 24.60% | 55.23% | 1.37% | 0.572 |
| gliner2-vladlinv-ru | GLINER2 | 25.19% | 64.60% | 0.68% | 0.635 |
| gliner2-vladlinv | GLINER2 | 25.19% | 64.52% | 0.71% | 0.630 |
| stanza-ru | STANZA | 26.03% | 51.55% | 8.92% | 0.299 |
| gliner2-large | GLINER2 | 26.61% | 58.58% | 2.44% | 0.512 |
| opf-ru | OPF | 26.78% | 49.04% | 3.32% | 0.460 |
| gliner2-hivetrace-uni | GLINER2 | 28.54% | 58.74% | 1.68% | 0.579 |
| gliner-pii-edge | GLINER | 28.79% | 46.95% | 2.00% | 0.495 |
| gliner-nvidia-ru | GLINER | 28.87% | 56.15% | 0.99% | 0.616 |
| pii-shield-onnx | ONNX | 31.72% | 47.70% | 6.02% | 0.408 |
| traciora | OPF | 33.56% | 53.72% | 1.85% | 0.467 |
| openmed-nemotron | HF | 35.15% | 38.83% | 4.32% | 0.368 |
| gliner-pii-base | GLINER | 36.82% | 43.68% | 1.60% | 0.474 |
| apararti | OPF | 38.33% | 48.54% | 3.09% | 0.423 |
| gliner-stream-pii | GLINER | 38.49% | 45.02% | 1.09% | 0.526 |
| natasha | NATASHA | 38.91% | 44.35% | 2.36% | 0.420 |
| spacy-alrosait | SPACY | 40.25% | 48.20% | 1.43% | 0.537 |
| openmed-multilingual | HF | 41.26% | 28.70% | 2.90% | 0.404 |
| opf-ru-v2+sent300 | OPF | 41.26% | 45.61% | 1.25% | 0.487 |
| opf-ru-v2+ov100 | OPF | 41.51% | 45.52% | 1.20% | 0.492 |
| opf-ru-v2 | OPF | 42.68% | 44.60% | 1.15% | 0.492 |
| openai-base | OPF | 45.02% | 46.03% | 1.85% | 0.445 |
| kalyan-ettin | HF | 47.53% | 29.21% | 2.13% | 0.365 |
| opf-kz-ru | OPF | 55.65% | 26.69% | 2.35% | 0.361 |
| gliner-urchade-ru | GLINER | 65.61% | 33.56% | 0.43% | 0.514 |
| gravitee-small | HF | 70.38% | 22.01% | 2.95% | 0.255 |
| gliner2-hivetrace-uni-ru | GLINER2 | 75.23% | 18.08% | 0.94% | 0.276 |
| rules-ru | RULES | 99.92% | 0.08% | 0.84% | 0.000 |
| betterleaks | LEAKS | 100.00% | 0.00% | 0.00% | 0.000 |
| gitleaks | LEAKS | 100.00% | 0.00% | 0.00% | 0.000 |